Please try and report results of Huffman compression
Hi all, during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test. It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later. The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later. The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off. Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps. How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes. Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental. The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip If you see errors which are caused by compression, please attach the diagnostic output. @Ticker: Please review the source. Gerd
Hi. https://files.mkgmap.org.uk/detail/544 ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error: Failed to render MultiPolygonRelation 2970267 that was with --latin1 mkgmap version 4839 works well. Regards Karl On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote:
Hi all,
during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test.
It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later.
The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later.
The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off.
Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps.
How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes.
Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental.
The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
If you see errors which are caused by compression, please attach the diagnostic output.
@Ticker: Please review the source.
Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi all, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4866 and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4867 Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests. Gerd ________________________________________ Von: 7770 <7770@foskan.eu> Gesendet: Samstag, 15. Januar 2022 18:53 An: mkgmap-dev@lists.mkgmap.org.uk Cc: Gerd Petermann Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi. https://files.mkgmap.org.uk/detail/544 ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error: Failed to render MultiPolygonRelation 2970267 that was with --latin1 mkgmap version 4839 works well. Regards Karl On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote:
Hi all,
during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test.
It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later.
The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later.
The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off.
Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps.
How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes.
Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental.
The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
If you see errors which are caused by compression, please attach the diagnostic output.
@Ticker: Please review the source.
Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Arndt, please post the diagnostic information from mkgmap for the map(s) that causes the crash. Esp. I need the data following the text "following frequencies:" Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de> Gesendet: Sonntag, 16. Januar 2022 16:43 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, i run a test with Speiche Deutschland, NRW+, Kanaren, Balearen, Alpen and "Fabrik"-a little cut around my home. size mkgmap-r4855 vs mkgmap-mdr2-r4867 (gmap) Alpen: 3,68 GB (3.954.902.039 Bytes) 3,67 GB (3.944.957.454 Bytes) Deutschland: 3,92 GB (4.215.119.117 Bytes) 3,91 GB (4.209.139.554 Bytes) Kanaren: 74,4 MB (78.077.953 Bytes) 74,2 MB (77.873.649 Bytes) NRW+ 3,06 GB (3.291.110.031 Bytes) 3,05 GB (3.284.340.528 Bytes) Balearen: 41,7 MB (43.772.910 Bytes) 41,5 MB (43.606.904 Bytes) The adress search in BaseCamp ist not OK: Balearen, Kanaren and Fabrik seems to be OK. Alpen: if you type a name from a city, there is no choice-list NRW+ and Germany: BaseCamp crash, when type a adress -> Fehler erkannt Es ist ein Problem mit BaseCamp aufgetreten App: BaseCamp At: 16.01.2022 16:35:40 (UTC1) OS: Windows 10 (64-bit) Processor: x86, Processor Level: 23, Processors:4, Model: 17 Stepping: 0, RAM: 14606744 BC.ADDRESSFINDCOMPONENTFINDERBASE_T.GETADDRESSFINDERRESULTS-1064-4.7.4.0 Es wurde versucht, im geschützten Speicher zu lesen oder zu schreiben. Dies ist häufig ein Hinweis darauf, dass anderer Speicher beschädigt ist. bei bc.AddressFindComponentFinderBase_t.GetAddressFinderResults(IList`1 A_0, Int32 A_1, String A_2) bei bc.AddressFindAutoCompleteComponentController_t.HandleAutoCompleteCitySearchRequest(AutoCompleteSearchRequestArgs_t aArgs) bei bc.AutoCompleteController_t.RequestItems() bei bc.AutoCompleteController_t.HandleTimerTick(Object sender, EventArgs e) bei System.Windows.Forms.Timer.OnTick(EventArgs e) bei System.Windows.Forms.Timer.TimerNativeWindow.WndProc(Message& m) bei System.Windows.Forms.NativeWindow.DebuggableCallback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam) bei System.Windows.Forms.UnsafeNativeMethods.DispatchMessageW(MSG& msg) bei System.Windows.Forms.Application.ComponentManager.System.Windows.Forms.UnsafeNativeMethods.IMsoComponentManager.FPushMessageLoop(IntPtr dwComponentID, Int32 reason, Int32 pvLoopData) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoopInner(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoop(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.Run(Form mainForm) bei main(String[] aArgs) Active Map Product: Speiche_Deutschland_220116 Version: 1.00 Installed Map Products: Map Name: Globale Karte (Garmin Product) Map Id: 133758977 Map Version: 2.0 Map Type: Bundle Custom Drawn Map: No Digital Elevation Model: No Map Name: Speiche_Fabrik_220116 Map Id: 517734401 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Kanaren_220116 Map Id: 518848513 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_NRWplus_220116 Map Id: 518914049 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Balearen_220116 Map Id: 518979585 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Deutschland_220116 Map Id: 519045121 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Alpen_220116 Map Id: 519110657 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Worldwide Autoroute DEM Basemap,NR (Garmin Product) Map Id: 3302470335 Map Version: 5.1 Map Type: Card Custom Drawn Map: No Digital Elevation Model: Yes .NET Versions: .NET FW 1.0 not installed. .NET FW 1.1 not installed. .NET FW 2.0 with SP2 installed .NET FW 3.0 with SP2 installed .NET FW 3.5 with SP1 installed OpenGL Version 2.1 Attached File: MiniDump Greetz Arndt Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>> hat am 16.01.2022 10:38 geschrieben: Hi all, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4866 and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4867 Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests. Gerd ________________________________________ Von: 7770 <7770@foskan.eu<mailto:7770@foskan.eu>> Gesendet: Samstag, 15. Januar 2022 18:53 An: mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> Cc: Gerd Petermann Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi. https://files.mkgmap.org.uk/detail/544 ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error: Failed to render MultiPolygonRelation 2970267 that was with --latin1 mkgmap version 4839 works well. Regards Karl On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote: Hi all, during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test. It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later. The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later. The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off. Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps. How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes. Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental. The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip If you see errors which are caused by compression, please attach the diagnostic output. @Ticker: Please review the source. Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Arndt, I don't see anything wrong in the diagnostic data. This seems to be a very small map. Please post a link to the tile(s) so that I can try to reproduce the crash here. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de> Gesendet: Sonntag, 16. Januar 2022 17:16 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, i forget to activate the diagnostic function. I build the maps new, but it takes time. Fabrik and NRWplusare running now...... Here are the information from "Fabrik", the other map send i later. Greetz Arndt Mkgmap version 4867 Time started: Sun Jan 16 17:11:03 CET 2022 Number of MapFailedExceptions: 0 building Huffman tree for the following frequencies: [24620, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 648, 2, 0, 959, 47594, 3, 12, 4, 0, 303, 5763, 12, 2261, 2254, 4, 16, 52, 4086, 261, 356, 2610, 5213, 5125, 3989, 2721, 2168, 1694, 2113, 1539, 1641, 1840, 84, 1245, 170, 1320, 0, 3, 6207, 4855, 618, 1680, 2499, 1767, 3949, 3152, 784, 808, 2849, 2951, 1127, 3473, 976, 2938, 294, 4674, 7662, 1941, 809, 908, 6439, 2179, 5, 633, 2732, 0, 2732, 29, 607, 0, 24393, 5179, 9548, 8380, 44728, 3449, 9432, 12777, 11171, 21, 5132, 12721, 6529, 18350, 9267, 6653, 105, 31110, 14401, 20263, 8101, 2806, 2674, 465, 1074, 1629, 0, 870, 0, 38, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 11, 0, 0, 6179, 0, 0, 1, 0, 477, 0, 0, 0, 3, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1200, 0, 0, 0, 0, 0, 1808, 0, 0, 0] depth:7 '4' 0x34 freq: 2721 depth:7 '[' 0x5b freq: 2732 depth:7 ']' 0x5d freq: 2732 depth:7 'v' 0x76 freq: 2806 depth:5 'i' 0x69 freq: 11171 depth:8 '>' 0x3e freq: 1320 depth:10 '/' 0x2f freq: 356 depth:11 '=' 0x3d freq: 170 depth:12 ';' 0x3b freq: 84 depth:12 'q' 0x71 freq: 105 depth:9 'I' 0x49 freq: 784 depth:7 'K' 0x4b freq: 2849 depth:6 '&' 0x26 freq: 5763 depth:7 'P' 0x50 freq: 2938 depth:7 'L' 0x4c freq: 2951 depth:6 'ß' 0xdf freq: 6179 depth:3 ' ' 0x20 freq: 47594 depth:4 'a' 0x61 freq: 24393 depth:4 '.' 0x00 freq: 24620 depth:6 'A' 0x41 freq: 6207 depth:7 'H' 0x48 freq: 3152 depth:8 '8' 0x38 freq: 1539 depth:9 'J' 0x4a freq: 808 depth:9 'U' 0x55 freq: 809 depth:5 'l' 0x6c freq: 12721 depth:5 'h' 0x68 freq: 12777 depth:6 'W' 0x57 freq: 6439 depth:6 'm' 0x6d freq: 6529 depth:8 'z' 0x7a freq: 1629 depth:8 '9' 0x39 freq: 1641 depth:8 'D' 0x44 freq: 1680 depth:8 '6' 0x36 freq: 1694 depth:6 'p' 0x70 freq: 6653 depth:7 'f' 0x66 freq: 3449 depth:7 'N' 0x4e freq: 3473 depth:8 'F' 0x46 freq: 1767 depth:9 '|' 0x7c freq: 870 depth:9 'V' 0x56 freq: 908 depth:8 'ü' 0xfc freq: 1808 depth:8 ':' 0x3a freq: 1840 depth:5 's' 0x73 freq: 14401 depth:6 'S' 0x53 freq: 7662 depth:10 'x' 0x78 freq: 465 depth:10 'ä' 0xe4 freq: 477 depth:9 ' ' 0x1f freq: 959 depth:8 'T' 0x54 freq: 1941 depth:7 'G' 0x47 freq: 3949 depth:4 'r' 0x72 freq: 31110 depth:7 '3' 0x33 freq: 3989 depth:7 '-' 0x2d freq: 4086 depth:6 'u' 0x75 freq: 8101 depth:6 'd' 0x64 freq: 8380 depth:9 'O' 0x4f freq: 976 depth:9 'y' 0x79 freq: 1074 depth:8 '7' 0x37 freq: 2113 depth:8 '5' 0x35 freq: 2168 depth:8 'X' 0x58 freq: 2179 depth:5 'n' 0x6e freq: 18350 depth:13 ',' 0x2c freq: 52 depth:15 '"' 0x22 freq: 12 depth:17 'è' 0xe8 freq: 3 depth:17 '#' 0x23 freq: 4 depth:16 'é' 0xe9 freq: 7 depth:14 '^' 0x5e freq: 29 depth:16 'Ä' 0xc4 freq: 8 depth:18 ' ' 0x1d freq: 2 depth:18 '' 0xad freq: 2 depth:19 '„' 0x84 freq: 1 depth:19 '°' 0xb0 freq: 1 depth:19 'â' 0xe2 freq: 1 depth:19 'ô' 0xf4 freq: 1 depth:15 'Ö' 0xd6 freq: 16 depth:15 '+' 0x2b freq: 16 depth:17 '*' 0x2a freq: 4 depth:17 'Y' 0x59 freq: 5 depth:16 'Ü' 0xdc freq: 11 depth:14 '~' 0x7e freq: 38 depth:15 'j' 0x6a freq: 21 depth:16 ''' 0x27 freq: 12 depth:18 'š' 0x9a freq: 3 depth:18 '!' 0x21 freq: 3 depth:18 '@' 0x40 freq: 3 depth:18 '–' 0x96 freq: 3 depth:11 '.' 0x2e freq: 261 depth:11 'Q' 0x51 freq: 294 depth:11 '%' 0x25 freq: 303 depth:9 'M' 0x4d freq: 1127 depth:8 ')' 0x29 freq: 2254 depth:7 'R' 0x52 freq: 4674 depth:6 'o' 0x6f freq: 9267 depth:6 'g' 0x67 freq: 9432 depth:8 '(' 0x28 freq: 2261 depth:9 'ö' 0xf6 freq: 1200 depth:10 '_' 0x5f freq: 607 depth:10 'C' 0x43 freq: 618 depth:7 'B' 0x42 freq: 4855 depth:6 'c' 0x63 freq: 9548 depth:8 'E' 0x45 freq: 2499 depth:9 '<' 0x3c freq: 1245 depth:10 'Z' 0x5a freq: 633 depth:10 ' ' 0x1c freq: 648 depth:7 '2' 0x32 freq: 5125 depth:5 't' 0x74 freq: 20263 depth:7 'k' 0x6b freq: 5132 depth:7 'b' 0x62 freq: 5179 depth:7 '1' 0x31 freq: 5213 depth:8 '0' 0x30 freq: 2610 depth:8 'w' 0x77 freq: 2674 depth:4 'e' 0x65 freq: 44728 Huffman code: 0000000000000000000 '„' 0x84 Huffman code: 0000000000000000001 '°' 0xb0 Huffman code: 0000000000000000010 'â' 0xe2 Huffman code: 0000000000000000011 'ô' 0xf4 Huffman code: 000000000000000010 ' ' 0x1d Huffman code: 000000000000000011 '' 0xad Huffman code: 000000000000000100 'š' 0x9a Huffman code: 000000000000000101 '!' 0x21 Huffman code: 000000000000000110 '@' 0x40 Huffman code: 000000000000000111 '–' 0x96 Huffman code: 00000000000000100 'è' 0xe8 Huffman code: 00000000000000101 '#' 0x23 Huffman code: 00000000000000110 '*' 0x2a Huffman code: 00000000000000111 'Y' 0x59 Huffman code: 0000000000000100 'é' 0xe9 Huffman code: 0000000000000101 'Ä' 0xc4 Huffman code: 0000000000000110 'Ü' 0xdc Huffman code: 0000000000000111 ''' 0x27 Huffman code: 000000000000100 '"' 0x22 Huffman code: 000000000000101 'Ö' 0xd6 Huffman code: 000000000000110 '+' 0x2b Huffman code: 000000000000111 'j' 0x6a Huffman code: 00000000000100 '^' 0x5e Huffman code: 00000000000101 '~' 0x7e Huffman code: 0000000000011 ',' 0x2c Huffman code: 000000000010 ';' 0x3b Huffman code: 000000000011 'q' 0x71 Huffman code: 00000000010 '=' 0x3d Huffman code: 00000000011 '.' 0x2e Huffman code: 00000000100 'Q' 0x51 Huffman code: 00000000101 '%' 0x25 Huffman code: 0000000011 '/' 0x2f Huffman code: 0000000100 'x' 0x78 Huffman code: 0000000101 'ä' 0xe4 Huffman code: 0000000110 '_' 0x5f Huffman code: 0000000111 'C' 0x43 Huffman code: 0000001000 'Z' 0x5a Huffman code: 0000001001 ' ' 0x1c Huffman code: 000000101 'I' 0x49 Huffman code: 000000110 'J' 0x4a Huffman code: 000000111 'U' 0x55 Huffman code: 000001000 '|' 0x7c Huffman code: 000001001 'V' 0x56 Huffman code: 000001010 ' ' 0x1f Huffman code: 000001011 'O' 0x4f Huffman code: 000001100 'y' 0x79 Huffman code: 000001101 'M' 0x4d Huffman code: 000001110 'ö' 0xf6 Huffman code: 000001111 '<' 0x3c Huffman code: 00001000 '>' 0x3e Huffman code: 00001001 '8' 0x38 Huffman code: 00001010 'z' 0x7a Huffman code: 00001011 '9' 0x39 Huffman code: 00001100 'D' 0x44 Huffman code: 00001101 '6' 0x36 Huffman code: 00001110 'F' 0x46 Huffman code: 00001111 'ü' 0xfc Huffman code: 00010000 ':' 0x3a Huffman code: 00010001 'T' 0x54 Huffman code: 00010010 '7' 0x37 Huffman code: 00010011 '5' 0x35 Huffman code: 00010100 'X' 0x58 Huffman code: 00010101 ')' 0x29 Huffman code: 00010110 '(' 0x28 Huffman code: 00010111 'E' 0x45 Huffman code: 00011000 '0' 0x30 Huffman code: 00011001 'w' 0x77 Huffman code: 0001101 '4' 0x34 Huffman code: 0001110 '[' 0x5b Huffman code: 0001111 ']' 0x5d Huffman code: 0010000 'v' 0x76 Huffman code: 0010001 'K' 0x4b Huffman code: 0010010 'P' 0x50 Huffman code: 0010011 'L' 0x4c Huffman code: 0010100 'H' 0x48 Huffman code: 0010101 'f' 0x66 Huffman code: 0010110 'N' 0x4e Huffman code: 0010111 'G' 0x47 Huffman code: 0011000 '3' 0x33 Huffman code: 0011001 '-' 0x2d Huffman code: 0011010 'R' 0x52 Huffman code: 0011011 'B' 0x42 Huffman code: 0011100 '2' 0x32 Huffman code: 0011101 'k' 0x6b Huffman code: 0011110 'b' 0x62 Huffman code: 0011111 '1' 0x31 Huffman code: 010000 '&' 0x26 Huffman code: 010001 'ß' 0xdf Huffman code: 010010 'A' 0x41 Huffman code: 010011 'W' 0x57 Huffman code: 010100 'm' 0x6d Huffman code: 010101 'p' 0x70 Huffman code: 010110 'S' 0x53 Huffman code: 010111 'u' 0x75 Huffman code: 011000 'd' 0x64 Huffman code: 011001 'o' 0x6f Huffman code: 011010 'g' 0x67 Huffman code: 011011 'c' 0x63 Huffman code: 111 ' ' 0x20 tab2: 31 11111 7 ' ' 0x20 tab2: 30 11110 7 ' ' 0x20 tab2: 29 11101 7 ' ' 0x20 tab2: 28 11100 7 ' ' 0x20 Huffman code: 1101 'a' 0x61 tab2: 27 11011 9 'a' 0x61 tab2: 26 11010 9 'a' 0x61 Huffman code: 1100 '.' 0x00 tab2: 25 11001 9 '.' 0x00 tab2: 24 11000 9 '.' 0x00 Huffman code: 1011 'r' 0x72 tab2: 23 10111 9 'r' 0x72 tab2: 22 10110 9 'r' 0x72 Huffman code: 1010 'e' 0x65 tab2: 21 10101 9 'e' 0x65 tab2: 20 10100 9 'e' 0x65 Huffman code: 10011 'i' 0x69 tab2: 19 10011 11 'i' 0x69 Huffman code: 10010 'l' 0x6c tab2: 18 10010 11 'l' 0x6c Huffman code: 10001 'h' 0x68 tab2: 17 10001 11 'h' 0x68 Huffman code: 10000 's' 0x73 tab2: 16 10000 11 's' 0x73 Huffman code: 01111 'n' 0x6e tab2: 15 01111 11 'n' 0x6e Huffman code: 01110 't' 0x74 tab2: 14 01110 11 't' 0x74 tab2: 13 01101 26 13 tab2: 12 01100 26 13 tab2: 11 01011 26 13 tab2: 10 01010 26 13 tab2: 9 01001 26 13 tab2: 8 01000 26 13 tab2: 7 00111 24 12 tab2: 6 00110 24 12 tab2: 5 00101 24 12 tab2: 4 00100 24 12 tab2: 3 00011 22 12 tab2: 2 00010 22 11 tab2: 1 00001 22 11 tab2: 0 00000 0 10 compressed/uncompressed MDR 15 size: 332289/475949 ratio ~0,698 Number of ExitExceptions: 0 Time finished: Sun Jan 16 17:12:07 CET 2022 Total time taken: 1 minute 4 seconds Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>> hat am 16.01.2022 16:53 geschrieben: Hi Arndt, please post the diagnostic information from mkgmap for the map(s) that causes the crash. Esp. I need the data following the text "following frequencies:" Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>> Gesendet: Sonntag, 16. Januar 2022 16:43 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, i run a test with Speiche Deutschland, NRW+, Kanaren, Balearen, Alpen and "Fabrik"-a little cut around my home. size mkgmap-r4855 vs mkgmap-mdr2-r4867 (gmap) Alpen: 3,68 GB (3.954.902.039 Bytes) 3,67 GB (3.944.957.454 Bytes) Deutschland: 3,92 GB (4.215.119.117 Bytes) 3,91 GB (4.209.139.554 Bytes) Kanaren: 74,4 MB (78.077.953 Bytes) 74,2 MB (77.873.649 Bytes) NRW+ 3,06 GB (3.291.110.031 Bytes) 3,05 GB (3.284.340.528 Bytes) Balearen: 41,7 MB (43.772.910 Bytes) 41,5 MB (43.606.904 Bytes) The adress search in BaseCamp ist not OK: Balearen, Kanaren and Fabrik seems to be OK. Alpen: if you type a name from a city, there is no choice-list NRW+ and Germany: BaseCamp crash, when type a adress -> Fehler erkannt Es ist ein Problem mit BaseCamp aufgetreten App: BaseCamp At: 16.01.2022 16:35:40 (UTC1) OS: Windows 10 (64-bit) Processor: x86, Processor Level: 23, Processors:4, Model: 17 Stepping: 0, RAM: 14606744 BC.ADDRESSFINDCOMPONENTFINDERBASE_T.GETADDRESSFINDERRESULTS-1064-4.7.4.0 Es wurde versucht, im geschützten Speicher zu lesen oder zu schreiben. Dies ist häufig ein Hinweis darauf, dass anderer Speicher beschädigt ist. bei bc.AddressFindComponentFinderBase_t.GetAddressFinderResults(IList`1 A_0, Int32 A_1, String A_2) bei bc.AddressFindAutoCompleteComponentController_t.HandleAutoCompleteCitySearchRequest(AutoCompleteSearchRequestArgs_t aArgs) bei bc.AutoCompleteController_t.RequestItems() bei bc.AutoCompleteController_t.HandleTimerTick(Object sender, EventArgs e) bei System.Windows.Forms.Timer.OnTick(EventArgs e) bei System.Windows.Forms.Timer.TimerNativeWindow.WndProc(Message& m) bei System.Windows.Forms.NativeWindow.DebuggableCallback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam) bei System.Windows.Forms.UnsafeNativeMethods.DispatchMessageW(MSG& msg) bei System.Windows.Forms.Application.ComponentManager.System.Windows.Forms.UnsafeNativeMethods.IMsoComponentManager.FPushMessageLoop(IntPtr dwComponentID, Int32 reason, Int32 pvLoopData) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoopInner(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoop(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.Run(Form mainForm) bei main(String[] aArgs) Active Map Product: Speiche_Deutschland_220116 Version: 1.00 Installed Map Products: Map Name: Globale Karte (Garmin Product) Map Id: 133758977 Map Version: 2.0 Map Type: Bundle Custom Drawn Map: No Digital Elevation Model: No Map Name: Speiche_Fabrik_220116 Map Id: 517734401 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Kanaren_220116 Map Id: 518848513 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_NRWplus_220116 Map Id: 518914049 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Balearen_220116 Map Id: 518979585 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Deutschland_220116 Map Id: 519045121 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Alpen_220116 Map Id: 519110657 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Worldwide Autoroute DEM Basemap,NR (Garmin Product) Map Id: 3302470335 Map Version: 5.1 Map Type: Card Custom Drawn Map: No Digital Elevation Model: Yes .NET Versions: .NET FW 1.0 not installed. .NET FW 1.1 not installed. .NET FW 2.0 with SP2 installed .NET FW 3.0 with SP2 installed .NET FW 3.5 with SP1 installed OpenGL Version 2.1 Attached File: MiniDump Greetz Arndt Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>> hat am 16.01.2022 10:38 geschrieben: Hi all, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4866 and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4867 Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests. Gerd ________________________________________ Von: 7770 <7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>>> Gesendet: Samstag, 15. Januar 2022 18:53 An: mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>> Cc: Gerd Petermann Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi. https://files.mkgmap.org.uk/detail/544 ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error: Failed to render MultiPolygonRelation 2970267 that was with --latin1 mkgmap version 4839 works well. Regards Karl On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote: Hi all, during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test. It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later. The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later. The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off. Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps. How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes. Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental. The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip If you see errors which are caused by compression, please attach the diagnostic output. @Ticker: Please review the source. Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Arndt, do you also have the *.img files from NRWplus? I want to create the index here, so I need the *.img files and the options. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de> Gesendet: Sonntag, 16. Januar 2022 18:37 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, NRWplus is ready. Did you need the splitter-tiles or the map? The gmap-Version from the map is here: https://speichenkarte.de/Karten/Speiche_NRWplus_gmap_220116.zip Greetz Arndt Mkgmap version 4867 Time started: Sun Jan 16 17:39:39 CET 2022 Number of MapFailedExceptions: 0 building Huffman tree for the following frequencies: [1792699, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1482, 24926, 6, 21343, 25884, 2755306, 241, 1152, 139, 2, 5895, 264210, 12919, 19085, 19040, 785, 2731, 3350, 485812, 19576, 12098, 320775, 731263, 573219, 512766, 423259, 436554, 360107, 338983, 298331, 262437, 49120, 5204, 5975, 1324, 4298, 2652, 257, 285338, 296089, 178974, 160441, 174395, 121554, 326595, 263906, 46925, 93948, 218941, 248492, 163284, 158630, 68101, 226700, 6978, 364913, 398358, 153151, 36950, 143603, 330475, 78809, 3585, 69181, 120894, 121, 120893, 340, 24998, 19, 1462864, 215564, 382722, 593424, 2604239, 174221, 556107, 491870, 726237, 58063, 260435, 742266, 353922, 1053248, 690950, 295924, 6781, 1605393, 894081, 1118505, 540150, 189274, 235839, 23262, 89834, 71828, 1, 20117, 1, 227, 0, 9, 0, 0, 0, 31, 2, 34, 0, 0, 0, 0, 0, 14, 0, 0, 0, 0, 4, 127, 27, 4, 32, 123, 13, 0, 0, 3, 0, 141, 0, 0, 0, 23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 7, 0, 0, 1403, 0, 0, 0, 62, 1, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 303, 6, 26, 0, 322, 3, 0, 0, 7, 1914, 5, 27, 1, 0, 73, 0, 0, 0, 0, 0, 5, 0, 2112, 3, 0, 0, 0, 2, 1532, 0, 0, 188593, 1079, 83, 1697, 3, 21996, 3, 0, 642, 7116, 23371, 1457, 2053, 1, 8, 312, 217, 0, 5, 3, 28, 929, 0, 33196, 0, 4, 2, 159, 680, 52894, 0, 0, 5] depth:6 '7' 0x37 freq: 338983 depth:10 '.' 0x2e freq: 19576 depth:10 '|' 0x7c freq: 20117 depth:10 ' ' 0x1e freq: 21343 depth:12 ';' 0x3b freq: 5204 depth:15 'ç' 0xe7 freq: 642 depth:16 'Ä' 0xc4 freq: 322 depth:16 '^' 0x5e freq: 340 depth:14 '=' 0x3d freq: 1324 depth:13 '?' 0x3f freq: 2652 depth:13 '+' 0x2b freq: 2731 depth:14 '°' 0xb0 freq: 1403 depth:14 'ê' 0xea freq: 1457 depth:12 '%' 0x25 freq: 5895 depth:8 'y' 0x79 freq: 89834 depth:7 'f' 0x66 freq: 174221 depth:5 'o' 0x6f freq: 690950 depth:7 'E' 0x45 freq: 174395 depth:7 'C' 0x43 freq: 178974 depth:6 'm' 0x6d freq: 353922 depth:6 '6' 0x36 freq: 360107 depth:6 'R' 0x52 freq: 364913 depth:5 'i' 0x69 freq: 726237 depth:5 '1' 0x31 freq: 731263 depth:4 'a' 0x61 freq: 1462864 depth:5 'l' 0x6c freq: 742266 depth:10 'ä' 0xe4 freq: 21996 depth:10 'x' 0x78 freq: 23262 depth:9 'I' 0x49 freq: 46925 depth:8 'J' 0x4a freq: 93948 depth:7 'ß' 0xdf freq: 188593 depth:6 'c' 0x63 freq: 382722 depth:4 'r' 0x72 freq: 1605393 depth:7 'v' 0x76 freq: 189274 depth:10 'é' 0xe9 freq: 23371 depth:11 '/' 0x2f freq: 12098 depth:12 '<' 0x3c freq: 5975 depth:15 'û' 0xfb freq: 680 depth:15 '*' 0x2a freq: 785 depth:14 ' ' 0x1b freq: 1482 depth:14 'Ü' 0xdc freq: 1532 depth:14 'â' 0xe2 freq: 1697 depth:9 ':' 0x3a freq: 49120 depth:10 ' ' 0x1c freq: 24926 depth:10 '_' 0x5f freq: 24998 depth:10 ' ' 0x1f freq: 25884 depth:11 ''' 0x27 freq: 12919 depth:12 'q' 0x71 freq: 6781 depth:13 ',' 0x2c freq: 3350 depth:13 'Y' 0x59 freq: 3585 depth:6 'S' 0x53 freq: 398358 depth:6 '4' 0x34 freq: 423259 depth:7 'b' 0x62 freq: 215564 depth:7 'K' 0x4b freq: 218941 depth:5 's' 0x73 freq: 894081 depth:6 '5' 0x35 freq: 436554 depth:7 'P' 0x50 freq: 226700 depth:9 'ü' 0xfc freq: 52894 depth:9 'j' 0x6a freq: 58063 depth:8 ']' 0x5d freq: 120893 depth:4 '.' 0x00 freq: 1792699 depth:7 'w' 0x77 freq: 235839 depth:8 '[' 0x5b freq: 120894 depth:8 'F' 0x46 freq: 121554 depth:6 '-' 0x2d freq: 485812 depth:6 'h' 0x68 freq: 491870 depth:7 'L' 0x4c freq: 248492 depth:7 'k' 0x6b freq: 260435 depth:6 '3' 0x33 freq: 512766 depth:7 '9' 0x39 freq: 262437 depth:7 'H' 0x48 freq: 263906 depth:5 'n' 0x6e freq: 1053248 depth:7 '&' 0x26 freq: 264210 depth:12 'Q' 0x51 freq: 6978 depth:12 'è' 0xe8 freq: 7116 depth:17 'ú' 0xfa freq: 159 depth:22 'ñ' 0xf1 freq: 5 depth:22 'ÿ' 0xff freq: 5 depth:23 '×' 0xd7 freq: 3 depth:23 'å' 0xe5 freq: 3 depth:24 'µ' 0xb5 freq: 1 depth:24 'Û' 0xdb freq: 2 depth:23 'š' 0x9a freq: 3 depth:20 ' ' 0xa0 freq: 23 depth:23 'ã' 0xe3 freq: 3 depth:23 'ò' 0xf2 freq: 3 depth:22 ' ' 0x1d freq: 6 depth:22 'Á' 0xc1 freq: 6 depth:22 'È' 0xc8 freq: 7 depth:20 'Â' 0xc2 freq: 26 depth:20 'Ë' 0xcb freq: 27 depth:21 '—' 0x97 freq: 13 depth:21 'Œ' 0x8c freq: 14 depth:20 '“' 0x93 freq: 27 depth:20 'ó' 0xf3 freq: 28 depth:17 'ï' 0xef freq: 217 depth:17 '~' 0x7e freq: 227 depth:15 'ô' 0xf4 freq: 929 depth:14 'É' 0xc9 freq: 1914 depth:14 'ë' 0xeb freq: 2053 depth:17 '!' 0x21 freq: 241 depth:18 '\' 0x5c freq: 121 depth:18 '–' 0x96 freq: 123 depth:22 '' 0xad freq: 7 depth:22 'í' 0xed freq: 8 depth:25 'ì' 0xec freq: 1 depth:25 '}' 0x7d freq: 1 depth:24 '$' 0x24 freq: 2 depth:23 '‘' 0x91 freq: 4 depth:23 'ø' 0xf8 freq: 4 depth:24 'ù' 0xf9 freq: 2 depth:25 '{' 0x7b freq: 1 depth:25 'Ì' 0xcc freq: 1 depth:20 '„' 0x84 freq: 31 depth:19 '´' 0xb4 freq: 62 depth:18 '’' 0x92 freq: 127 depth:17 '@' 0x40 freq: 257 depth:15 'à' 0xe0 freq: 1079 depth:13 '>' 0x3e freq: 4298 depth:14 'Ö' 0xd6 freq: 2112 depth:15 '"' 0x22 freq: 1152 depth:18 '#' 0x23 freq: 139 depth:20 '•' 0x95 freq: 32 depth:20 '†' 0x86 freq: 34 depth:19 'Î' 0xce freq: 73 depth:18 'œ' 0x9c freq: 141 depth:21 ' ' 0x0a freq: 18 depth:23 '”' 0x94 freq: 4 depth:23 'Ô' 0xd4 freq: 5 depth:22 '€' 0x80 freq: 9 depth:21 '`' 0x60 freq: 19 depth:23 '«' 0xab freq: 5 depth:23 '»' 0xbb freq: 5 depth:23 'Ê' 0xca freq: 5 depth:24 '…' 0x85 freq: 2 depth:24 'Å' 0xc5 freq: 3 depth:19 'á' 0xe1 freq: 83 depth:17 'À' 0xc0 freq: 303 depth:17 'î' 0xee freq: 312 depth:10 'ö' 0xf6 freq: 33196 depth:9 'O' 0x4f freq: 68101 depth:9 'Z' 0x5a freq: 69181 depth:9 'z' 0x7a freq: 71828 depth:6 'u' 0x75 freq: 540150 depth:5 't' 0x74 freq: 1118505 depth:6 'g' 0x67 freq: 556107 depth:6 '2' 0x32 freq: 573219 depth:7 'A' 0x41 freq: 285338 depth:7 'p' 0x70 freq: 295924 depth:7 'B' 0x42 freq: 296089 depth:8 'V' 0x56 freq: 143603 depth:8 'T' 0x54 freq: 153151 depth:6 'd' 0x64 freq: 593424 depth:7 '8' 0x38 freq: 298331 depth:10 'U' 0x55 freq: 36950 depth:11 ')' 0x29 freq: 19040 depth:11 '(' 0x28 freq: 19085 depth:9 'X' 0x58 freq: 78809 depth:8 'N' 0x4e freq: 158630 depth:7 '0' 0x30 freq: 320775 depth:8 'D' 0x44 freq: 160441 depth:8 'M' 0x4d freq: 163284 depth:7 'G' 0x47 freq: 326595 depth:7 'W' 0x57 freq: 330475 depth:4 'e' 0x65 freq: 2604239 depth:4 ' ' 0x20 freq: 2755306 Huffman code: 0000000000000000000000000 'ì' 0xec Huffman code: 0000000000000000000000001 '}' 0x7d Huffman code: 0000000000000000000000010 '{' 0x7b Huffman code: 0000000000000000000000011 'Ì' 0xcc Huffman code: 000000000000000000000010 'µ' 0xb5 Huffman code: 000000000000000000000011 'Û' 0xdb Huffman code: 000000000000000000000100 '$' 0x24 Huffman code: 000000000000000000000101 'ù' 0xf9 Huffman code: 000000000000000000000110 '…' 0x85 Huffman code: 000000000000000000000111 'Å' 0xc5 Huffman code: 00000000000000000000100 '×' 0xd7 Huffman code: 00000000000000000000101 'å' 0xe5 Huffman code: 00000000000000000000110 'š' 0x9a Huffman code: 00000000000000000000111 'ã' 0xe3 Huffman code: 00000000000000000001000 'ò' 0xf2 Huffman code: 00000000000000000001001 '‘' 0x91 Huffman code: 00000000000000000001010 'ø' 0xf8 Huffman code: 00000000000000000001011 '”' 0x94 Huffman code: 00000000000000000001100 'Ô' 0xd4 Huffman code: 00000000000000000001101 '«' 0xab Huffman code: 00000000000000000001110 '»' 0xbb Huffman code: 00000000000000000001111 'Ê' 0xca Huffman code: 0000000000000000001000 'ñ' 0xf1 Huffman code: 0000000000000000001001 'ÿ' 0xff Huffman code: 0000000000000000001010 ' ' 0x1d Huffman code: 0000000000000000001011 'Á' 0xc1 Huffman code: 0000000000000000001100 'È' 0xc8 Huffman code: 0000000000000000001101 '' 0xad Huffman code: 0000000000000000001110 'í' 0xed Huffman code: 0000000000000000001111 '€' 0x80 Huffman code: 000000000000000001000 '—' 0x97 Huffman code: 000000000000000001001 'Œ' 0x8c Huffman code: 000000000000000001010 ' ' 0x0a Huffman code: 000000000000000001011 '`' 0x60 Huffman code: 00000000000000000110 ' ' 0xa0 Huffman code: 00000000000000000111 'Â' 0xc2 Huffman code: 00000000000000001000 'Ë' 0xcb Huffman code: 00000000000000001001 '“' 0x93 Huffman code: 00000000000000001010 'ó' 0xf3 Huffman code: 00000000000000001011 '„' 0x84 Huffman code: 00000000000000001100 '•' 0x95 Huffman code: 00000000000000001101 '†' 0x86 Huffman code: 0000000000000000111 '´' 0xb4 Huffman code: 0000000000000001000 'Î' 0xce Huffman code: 0000000000000001001 'á' 0xe1 Huffman code: 000000000000000101 '\' 0x5c Huffman code: 000000000000000110 '–' 0x96 Huffman code: 000000000000000111 '’' 0x92 Huffman code: 000000000000001000 '#' 0x23 Huffman code: 000000000000001001 'œ' 0x9c Huffman code: 00000000000000101 'ú' 0xfa Huffman code: 00000000000000110 'ï' 0xef Huffman code: 00000000000000111 '~' 0x7e Huffman code: 00000000000001000 '!' 0x21 Huffman code: 00000000000001001 '@' 0x40 Huffman code: 00000000000001010 'À' 0xc0 Huffman code: 00000000000001011 'î' 0xee Huffman code: 0000000000000110 'Ä' 0xc4 Huffman code: 0000000000000111 '^' 0x5e Huffman code: 000000000000100 'ç' 0xe7 Huffman code: 000000000000101 'û' 0xfb Huffman code: 000000000000110 '*' 0x2a Huffman code: 000000000000111 'ô' 0xf4 Huffman code: 000000000001000 'à' 0xe0 Huffman code: 000000000001001 '"' 0x22 Huffman code: 00000000000101 '=' 0x3d Huffman code: 00000000000110 '°' 0xb0 Huffman code: 00000000000111 'ê' 0xea Huffman code: 00000000001000 ' ' 0x1b Huffman code: 00000000001001 'Ü' 0xdc Huffman code: 00000000001010 'â' 0xe2 Huffman code: 00000000001011 'É' 0xc9 Huffman code: 00000000001100 'ë' 0xeb Huffman code: 00000000001101 'Ö' 0xd6 Huffman code: 0000000000111 '?' 0x3f Huffman code: 0000000001000 '+' 0x2b Huffman code: 0000000001001 ',' 0x2c Huffman code: 0000000001010 'Y' 0x59 Huffman code: 0000000001011 '>' 0x3e Huffman code: 000000000110 ';' 0x3b Huffman code: 000000000111 '%' 0x25 Huffman code: 000000001000 '<' 0x3c Huffman code: 000000001001 'q' 0x71 Huffman code: 000000001010 'Q' 0x51 Huffman code: 000000001011 'è' 0xe8 Huffman code: 00000000110 '/' 0x2f Huffman code: 00000000111 ''' 0x27 Huffman code: 00000001000 ')' 0x29 Huffman code: 00000001001 '(' 0x28 Huffman code: 0000000101 '.' 0x2e Huffman code: 0000000110 '|' 0x7c Huffman code: 0000000111 ' ' 0x1e Huffman code: 0000001000 'ä' 0xe4 Huffman code: 0000001001 'x' 0x78 Huffman code: 0000001010 'é' 0xe9 Huffman code: 0000001011 ' ' 0x1c Huffman code: 0000001100 '_' 0x5f Huffman code: 0000001101 ' ' 0x1f Huffman code: 0000001110 'ö' 0xf6 Huffman code: 0000001111 'U' 0x55 Huffman code: 000001000 'I' 0x49 Huffman code: 000001001 ':' 0x3a Huffman code: 000001010 'ü' 0xfc Huffman code: 000001011 'j' 0x6a Huffman code: 000001100 'O' 0x4f Huffman code: 000001101 'Z' 0x5a Huffman code: 000001110 'z' 0x7a Huffman code: 000001111 'X' 0x58 Huffman code: 00001000 'y' 0x79 Huffman code: 00001001 'J' 0x4a Huffman code: 00001010 ']' 0x5d Huffman code: 00001011 '[' 0x5b Huffman code: 00001100 'F' 0x46 Huffman code: 00001101 'V' 0x56 Huffman code: 00001110 'T' 0x54 Huffman code: 00001111 'N' 0x4e Huffman code: 00010000 'D' 0x44 Huffman code: 00010001 'M' 0x4d Huffman code: 0001001 'f' 0x66 Huffman code: 0001010 'E' 0x45 Huffman code: 0001011 'C' 0x43 Huffman code: 0001100 'ß' 0xdf Huffman code: 0001101 'v' 0x76 Huffman code: 0001110 'b' 0x62 Huffman code: 0001111 'K' 0x4b Huffman code: 0010000 'P' 0x50 Huffman code: 0010001 'w' 0x77 Huffman code: 0010010 'L' 0x4c Huffman code: 0010011 'k' 0x6b Huffman code: 0010100 '9' 0x39 Huffman code: 0010101 'H' 0x48 Huffman code: 0010110 '&' 0x26 Huffman code: 0010111 'A' 0x41 Huffman code: 0011000 'p' 0x70 Huffman code: 0011001 'B' 0x42 Huffman code: 0011010 '8' 0x38 Huffman code: 0011011 '0' 0x30 Huffman code: 0011100 'G' 0x47 Huffman code: 0011101 'W' 0x57 Huffman code: 001111 '7' 0x37 Huffman code: 010000 'm' 0x6d Huffman code: 010001 '6' 0x36 Huffman code: 010010 'R' 0x52 Huffman code: 010011 'c' 0x63 Huffman code: 010100 'S' 0x53 Huffman code: 010101 '4' 0x34 Huffman code: 010110 '5' 0x35 Huffman code: 010111 '-' 0x2d Huffman code: 011000 'h' 0x68 Huffman code: 011001 '3' 0x33 Huffman code: 011010 'u' 0x75 Huffman code: 011011 'g' 0x67 Huffman code: 011100 '2' 0x32 Huffman code: 011101 'd' 0x64 Huffman code: 1111 'a' 0x61 tab2: 31 11111 9 'a' 0x61 tab2: 30 11110 9 'a' 0x61 Huffman code: 1110 'r' 0x72 tab2: 29 11101 9 'r' 0x72 tab2: 28 11100 9 'r' 0x72 Huffman code: 1101 '.' 0x00 tab2: 27 11011 9 '.' 0x00 tab2: 26 11010 9 '.' 0x00 Huffman code: 1100 'e' 0x65 tab2: 25 11001 9 'e' 0x65 tab2: 24 11000 9 'e' 0x65 Huffman code: 1011 ' ' 0x20 tab2: 23 10111 9 ' ' 0x20 tab2: 22 10110 9 ' ' 0x20 Huffman code: 10101 'o' 0x6f tab2: 21 10101 11 'o' 0x6f Huffman code: 10100 'i' 0x69 tab2: 20 10100 11 'i' 0x69 Huffman code: 10011 '1' 0x31 tab2: 19 10011 11 '1' 0x31 Huffman code: 10010 'l' 0x6c tab2: 18 10010 11 'l' 0x6c Huffman code: 10001 's' 0x73 tab2: 17 10001 11 's' 0x73 Huffman code: 10000 'n' 0x6e tab2: 16 10000 11 'n' 0x6e Huffman code: 01111 't' 0x74 tab2: 15 01111 11 't' 0x74 tab2: 14 01110 38 19 tab2: 13 01101 38 19 tab2: 12 01100 38 19 tab2: 11 01011 38 19 tab2: 10 01010 38 19 tab2: 9 01001 38 19 tab2: 8 01000 38 19 tab2: 7 00111 36 19 tab2: 6 00110 36 18 tab2: 5 00101 36 18 tab2: 4 00100 36 18 tab2: 3 00011 36 18 tab2: 2 00010 34 18 tab2: 1 00001 34 17 tab2: 0 00000 0 16 compressed/uncompressed MDR 15 size: 21839978/30483100 ratio ~0,716 Number of ExitExceptions: 0 Time finished: Sun Jan 16 18:33:53 CET 2022 Total time taken: 54 minutes 13 seconds Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>> hat am 16.01.2022 18:14 geschrieben: Hi Arndt, I don't see anything wrong in the diagnostic data. This seems to be a very small map. Please post a link to the tile(s) so that I can try to reproduce the crash here. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>> Gesendet: Sonntag, 16. Januar 2022 17:16 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, i forget to activate the diagnostic function. I build the maps new, but it takes time. Fabrik and NRWplusare running now...... Here are the information from "Fabrik", the other map send i later. Greetz Arndt Mkgmap version 4867 Time started: Sun Jan 16 17:11:03 CET 2022 Number of MapFailedExceptions: 0 building Huffman tree for the following frequencies: [24620, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 648, 2, 0, 959, 47594, 3, 12, 4, 0, 303, 5763, 12, 2261, 2254, 4, 16, 52, 4086, 261, 356, 2610, 5213, 5125, 3989, 2721, 2168, 1694, 2113, 1539, 1641, 1840, 84, 1245, 170, 1320, 0, 3, 6207, 4855, 618, 1680, 2499, 1767, 3949, 3152, 784, 808, 2849, 2951, 1127, 3473, 976, 2938, 294, 4674, 7662, 1941, 809, 908, 6439, 2179, 5, 633, 2732, 0, 2732, 29, 607, 0, 24393, 5179, 9548, 8380, 44728, 3449, 9432, 12777, 11171, 21, 5132, 12721, 6529, 18350, 9267, 6653, 105, 31110, 14401, 20263, 8101, 2806, 2674, 465, 1074, 1629, 0, 870, 0, 38, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 11, 0, 0, 6179, 0, 0, 1, 0, 477, 0, 0, 0, 3, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1200, 0, 0, 0, 0, 0, 1808, 0, 0, 0] depth:7 '4' 0x34 freq: 2721 depth:7 '[' 0x5b freq: 2732 depth:7 ']' 0x5d freq: 2732 depth:7 'v' 0x76 freq: 2806 depth:5 'i' 0x69 freq: 11171 depth:8 '>' 0x3e freq: 1320 depth:10 '/' 0x2f freq: 356 depth:11 '=' 0x3d freq: 170 depth:12 ';' 0x3b freq: 84 depth:12 'q' 0x71 freq: 105 depth:9 'I' 0x49 freq: 784 depth:7 'K' 0x4b freq: 2849 depth:6 '&' 0x26 freq: 5763 depth:7 'P' 0x50 freq: 2938 depth:7 'L' 0x4c freq: 2951 depth:6 'ß' 0xdf freq: 6179 depth:3 ' ' 0x20 freq: 47594 depth:4 'a' 0x61 freq: 24393 depth:4 '.' 0x00 freq: 24620 depth:6 'A' 0x41 freq: 6207 depth:7 'H' 0x48 freq: 3152 depth:8 '8' 0x38 freq: 1539 depth:9 'J' 0x4a freq: 808 depth:9 'U' 0x55 freq: 809 depth:5 'l' 0x6c freq: 12721 depth:5 'h' 0x68 freq: 12777 depth:6 'W' 0x57 freq: 6439 depth:6 'm' 0x6d freq: 6529 depth:8 'z' 0x7a freq: 1629 depth:8 '9' 0x39 freq: 1641 depth:8 'D' 0x44 freq: 1680 depth:8 '6' 0x36 freq: 1694 depth:6 'p' 0x70 freq: 6653 depth:7 'f' 0x66 freq: 3449 depth:7 'N' 0x4e freq: 3473 depth:8 'F' 0x46 freq: 1767 depth:9 '|' 0x7c freq: 870 depth:9 'V' 0x56 freq: 908 depth:8 'ü' 0xfc freq: 1808 depth:8 ':' 0x3a freq: 1840 depth:5 's' 0x73 freq: 14401 depth:6 'S' 0x53 freq: 7662 depth:10 'x' 0x78 freq: 465 depth:10 'ä' 0xe4 freq: 477 depth:9 ' ' 0x1f freq: 959 depth:8 'T' 0x54 freq: 1941 depth:7 'G' 0x47 freq: 3949 depth:4 'r' 0x72 freq: 31110 depth:7 '3' 0x33 freq: 3989 depth:7 '-' 0x2d freq: 4086 depth:6 'u' 0x75 freq: 8101 depth:6 'd' 0x64 freq: 8380 depth:9 'O' 0x4f freq: 976 depth:9 'y' 0x79 freq: 1074 depth:8 '7' 0x37 freq: 2113 depth:8 '5' 0x35 freq: 2168 depth:8 'X' 0x58 freq: 2179 depth:5 'n' 0x6e freq: 18350 depth:13 ',' 0x2c freq: 52 depth:15 '"' 0x22 freq: 12 depth:17 'è' 0xe8 freq: 3 depth:17 '#' 0x23 freq: 4 depth:16 'é' 0xe9 freq: 7 depth:14 '^' 0x5e freq: 29 depth:16 'Ä' 0xc4 freq: 8 depth:18 ' ' 0x1d freq: 2 depth:18 '' 0xad freq: 2 depth:19 '„' 0x84 freq: 1 depth:19 '°' 0xb0 freq: 1 depth:19 'â' 0xe2 freq: 1 depth:19 'ô' 0xf4 freq: 1 depth:15 'Ö' 0xd6 freq: 16 depth:15 '+' 0x2b freq: 16 depth:17 '*' 0x2a freq: 4 depth:17 'Y' 0x59 freq: 5 depth:16 'Ü' 0xdc freq: 11 depth:14 '~' 0x7e freq: 38 depth:15 'j' 0x6a freq: 21 depth:16 ''' 0x27 freq: 12 depth:18 'š' 0x9a freq: 3 depth:18 '!' 0x21 freq: 3 depth:18 '@' 0x40 freq: 3 depth:18 '–' 0x96 freq: 3 depth:11 '.' 0x2e freq: 261 depth:11 'Q' 0x51 freq: 294 depth:11 '%' 0x25 freq: 303 depth:9 'M' 0x4d freq: 1127 depth:8 ')' 0x29 freq: 2254 depth:7 'R' 0x52 freq: 4674 depth:6 'o' 0x6f freq: 9267 depth:6 'g' 0x67 freq: 9432 depth:8 '(' 0x28 freq: 2261 depth:9 'ö' 0xf6 freq: 1200 depth:10 '_' 0x5f freq: 607 depth:10 'C' 0x43 freq: 618 depth:7 'B' 0x42 freq: 4855 depth:6 'c' 0x63 freq: 9548 depth:8 'E' 0x45 freq: 2499 depth:9 '<' 0x3c freq: 1245 depth:10 'Z' 0x5a freq: 633 depth:10 ' ' 0x1c freq: 648 depth:7 '2' 0x32 freq: 5125 depth:5 't' 0x74 freq: 20263 depth:7 'k' 0x6b freq: 5132 depth:7 'b' 0x62 freq: 5179 depth:7 '1' 0x31 freq: 5213 depth:8 '0' 0x30 freq: 2610 depth:8 'w' 0x77 freq: 2674 depth:4 'e' 0x65 freq: 44728 Huffman code: 0000000000000000000 '„' 0x84 Huffman code: 0000000000000000001 '°' 0xb0 Huffman code: 0000000000000000010 'â' 0xe2 Huffman code: 0000000000000000011 'ô' 0xf4 Huffman code: 000000000000000010 ' ' 0x1d Huffman code: 000000000000000011 '' 0xad Huffman code: 000000000000000100 'š' 0x9a Huffman code: 000000000000000101 '!' 0x21 Huffman code: 000000000000000110 '@' 0x40 Huffman code: 000000000000000111 '–' 0x96 Huffman code: 00000000000000100 'è' 0xe8 Huffman code: 00000000000000101 '#' 0x23 Huffman code: 00000000000000110 '*' 0x2a Huffman code: 00000000000000111 'Y' 0x59 Huffman code: 0000000000000100 'é' 0xe9 Huffman code: 0000000000000101 'Ä' 0xc4 Huffman code: 0000000000000110 'Ü' 0xdc Huffman code: 0000000000000111 ''' 0x27 Huffman code: 000000000000100 '"' 0x22 Huffman code: 000000000000101 'Ö' 0xd6 Huffman code: 000000000000110 '+' 0x2b Huffman code: 000000000000111 'j' 0x6a Huffman code: 00000000000100 '^' 0x5e Huffman code: 00000000000101 '~' 0x7e Huffman code: 0000000000011 ',' 0x2c Huffman code: 000000000010 ';' 0x3b Huffman code: 000000000011 'q' 0x71 Huffman code: 00000000010 '=' 0x3d Huffman code: 00000000011 '.' 0x2e Huffman code: 00000000100 'Q' 0x51 Huffman code: 00000000101 '%' 0x25 Huffman code: 0000000011 '/' 0x2f Huffman code: 0000000100 'x' 0x78 Huffman code: 0000000101 'ä' 0xe4 Huffman code: 0000000110 '_' 0x5f Huffman code: 0000000111 'C' 0x43 Huffman code: 0000001000 'Z' 0x5a Huffman code: 0000001001 ' ' 0x1c Huffman code: 000000101 'I' 0x49 Huffman code: 000000110 'J' 0x4a Huffman code: 000000111 'U' 0x55 Huffman code: 000001000 '|' 0x7c Huffman code: 000001001 'V' 0x56 Huffman code: 000001010 ' ' 0x1f Huffman code: 000001011 'O' 0x4f Huffman code: 000001100 'y' 0x79 Huffman code: 000001101 'M' 0x4d Huffman code: 000001110 'ö' 0xf6 Huffman code: 000001111 '<' 0x3c Huffman code: 00001000 '>' 0x3e Huffman code: 00001001 '8' 0x38 Huffman code: 00001010 'z' 0x7a Huffman code: 00001011 '9' 0x39 Huffman code: 00001100 'D' 0x44 Huffman code: 00001101 '6' 0x36 Huffman code: 00001110 'F' 0x46 Huffman code: 00001111 'ü' 0xfc Huffman code: 00010000 ':' 0x3a Huffman code: 00010001 'T' 0x54 Huffman code: 00010010 '7' 0x37 Huffman code: 00010011 '5' 0x35 Huffman code: 00010100 'X' 0x58 Huffman code: 00010101 ')' 0x29 Huffman code: 00010110 '(' 0x28 Huffman code: 00010111 'E' 0x45 Huffman code: 00011000 '0' 0x30 Huffman code: 00011001 'w' 0x77 Huffman code: 0001101 '4' 0x34 Huffman code: 0001110 '[' 0x5b Huffman code: 0001111 ']' 0x5d Huffman code: 0010000 'v' 0x76 Huffman code: 0010001 'K' 0x4b Huffman code: 0010010 'P' 0x50 Huffman code: 0010011 'L' 0x4c Huffman code: 0010100 'H' 0x48 Huffman code: 0010101 'f' 0x66 Huffman code: 0010110 'N' 0x4e Huffman code: 0010111 'G' 0x47 Huffman code: 0011000 '3' 0x33 Huffman code: 0011001 '-' 0x2d Huffman code: 0011010 'R' 0x52 Huffman code: 0011011 'B' 0x42 Huffman code: 0011100 '2' 0x32 Huffman code: 0011101 'k' 0x6b Huffman code: 0011110 'b' 0x62 Huffman code: 0011111 '1' 0x31 Huffman code: 010000 '&' 0x26 Huffman code: 010001 'ß' 0xdf Huffman code: 010010 'A' 0x41 Huffman code: 010011 'W' 0x57 Huffman code: 010100 'm' 0x6d Huffman code: 010101 'p' 0x70 Huffman code: 010110 'S' 0x53 Huffman code: 010111 'u' 0x75 Huffman code: 011000 'd' 0x64 Huffman code: 011001 'o' 0x6f Huffman code: 011010 'g' 0x67 Huffman code: 011011 'c' 0x63 Huffman code: 111 ' ' 0x20 tab2: 31 11111 7 ' ' 0x20 tab2: 30 11110 7 ' ' 0x20 tab2: 29 11101 7 ' ' 0x20 tab2: 28 11100 7 ' ' 0x20 Huffman code: 1101 'a' 0x61 tab2: 27 11011 9 'a' 0x61 tab2: 26 11010 9 'a' 0x61 Huffman code: 1100 '.' 0x00 tab2: 25 11001 9 '.' 0x00 tab2: 24 11000 9 '.' 0x00 Huffman code: 1011 'r' 0x72 tab2: 23 10111 9 'r' 0x72 tab2: 22 10110 9 'r' 0x72 Huffman code: 1010 'e' 0x65 tab2: 21 10101 9 'e' 0x65 tab2: 20 10100 9 'e' 0x65 Huffman code: 10011 'i' 0x69 tab2: 19 10011 11 'i' 0x69 Huffman code: 10010 'l' 0x6c tab2: 18 10010 11 'l' 0x6c Huffman code: 10001 'h' 0x68 tab2: 17 10001 11 'h' 0x68 Huffman code: 10000 's' 0x73 tab2: 16 10000 11 's' 0x73 Huffman code: 01111 'n' 0x6e tab2: 15 01111 11 'n' 0x6e Huffman code: 01110 't' 0x74 tab2: 14 01110 11 't' 0x74 tab2: 13 01101 26 13 tab2: 12 01100 26 13 tab2: 11 01011 26 13 tab2: 10 01010 26 13 tab2: 9 01001 26 13 tab2: 8 01000 26 13 tab2: 7 00111 24 12 tab2: 6 00110 24 12 tab2: 5 00101 24 12 tab2: 4 00100 24 12 tab2: 3 00011 22 12 tab2: 2 00010 22 11 tab2: 1 00001 22 11 tab2: 0 00000 0 10 compressed/uncompressed MDR 15 size: 332289/475949 ratio ~0,698 Number of ExitExceptions: 0 Time finished: Sun Jan 16 17:12:07 CET 2022 Total time taken: 1 minute 4 seconds Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>> hat am 16.01.2022 16:53 geschrieben: Hi Arndt, please post the diagnostic information from mkgmap for the map(s) that causes the crash. Esp. I need the data following the text "following frequencies:" Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>>> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de<mailto:arndt@speichenkarte.de><mailto:arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>>> Gesendet: Sonntag, 16. Januar 2022 16:43 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, i run a test with Speiche Deutschland, NRW+, Kanaren, Balearen, Alpen and "Fabrik"-a little cut around my home. size mkgmap-r4855 vs mkgmap-mdr2-r4867 (gmap) Alpen: 3,68 GB (3.954.902.039 Bytes) 3,67 GB (3.944.957.454 Bytes) Deutschland: 3,92 GB (4.215.119.117 Bytes) 3,91 GB (4.209.139.554 Bytes) Kanaren: 74,4 MB (78.077.953 Bytes) 74,2 MB (77.873.649 Bytes) NRW+ 3,06 GB (3.291.110.031 Bytes) 3,05 GB (3.284.340.528 Bytes) Balearen: 41,7 MB (43.772.910 Bytes) 41,5 MB (43.606.904 Bytes) The adress search in BaseCamp ist not OK: Balearen, Kanaren and Fabrik seems to be OK. Alpen: if you type a name from a city, there is no choice-list NRW+ and Germany: BaseCamp crash, when type a adress -> Fehler erkannt Es ist ein Problem mit BaseCamp aufgetreten App: BaseCamp At: 16.01.2022 16:35:40 (UTC1) OS: Windows 10 (64-bit) Processor: x86, Processor Level: 23, Processors:4, Model: 17 Stepping: 0, RAM: 14606744 BC.ADDRESSFINDCOMPONENTFINDERBASE_T.GETADDRESSFINDERRESULTS-1064-4.7.4.0 Es wurde versucht, im geschützten Speicher zu lesen oder zu schreiben. Dies ist häufig ein Hinweis darauf, dass anderer Speicher beschädigt ist. bei bc.AddressFindComponentFinderBase_t.GetAddressFinderResults(IList`1 A_0, Int32 A_1, String A_2) bei bc.AddressFindAutoCompleteComponentController_t.HandleAutoCompleteCitySearchRequest(AutoCompleteSearchRequestArgs_t aArgs) bei bc.AutoCompleteController_t.RequestItems() bei bc.AutoCompleteController_t.HandleTimerTick(Object sender, EventArgs e) bei System.Windows.Forms.Timer.OnTick(EventArgs e) bei System.Windows.Forms.Timer.TimerNativeWindow.WndProc(Message& m) bei System.Windows.Forms.NativeWindow.DebuggableCallback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam) bei System.Windows.Forms.UnsafeNativeMethods.DispatchMessageW(MSG& msg) bei System.Windows.Forms.Application.ComponentManager.System.Windows.Forms.UnsafeNativeMethods.IMsoComponentManager.FPushMessageLoop(IntPtr dwComponentID, Int32 reason, Int32 pvLoopData) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoopInner(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoop(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.Run(Form mainForm) bei main(String[] aArgs) Active Map Product: Speiche_Deutschland_220116 Version: 1.00 Installed Map Products: Map Name: Globale Karte (Garmin Product) Map Id: 133758977 Map Version: 2.0 Map Type: Bundle Custom Drawn Map: No Digital Elevation Model: No Map Name: Speiche_Fabrik_220116 Map Id: 517734401 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Kanaren_220116 Map Id: 518848513 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_NRWplus_220116 Map Id: 518914049 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Balearen_220116 Map Id: 518979585 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Deutschland_220116 Map Id: 519045121 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Alpen_220116 Map Id: 519110657 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Worldwide Autoroute DEM Basemap,NR (Garmin Product) Map Id: 3302470335 Map Version: 5.1 Map Type: Card Custom Drawn Map: No Digital Elevation Model: Yes .NET Versions: .NET FW 1.0 not installed. .NET FW 1.1 not installed. .NET FW 2.0 with SP2 installed .NET FW 3.0 with SP2 installed .NET FW 3.5 with SP1 installed OpenGL Version 2.1 Attached File: MiniDump Greetz Arndt Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>>> hat am 16.01.2022 10:38 geschrieben: Hi all, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4866 and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4867 Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests. Gerd ________________________________________ Von: 7770 <7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>><mailto:7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>>>> Gesendet: Samstag, 15. Januar 2022 18:53 An: mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>> Cc: Gerd Petermann Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi. https://files.mkgmap.org.uk/detail/544 ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error: Failed to render MultiPolygonRelation 2970267 that was with --latin1 mkgmap version 4839 works well. Regards Karl On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote: Hi all, during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test. It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later. The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later. The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off. Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps. How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes. Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental. The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip If you see errors which are caused by compression, please attach the diagnostic output. @Ticker: Please review the source. Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Arndt, thanks, I'll try to download and reproduce this tomorrow Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de> Gesendet: Sonntag, 16. Januar 2022 19:34 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, the tiles are here: https://speichenkarte.de/Karten/Speiche_NRWplus_mkgmap.zip splitter tiles: https://speichenkarte.de/Karten/Speiche_NRWplus_Splitter.zip Greetz Arndt P.S. options: copyright-message=(C) speichenkarte.de product-id=1 license-file=.\Daten\License.txt draw-priority=28 latin1 lower-case max-jobs merge-lines allow-reverse-merge line-types-with-direction=0x01,0x10000,0x10011,0x10e1c,0x10f00,0x10f03,0x10f04,0x11006 keep-going remove-ovm-work-files preserve-element-order drive-on=detect,right link-pois-to-ways add-pois-to-areas add-pois-to-lines route ignore-turn-restrictions #check-roundabouts #check-roundabout-flares poi-address location-autofill=is_in,nearest housenumbers process-destination process-exits bounds=.\Daten\bounds.zip precomp-sea=.\Daten\sea.zip generate-sea: land-tag=natural=background show-profiles=1 cycle-map #reduce-point-density=8 #reduce-point-density-polygon=10 polygon-size-limits=24:0,23:12,22:11,21:9,20:7,19:5 simplify-lines:23:5,22:6,21:7,20:8,19:10 simplify-polygons:23:8,22:9,21:10,20:11,19:12 improve-overview dem=.\phyghtmap\hgt\Sonny1,.\phyghtmap\hgt\VIEW1,.\phyghtmap\hgt\Sonny3,.\phyghtmap\hgt\VIEW3,.\phyghtmap\hgt\SRTM1,.\phyghtmap\hgt\SRTM3 overview-dem-dist=106048 dem-dists=3312,13248,13248,13248,13248 tdbfile index split-name-index mdr7-del="Service,Foot,Cyw,Steps,Pth,Trk,Bridl,unpav-CyW,pav-Pth,pav-Footpth,pav-Trk,Ped,Primary,Secondary,Tertiary,Pri_link,Sec_link,Tert_link,Unclassified,Road,Minor,Residential,Living_Street,Via-Ferrata,Plt,Gr1,Gr2,Gr3,Gr4,Gr5,dam,Sc0,Sc1,Sc2,Sc3,Sc4,Sc5,imba0,imba1,imba2,imba3,imba4,imba5,Up0|max15%,Up1|max20%,Up2|max25%,Up3|max30%,Up4|max40%,Up5|min40%,Sc0+,Sc1+,Sc2+,Sc3+,Sc4+,Sc5+,imba0+,imba1+,imba2+,imba3+,imba4+,imba5+,Up0+|max15%,Up1+|max20%,Up2+|max25%,Up3+|max30%,Up4+|max40%,Up5+|min40%,Sc0-,Sc1-,Sc2-,Sc3-,Sc4-,Sc5-,imba0-,imba1-,imba2-,imba3-,imba4-,imba5-,Up0|max15%,Up1-|max20%,Up2-|max25%,Up3-|max30%,Up4-|max40%,Up5-|min40%,ford,flood_prone,parking_aisle,driveway,alley,emergency_access" poi-excl-index=0x00100-0x11501,0x2805,0x2800-0x281f,0x2902,0x2912-0x2917,0x640f,0x6602,0x2a00-0x661f gmapsupp hide-gmapsupp-on-pc gmapi add-boundary-nodes-at-admin-boundaries=4 #check-routing-island-len=700 #report-routing-islands max-routing-island-len=700 #x-no-force-end-nodes-routing-nodes Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>> hat am 16.01.2022 18:49 geschrieben: Hi Arndt, do you also have the *.img files from NRWplus? I want to create the index here, so I need the *.img files and the options. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>> Gesendet: Sonntag, 16. Januar 2022 18:37 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, NRWplus is ready. Did you need the splitter-tiles or the map? The gmap-Version from the map is here: https://speichenkarte.de/Karten/Speiche_NRWplus_gmap_220116.zip Greetz Arndt Mkgmap version 4867 Time started: Sun Jan 16 17:39:39 CET 2022 Number of MapFailedExceptions: 0 building Huffman tree for the following frequencies: [1792699, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1482, 24926, 6, 21343, 25884, 2755306, 241, 1152, 139, 2, 5895, 264210, 12919, 19085, 19040, 785, 2731, 3350, 485812, 19576, 12098, 320775, 731263, 573219, 512766, 423259, 436554, 360107, 338983, 298331, 262437, 49120, 5204, 5975, 1324, 4298, 2652, 257, 285338, 296089, 178974, 160441, 174395, 121554, 326595, 263906, 46925, 93948, 218941, 248492, 163284, 158630, 68101, 226700, 6978, 364913, 398358, 153151, 36950, 143603, 330475, 78809, 3585, 69181, 120894, 121, 120893, 340, 24998, 19, 1462864, 215564, 382722, 593424, 2604239, 174221, 556107, 491870, 726237, 58063, 260435, 742266, 353922, 1053248, 690950, 295924, 6781, 1605393, 894081, 1118505, 540150, 189274, 235839, 23262, 89834, 71828, 1, 20117, 1, 227, 0, 9, 0, 0, 0, 31, 2, 34, 0, 0, 0, 0, 0, 14, 0, 0, 0, 0, 4, 127, 27, 4, 32, 123, 13, 0, 0, 3, 0, 141, 0, 0, 0, 23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 7, 0, 0, 1403, 0, 0, 0, 62, 1, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 303, 6, 26, 0, 322, 3, 0, 0, 7, 1914, 5, 27, 1, 0, 73, 0, 0, 0, 0, 0, 5, 0, 2112, 3, 0, 0, 0, 2, 1532, 0, 0, 188593, 1079, 83, 1697, 3, 21996, 3, 0, 642, 7116, 23371, 1457, 2053, 1, 8, 312, 217, 0, 5, 3, 28, 929, 0, 33196, 0, 4, 2, 159, 680, 52894, 0, 0, 5] depth:6 '7' 0x37 freq: 338983 depth:10 '.' 0x2e freq: 19576 depth:10 '|' 0x7c freq: 20117 depth:10 ' ' 0x1e freq: 21343 depth:12 ';' 0x3b freq: 5204 depth:15 'ç' 0xe7 freq: 642 depth:16 'Ä' 0xc4 freq: 322 depth:16 '^' 0x5e freq: 340 depth:14 '=' 0x3d freq: 1324 depth:13 '?' 0x3f freq: 2652 depth:13 '+' 0x2b freq: 2731 depth:14 '°' 0xb0 freq: 1403 depth:14 'ê' 0xea freq: 1457 depth:12 '%' 0x25 freq: 5895 depth:8 'y' 0x79 freq: 89834 depth:7 'f' 0x66 freq: 174221 depth:5 'o' 0x6f freq: 690950 depth:7 'E' 0x45 freq: 174395 depth:7 'C' 0x43 freq: 178974 depth:6 'm' 0x6d freq: 353922 depth:6 '6' 0x36 freq: 360107 depth:6 'R' 0x52 freq: 364913 depth:5 'i' 0x69 freq: 726237 depth:5 '1' 0x31 freq: 731263 depth:4 'a' 0x61 freq: 1462864 depth:5 'l' 0x6c freq: 742266 depth:10 'ä' 0xe4 freq: 21996 depth:10 'x' 0x78 freq: 23262 depth:9 'I' 0x49 freq: 46925 depth:8 'J' 0x4a freq: 93948 depth:7 'ß' 0xdf freq: 188593 depth:6 'c' 0x63 freq: 382722 depth:4 'r' 0x72 freq: 1605393 depth:7 'v' 0x76 freq: 189274 depth:10 'é' 0xe9 freq: 23371 depth:11 '/' 0x2f freq: 12098 depth:12 '<' 0x3c freq: 5975 depth:15 'û' 0xfb freq: 680 depth:15 '*' 0x2a freq: 785 depth:14 ' ' 0x1b freq: 1482 depth:14 'Ü' 0xdc freq: 1532 depth:14 'â' 0xe2 freq: 1697 depth:9 ':' 0x3a freq: 49120 depth:10 ' ' 0x1c freq: 24926 depth:10 '_' 0x5f freq: 24998 depth:10 ' ' 0x1f freq: 25884 depth:11 ''' 0x27 freq: 12919 depth:12 'q' 0x71 freq: 6781 depth:13 ',' 0x2c freq: 3350 depth:13 'Y' 0x59 freq: 3585 depth:6 'S' 0x53 freq: 398358 depth:6 '4' 0x34 freq: 423259 depth:7 'b' 0x62 freq: 215564 depth:7 'K' 0x4b freq: 218941 depth:5 's' 0x73 freq: 894081 depth:6 '5' 0x35 freq: 436554 depth:7 'P' 0x50 freq: 226700 depth:9 'ü' 0xfc freq: 52894 depth:9 'j' 0x6a freq: 58063 depth:8 ']' 0x5d freq: 120893 depth:4 '.' 0x00 freq: 1792699 depth:7 'w' 0x77 freq: 235839 depth:8 '[' 0x5b freq: 120894 depth:8 'F' 0x46 freq: 121554 depth:6 '-' 0x2d freq: 485812 depth:6 'h' 0x68 freq: 491870 depth:7 'L' 0x4c freq: 248492 depth:7 'k' 0x6b freq: 260435 depth:6 '3' 0x33 freq: 512766 depth:7 '9' 0x39 freq: 262437 depth:7 'H' 0x48 freq: 263906 depth:5 'n' 0x6e freq: 1053248 depth:7 '&' 0x26 freq: 264210 depth:12 'Q' 0x51 freq: 6978 depth:12 'è' 0xe8 freq: 7116 depth:17 'ú' 0xfa freq: 159 depth:22 'ñ' 0xf1 freq: 5 depth:22 'ÿ' 0xff freq: 5 depth:23 '×' 0xd7 freq: 3 depth:23 'å' 0xe5 freq: 3 depth:24 'µ' 0xb5 freq: 1 depth:24 'Û' 0xdb freq: 2 depth:23 'š' 0x9a freq: 3 depth:20 ' ' 0xa0 freq: 23 depth:23 'ã' 0xe3 freq: 3 depth:23 'ò' 0xf2 freq: 3 depth:22 ' ' 0x1d freq: 6 depth:22 'Á' 0xc1 freq: 6 depth:22 'È' 0xc8 freq: 7 depth:20 'Â' 0xc2 freq: 26 depth:20 'Ë' 0xcb freq: 27 depth:21 '—' 0x97 freq: 13 depth:21 'Œ' 0x8c freq: 14 depth:20 '“' 0x93 freq: 27 depth:20 'ó' 0xf3 freq: 28 depth:17 'ï' 0xef freq: 217 depth:17 '~' 0x7e freq: 227 depth:15 'ô' 0xf4 freq: 929 depth:14 'É' 0xc9 freq: 1914 depth:14 'ë' 0xeb freq: 2053 depth:17 '!' 0x21 freq: 241 depth:18 '\' 0x5c freq: 121 depth:18 '–' 0x96 freq: 123 depth:22 '' 0xad freq: 7 depth:22 'í' 0xed freq: 8 depth:25 'ì' 0xec freq: 1 depth:25 '}' 0x7d freq: 1 depth:24 '$' 0x24 freq: 2 depth:23 '‘' 0x91 freq: 4 depth:23 'ø' 0xf8 freq: 4 depth:24 'ù' 0xf9 freq: 2 depth:25 '{' 0x7b freq: 1 depth:25 'Ì' 0xcc freq: 1 depth:20 '„' 0x84 freq: 31 depth:19 '´' 0xb4 freq: 62 depth:18 '’' 0x92 freq: 127 depth:17 '@' 0x40 freq: 257 depth:15 'à' 0xe0 freq: 1079 depth:13 '>' 0x3e freq: 4298 depth:14 'Ö' 0xd6 freq: 2112 depth:15 '"' 0x22 freq: 1152 depth:18 '#' 0x23 freq: 139 depth:20 '•' 0x95 freq: 32 depth:20 '†' 0x86 freq: 34 depth:19 'Î' 0xce freq: 73 depth:18 'œ' 0x9c freq: 141 depth:21 ' ' 0x0a freq: 18 depth:23 '”' 0x94 freq: 4 depth:23 'Ô' 0xd4 freq: 5 depth:22 '€' 0x80 freq: 9 depth:21 '`' 0x60 freq: 19 depth:23 '«' 0xab freq: 5 depth:23 '»' 0xbb freq: 5 depth:23 'Ê' 0xca freq: 5 depth:24 '…' 0x85 freq: 2 depth:24 'Å' 0xc5 freq: 3 depth:19 'á' 0xe1 freq: 83 depth:17 'À' 0xc0 freq: 303 depth:17 'î' 0xee freq: 312 depth:10 'ö' 0xf6 freq: 33196 depth:9 'O' 0x4f freq: 68101 depth:9 'Z' 0x5a freq: 69181 depth:9 'z' 0x7a freq: 71828 depth:6 'u' 0x75 freq: 540150 depth:5 't' 0x74 freq: 1118505 depth:6 'g' 0x67 freq: 556107 depth:6 '2' 0x32 freq: 573219 depth:7 'A' 0x41 freq: 285338 depth:7 'p' 0x70 freq: 295924 depth:7 'B' 0x42 freq: 296089 depth:8 'V' 0x56 freq: 143603 depth:8 'T' 0x54 freq: 153151 depth:6 'd' 0x64 freq: 593424 depth:7 '8' 0x38 freq: 298331 depth:10 'U' 0x55 freq: 36950 depth:11 ')' 0x29 freq: 19040 depth:11 '(' 0x28 freq: 19085 depth:9 'X' 0x58 freq: 78809 depth:8 'N' 0x4e freq: 158630 depth:7 '0' 0x30 freq: 320775 depth:8 'D' 0x44 freq: 160441 depth:8 'M' 0x4d freq: 163284 depth:7 'G' 0x47 freq: 326595 depth:7 'W' 0x57 freq: 330475 depth:4 'e' 0x65 freq: 2604239 depth:4 ' ' 0x20 freq: 2755306 Huffman code: 0000000000000000000000000 'ì' 0xec Huffman code: 0000000000000000000000001 '}' 0x7d Huffman code: 0000000000000000000000010 '{' 0x7b Huffman code: 0000000000000000000000011 'Ì' 0xcc Huffman code: 000000000000000000000010 'µ' 0xb5 Huffman code: 000000000000000000000011 'Û' 0xdb Huffman code: 000000000000000000000100 '$' 0x24 Huffman code: 000000000000000000000101 'ù' 0xf9 Huffman code: 000000000000000000000110 '…' 0x85 Huffman code: 000000000000000000000111 'Å' 0xc5 Huffman code: 00000000000000000000100 '×' 0xd7 Huffman code: 00000000000000000000101 'å' 0xe5 Huffman code: 00000000000000000000110 'š' 0x9a Huffman code: 00000000000000000000111 'ã' 0xe3 Huffman code: 00000000000000000001000 'ò' 0xf2 Huffman code: 00000000000000000001001 '‘' 0x91 Huffman code: 00000000000000000001010 'ø' 0xf8 Huffman code: 00000000000000000001011 '”' 0x94 Huffman code: 00000000000000000001100 'Ô' 0xd4 Huffman code: 00000000000000000001101 '«' 0xab Huffman code: 00000000000000000001110 '»' 0xbb Huffman code: 00000000000000000001111 'Ê' 0xca Huffman code: 0000000000000000001000 'ñ' 0xf1 Huffman code: 0000000000000000001001 'ÿ' 0xff Huffman code: 0000000000000000001010 ' ' 0x1d Huffman code: 0000000000000000001011 'Á' 0xc1 Huffman code: 0000000000000000001100 'È' 0xc8 Huffman code: 0000000000000000001101 '' 0xad Huffman code: 0000000000000000001110 'í' 0xed Huffman code: 0000000000000000001111 '€' 0x80 Huffman code: 000000000000000001000 '—' 0x97 Huffman code: 000000000000000001001 'Œ' 0x8c Huffman code: 000000000000000001010 ' ' 0x0a Huffman code: 000000000000000001011 '`' 0x60 Huffman code: 00000000000000000110 ' ' 0xa0 Huffman code: 00000000000000000111 'Â' 0xc2 Huffman code: 00000000000000001000 'Ë' 0xcb Huffman code: 00000000000000001001 '“' 0x93 Huffman code: 00000000000000001010 'ó' 0xf3 Huffman code: 00000000000000001011 '„' 0x84 Huffman code: 00000000000000001100 '•' 0x95 Huffman code: 00000000000000001101 '†' 0x86 Huffman code: 0000000000000000111 '´' 0xb4 Huffman code: 0000000000000001000 'Î' 0xce Huffman code: 0000000000000001001 'á' 0xe1 Huffman code: 000000000000000101 '\' 0x5c Huffman code: 000000000000000110 '–' 0x96 Huffman code: 000000000000000111 '’' 0x92 Huffman code: 000000000000001000 '#' 0x23 Huffman code: 000000000000001001 'œ' 0x9c Huffman code: 00000000000000101 'ú' 0xfa Huffman code: 00000000000000110 'ï' 0xef Huffman code: 00000000000000111 '~' 0x7e Huffman code: 00000000000001000 '!' 0x21 Huffman code: 00000000000001001 '@' 0x40 Huffman code: 00000000000001010 'À' 0xc0 Huffman code: 00000000000001011 'î' 0xee Huffman code: 0000000000000110 'Ä' 0xc4 Huffman code: 0000000000000111 '^' 0x5e Huffman code: 000000000000100 'ç' 0xe7 Huffman code: 000000000000101 'û' 0xfb Huffman code: 000000000000110 '*' 0x2a Huffman code: 000000000000111 'ô' 0xf4 Huffman code: 000000000001000 'à' 0xe0 Huffman code: 000000000001001 '"' 0x22 Huffman code: 00000000000101 '=' 0x3d Huffman code: 00000000000110 '°' 0xb0 Huffman code: 00000000000111 'ê' 0xea Huffman code: 00000000001000 ' ' 0x1b Huffman code: 00000000001001 'Ü' 0xdc Huffman code: 00000000001010 'â' 0xe2 Huffman code: 00000000001011 'É' 0xc9 Huffman code: 00000000001100 'ë' 0xeb Huffman code: 00000000001101 'Ö' 0xd6 Huffman code: 0000000000111 '?' 0x3f Huffman code: 0000000001000 '+' 0x2b Huffman code: 0000000001001 ',' 0x2c Huffman code: 0000000001010 'Y' 0x59 Huffman code: 0000000001011 '>' 0x3e Huffman code: 000000000110 ';' 0x3b Huffman code: 000000000111 '%' 0x25 Huffman code: 000000001000 '<' 0x3c Huffman code: 000000001001 'q' 0x71 Huffman code: 000000001010 'Q' 0x51 Huffman code: 000000001011 'è' 0xe8 Huffman code: 00000000110 '/' 0x2f Huffman code: 00000000111 ''' 0x27 Huffman code: 00000001000 ')' 0x29 Huffman code: 00000001001 '(' 0x28 Huffman code: 0000000101 '.' 0x2e Huffman code: 0000000110 '|' 0x7c Huffman code: 0000000111 ' ' 0x1e Huffman code: 0000001000 'ä' 0xe4 Huffman code: 0000001001 'x' 0x78 Huffman code: 0000001010 'é' 0xe9 Huffman code: 0000001011 ' ' 0x1c Huffman code: 0000001100 '_' 0x5f Huffman code: 0000001101 ' ' 0x1f Huffman code: 0000001110 'ö' 0xf6 Huffman code: 0000001111 'U' 0x55 Huffman code: 000001000 'I' 0x49 Huffman code: 000001001 ':' 0x3a Huffman code: 000001010 'ü' 0xfc Huffman code: 000001011 'j' 0x6a Huffman code: 000001100 'O' 0x4f Huffman code: 000001101 'Z' 0x5a Huffman code: 000001110 'z' 0x7a Huffman code: 000001111 'X' 0x58 Huffman code: 00001000 'y' 0x79 Huffman code: 00001001 'J' 0x4a Huffman code: 00001010 ']' 0x5d Huffman code: 00001011 '[' 0x5b Huffman code: 00001100 'F' 0x46 Huffman code: 00001101 'V' 0x56 Huffman code: 00001110 'T' 0x54 Huffman code: 00001111 'N' 0x4e Huffman code: 00010000 'D' 0x44 Huffman code: 00010001 'M' 0x4d Huffman code: 0001001 'f' 0x66 Huffman code: 0001010 'E' 0x45 Huffman code: 0001011 'C' 0x43 Huffman code: 0001100 'ß' 0xdf Huffman code: 0001101 'v' 0x76 Huffman code: 0001110 'b' 0x62 Huffman code: 0001111 'K' 0x4b Huffman code: 0010000 'P' 0x50 Huffman code: 0010001 'w' 0x77 Huffman code: 0010010 'L' 0x4c Huffman code: 0010011 'k' 0x6b Huffman code: 0010100 '9' 0x39 Huffman code: 0010101 'H' 0x48 Huffman code: 0010110 '&' 0x26 Huffman code: 0010111 'A' 0x41 Huffman code: 0011000 'p' 0x70 Huffman code: 0011001 'B' 0x42 Huffman code: 0011010 '8' 0x38 Huffman code: 0011011 '0' 0x30 Huffman code: 0011100 'G' 0x47 Huffman code: 0011101 'W' 0x57 Huffman code: 001111 '7' 0x37 Huffman code: 010000 'm' 0x6d Huffman code: 010001 '6' 0x36 Huffman code: 010010 'R' 0x52 Huffman code: 010011 'c' 0x63 Huffman code: 010100 'S' 0x53 Huffman code: 010101 '4' 0x34 Huffman code: 010110 '5' 0x35 Huffman code: 010111 '-' 0x2d Huffman code: 011000 'h' 0x68 Huffman code: 011001 '3' 0x33 Huffman code: 011010 'u' 0x75 Huffman code: 011011 'g' 0x67 Huffman code: 011100 '2' 0x32 Huffman code: 011101 'd' 0x64 Huffman code: 1111 'a' 0x61 tab2: 31 11111 9 'a' 0x61 tab2: 30 11110 9 'a' 0x61 Huffman code: 1110 'r' 0x72 tab2: 29 11101 9 'r' 0x72 tab2: 28 11100 9 'r' 0x72 Huffman code: 1101 '.' 0x00 tab2: 27 11011 9 '.' 0x00 tab2: 26 11010 9 '.' 0x00 Huffman code: 1100 'e' 0x65 tab2: 25 11001 9 'e' 0x65 tab2: 24 11000 9 'e' 0x65 Huffman code: 1011 ' ' 0x20 tab2: 23 10111 9 ' ' 0x20 tab2: 22 10110 9 ' ' 0x20 Huffman code: 10101 'o' 0x6f tab2: 21 10101 11 'o' 0x6f Huffman code: 10100 'i' 0x69 tab2: 20 10100 11 'i' 0x69 Huffman code: 10011 '1' 0x31 tab2: 19 10011 11 '1' 0x31 Huffman code: 10010 'l' 0x6c tab2: 18 10010 11 'l' 0x6c Huffman code: 10001 's' 0x73 tab2: 17 10001 11 's' 0x73 Huffman code: 10000 'n' 0x6e tab2: 16 10000 11 'n' 0x6e Huffman code: 01111 't' 0x74 tab2: 15 01111 11 't' 0x74 tab2: 14 01110 38 19 tab2: 13 01101 38 19 tab2: 12 01100 38 19 tab2: 11 01011 38 19 tab2: 10 01010 38 19 tab2: 9 01001 38 19 tab2: 8 01000 38 19 tab2: 7 00111 36 19 tab2: 6 00110 36 18 tab2: 5 00101 36 18 tab2: 4 00100 36 18 tab2: 3 00011 36 18 tab2: 2 00010 34 18 tab2: 1 00001 34 17 tab2: 0 00000 0 16 compressed/uncompressed MDR 15 size: 21839978/30483100 ratio ~0,716 Number of ExitExceptions: 0 Time finished: Sun Jan 16 18:33:53 CET 2022 Total time taken: 54 minutes 13 seconds Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>> hat am 16.01.2022 18:14 geschrieben: Hi Arndt, I don't see anything wrong in the diagnostic data. This seems to be a very small map. Please post a link to the tile(s) so that I can try to reproduce the crash here. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>>> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de<mailto:arndt@speichenkarte.de><mailto:arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>>> Gesendet: Sonntag, 16. Januar 2022 17:16 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, i forget to activate the diagnostic function. I build the maps new, but it takes time. Fabrik and NRWplusare running now...... Here are the information from "Fabrik", the other map send i later. Greetz Arndt Mkgmap version 4867 Time started: Sun Jan 16 17:11:03 CET 2022 Number of MapFailedExceptions: 0 building Huffman tree for the following frequencies: [24620, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 648, 2, 0, 959, 47594, 3, 12, 4, 0, 303, 5763, 12, 2261, 2254, 4, 16, 52, 4086, 261, 356, 2610, 5213, 5125, 3989, 2721, 2168, 1694, 2113, 1539, 1641, 1840, 84, 1245, 170, 1320, 0, 3, 6207, 4855, 618, 1680, 2499, 1767, 3949, 3152, 784, 808, 2849, 2951, 1127, 3473, 976, 2938, 294, 4674, 7662, 1941, 809, 908, 6439, 2179, 5, 633, 2732, 0, 2732, 29, 607, 0, 24393, 5179, 9548, 8380, 44728, 3449, 9432, 12777, 11171, 21, 5132, 12721, 6529, 18350, 9267, 6653, 105, 31110, 14401, 20263, 8101, 2806, 2674, 465, 1074, 1629, 0, 870, 0, 38, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 11, 0, 0, 6179, 0, 0, 1, 0, 477, 0, 0, 0, 3, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1200, 0, 0, 0, 0, 0, 1808, 0, 0, 0] depth:7 '4' 0x34 freq: 2721 depth:7 '[' 0x5b freq: 2732 depth:7 ']' 0x5d freq: 2732 depth:7 'v' 0x76 freq: 2806 depth:5 'i' 0x69 freq: 11171 depth:8 '>' 0x3e freq: 1320 depth:10 '/' 0x2f freq: 356 depth:11 '=' 0x3d freq: 170 depth:12 ';' 0x3b freq: 84 depth:12 'q' 0x71 freq: 105 depth:9 'I' 0x49 freq: 784 depth:7 'K' 0x4b freq: 2849 depth:6 '&' 0x26 freq: 5763 depth:7 'P' 0x50 freq: 2938 depth:7 'L' 0x4c freq: 2951 depth:6 'ß' 0xdf freq: 6179 depth:3 ' ' 0x20 freq: 47594 depth:4 'a' 0x61 freq: 24393 depth:4 '.' 0x00 freq: 24620 depth:6 'A' 0x41 freq: 6207 depth:7 'H' 0x48 freq: 3152 depth:8 '8' 0x38 freq: 1539 depth:9 'J' 0x4a freq: 808 depth:9 'U' 0x55 freq: 809 depth:5 'l' 0x6c freq: 12721 depth:5 'h' 0x68 freq: 12777 depth:6 'W' 0x57 freq: 6439 depth:6 'm' 0x6d freq: 6529 depth:8 'z' 0x7a freq: 1629 depth:8 '9' 0x39 freq: 1641 depth:8 'D' 0x44 freq: 1680 depth:8 '6' 0x36 freq: 1694 depth:6 'p' 0x70 freq: 6653 depth:7 'f' 0x66 freq: 3449 depth:7 'N' 0x4e freq: 3473 depth:8 'F' 0x46 freq: 1767 depth:9 '|' 0x7c freq: 870 depth:9 'V' 0x56 freq: 908 depth:8 'ü' 0xfc freq: 1808 depth:8 ':' 0x3a freq: 1840 depth:5 's' 0x73 freq: 14401 depth:6 'S' 0x53 freq: 7662 depth:10 'x' 0x78 freq: 465 depth:10 'ä' 0xe4 freq: 477 depth:9 ' ' 0x1f freq: 959 depth:8 'T' 0x54 freq: 1941 depth:7 'G' 0x47 freq: 3949 depth:4 'r' 0x72 freq: 31110 depth:7 '3' 0x33 freq: 3989 depth:7 '-' 0x2d freq: 4086 depth:6 'u' 0x75 freq: 8101 depth:6 'd' 0x64 freq: 8380 depth:9 'O' 0x4f freq: 976 depth:9 'y' 0x79 freq: 1074 depth:8 '7' 0x37 freq: 2113 depth:8 '5' 0x35 freq: 2168 depth:8 'X' 0x58 freq: 2179 depth:5 'n' 0x6e freq: 18350 depth:13 ',' 0x2c freq: 52 depth:15 '"' 0x22 freq: 12 depth:17 'è' 0xe8 freq: 3 depth:17 '#' 0x23 freq: 4 depth:16 'é' 0xe9 freq: 7 depth:14 '^' 0x5e freq: 29 depth:16 'Ä' 0xc4 freq: 8 depth:18 ' ' 0x1d freq: 2 depth:18 '' 0xad freq: 2 depth:19 '„' 0x84 freq: 1 depth:19 '°' 0xb0 freq: 1 depth:19 'â' 0xe2 freq: 1 depth:19 'ô' 0xf4 freq: 1 depth:15 'Ö' 0xd6 freq: 16 depth:15 '+' 0x2b freq: 16 depth:17 '*' 0x2a freq: 4 depth:17 'Y' 0x59 freq: 5 depth:16 'Ü' 0xdc freq: 11 depth:14 '~' 0x7e freq: 38 depth:15 'j' 0x6a freq: 21 depth:16 ''' 0x27 freq: 12 depth:18 'š' 0x9a freq: 3 depth:18 '!' 0x21 freq: 3 depth:18 '@' 0x40 freq: 3 depth:18 '–' 0x96 freq: 3 depth:11 '.' 0x2e freq: 261 depth:11 'Q' 0x51 freq: 294 depth:11 '%' 0x25 freq: 303 depth:9 'M' 0x4d freq: 1127 depth:8 ')' 0x29 freq: 2254 depth:7 'R' 0x52 freq: 4674 depth:6 'o' 0x6f freq: 9267 depth:6 'g' 0x67 freq: 9432 depth:8 '(' 0x28 freq: 2261 depth:9 'ö' 0xf6 freq: 1200 depth:10 '_' 0x5f freq: 607 depth:10 'C' 0x43 freq: 618 depth:7 'B' 0x42 freq: 4855 depth:6 'c' 0x63 freq: 9548 depth:8 'E' 0x45 freq: 2499 depth:9 '<' 0x3c freq: 1245 depth:10 'Z' 0x5a freq: 633 depth:10 ' ' 0x1c freq: 648 depth:7 '2' 0x32 freq: 5125 depth:5 't' 0x74 freq: 20263 depth:7 'k' 0x6b freq: 5132 depth:7 'b' 0x62 freq: 5179 depth:7 '1' 0x31 freq: 5213 depth:8 '0' 0x30 freq: 2610 depth:8 'w' 0x77 freq: 2674 depth:4 'e' 0x65 freq: 44728 Huffman code: 0000000000000000000 '„' 0x84 Huffman code: 0000000000000000001 '°' 0xb0 Huffman code: 0000000000000000010 'â' 0xe2 Huffman code: 0000000000000000011 'ô' 0xf4 Huffman code: 000000000000000010 ' ' 0x1d Huffman code: 000000000000000011 '' 0xad Huffman code: 000000000000000100 'š' 0x9a Huffman code: 000000000000000101 '!' 0x21 Huffman code: 000000000000000110 '@' 0x40 Huffman code: 000000000000000111 '–' 0x96 Huffman code: 00000000000000100 'è' 0xe8 Huffman code: 00000000000000101 '#' 0x23 Huffman code: 00000000000000110 '*' 0x2a Huffman code: 00000000000000111 'Y' 0x59 Huffman code: 0000000000000100 'é' 0xe9 Huffman code: 0000000000000101 'Ä' 0xc4 Huffman code: 0000000000000110 'Ü' 0xdc Huffman code: 0000000000000111 ''' 0x27 Huffman code: 000000000000100 '"' 0x22 Huffman code: 000000000000101 'Ö' 0xd6 Huffman code: 000000000000110 '+' 0x2b Huffman code: 000000000000111 'j' 0x6a Huffman code: 00000000000100 '^' 0x5e Huffman code: 00000000000101 '~' 0x7e Huffman code: 0000000000011 ',' 0x2c Huffman code: 000000000010 ';' 0x3b Huffman code: 000000000011 'q' 0x71 Huffman code: 00000000010 '=' 0x3d Huffman code: 00000000011 '.' 0x2e Huffman code: 00000000100 'Q' 0x51 Huffman code: 00000000101 '%' 0x25 Huffman code: 0000000011 '/' 0x2f Huffman code: 0000000100 'x' 0x78 Huffman code: 0000000101 'ä' 0xe4 Huffman code: 0000000110 '_' 0x5f Huffman code: 0000000111 'C' 0x43 Huffman code: 0000001000 'Z' 0x5a Huffman code: 0000001001 ' ' 0x1c Huffman code: 000000101 'I' 0x49 Huffman code: 000000110 'J' 0x4a Huffman code: 000000111 'U' 0x55 Huffman code: 000001000 '|' 0x7c Huffman code: 000001001 'V' 0x56 Huffman code: 000001010 ' ' 0x1f Huffman code: 000001011 'O' 0x4f Huffman code: 000001100 'y' 0x79 Huffman code: 000001101 'M' 0x4d Huffman code: 000001110 'ö' 0xf6 Huffman code: 000001111 '<' 0x3c Huffman code: 00001000 '>' 0x3e Huffman code: 00001001 '8' 0x38 Huffman code: 00001010 'z' 0x7a Huffman code: 00001011 '9' 0x39 Huffman code: 00001100 'D' 0x44 Huffman code: 00001101 '6' 0x36 Huffman code: 00001110 'F' 0x46 Huffman code: 00001111 'ü' 0xfc Huffman code: 00010000 ':' 0x3a Huffman code: 00010001 'T' 0x54 Huffman code: 00010010 '7' 0x37 Huffman code: 00010011 '5' 0x35 Huffman code: 00010100 'X' 0x58 Huffman code: 00010101 ')' 0x29 Huffman code: 00010110 '(' 0x28 Huffman code: 00010111 'E' 0x45 Huffman code: 00011000 '0' 0x30 Huffman code: 00011001 'w' 0x77 Huffman code: 0001101 '4' 0x34 Huffman code: 0001110 '[' 0x5b Huffman code: 0001111 ']' 0x5d Huffman code: 0010000 'v' 0x76 Huffman code: 0010001 'K' 0x4b Huffman code: 0010010 'P' 0x50 Huffman code: 0010011 'L' 0x4c Huffman code: 0010100 'H' 0x48 Huffman code: 0010101 'f' 0x66 Huffman code: 0010110 'N' 0x4e Huffman code: 0010111 'G' 0x47 Huffman code: 0011000 '3' 0x33 Huffman code: 0011001 '-' 0x2d Huffman code: 0011010 'R' 0x52 Huffman code: 0011011 'B' 0x42 Huffman code: 0011100 '2' 0x32 Huffman code: 0011101 'k' 0x6b Huffman code: 0011110 'b' 0x62 Huffman code: 0011111 '1' 0x31 Huffman code: 010000 '&' 0x26 Huffman code: 010001 'ß' 0xdf Huffman code: 010010 'A' 0x41 Huffman code: 010011 'W' 0x57 Huffman code: 010100 'm' 0x6d Huffman code: 010101 'p' 0x70 Huffman code: 010110 'S' 0x53 Huffman code: 010111 'u' 0x75 Huffman code: 011000 'd' 0x64 Huffman code: 011001 'o' 0x6f Huffman code: 011010 'g' 0x67 Huffman code: 011011 'c' 0x63 Huffman code: 111 ' ' 0x20 tab2: 31 11111 7 ' ' 0x20 tab2: 30 11110 7 ' ' 0x20 tab2: 29 11101 7 ' ' 0x20 tab2: 28 11100 7 ' ' 0x20 Huffman code: 1101 'a' 0x61 tab2: 27 11011 9 'a' 0x61 tab2: 26 11010 9 'a' 0x61 Huffman code: 1100 '.' 0x00 tab2: 25 11001 9 '.' 0x00 tab2: 24 11000 9 '.' 0x00 Huffman code: 1011 'r' 0x72 tab2: 23 10111 9 'r' 0x72 tab2: 22 10110 9 'r' 0x72 Huffman code: 1010 'e' 0x65 tab2: 21 10101 9 'e' 0x65 tab2: 20 10100 9 'e' 0x65 Huffman code: 10011 'i' 0x69 tab2: 19 10011 11 'i' 0x69 Huffman code: 10010 'l' 0x6c tab2: 18 10010 11 'l' 0x6c Huffman code: 10001 'h' 0x68 tab2: 17 10001 11 'h' 0x68 Huffman code: 10000 's' 0x73 tab2: 16 10000 11 's' 0x73 Huffman code: 01111 'n' 0x6e tab2: 15 01111 11 'n' 0x6e Huffman code: 01110 't' 0x74 tab2: 14 01110 11 't' 0x74 tab2: 13 01101 26 13 tab2: 12 01100 26 13 tab2: 11 01011 26 13 tab2: 10 01010 26 13 tab2: 9 01001 26 13 tab2: 8 01000 26 13 tab2: 7 00111 24 12 tab2: 6 00110 24 12 tab2: 5 00101 24 12 tab2: 4 00100 24 12 tab2: 3 00011 22 12 tab2: 2 00010 22 11 tab2: 1 00001 22 11 tab2: 0 00000 0 10 compressed/uncompressed MDR 15 size: 332289/475949 ratio ~0,698 Number of ExitExceptions: 0 Time finished: Sun Jan 16 17:12:07 CET 2022 Total time taken: 1 minute 4 seconds Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>>> hat am 16.01.2022 16:53 geschrieben: Hi Arndt, please post the diagnostic information from mkgmap for the map(s) that causes the crash. Esp. I need the data following the text "following frequencies:" Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>>>> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de<mailto:arndt@speichenkarte.de><mailto:arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>><mailto:arndt@speichenkarte.de<mailto:arndt@speichenkarte.de><mailto:arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>>>> Gesendet: Sonntag, 16. Januar 2022 16:43 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, i run a test with Speiche Deutschland, NRW+, Kanaren, Balearen, Alpen and "Fabrik"-a little cut around my home. size mkgmap-r4855 vs mkgmap-mdr2-r4867 (gmap) Alpen: 3,68 GB (3.954.902.039 Bytes) 3,67 GB (3.944.957.454 Bytes) Deutschland: 3,92 GB (4.215.119.117 Bytes) 3,91 GB (4.209.139.554 Bytes) Kanaren: 74,4 MB (78.077.953 Bytes) 74,2 MB (77.873.649 Bytes) NRW+ 3,06 GB (3.291.110.031 Bytes) 3,05 GB (3.284.340.528 Bytes) Balearen: 41,7 MB (43.772.910 Bytes) 41,5 MB (43.606.904 Bytes) The adress search in BaseCamp ist not OK: Balearen, Kanaren and Fabrik seems to be OK. Alpen: if you type a name from a city, there is no choice-list NRW+ and Germany: BaseCamp crash, when type a adress -> Fehler erkannt Es ist ein Problem mit BaseCamp aufgetreten App: BaseCamp At: 16.01.2022 16:35:40 (UTC1) OS: Windows 10 (64-bit) Processor: x86, Processor Level: 23, Processors:4, Model: 17 Stepping: 0, RAM: 14606744 BC.ADDRESSFINDCOMPONENTFINDERBASE_T.GETADDRESSFINDERRESULTS-1064-4.7.4.0 Es wurde versucht, im geschützten Speicher zu lesen oder zu schreiben. Dies ist häufig ein Hinweis darauf, dass anderer Speicher beschädigt ist. bei bc.AddressFindComponentFinderBase_t.GetAddressFinderResults(IList`1 A_0, Int32 A_1, String A_2) bei bc.AddressFindAutoCompleteComponentController_t.HandleAutoCompleteCitySearchRequest(AutoCompleteSearchRequestArgs_t aArgs) bei bc.AutoCompleteController_t.RequestItems() bei bc.AutoCompleteController_t.HandleTimerTick(Object sender, EventArgs e) bei System.Windows.Forms.Timer.OnTick(EventArgs e) bei System.Windows.Forms.Timer.TimerNativeWindow.WndProc(Message& m) bei System.Windows.Forms.NativeWindow.DebuggableCallback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam) bei System.Windows.Forms.UnsafeNativeMethods.DispatchMessageW(MSG& msg) bei System.Windows.Forms.Application.ComponentManager.System.Windows.Forms.UnsafeNativeMethods.IMsoComponentManager.FPushMessageLoop(IntPtr dwComponentID, Int32 reason, Int32 pvLoopData) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoopInner(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoop(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.Run(Form mainForm) bei main(String[] aArgs) Active Map Product: Speiche_Deutschland_220116 Version: 1.00 Installed Map Products: Map Name: Globale Karte (Garmin Product) Map Id: 133758977 Map Version: 2.0 Map Type: Bundle Custom Drawn Map: No Digital Elevation Model: No Map Name: Speiche_Fabrik_220116 Map Id: 517734401 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Kanaren_220116 Map Id: 518848513 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_NRWplus_220116 Map Id: 518914049 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Balearen_220116 Map Id: 518979585 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Deutschland_220116 Map Id: 519045121 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Alpen_220116 Map Id: 519110657 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Worldwide Autoroute DEM Basemap,NR (Garmin Product) Map Id: 3302470335 Map Version: 5.1 Map Type: Card Custom Drawn Map: No Digital Elevation Model: Yes .NET Versions: .NET FW 1.0 not installed. .NET FW 1.1 not installed. .NET FW 2.0 with SP2 installed .NET FW 3.0 with SP2 installed .NET FW 3.5 with SP1 installed OpenGL Version 2.1 Attached File: MiniDump Greetz Arndt Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>>>> hat am 16.01.2022 10:38 geschrieben: Hi all, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4866 and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4867 Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests. Gerd ________________________________________ Von: 7770 <7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>><mailto:7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>>><mailto:7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>><mailto:7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>>>>> Gesendet: Samstag, 15. Januar 2022 18:53 An: mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>>> Cc: Gerd Petermann Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi. https://files.mkgmap.org.uk/detail/544 ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error: Failed to render MultiPolygonRelation 2970267 that was with --latin1 mkgmap version 4839 works well. Regards Karl On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote: Hi all, during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test. It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later. The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later. The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off. Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps. How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes. Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental. The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip If you see errors which are caused by compression, please attach the diagnostic output. @Ticker: Please review the source. Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Arndt, I can reproduce the crash with NRW++. I am not yet sure where this has to be fixed, but it is related to the large number of different characters. Gerd ________________________________________ Von: Gerd Petermann <gpetermann_muenchen@hotmail.com> Gesendet: Sonntag, 16. Januar 2022 20:18 An: Development list for mkgmap Betreff: AW: [mkgmap-dev] Please try and report results of Huffman compression Hi Arndt, thanks, I'll try to download and reproduce this tomorrow Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de> Gesendet: Sonntag, 16. Januar 2022 19:34 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, the tiles are here: https://speichenkarte.de/Karten/Speiche_NRWplus_mkgmap.zip splitter tiles: https://speichenkarte.de/Karten/Speiche_NRWplus_Splitter.zip Greetz Arndt P.S. options: copyright-message=(C) speichenkarte.de product-id=1 license-file=.\Daten\License.txt draw-priority=28 latin1 lower-case max-jobs merge-lines allow-reverse-merge line-types-with-direction=0x01,0x10000,0x10011,0x10e1c,0x10f00,0x10f03,0x10f04,0x11006 keep-going remove-ovm-work-files preserve-element-order drive-on=detect,right link-pois-to-ways add-pois-to-areas add-pois-to-lines route ignore-turn-restrictions #check-roundabouts #check-roundabout-flares poi-address location-autofill=is_in,nearest housenumbers process-destination process-exits bounds=.\Daten\bounds.zip precomp-sea=.\Daten\sea.zip generate-sea: land-tag=natural=background show-profiles=1 cycle-map #reduce-point-density=8 #reduce-point-density-polygon=10 polygon-size-limits=24:0,23:12,22:11,21:9,20:7,19:5 simplify-lines:23:5,22:6,21:7,20:8,19:10 simplify-polygons:23:8,22:9,21:10,20:11,19:12 improve-overview dem=.\phyghtmap\hgt\Sonny1,.\phyghtmap\hgt\VIEW1,.\phyghtmap\hgt\Sonny3,.\phyghtmap\hgt\VIEW3,.\phyghtmap\hgt\SRTM1,.\phyghtmap\hgt\SRTM3 overview-dem-dist=106048 dem-dists=3312,13248,13248,13248,13248 tdbfile index split-name-index mdr7-del="Service,Foot,Cyw,Steps,Pth,Trk,Bridl,unpav-CyW,pav-Pth,pav-Footpth,pav-Trk,Ped,Primary,Secondary,Tertiary,Pri_link,Sec_link,Tert_link,Unclassified,Road,Minor,Residential,Living_Street,Via-Ferrata,Plt,Gr1,Gr2,Gr3,Gr4,Gr5,dam,Sc0,Sc1,Sc2,Sc3,Sc4,Sc5,imba0,imba1,imba2,imba3,imba4,imba5,Up0|max15%,Up1|max20%,Up2|max25%,Up3|max30%,Up4|max40%,Up5|min40%,Sc0+,Sc1+,Sc2+,Sc3+,Sc4+,Sc5+,imba0+,imba1+,imba2+,imba3+,imba4+,imba5+,Up0+|max15%,Up1+|max20%,Up2+|max25%,Up3+|max30%,Up4+|max40%,Up5+|min40%,Sc0-,Sc1-,Sc2-,Sc3-,Sc4-,Sc5-,imba0-,imba1-,imba2-,imba3-,imba4-,imba5-,Up0|max15%,Up1-|max20%,Up2-|max25%,Up3-|max30%,Up4-|max40%,Up5-|min40%,ford,flood_prone,parking_aisle,driveway,alley,emergency_access" poi-excl-index=0x00100-0x11501,0x2805,0x2800-0x281f,0x2902,0x2912-0x2917,0x640f,0x6602,0x2a00-0x661f gmapsupp hide-gmapsupp-on-pc gmapi add-boundary-nodes-at-admin-boundaries=4 #check-routing-island-len=700 #report-routing-islands max-routing-island-len=700 #x-no-force-end-nodes-routing-nodes Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>> hat am 16.01.2022 18:49 geschrieben: Hi Arndt, do you also have the *.img files from NRWplus? I want to create the index here, so I need the *.img files and the options. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>> Gesendet: Sonntag, 16. Januar 2022 18:37 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, NRWplus is ready. Did you need the splitter-tiles or the map? The gmap-Version from the map is here: https://speichenkarte.de/Karten/Speiche_NRWplus_gmap_220116.zip Greetz Arndt Mkgmap version 4867 Time started: Sun Jan 16 17:39:39 CET 2022 Number of MapFailedExceptions: 0 building Huffman tree for the following frequencies: [1792699, 0, 0, 0, 0, 0, 0, 0, 0, 0, 18, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1482, 24926, 6, 21343, 25884, 2755306, 241, 1152, 139, 2, 5895, 264210, 12919, 19085, 19040, 785, 2731, 3350, 485812, 19576, 12098, 320775, 731263, 573219, 512766, 423259, 436554, 360107, 338983, 298331, 262437, 49120, 5204, 5975, 1324, 4298, 2652, 257, 285338, 296089, 178974, 160441, 174395, 121554, 326595, 263906, 46925, 93948, 218941, 248492, 163284, 158630, 68101, 226700, 6978, 364913, 398358, 153151, 36950, 143603, 330475, 78809, 3585, 69181, 120894, 121, 120893, 340, 24998, 19, 1462864, 215564, 382722, 593424, 2604239, 174221, 556107, 491870, 726237, 58063, 260435, 742266, 353922, 1053248, 690950, 295924, 6781, 1605393, 894081, 1118505, 540150, 189274, 235839, 23262, 89834, 71828, 1, 20117, 1, 227, 0, 9, 0, 0, 0, 31, 2, 34, 0, 0, 0, 0, 0, 14, 0, 0, 0, 0, 4, 127, 27, 4, 32, 123, 13, 0, 0, 3, 0, 141, 0, 0, 0, 23, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 5, 0, 7, 0, 0, 1403, 0, 0, 0, 62, 1, 0, 0, 0, 0, 0, 5, 0, 0, 0, 0, 303, 6, 26, 0, 322, 3, 0, 0, 7, 1914, 5, 27, 1, 0, 73, 0, 0, 0, 0, 0, 5, 0, 2112, 3, 0, 0, 0, 2, 1532, 0, 0, 188593, 1079, 83, 1697, 3, 21996, 3, 0, 642, 7116, 23371, 1457, 2053, 1, 8, 312, 217, 0, 5, 3, 28, 929, 0, 33196, 0, 4, 2, 159, 680, 52894, 0, 0, 5] depth:6 '7' 0x37 freq: 338983 depth:10 '.' 0x2e freq: 19576 depth:10 '|' 0x7c freq: 20117 depth:10 ' ' 0x1e freq: 21343 depth:12 ';' 0x3b freq: 5204 depth:15 'ç' 0xe7 freq: 642 depth:16 'Ä' 0xc4 freq: 322 depth:16 '^' 0x5e freq: 340 depth:14 '=' 0x3d freq: 1324 depth:13 '?' 0x3f freq: 2652 depth:13 '+' 0x2b freq: 2731 depth:14 '°' 0xb0 freq: 1403 depth:14 'ê' 0xea freq: 1457 depth:12 '%' 0x25 freq: 5895 depth:8 'y' 0x79 freq: 89834 depth:7 'f' 0x66 freq: 174221 depth:5 'o' 0x6f freq: 690950 depth:7 'E' 0x45 freq: 174395 depth:7 'C' 0x43 freq: 178974 depth:6 'm' 0x6d freq: 353922 depth:6 '6' 0x36 freq: 360107 depth:6 'R' 0x52 freq: 364913 depth:5 'i' 0x69 freq: 726237 depth:5 '1' 0x31 freq: 731263 depth:4 'a' 0x61 freq: 1462864 depth:5 'l' 0x6c freq: 742266 depth:10 'ä' 0xe4 freq: 21996 depth:10 'x' 0x78 freq: 23262 depth:9 'I' 0x49 freq: 46925 depth:8 'J' 0x4a freq: 93948 depth:7 'ß' 0xdf freq: 188593 depth:6 'c' 0x63 freq: 382722 depth:4 'r' 0x72 freq: 1605393 depth:7 'v' 0x76 freq: 189274 depth:10 'é' 0xe9 freq: 23371 depth:11 '/' 0x2f freq: 12098 depth:12 '<' 0x3c freq: 5975 depth:15 'û' 0xfb freq: 680 depth:15 '*' 0x2a freq: 785 depth:14 ' ' 0x1b freq: 1482 depth:14 'Ü' 0xdc freq: 1532 depth:14 'â' 0xe2 freq: 1697 depth:9 ':' 0x3a freq: 49120 depth:10 ' ' 0x1c freq: 24926 depth:10 '_' 0x5f freq: 24998 depth:10 ' ' 0x1f freq: 25884 depth:11 ''' 0x27 freq: 12919 depth:12 'q' 0x71 freq: 6781 depth:13 ',' 0x2c freq: 3350 depth:13 'Y' 0x59 freq: 3585 depth:6 'S' 0x53 freq: 398358 depth:6 '4' 0x34 freq: 423259 depth:7 'b' 0x62 freq: 215564 depth:7 'K' 0x4b freq: 218941 depth:5 's' 0x73 freq: 894081 depth:6 '5' 0x35 freq: 436554 depth:7 'P' 0x50 freq: 226700 depth:9 'ü' 0xfc freq: 52894 depth:9 'j' 0x6a freq: 58063 depth:8 ']' 0x5d freq: 120893 depth:4 '.' 0x00 freq: 1792699 depth:7 'w' 0x77 freq: 235839 depth:8 '[' 0x5b freq: 120894 depth:8 'F' 0x46 freq: 121554 depth:6 '-' 0x2d freq: 485812 depth:6 'h' 0x68 freq: 491870 depth:7 'L' 0x4c freq: 248492 depth:7 'k' 0x6b freq: 260435 depth:6 '3' 0x33 freq: 512766 depth:7 '9' 0x39 freq: 262437 depth:7 'H' 0x48 freq: 263906 depth:5 'n' 0x6e freq: 1053248 depth:7 '&' 0x26 freq: 264210 depth:12 'Q' 0x51 freq: 6978 depth:12 'è' 0xe8 freq: 7116 depth:17 'ú' 0xfa freq: 159 depth:22 'ñ' 0xf1 freq: 5 depth:22 'ÿ' 0xff freq: 5 depth:23 '×' 0xd7 freq: 3 depth:23 'å' 0xe5 freq: 3 depth:24 'µ' 0xb5 freq: 1 depth:24 'Û' 0xdb freq: 2 depth:23 'š' 0x9a freq: 3 depth:20 ' ' 0xa0 freq: 23 depth:23 'ã' 0xe3 freq: 3 depth:23 'ò' 0xf2 freq: 3 depth:22 ' ' 0x1d freq: 6 depth:22 'Á' 0xc1 freq: 6 depth:22 'È' 0xc8 freq: 7 depth:20 'Â' 0xc2 freq: 26 depth:20 'Ë' 0xcb freq: 27 depth:21 '—' 0x97 freq: 13 depth:21 'Œ' 0x8c freq: 14 depth:20 '“' 0x93 freq: 27 depth:20 'ó' 0xf3 freq: 28 depth:17 'ï' 0xef freq: 217 depth:17 '~' 0x7e freq: 227 depth:15 'ô' 0xf4 freq: 929 depth:14 'É' 0xc9 freq: 1914 depth:14 'ë' 0xeb freq: 2053 depth:17 '!' 0x21 freq: 241 depth:18 '\' 0x5c freq: 121 depth:18 '–' 0x96 freq: 123 depth:22 '' 0xad freq: 7 depth:22 'í' 0xed freq: 8 depth:25 'ì' 0xec freq: 1 depth:25 '}' 0x7d freq: 1 depth:24 '$' 0x24 freq: 2 depth:23 '‘' 0x91 freq: 4 depth:23 'ø' 0xf8 freq: 4 depth:24 'ù' 0xf9 freq: 2 depth:25 '{' 0x7b freq: 1 depth:25 'Ì' 0xcc freq: 1 depth:20 '„' 0x84 freq: 31 depth:19 '´' 0xb4 freq: 62 depth:18 '’' 0x92 freq: 127 depth:17 '@' 0x40 freq: 257 depth:15 'à' 0xe0 freq: 1079 depth:13 '>' 0x3e freq: 4298 depth:14 'Ö' 0xd6 freq: 2112 depth:15 '"' 0x22 freq: 1152 depth:18 '#' 0x23 freq: 139 depth:20 '•' 0x95 freq: 32 depth:20 '†' 0x86 freq: 34 depth:19 'Î' 0xce freq: 73 depth:18 'œ' 0x9c freq: 141 depth:21 ' ' 0x0a freq: 18 depth:23 '”' 0x94 freq: 4 depth:23 'Ô' 0xd4 freq: 5 depth:22 '€' 0x80 freq: 9 depth:21 '`' 0x60 freq: 19 depth:23 '«' 0xab freq: 5 depth:23 '»' 0xbb freq: 5 depth:23 'Ê' 0xca freq: 5 depth:24 '…' 0x85 freq: 2 depth:24 'Å' 0xc5 freq: 3 depth:19 'á' 0xe1 freq: 83 depth:17 'À' 0xc0 freq: 303 depth:17 'î' 0xee freq: 312 depth:10 'ö' 0xf6 freq: 33196 depth:9 'O' 0x4f freq: 68101 depth:9 'Z' 0x5a freq: 69181 depth:9 'z' 0x7a freq: 71828 depth:6 'u' 0x75 freq: 540150 depth:5 't' 0x74 freq: 1118505 depth:6 'g' 0x67 freq: 556107 depth:6 '2' 0x32 freq: 573219 depth:7 'A' 0x41 freq: 285338 depth:7 'p' 0x70 freq: 295924 depth:7 'B' 0x42 freq: 296089 depth:8 'V' 0x56 freq: 143603 depth:8 'T' 0x54 freq: 153151 depth:6 'd' 0x64 freq: 593424 depth:7 '8' 0x38 freq: 298331 depth:10 'U' 0x55 freq: 36950 depth:11 ')' 0x29 freq: 19040 depth:11 '(' 0x28 freq: 19085 depth:9 'X' 0x58 freq: 78809 depth:8 'N' 0x4e freq: 158630 depth:7 '0' 0x30 freq: 320775 depth:8 'D' 0x44 freq: 160441 depth:8 'M' 0x4d freq: 163284 depth:7 'G' 0x47 freq: 326595 depth:7 'W' 0x57 freq: 330475 depth:4 'e' 0x65 freq: 2604239 depth:4 ' ' 0x20 freq: 2755306 Huffman code: 0000000000000000000000000 'ì' 0xec Huffman code: 0000000000000000000000001 '}' 0x7d Huffman code: 0000000000000000000000010 '{' 0x7b Huffman code: 0000000000000000000000011 'Ì' 0xcc Huffman code: 000000000000000000000010 'µ' 0xb5 Huffman code: 000000000000000000000011 'Û' 0xdb Huffman code: 000000000000000000000100 '$' 0x24 Huffman code: 000000000000000000000101 'ù' 0xf9 Huffman code: 000000000000000000000110 '…' 0x85 Huffman code: 000000000000000000000111 'Å' 0xc5 Huffman code: 00000000000000000000100 '×' 0xd7 Huffman code: 00000000000000000000101 'å' 0xe5 Huffman code: 00000000000000000000110 'š' 0x9a Huffman code: 00000000000000000000111 'ã' 0xe3 Huffman code: 00000000000000000001000 'ò' 0xf2 Huffman code: 00000000000000000001001 '‘' 0x91 Huffman code: 00000000000000000001010 'ø' 0xf8 Huffman code: 00000000000000000001011 '”' 0x94 Huffman code: 00000000000000000001100 'Ô' 0xd4 Huffman code: 00000000000000000001101 '«' 0xab Huffman code: 00000000000000000001110 '»' 0xbb Huffman code: 00000000000000000001111 'Ê' 0xca Huffman code: 0000000000000000001000 'ñ' 0xf1 Huffman code: 0000000000000000001001 'ÿ' 0xff Huffman code: 0000000000000000001010 ' ' 0x1d Huffman code: 0000000000000000001011 'Á' 0xc1 Huffman code: 0000000000000000001100 'È' 0xc8 Huffman code: 0000000000000000001101 '' 0xad Huffman code: 0000000000000000001110 'í' 0xed Huffman code: 0000000000000000001111 '€' 0x80 Huffman code: 000000000000000001000 '—' 0x97 Huffman code: 000000000000000001001 'Œ' 0x8c Huffman code: 000000000000000001010 ' ' 0x0a Huffman code: 000000000000000001011 '`' 0x60 Huffman code: 00000000000000000110 ' ' 0xa0 Huffman code: 00000000000000000111 'Â' 0xc2 Huffman code: 00000000000000001000 'Ë' 0xcb Huffman code: 00000000000000001001 '“' 0x93 Huffman code: 00000000000000001010 'ó' 0xf3 Huffman code: 00000000000000001011 '„' 0x84 Huffman code: 00000000000000001100 '•' 0x95 Huffman code: 00000000000000001101 '†' 0x86 Huffman code: 0000000000000000111 '´' 0xb4 Huffman code: 0000000000000001000 'Î' 0xce Huffman code: 0000000000000001001 'á' 0xe1 Huffman code: 000000000000000101 '\' 0x5c Huffman code: 000000000000000110 '–' 0x96 Huffman code: 000000000000000111 '’' 0x92 Huffman code: 000000000000001000 '#' 0x23 Huffman code: 000000000000001001 'œ' 0x9c Huffman code: 00000000000000101 'ú' 0xfa Huffman code: 00000000000000110 'ï' 0xef Huffman code: 00000000000000111 '~' 0x7e Huffman code: 00000000000001000 '!' 0x21 Huffman code: 00000000000001001 '@' 0x40 Huffman code: 00000000000001010 'À' 0xc0 Huffman code: 00000000000001011 'î' 0xee Huffman code: 0000000000000110 'Ä' 0xc4 Huffman code: 0000000000000111 '^' 0x5e Huffman code: 000000000000100 'ç' 0xe7 Huffman code: 000000000000101 'û' 0xfb Huffman code: 000000000000110 '*' 0x2a Huffman code: 000000000000111 'ô' 0xf4 Huffman code: 000000000001000 'à' 0xe0 Huffman code: 000000000001001 '"' 0x22 Huffman code: 00000000000101 '=' 0x3d Huffman code: 00000000000110 '°' 0xb0 Huffman code: 00000000000111 'ê' 0xea Huffman code: 00000000001000 ' ' 0x1b Huffman code: 00000000001001 'Ü' 0xdc Huffman code: 00000000001010 'â' 0xe2 Huffman code: 00000000001011 'É' 0xc9 Huffman code: 00000000001100 'ë' 0xeb Huffman code: 00000000001101 'Ö' 0xd6 Huffman code: 0000000000111 '?' 0x3f Huffman code: 0000000001000 '+' 0x2b Huffman code: 0000000001001 ',' 0x2c Huffman code: 0000000001010 'Y' 0x59 Huffman code: 0000000001011 '>' 0x3e Huffman code: 000000000110 ';' 0x3b Huffman code: 000000000111 '%' 0x25 Huffman code: 000000001000 '<' 0x3c Huffman code: 000000001001 'q' 0x71 Huffman code: 000000001010 'Q' 0x51 Huffman code: 000000001011 'è' 0xe8 Huffman code: 00000000110 '/' 0x2f Huffman code: 00000000111 ''' 0x27 Huffman code: 00000001000 ')' 0x29 Huffman code: 00000001001 '(' 0x28 Huffman code: 0000000101 '.' 0x2e Huffman code: 0000000110 '|' 0x7c Huffman code: 0000000111 ' ' 0x1e Huffman code: 0000001000 'ä' 0xe4 Huffman code: 0000001001 'x' 0x78 Huffman code: 0000001010 'é' 0xe9 Huffman code: 0000001011 ' ' 0x1c Huffman code: 0000001100 '_' 0x5f Huffman code: 0000001101 ' ' 0x1f Huffman code: 0000001110 'ö' 0xf6 Huffman code: 0000001111 'U' 0x55 Huffman code: 000001000 'I' 0x49 Huffman code: 000001001 ':' 0x3a Huffman code: 000001010 'ü' 0xfc Huffman code: 000001011 'j' 0x6a Huffman code: 000001100 'O' 0x4f Huffman code: 000001101 'Z' 0x5a Huffman code: 000001110 'z' 0x7a Huffman code: 000001111 'X' 0x58 Huffman code: 00001000 'y' 0x79 Huffman code: 00001001 'J' 0x4a Huffman code: 00001010 ']' 0x5d Huffman code: 00001011 '[' 0x5b Huffman code: 00001100 'F' 0x46 Huffman code: 00001101 'V' 0x56 Huffman code: 00001110 'T' 0x54 Huffman code: 00001111 'N' 0x4e Huffman code: 00010000 'D' 0x44 Huffman code: 00010001 'M' 0x4d Huffman code: 0001001 'f' 0x66 Huffman code: 0001010 'E' 0x45 Huffman code: 0001011 'C' 0x43 Huffman code: 0001100 'ß' 0xdf Huffman code: 0001101 'v' 0x76 Huffman code: 0001110 'b' 0x62 Huffman code: 0001111 'K' 0x4b Huffman code: 0010000 'P' 0x50 Huffman code: 0010001 'w' 0x77 Huffman code: 0010010 'L' 0x4c Huffman code: 0010011 'k' 0x6b Huffman code: 0010100 '9' 0x39 Huffman code: 0010101 'H' 0x48 Huffman code: 0010110 '&' 0x26 Huffman code: 0010111 'A' 0x41 Huffman code: 0011000 'p' 0x70 Huffman code: 0011001 'B' 0x42 Huffman code: 0011010 '8' 0x38 Huffman code: 0011011 '0' 0x30 Huffman code: 0011100 'G' 0x47 Huffman code: 0011101 'W' 0x57 Huffman code: 001111 '7' 0x37 Huffman code: 010000 'm' 0x6d Huffman code: 010001 '6' 0x36 Huffman code: 010010 'R' 0x52 Huffman code: 010011 'c' 0x63 Huffman code: 010100 'S' 0x53 Huffman code: 010101 '4' 0x34 Huffman code: 010110 '5' 0x35 Huffman code: 010111 '-' 0x2d Huffman code: 011000 'h' 0x68 Huffman code: 011001 '3' 0x33 Huffman code: 011010 'u' 0x75 Huffman code: 011011 'g' 0x67 Huffman code: 011100 '2' 0x32 Huffman code: 011101 'd' 0x64 Huffman code: 1111 'a' 0x61 tab2: 31 11111 9 'a' 0x61 tab2: 30 11110 9 'a' 0x61 Huffman code: 1110 'r' 0x72 tab2: 29 11101 9 'r' 0x72 tab2: 28 11100 9 'r' 0x72 Huffman code: 1101 '.' 0x00 tab2: 27 11011 9 '.' 0x00 tab2: 26 11010 9 '.' 0x00 Huffman code: 1100 'e' 0x65 tab2: 25 11001 9 'e' 0x65 tab2: 24 11000 9 'e' 0x65 Huffman code: 1011 ' ' 0x20 tab2: 23 10111 9 ' ' 0x20 tab2: 22 10110 9 ' ' 0x20 Huffman code: 10101 'o' 0x6f tab2: 21 10101 11 'o' 0x6f Huffman code: 10100 'i' 0x69 tab2: 20 10100 11 'i' 0x69 Huffman code: 10011 '1' 0x31 tab2: 19 10011 11 '1' 0x31 Huffman code: 10010 'l' 0x6c tab2: 18 10010 11 'l' 0x6c Huffman code: 10001 's' 0x73 tab2: 17 10001 11 's' 0x73 Huffman code: 10000 'n' 0x6e tab2: 16 10000 11 'n' 0x6e Huffman code: 01111 't' 0x74 tab2: 15 01111 11 't' 0x74 tab2: 14 01110 38 19 tab2: 13 01101 38 19 tab2: 12 01100 38 19 tab2: 11 01011 38 19 tab2: 10 01010 38 19 tab2: 9 01001 38 19 tab2: 8 01000 38 19 tab2: 7 00111 36 19 tab2: 6 00110 36 18 tab2: 5 00101 36 18 tab2: 4 00100 36 18 tab2: 3 00011 36 18 tab2: 2 00010 34 18 tab2: 1 00001 34 17 tab2: 0 00000 0 16 compressed/uncompressed MDR 15 size: 21839978/30483100 ratio ~0,716 Number of ExitExceptions: 0 Time finished: Sun Jan 16 18:33:53 CET 2022 Total time taken: 54 minutes 13 seconds Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>> hat am 16.01.2022 18:14 geschrieben: Hi Arndt, I don't see anything wrong in the diagnostic data. This seems to be a very small map. Please post a link to the tile(s) so that I can try to reproduce the crash here. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>>> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de<mailto:arndt@speichenkarte.de><mailto:arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>>> Gesendet: Sonntag, 16. Januar 2022 17:16 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, i forget to activate the diagnostic function. I build the maps new, but it takes time. Fabrik and NRWplusare running now...... Here are the information from "Fabrik", the other map send i later. Greetz Arndt Mkgmap version 4867 Time started: Sun Jan 16 17:11:03 CET 2022 Number of MapFailedExceptions: 0 building Huffman tree for the following frequencies: [24620, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 648, 2, 0, 959, 47594, 3, 12, 4, 0, 303, 5763, 12, 2261, 2254, 4, 16, 52, 4086, 261, 356, 2610, 5213, 5125, 3989, 2721, 2168, 1694, 2113, 1539, 1641, 1840, 84, 1245, 170, 1320, 0, 3, 6207, 4855, 618, 1680, 2499, 1767, 3949, 3152, 784, 808, 2849, 2951, 1127, 3473, 976, 2938, 294, 4674, 7662, 1941, 809, 908, 6439, 2179, 5, 633, 2732, 0, 2732, 29, 607, 0, 24393, 5179, 9548, 8380, 44728, 3449, 9432, 12777, 11171, 21, 5132, 12721, 6529, 18350, 9267, 6653, 105, 31110, 14401, 20263, 8101, 2806, 2674, 465, 1074, 1629, 0, 870, 0, 38, 0, 0, 0, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 3, 0, 0, 0, 3, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 2, 0, 0, 1, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 8, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 16, 0, 0, 0, 0, 0, 11, 0, 0, 6179, 0, 0, 1, 0, 477, 0, 0, 0, 3, 7, 0, 0, 0, 0, 0, 0, 0, 0, 0, 0, 1, 0, 1200, 0, 0, 0, 0, 0, 1808, 0, 0, 0] depth:7 '4' 0x34 freq: 2721 depth:7 '[' 0x5b freq: 2732 depth:7 ']' 0x5d freq: 2732 depth:7 'v' 0x76 freq: 2806 depth:5 'i' 0x69 freq: 11171 depth:8 '>' 0x3e freq: 1320 depth:10 '/' 0x2f freq: 356 depth:11 '=' 0x3d freq: 170 depth:12 ';' 0x3b freq: 84 depth:12 'q' 0x71 freq: 105 depth:9 'I' 0x49 freq: 784 depth:7 'K' 0x4b freq: 2849 depth:6 '&' 0x26 freq: 5763 depth:7 'P' 0x50 freq: 2938 depth:7 'L' 0x4c freq: 2951 depth:6 'ß' 0xdf freq: 6179 depth:3 ' ' 0x20 freq: 47594 depth:4 'a' 0x61 freq: 24393 depth:4 '.' 0x00 freq: 24620 depth:6 'A' 0x41 freq: 6207 depth:7 'H' 0x48 freq: 3152 depth:8 '8' 0x38 freq: 1539 depth:9 'J' 0x4a freq: 808 depth:9 'U' 0x55 freq: 809 depth:5 'l' 0x6c freq: 12721 depth:5 'h' 0x68 freq: 12777 depth:6 'W' 0x57 freq: 6439 depth:6 'm' 0x6d freq: 6529 depth:8 'z' 0x7a freq: 1629 depth:8 '9' 0x39 freq: 1641 depth:8 'D' 0x44 freq: 1680 depth:8 '6' 0x36 freq: 1694 depth:6 'p' 0x70 freq: 6653 depth:7 'f' 0x66 freq: 3449 depth:7 'N' 0x4e freq: 3473 depth:8 'F' 0x46 freq: 1767 depth:9 '|' 0x7c freq: 870 depth:9 'V' 0x56 freq: 908 depth:8 'ü' 0xfc freq: 1808 depth:8 ':' 0x3a freq: 1840 depth:5 's' 0x73 freq: 14401 depth:6 'S' 0x53 freq: 7662 depth:10 'x' 0x78 freq: 465 depth:10 'ä' 0xe4 freq: 477 depth:9 ' ' 0x1f freq: 959 depth:8 'T' 0x54 freq: 1941 depth:7 'G' 0x47 freq: 3949 depth:4 'r' 0x72 freq: 31110 depth:7 '3' 0x33 freq: 3989 depth:7 '-' 0x2d freq: 4086 depth:6 'u' 0x75 freq: 8101 depth:6 'd' 0x64 freq: 8380 depth:9 'O' 0x4f freq: 976 depth:9 'y' 0x79 freq: 1074 depth:8 '7' 0x37 freq: 2113 depth:8 '5' 0x35 freq: 2168 depth:8 'X' 0x58 freq: 2179 depth:5 'n' 0x6e freq: 18350 depth:13 ',' 0x2c freq: 52 depth:15 '"' 0x22 freq: 12 depth:17 'è' 0xe8 freq: 3 depth:17 '#' 0x23 freq: 4 depth:16 'é' 0xe9 freq: 7 depth:14 '^' 0x5e freq: 29 depth:16 'Ä' 0xc4 freq: 8 depth:18 ' ' 0x1d freq: 2 depth:18 '' 0xad freq: 2 depth:19 '„' 0x84 freq: 1 depth:19 '°' 0xb0 freq: 1 depth:19 'â' 0xe2 freq: 1 depth:19 'ô' 0xf4 freq: 1 depth:15 'Ö' 0xd6 freq: 16 depth:15 '+' 0x2b freq: 16 depth:17 '*' 0x2a freq: 4 depth:17 'Y' 0x59 freq: 5 depth:16 'Ü' 0xdc freq: 11 depth:14 '~' 0x7e freq: 38 depth:15 'j' 0x6a freq: 21 depth:16 ''' 0x27 freq: 12 depth:18 'š' 0x9a freq: 3 depth:18 '!' 0x21 freq: 3 depth:18 '@' 0x40 freq: 3 depth:18 '–' 0x96 freq: 3 depth:11 '.' 0x2e freq: 261 depth:11 'Q' 0x51 freq: 294 depth:11 '%' 0x25 freq: 303 depth:9 'M' 0x4d freq: 1127 depth:8 ')' 0x29 freq: 2254 depth:7 'R' 0x52 freq: 4674 depth:6 'o' 0x6f freq: 9267 depth:6 'g' 0x67 freq: 9432 depth:8 '(' 0x28 freq: 2261 depth:9 'ö' 0xf6 freq: 1200 depth:10 '_' 0x5f freq: 607 depth:10 'C' 0x43 freq: 618 depth:7 'B' 0x42 freq: 4855 depth:6 'c' 0x63 freq: 9548 depth:8 'E' 0x45 freq: 2499 depth:9 '<' 0x3c freq: 1245 depth:10 'Z' 0x5a freq: 633 depth:10 ' ' 0x1c freq: 648 depth:7 '2' 0x32 freq: 5125 depth:5 't' 0x74 freq: 20263 depth:7 'k' 0x6b freq: 5132 depth:7 'b' 0x62 freq: 5179 depth:7 '1' 0x31 freq: 5213 depth:8 '0' 0x30 freq: 2610 depth:8 'w' 0x77 freq: 2674 depth:4 'e' 0x65 freq: 44728 Huffman code: 0000000000000000000 '„' 0x84 Huffman code: 0000000000000000001 '°' 0xb0 Huffman code: 0000000000000000010 'â' 0xe2 Huffman code: 0000000000000000011 'ô' 0xf4 Huffman code: 000000000000000010 ' ' 0x1d Huffman code: 000000000000000011 '' 0xad Huffman code: 000000000000000100 'š' 0x9a Huffman code: 000000000000000101 '!' 0x21 Huffman code: 000000000000000110 '@' 0x40 Huffman code: 000000000000000111 '–' 0x96 Huffman code: 00000000000000100 'è' 0xe8 Huffman code: 00000000000000101 '#' 0x23 Huffman code: 00000000000000110 '*' 0x2a Huffman code: 00000000000000111 'Y' 0x59 Huffman code: 0000000000000100 'é' 0xe9 Huffman code: 0000000000000101 'Ä' 0xc4 Huffman code: 0000000000000110 'Ü' 0xdc Huffman code: 0000000000000111 ''' 0x27 Huffman code: 000000000000100 '"' 0x22 Huffman code: 000000000000101 'Ö' 0xd6 Huffman code: 000000000000110 '+' 0x2b Huffman code: 000000000000111 'j' 0x6a Huffman code: 00000000000100 '^' 0x5e Huffman code: 00000000000101 '~' 0x7e Huffman code: 0000000000011 ',' 0x2c Huffman code: 000000000010 ';' 0x3b Huffman code: 000000000011 'q' 0x71 Huffman code: 00000000010 '=' 0x3d Huffman code: 00000000011 '.' 0x2e Huffman code: 00000000100 'Q' 0x51 Huffman code: 00000000101 '%' 0x25 Huffman code: 0000000011 '/' 0x2f Huffman code: 0000000100 'x' 0x78 Huffman code: 0000000101 'ä' 0xe4 Huffman code: 0000000110 '_' 0x5f Huffman code: 0000000111 'C' 0x43 Huffman code: 0000001000 'Z' 0x5a Huffman code: 0000001001 ' ' 0x1c Huffman code: 000000101 'I' 0x49 Huffman code: 000000110 'J' 0x4a Huffman code: 000000111 'U' 0x55 Huffman code: 000001000 '|' 0x7c Huffman code: 000001001 'V' 0x56 Huffman code: 000001010 ' ' 0x1f Huffman code: 000001011 'O' 0x4f Huffman code: 000001100 'y' 0x79 Huffman code: 000001101 'M' 0x4d Huffman code: 000001110 'ö' 0xf6 Huffman code: 000001111 '<' 0x3c Huffman code: 00001000 '>' 0x3e Huffman code: 00001001 '8' 0x38 Huffman code: 00001010 'z' 0x7a Huffman code: 00001011 '9' 0x39 Huffman code: 00001100 'D' 0x44 Huffman code: 00001101 '6' 0x36 Huffman code: 00001110 'F' 0x46 Huffman code: 00001111 'ü' 0xfc Huffman code: 00010000 ':' 0x3a Huffman code: 00010001 'T' 0x54 Huffman code: 00010010 '7' 0x37 Huffman code: 00010011 '5' 0x35 Huffman code: 00010100 'X' 0x58 Huffman code: 00010101 ')' 0x29 Huffman code: 00010110 '(' 0x28 Huffman code: 00010111 'E' 0x45 Huffman code: 00011000 '0' 0x30 Huffman code: 00011001 'w' 0x77 Huffman code: 0001101 '4' 0x34 Huffman code: 0001110 '[' 0x5b Huffman code: 0001111 ']' 0x5d Huffman code: 0010000 'v' 0x76 Huffman code: 0010001 'K' 0x4b Huffman code: 0010010 'P' 0x50 Huffman code: 0010011 'L' 0x4c Huffman code: 0010100 'H' 0x48 Huffman code: 0010101 'f' 0x66 Huffman code: 0010110 'N' 0x4e Huffman code: 0010111 'G' 0x47 Huffman code: 0011000 '3' 0x33 Huffman code: 0011001 '-' 0x2d Huffman code: 0011010 'R' 0x52 Huffman code: 0011011 'B' 0x42 Huffman code: 0011100 '2' 0x32 Huffman code: 0011101 'k' 0x6b Huffman code: 0011110 'b' 0x62 Huffman code: 0011111 '1' 0x31 Huffman code: 010000 '&' 0x26 Huffman code: 010001 'ß' 0xdf Huffman code: 010010 'A' 0x41 Huffman code: 010011 'W' 0x57 Huffman code: 010100 'm' 0x6d Huffman code: 010101 'p' 0x70 Huffman code: 010110 'S' 0x53 Huffman code: 010111 'u' 0x75 Huffman code: 011000 'd' 0x64 Huffman code: 011001 'o' 0x6f Huffman code: 011010 'g' 0x67 Huffman code: 011011 'c' 0x63 Huffman code: 111 ' ' 0x20 tab2: 31 11111 7 ' ' 0x20 tab2: 30 11110 7 ' ' 0x20 tab2: 29 11101 7 ' ' 0x20 tab2: 28 11100 7 ' ' 0x20 Huffman code: 1101 'a' 0x61 tab2: 27 11011 9 'a' 0x61 tab2: 26 11010 9 'a' 0x61 Huffman code: 1100 '.' 0x00 tab2: 25 11001 9 '.' 0x00 tab2: 24 11000 9 '.' 0x00 Huffman code: 1011 'r' 0x72 tab2: 23 10111 9 'r' 0x72 tab2: 22 10110 9 'r' 0x72 Huffman code: 1010 'e' 0x65 tab2: 21 10101 9 'e' 0x65 tab2: 20 10100 9 'e' 0x65 Huffman code: 10011 'i' 0x69 tab2: 19 10011 11 'i' 0x69 Huffman code: 10010 'l' 0x6c tab2: 18 10010 11 'l' 0x6c Huffman code: 10001 'h' 0x68 tab2: 17 10001 11 'h' 0x68 Huffman code: 10000 's' 0x73 tab2: 16 10000 11 's' 0x73 Huffman code: 01111 'n' 0x6e tab2: 15 01111 11 'n' 0x6e Huffman code: 01110 't' 0x74 tab2: 14 01110 11 't' 0x74 tab2: 13 01101 26 13 tab2: 12 01100 26 13 tab2: 11 01011 26 13 tab2: 10 01010 26 13 tab2: 9 01001 26 13 tab2: 8 01000 26 13 tab2: 7 00111 24 12 tab2: 6 00110 24 12 tab2: 5 00101 24 12 tab2: 4 00100 24 12 tab2: 3 00011 22 12 tab2: 2 00010 22 11 tab2: 1 00001 22 11 tab2: 0 00000 0 10 compressed/uncompressed MDR 15 size: 332289/475949 ratio ~0,698 Number of ExitExceptions: 0 Time finished: Sun Jan 16 17:12:07 CET 2022 Total time taken: 1 minute 4 seconds Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>>> hat am 16.01.2022 16:53 geschrieben: Hi Arndt, please post the diagnostic information from mkgmap for the map(s) that causes the crash. Esp. I need the data following the text "following frequencies:" Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>>>> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de<mailto:arndt@speichenkarte.de><mailto:arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>><mailto:arndt@speichenkarte.de<mailto:arndt@speichenkarte.de><mailto:arndt@speichenkarte.de<mailto:arndt@speichenkarte.de>>>> Gesendet: Sonntag, 16. Januar 2022 16:43 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd, i run a test with Speiche Deutschland, NRW+, Kanaren, Balearen, Alpen and "Fabrik"-a little cut around my home. size mkgmap-r4855 vs mkgmap-mdr2-r4867 (gmap) Alpen: 3,68 GB (3.954.902.039 Bytes) 3,67 GB (3.944.957.454 Bytes) Deutschland: 3,92 GB (4.215.119.117 Bytes) 3,91 GB (4.209.139.554 Bytes) Kanaren: 74,4 MB (78.077.953 Bytes) 74,2 MB (77.873.649 Bytes) NRW+ 3,06 GB (3.291.110.031 Bytes) 3,05 GB (3.284.340.528 Bytes) Balearen: 41,7 MB (43.772.910 Bytes) 41,5 MB (43.606.904 Bytes) The adress search in BaseCamp ist not OK: Balearen, Kanaren and Fabrik seems to be OK. Alpen: if you type a name from a city, there is no choice-list NRW+ and Germany: BaseCamp crash, when type a adress -> Fehler erkannt Es ist ein Problem mit BaseCamp aufgetreten App: BaseCamp At: 16.01.2022 16:35:40 (UTC1) OS: Windows 10 (64-bit) Processor: x86, Processor Level: 23, Processors:4, Model: 17 Stepping: 0, RAM: 14606744 BC.ADDRESSFINDCOMPONENTFINDERBASE_T.GETADDRESSFINDERRESULTS-1064-4.7.4.0 Es wurde versucht, im geschützten Speicher zu lesen oder zu schreiben. Dies ist häufig ein Hinweis darauf, dass anderer Speicher beschädigt ist. bei bc.AddressFindComponentFinderBase_t.GetAddressFinderResults(IList`1 A_0, Int32 A_1, String A_2) bei bc.AddressFindAutoCompleteComponentController_t.HandleAutoCompleteCitySearchRequest(AutoCompleteSearchRequestArgs_t aArgs) bei bc.AutoCompleteController_t.RequestItems() bei bc.AutoCompleteController_t.HandleTimerTick(Object sender, EventArgs e) bei System.Windows.Forms.Timer.OnTick(EventArgs e) bei System.Windows.Forms.Timer.TimerNativeWindow.WndProc(Message& m) bei System.Windows.Forms.NativeWindow.DebuggableCallback(IntPtr hWnd, Int32 msg, IntPtr wparam, IntPtr lparam) bei System.Windows.Forms.UnsafeNativeMethods.DispatchMessageW(MSG& msg) bei System.Windows.Forms.Application.ComponentManager.System.Windows.Forms.UnsafeNativeMethods.IMsoComponentManager.FPushMessageLoop(IntPtr dwComponentID, Int32 reason, Int32 pvLoopData) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoopInner(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.ThreadContext.RunMessageLoop(Int32 reason, ApplicationContext context) bei System.Windows.Forms.Application.Run(Form mainForm) bei main(String[] aArgs) Active Map Product: Speiche_Deutschland_220116 Version: 1.00 Installed Map Products: Map Name: Globale Karte (Garmin Product) Map Id: 133758977 Map Version: 2.0 Map Type: Bundle Custom Drawn Map: No Digital Elevation Model: No Map Name: Speiche_Fabrik_220116 Map Id: 517734401 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Kanaren_220116 Map Id: 518848513 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_NRWplus_220116 Map Id: 518914049 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Balearen_220116 Map Id: 518979585 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Deutschland_220116 Map Id: 519045121 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Speiche_Alpen_220116 Map Id: 519110657 Map Version: 1.0 Map Type: Bundle Custom Drawn Map: Yes Digital Elevation Model: Yes Map Name: Worldwide Autoroute DEM Basemap,NR (Garmin Product) Map Id: 3302470335 Map Version: 5.1 Map Type: Card Custom Drawn Map: No Digital Elevation Model: Yes .NET Versions: .NET FW 1.0 not installed. .NET FW 1.1 not installed. .NET FW 2.0 with SP2 installed .NET FW 3.0 with SP2 installed .NET FW 3.5 with SP1 installed OpenGL Version 2.1 Attached File: MiniDump Greetz Arndt Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com><mailto:gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>>>>> hat am 16.01.2022 10:38 geschrieben: Hi all, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4866 and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4867 Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests. Gerd ________________________________________ Von: 7770 <7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>><mailto:7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>>><mailto:7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>><mailto:7770@foskan.eu<mailto:7770@foskan.eu><mailto:7770@foskan.eu<mailto:7770@foskan.eu>>>>> Gesendet: Samstag, 15. Januar 2022 18:53 An: mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>>> Cc: Gerd Petermann Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi. https://files.mkgmap.org.uk/detail/544 ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error: Failed to render MultiPolygonRelation 2970267 that was with --latin1 mkgmap version 4839 works well. Regards Karl On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote: Hi all, during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test. It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later. The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later. The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off. Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps. How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes. Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental. The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip If you see errors which are caused by compression, please attach the diagnostic output. @Ticker: Please review the source. Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk><mailto:mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Gerd I'm just starting to look at this, but won't be able to do much today, but some initial findings: If just making gmapi from .img, unless --code-page is given it doesn't do compression, however the Mdr generated with the expected charset. MdrCheck and MdrDisplay, including string dump, look good Ticker On Sat, 2022-01-15 at 15:59 +0000, Gerd Petermann wrote:
Hi all,
during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test.
It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later.
The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later.
The encoding is enabled by default, special option --x-no-mdr15- compression can be used to turn it off.
Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps.
How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15- compression to verify if this is caused by compression or maybe other changes.
Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental.
The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
If you see errors which are caused by compression, please attach the diagnostic output.
@Ticker: Please review the source.
Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Ticker, reg. " unless --code-page is given" I see. Will try to change the code so that Mdr16 evaluates sort later. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk> Gesendet: Sonntag, 16. Januar 2022 13:37 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd I'm just starting to look at this, but won't be able to do much today, but some initial findings: If just making gmapi from .img, unless --code-page is given it doesn't do compression, however the Mdr generated with the expected charset. MdrCheck and MdrDisplay, including string dump, look good Ticker On Sat, 2022-01-15 at 15:59 +0000, Gerd Petermann wrote:
Hi all,
during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test.
It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later.
The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later.
The encoding is enabled by default, special option --x-no-mdr15- compression can be used to turn it off.
Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps.
How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15- compression to verify if this is caused by compression or maybe other changes.
Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental.
The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
If you see errors which are caused by compression, please attach the diagnostic output.
@Ticker: Please review the source.
Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Gerd A bit more: Are the boundary conditions for tab1Width (ie the space for the shifted minCode values) correct? eg if depth is 16, there is no minCode for this level, so the maximum minCode appears at level 15, the range being 1..2^15-1 (I think) I see a couple of problems with unicode: 1/ To fit the char into prefixTable, must be either 1 byte in utf8 representation or <= 8 bits in absolute value (or v0 is made 16 bits instead). It could be that lookupBits is reduced until this isn't a problem. What did example unicode mdrs have? 2/ If >256 chars not in prefix table, the offset per level in tab1 needs to be bigger than a byte. I'm still surprised that it didn't appear to work when all the chars fit into the prefix table. Maybe the top nibble of lookupBits is a flag saying that tab1 is present, although the tab1length would do that equally well. The 8 after 1stLevWithStruct and rowsIn1stTable is still troubling, as I'd have expected it to be associated with the prefixTable Ticker On Sun, 2022-01-16 at 12:37 +0000, Ticker Berkin wrote:
Hi Gerd
I'm just starting to look at this, but won't be able to do much today, but some initial findings:
If just making gmapi from .img, unless --code-page is given it doesn't do compression, however the Mdr generated with the expected charset.
MdrCheck and MdrDisplay, including string dump, look good
Ticker
On Sat, 2022-01-15 at 15:59 +0000, Gerd Petermann wrote:
Hi all,
during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test.
It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later.
The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later.
The encoding is enabled by default, special option --x-no-mdr15- compression can be used to turn it off.
Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps.
How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15- compression to verify if this is caused by compression or maybe other changes.
Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental.
The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
If you see errors which are caused by compression, please attach the diagnostic output.
@Ticker: Please review the source.
Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Gerd More unicode problems: The data structures for the frequency analysis and then the list of chars to encode will all need attention. Ticker
Hi Ticker, you seem to think that the encoder must understand what a codepoint is? I don't think so. The only important thing is that utf-8 still can use a single 0 to terminate strings. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk> Gesendet: Sonntag, 16. Januar 2022 19:43 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd More unicode problems: The data structures for the frequency analysis and then the list of chars to encode will all need attention. Ticker _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Gerd So, for unicode, it just runs on the stream of utf-8 representation a byte at a time, rather than on unicode chars? It works but is not a good compression. Ticker On Sun, 2022-01-16 at 19:16 +0000, Gerd Petermann wrote:
Hi Ticker,
you seem to think that the encoder must understand what a codepoint is? I don't think so. The only important thing is that utf-8 still can use a single 0 to terminate strings.
Gerd
________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk> Gesendet: Sonntag, 16. Januar 2022 19:43 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression
Hi Gerd
More unicode problems: The data structures for the frequency analysis and then the list of chars to encode will all need attention.
Ticker
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Ticker, yes, one byte at a time. Else we would need symbol width > 8, and Garmin doesn't use that for the unicode maps that I know.to I plan to contact the author of GPXsee, Martin Tůma. He seems to know much more than we do and maybe he is willing to help. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk> Gesendet: Sonntag, 16. Januar 2022 23:40 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd So, for unicode, it just runs on the stream of utf-8 representation a byte at a time, rather than on unicode chars? It works but is not a good compression. Ticker On Sun, 2022-01-16 at 19:16 +0000, Gerd Petermann wrote:
Hi Ticker,
you seem to think that the encoder must understand what a codepoint is? I don't think so. The only important thing is that utf-8 still can use a single 0 to terminate strings.
Gerd
________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk> Gesendet: Sonntag, 16. Januar 2022 19:43 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression
Hi Gerd
More unicode problems: The data structures for the frequency analysis and then the list of chars to encode will all need attention.
Ticker
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Gerd I'm looking at GPXSee at the moment. Significant to the problem lots of symbols: The size of the tab1 offset into the symbol list is the same as the size of the size (the 1+ bytes after the 8/symbol width), so, if more than 127, it needs an extra byte. Ticker On Mon, 2022-01-17 at 04:26 +0000, Gerd Petermann wrote:
Hi Ticker,
yes, one byte at a time. Else we would need symbol width > 8, and Garmin doesn't use that for the unicode maps that I know.to I plan to contact the author of GPXsee, Martin Tůma. He seems to know much more than we do and maybe he is willing to help.
Gerd
Hi Ticker, yes, thanks, that was the problem. The table width also depends on this and I didn't understand that so far. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk> Gesendet: Montag, 17. Januar 2022 10:44 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd I'm looking at GPXSee at the moment. Significant to the problem lots of symbols: The size of the tab1 offset into the symbol list is the same as the size of the size (the 1+ bytes after the 8/symbol width), so, if more than 127, it needs an extra byte. Ticker On Mon, 2022-01-17 at 04:26 +0000, Gerd Petermann wrote:
Hi Ticker,
yes, one byte at a time. Else we would need symbol width > 8, and Garmin doesn't use that for the unicode maps that I know.to I plan to contact the author of GPXsee, Martin Tůma. He seems to know much more than we do and maybe he is willing to help.
Gerd
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi all, Ticker found the error, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4870 I also fixed display tool. Please try again with r4870: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4870.zip Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Gerd Petermann <gpetermann_muenchen@hotmail.com> Gesendet: Montag, 17. Januar 2022 11:16 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Ticker, yes, thanks, that was the problem. The table width also depends on this and I didn't understand that so far. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk> Gesendet: Montag, 17. Januar 2022 10:44 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd I'm looking at GPXSee at the moment. Significant to the problem lots of symbols: The size of the tab1 offset into the symbol list is the same as the size of the size (the 1+ bytes after the 8/symbol width), so, if more than 127, it needs an extra byte. Ticker On Mon, 2022-01-17 at 04:26 +0000, Gerd Petermann wrote:
Hi Ticker,
yes, one byte at a time. Else we would need symbol width > 8, and Garmin doesn't use that for the unicode maps that I know.to I plan to contact the author of GPXsee, Martin Tůma. He seems to know much more than we do and maybe he is willing to help.
Gerd
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Arndt, I think there are still problems with address search, probably not related to compression, but to problems with --lower-case. I'm still analysing it... Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Arndt Röhrig <arndt@speichenkarte.de> Gesendet: Montag, 17. Januar 2022 15:56 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi all, now the search works with r4870 and Speiche_NRWplus. Thankx for the fix! Greetz Arndt Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>> hat am 17.01.2022 11:35 geschrieben: Hi all, Ticker found the error, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4870 I also fixed display tool. Please try again with r4870: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4870.zip Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>> im Auftrag von Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>> Gesendet: Montag, 17. Januar 2022 11:16 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Ticker, yes, thanks, that was the problem. The table width also depends on this and I didn't understand that so far. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk<mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk>> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk<mailto:rwb-mkgmap@jagit.co.uk>> Gesendet: Montag, 17. Januar 2022 10:44 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi Gerd I'm looking at GPXSee at the moment. Significant to the problem lots of symbols: The size of the tab1 offset into the symbol list is the same as the size of the size (the 1+ bytes after the 8/symbol width), so, if more than 127, it needs an extra byte. Ticker On Mon, 2022-01-17 at 04:26 +0000, Gerd Petermann wrote: Hi Ticker, yes, one byte at a time. Else we would need symbol width > 8, and Garmin doesn't use that for the unicode maps that I know.to I plan to contact the author of GPXsee, Martin Tůma. He seems to know much more than we do and maybe he is willing to help. Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
participants (5)
-
7770 -
Arndt Röhrig -
Gerd Petermann -
Gerd Petermann
-
Ticker Berkin