Hi John, a lot of things were changed since v4286. I have no idea what can cause a 30% slower execution. Are you sure about this? Maybe you just ran both versions once and the older worked with filled disk cache? Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von John Thorn <johnrthorn@gmail.com> Gesendet: Sonntag, 16. Januar 2022 14:18 An: mkgmap-dev@lists.mkgmap.org.uk Betreff: Re: [mkgmap-dev] mkgmap-dev Digest, Vol 162, Issue 25 Hi Gerd et al, Downloaded 4865 and ran it to make a .GMAP with no changes to data nor options Compared with running v4286 (which works for me so I still use) : MDR is now 43092K was 47347K Runtime (reading .MP files) seemed slower, maybe 30% slower Some .RGN files are bigger : now 5855K was 5823K, for example. Searching in Basecamp runs with no problems. Keep up the good work! John On Sun, 16 Jan 2022 at 12:00, <mkgmap-dev-request@lists.mkgmap.org.uk<mailto:mkgmap-dev-request@lists.mkgmap.org.uk>> wrote: Send mkgmap-dev mailing list submissions to mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> To subscribe or unsubscribe via the World Wide Web, visit https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev or, via email, send a message with subject or body 'help' to mkgmap-dev-request@lists.mkgmap.org.uk<mailto:mkgmap-dev-request@lists.mkgmap.org.uk> You can reach the person managing the list at mkgmap-dev-owner@lists.mkgmap.org.uk<mailto:mkgmap-dev-owner@lists.mkgmap.org.uk> When replying, please edit your Subject line so it is more specific than "Re: Contents of mkgmap-dev digest..." Today's Topics: 1. Please try and report results of Huffman compression (Gerd Petermann) 2. Re: Please try and report results of Huffman compression (7770) 3. Re: Please try and report results of Huffman compression (Gerd Petermann) ---------- Forwarded message ---------- From: Gerd Petermann <GPetermann_muenchen@hotmail.com<mailto:GPetermann_muenchen@hotmail.com>> To: "mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>" <mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>> Cc: Bcc: Date: Sat, 15 Jan 2022 15:59:24 +0000 Subject: [mkgmap-dev] Please try and report results of Huffman compression Hi all, during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test. It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later. The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later. The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off. Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps. How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes. Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental. The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip If you see errors which are caused by compression, please attach the diagnostic output. @Ticker: Please review the source. Gerd ---------- Forwarded message ---------- From: 7770 <7770@foskan.eu<mailto:7770@foskan.eu>> To: "mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>" <mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>> Cc: Bcc: Date: Sat, 15 Jan 2022 18:53:37 +0100 Subject: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi. https://files.mkgmap.org.uk/detail/544 ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error: Failed to render MultiPolygonRelation 2970267 that was with --latin1 mkgmap version 4839 works well. Regards Karl On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote:
Hi all,
during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test.
It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later.
The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later.
The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off.
Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps.
How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes.
Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental.
The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
If you see errors which are caused by compression, please attach the diagnostic output.
@Ticker: Please review the source.
Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
---------- Forwarded message ---------- From: Gerd Petermann <gpetermann_muenchen@hotmail.com<mailto:gpetermann_muenchen@hotmail.com>> To: "mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>" <mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk>> Cc: Bcc: Date: Sun, 16 Jan 2022 09:38:14 +0000 Subject: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi all, see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4866 and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4867 Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests. Gerd ________________________________________ Von: 7770 <7770@foskan.eu<mailto:7770@foskan.eu>> Gesendet: Samstag, 15. Januar 2022 18:53 An: mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> Cc: Gerd Petermann Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression Hi. https://files.mkgmap.org.uk/detail/544 ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error: Failed to render MultiPolygonRelation 2970267 that was with --latin1 mkgmap version 4839 works well. Regards Karl On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote:
Hi all,
during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test.
It works with codepages 1250 ..1258 or 65001. I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later.
The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled. This will be changed to debug level later.
The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off.
Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit) Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy. Note also that this branch includes the changes from the faster-mp branch and introduces a few changes which are relavant for --lower-case maps.
How to test? Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching. If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes.
Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental.
The binary is here: https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
If you see errors which are caused by compression, please attach the diagnostic output.
@Ticker: Please review the source.
Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev