Hi Gerd et al,

Downloaded 4865 and ran it to make a .GMAP with no changes to data nor options

Compared with running v4286 (which works for me so I still use) :

MDR is now 43092K was 47347K

Runtime (reading .MP files) seemed slower, maybe 30% slower

Some .RGN files are bigger : now 5855K was 5823K, for example.

Searching in Basecamp runs with no problems.

Keep up the good work!

John

On Sun, 16 Jan 2022 at 12:00, <mkgmap-dev-request@lists.mkgmap.org.uk> wrote:
Send mkgmap-dev mailing list submissions to
        mkgmap-dev@lists.mkgmap.org.uk

To subscribe or unsubscribe via the World Wide Web, visit
        https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
or, via email, send a message with subject or body 'help' to
        mkgmap-dev-request@lists.mkgmap.org.uk

You can reach the person managing the list at
        mkgmap-dev-owner@lists.mkgmap.org.uk

When replying, please edit your Subject line so it is more specific
than "Re: Contents of mkgmap-dev digest..."
Today's Topics:

   1. Please try and report results of Huffman compression
      (Gerd Petermann)
   2. Re: Please try and report results of Huffman      compression (7770)
   3. Re: Please try and report results of Huffman      compression
      (Gerd Petermann)



---------- Forwarded message ----------
From: Gerd Petermann <GPetermann_muenchen@hotmail.com>
To: "mkgmap-dev@lists.mkgmap.org.uk" <mkgmap-dev@lists.mkgmap.org.uk>
Cc: 
Bcc: 
Date: Sat, 15 Jan 2022 15:59:24 +0000
Subject: [mkgmap-dev] Please try and report results of Huffman compression
Hi all,

during the last weeks Ticker and I decoded Garmin's String compression of the global index for the PC (the *_mdr.img) .
In the mdr2 branch I've coded support for that in mkgmap and I think its ready for a first beta test.

It works with codepages 1250 ..1258 or 65001.
I've no idea how the 2-byte pages work, but Garmin seems to support that, too. Maybe I'll work on this later.

The branch version produces around 200 lines of diagnostic output to show what happens when compression is enabled.
This will be changed to debug level later.

The encoding is enabled by default, special option --x-no-mdr15-compression can be used to turn it off.

Note that the size of the *_mdr.img file will be smaller (which is esp. intersting for those who get close to the 2G limit)
Note also that a zipped *_mdr.img can and will be larger since zip cannot remove as much redundancy.
Note also that this branch includes the changes from the faster-mp branch and introduces a few changes
which are relavant for --lower-case maps.

How to test?
Install the map in MapSource and check if you see any unexpected characters in the result lists or maybe even crashes while searching.
If so, please try the same input files with the --x-no-mdr15-compression to verify if this is caused by compression or maybe other changes.

Please don't yet publish the maps, but let me know if you see anything unexpected. Some changes reg. lower-case in this branch are still experimental.

The binary is here:
https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip

If you see errors which are caused by compression, please attach the diagnostic output.

@Ticker: Please review the source.

Gerd



---------- Forwarded message ----------
From: 7770 <7770@foskan.eu>
To: "mkgmap-dev@lists.mkgmap.org.uk" <mkgmap-dev@lists.mkgmap.org.uk>
Cc: 
Bcc: 
Date: Sat, 15 Jan 2022 18:53:37 +0100
Subject: Re: [mkgmap-dev] Please try and report results of Huffman compression
Hi.
https://files.mkgmap.org.uk/detail/544

ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error:
Failed to render MultiPolygonRelation 2970267
that was with --latin1

mkgmap version 4839 works well.


Regards
Karl

On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote:
> Hi all,
>
> during the last weeks Ticker and I decoded Garmin's String compression of
> the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded
> support for that in mkgmap and I think its ready for a first beta test.
>
> It works with codepages 1250 ..1258 or 65001.
> I've no idea how the 2-byte pages work, but Garmin seems to support that,
> too. Maybe I'll work on this later.
>
> The branch version produces around 200 lines of diagnostic output to show
> what happens when compression is enabled. This will be changed to debug
> level later.
>
> The encoding is enabled by default, special option --x-no-mdr15-compression
> can be used to turn it off.
>
> Note that the size of the *_mdr.img file will be smaller (which is esp.
> intersting for those who get close to the 2G limit) Note also that a zipped
> *_mdr.img can and will be larger since zip cannot remove as much
> redundancy. Note also that this branch includes the changes from the
> faster-mp branch and introduces a few changes which are relavant for
> --lower-case maps.
>
> How to test?
> Install the map in MapSource and check if you see any unexpected characters
> in the result lists or maybe even crashes while searching. If so, please
> try the same input files with the --x-no-mdr15-compression to verify if
> this is caused by compression or maybe other changes.
>
> Please don't yet publish the maps, but let me know if you see anything
> unexpected. Some changes reg. lower-case in this branch are still
> experimental.
>
> The binary is here:
> https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
>
> If you see errors which are caused by compression, please attach the
> diagnostic output.
>
> @Ticker: Please review the source.
>
> Gerd
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev








---------- Forwarded message ----------
From: Gerd Petermann <gpetermann_muenchen@hotmail.com>
To: "mkgmap-dev@lists.mkgmap.org.uk" <mkgmap-dev@lists.mkgmap.org.uk>
Cc: 
Bcc: 
Date: Sun, 16 Jan 2022 09:38:14 +0000
Subject: Re: [mkgmap-dev] Please try and report results of Huffman compression
Hi all,

see https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4866
and https://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4867

Please use https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4867.zip for further tests.

Gerd

________________________________________
Von: 7770 <7770@foskan.eu>
Gesendet: Samstag, 15. Januar 2022 18:53
An: mkgmap-dev@lists.mkgmap.org.uk
Cc: Gerd Petermann
Betreff: Re: [mkgmap-dev] Please try and report results of Huffman compression

Hi.
https://files.mkgmap.org.uk/detail/544

ALLVARLIG (MultiPolygonRelation): folder/77700046.osm.pbf: Internal error:
Failed to render MultiPolygonRelation 2970267
that was with --latin1

mkgmap version 4839 works well.


Regards
Karl

On lördag 15 januari 2022 16:59:24 CET Gerd Petermann wrote:
> Hi all,
>
> during the last weeks Ticker and I decoded Garmin's String compression of
> the global index for the PC (the *_mdr.img) . In the mdr2 branch I've coded
> support for that in mkgmap and I think its ready for a first beta test.
>
> It works with codepages 1250 ..1258 or 65001.
> I've no idea how the 2-byte pages work, but Garmin seems to support that,
> too. Maybe I'll work on this later.
>
> The branch version produces around 200 lines of diagnostic output to show
> what happens when compression is enabled. This will be changed to debug
> level later.
>
> The encoding is enabled by default, special option --x-no-mdr15-compression
> can be used to turn it off.
>
> Note that the size of the *_mdr.img file will be smaller (which is esp.
> intersting for those who get close to the 2G limit) Note also that a zipped
> *_mdr.img can and will be larger since zip cannot remove as much
> redundancy. Note also that this branch includes the changes from the
> faster-mp branch and introduces a few changes which are relavant for
> --lower-case maps.
>
> How to test?
> Install the map in MapSource and check if you see any unexpected characters
> in the result lists or maybe even crashes while searching. If so, please
> try the same input files with the --x-no-mdr15-compression to verify if
> this is caused by compression or maybe other changes.
>
> Please don't yet publish the maps, but let me know if you see anything
> unexpected. Some changes reg. lower-case in this branch are still
> experimental.
>
> The binary is here:
> https://www.mkgmap.org.uk/download/mkgmap-mdr2-r4865.zip
>
> If you see errors which are caused by compression, please attach the
> diagnostic output.
>
> @Ticker: Please review the source.
>
> Gerd
> _______________________________________________
> mkgmap-dev mailing list
> mkgmap-dev@lists.mkgmap.org.uk
> https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev





_______________________________________________
mkgmap-dev mailing list
mkgmap-dev@lists.mkgmap.org.uk
https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev