undocumented contour line feature
Hi all, mkgmap contains sources to generate contour lines from SRTM data, but it seems to be very incomplete. The last significant changes in the source was in 2010, and I never heard that anybody uses options like --x-contours since I started to contribute to mkgmap. See also http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2009q3/002581.html I'd like to either remove the code completely or mayve make it work if you think that it would be better to have the code in mkgmap instead of a separate package like phyghtmap. Does anybody remember why it is not documented? Gerd
Hi all, I've tried to use it with --x-contours and it turned out that it doesn't work. 1) The code expects the SRTM data to be available, it has no automatic download feature like e.g. phyghtmap. I think that this would be needed to make it a good feature. 2) The code can only add SRTM data for a tile which is not too large ("must not span more than one SRTM file"). This would also require more work. 3) If the code generates ways they are ignored because some methods are not called to process them. It may have worked before r2599, but surely not since then. So, I think it is safe to remove the code since nobody complained. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Gerd Petermann <GPetermann_muenchen@hotmail.com> Gesendet: Freitag, 24. März 2017 10:08:57 An: mkgmap-dev@lists.mkgmap.org.uk Betreff: [mkgmap-dev] undocumented contour line feature Hi all, mkgmap contains sources to generate contour lines from SRTM data, but it seems to be very incomplete. The last significant changes in the source was in 2010, and I never heard that anybody uses options like --x-contours since I started to contribute to mkgmap. See also http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2009q3/002581.html I'd like to either remove the code completely or mayve make it work if you think that it would be better to have the code in mkgmap instead of a separate package like phyghtmap. Does anybody remember why it is not documented? Gerd _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start j/ava -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img./ and get the error. with mkgmap-r3864 it get the same error. How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ... thomas
Hi Thomas, I think it depends on the style. The more indexable objects you create and the longer the names, the more memory is needed. Andrzej suggested not to put POI with type 0x28 into the index. Do you think this would help to reduce size in your case? See this thread: http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x2800-tt5889... Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ? Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de> In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img. and get the error. [cid:part1.6A605C7E.D89F4F60@img2ms.de] with mkgmap-r3864 it get the same error. How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ... thomas
Is it possible to not put POIs into the index, but still have them displayed? I would like to have gates and stiles on my map, but not have them searchable in the index. Is this possible? Cheers, Mike -----Original Message----- From: Gerd Petermann [mailto:GPetermann_muenchen@hotmail.com] Sent: 24 March 2017 16:25 To: Development list for mkgmap <mkgmap-dev@lists.mkgmap.org.uk> Subject: Re: [mkgmap-dev] RAM and mdr Europa ? Hi Thomas, I think it depends on the style. The more indexable objects you create and the longer the names, the more memory is needed. Andrzej suggested not to put POI with type 0x28 into the index. Do you think this would help to reduce size in your case? See this thread: http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x2800-tt5889 663.html Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ? Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de> In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img. and get the error. [cid:part1.6A605C7E.D89F4F60@img2ms.de] with mkgmap-r3864 it get the same error. How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ... thomas
Hi Mike, my understanding is that mkgmap can decide which elements are used to build the index and what string are put into the index. AFAIK it can not decide what you can search in the device, as it may also perform a search without an index. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Mike Baggaley <mike@tvage.co.uk> Gesendet: Freitag, 24. März 2017 17:33:47 An: 'Development list for mkgmap' Betreff: Re: [mkgmap-dev] RAM and mdr Europa ? Is it possible to not put POIs into the index, but still have them displayed? I would like to have gates and stiles on my map, but not have them searchable in the index. Is this possible? Cheers, Mike -----Original Message----- From: Gerd Petermann [mailto:GPetermann_muenchen@hotmail.com] Sent: 24 March 2017 16:25 To: Development list for mkgmap <mkgmap-dev@lists.mkgmap.org.uk> Subject: Re: [mkgmap-dev] RAM and mdr Europa ? Hi Thomas, I think it depends on the style. The more indexable objects you create and the longer the names, the more memory is needed. Andrzej suggested not to put POI with type 0x28 into the index. Do you think this would help to reduce size in your case? See this thread: http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x2800-tt5889 663.html Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ? Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de> In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img. and get the error. [cid:part1.6A605C7E.D89F4F60@img2ms.de] with mkgmap-r3864 it get the same error. How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ... thomas _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
... but we have currently no option to control what is used for the index. I assume it could be a new special tag like mkgmap:no-index=true or maybe a program option like --exclude-from-index=type1,type2, type3..type4 which would exclude single types or ranges. No idea how much work that would be and how the device works when something is not in the index. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Gerd Petermann <GPetermann_muenchen@hotmail.com> Gesendet: Freitag, 24. März 2017 17:40:41 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] RAM and mdr Europa ? Hi Mike, my understanding is that mkgmap can decide which elements are used to build the index and what string are put into the index. AFAIK it can not decide what you can search in the device, as it may also perform a search without an index. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Mike Baggaley <mike@tvage.co.uk> Gesendet: Freitag, 24. März 2017 17:33:47 An: 'Development list for mkgmap' Betreff: Re: [mkgmap-dev] RAM and mdr Europa ? Is it possible to not put POIs into the index, but still have them displayed? I would like to have gates and stiles on my map, but not have them searchable in the index. Is this possible? Cheers, Mike -----Original Message----- From: Gerd Petermann [mailto:GPetermann_muenchen@hotmail.com] Sent: 24 March 2017 16:25 To: Development list for mkgmap <mkgmap-dev@lists.mkgmap.org.uk> Subject: Re: [mkgmap-dev] RAM and mdr Europa ? Hi Thomas, I think it depends on the style. The more indexable objects you create and the longer the names, the more memory is needed. Andrzej suggested not to put POI with type 0x28 into the index. Do you think this would help to reduce size in your case? See this thread: http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x2800-tt5889 663.html Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ? Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de> In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img. and get the error. [cid:part1.6A605C7E.D89F4F60@img2ms.de] with mkgmap-r3864 it get the same error. How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ... thomas _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
I have this in my style - as a change from default style- works nicely: #RWB barrier=bollard | barrier=bus_trap | barrier=gate [0x660f resolution 24] #RWB barrier=block | barrier=cycle_barrier | barrier=stile | barrier=kissing_gate [0x660f resolution 24] #RWB get lots of Unnamed Pillar. #RWB Also fills up find>geographic for no good purpose so use arb point barrier=bollard | barrier=gate | barrier=block | barrier=stile {add name='${barrier}'} [0x3200 resolution 24] barrier=bus_trap | barrier=cycle_barrier | barrier=kissing_gate {add name='${barrier|subst:"_=> "}'} [0x3200 resolution 24] Ticker On Fri, 2017-03-24 at 16:33 +0000, Mike Baggaley wrote:
Is it possible to not put POIs into the index, but still have them displayed? I would like to have gates and stiles on my map, but not have them searchable in the index. Is this possible?
Cheers, Mike
-----Original Message----- From: Gerd Petermann [mailto:GPetermann_muenchen@hotmail.com] Sent: 24 March 2017 16:25 To: Development list for mkgmap <mkgmap-dev@lists.mkgmap.org.uk> Subject: Re: [mkgmap-dev] RAM and mdr Europa ?
Hi Thomas,
I think it depends on the style. The more indexable objects you create and the longer the names, the more memory is needed. Andrzej suggested not to put POI with type 0x28 into the index. Do you think this would help to reduce size in your case? See this thread: http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x2800 -tt5889 663.html
Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ?
Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de>; In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img.
and get the error.
[cid:part1.6A605C7E.D89F4F60@img2ms.de]
with mkgmap-r3864 it get the same error.
How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ...
thomas
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Ticker, can you explain this a bit, please? I don't understand what RW8 means, but it seems that you have many named barriers in your area? Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk> Gesendet: Montag, 27. März 2017 14:59:26 An: mkgmap-dev@lists.mkgmap.org.uk Betreff: Re: [mkgmap-dev] RAM and mdr Europa ? I have this in my style - as a change from default style- works nicely: #RWB barrier=bollard | barrier=bus_trap | barrier=gate [0x660f resolution 24] #RWB barrier=block | barrier=cycle_barrier | barrier=stile | barrier=kissing_gate [0x660f resolution 24] #RWB get lots of Unnamed Pillar. #RWB Also fills up find>geographic for no good purpose so use arb point barrier=bollard | barrier=gate | barrier=block | barrier=stile {add name='${barrier}'} [0x3200 resolution 24] barrier=bus_trap | barrier=cycle_barrier | barrier=kissing_gate {add name='${barrier|subst:"_=> "}'} [0x3200 resolution 24] Ticker On Fri, 2017-03-24 at 16:33 +0000, Mike Baggaley wrote:
Is it possible to not put POIs into the index, but still have them displayed? I would like to have gates and stiles on my map, but not have them searchable in the index. Is this possible?
Cheers, Mike
-----Original Message----- From: Gerd Petermann [mailto:GPetermann_muenchen@hotmail.com] Sent: 24 March 2017 16:25 To: Development list for mkgmap <mkgmap-dev@lists.mkgmap.org.uk> Subject: Re: [mkgmap-dev] RAM and mdr Europa ?
Hi Thomas,
I think it depends on the style. The more indexable objects you create and the longer the names, the more memory is needed. Andrzej suggested not to put POI with type 0x28 into the index. Do you think this would help to reduce size in your case? See this thread: http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x2800 -tt5889 663.html
Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ?
Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de>; In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img.
and get the error.
[cid:part1.6A605C7E.D89F4F60@img2ms.de]
with mkgmap-r3864 it get the same error.
How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ...
thomas
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi On my device: find > "All POI" (or any of the more specific finds) only show certain types - 0x12, 0x1c, 0x1d, 0x29 - 0x30, 0x64 - 0x66. If the POI doesn't have a name, it shows as "Unnamed xxx" where xxx seems to be supplied by the garmin device depending on the type/subtype The default style has the following: barrier=bollard | barrier=bus_trap | barrier=gate [0x660f resolution 24] barrier=block | barrier=cycle_barrier | barrier=stile | barrier=kissing_gate [0x660f resolution 24] 0x660f on my device is "Land Feature"/"Pillar" So, when out walking and I want to see what is nearby, doing a find>"All POI" can yield a long list of "Unnamed Pillar" because of all the nearby gates and stiles. I never want to search for a barrier, but would like to see them on the map, so using a POI type that doesn't show on find> and setting the name of the POI to the type of barrier solves this. Likewise, I like to see linear barriers, so in my style/lines I have: barrier=wall | barrier=fence | barrier=hedge | barrier=ditch {add name='${barrier|subst:"_=> "}'} [0x2a resolution 24] #RWB is just an marker I use so I can tell which are my changes from the default style when I want to merge in release changes. It occurred to me later: is there a set of POI types that are never searchable on any device. If so, can they be omitted from the POI index, so saving mkgmap index processing memory and IMG size Ticker On Tue, 2017-03-28 at 05:26 +0000, Gerd Petermann wrote:
Hi Ticker,
can you explain this a bit, please? I don't understand what RW8 means, but it seems that you have many named barriers in your area?
Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Ticker Berkin <rwb-mkgmap@jagit.co.uk> Gesendet: Montag, 27. März 2017 14:59:26 An: mkgmap-dev@lists.mkgmap.org.uk Betreff: Re: [mkgmap-dev] RAM and mdr Europa ?
I have this in my style - as a change from default style- works nicely:
#RWB barrier=bollard | barrier=bus_trap | barrier=gate [0x660f resolution 24] #RWB barrier=block | barrier=cycle_barrier | barrier=stile | barrier=kissing_gate [0x660f resolution 24] #RWB get lots of Unnamed Pillar. #RWB Also fills up find>geographic for no good purpose so use arb point barrier=bollard | barrier=gate | barrier=block | barrier=stile {add name='${barrier}'} [0x3200 resolution 24] barrier=bus_trap | barrier=cycle_barrier | barrier=kissing_gate {add name='${barrier|subst:"_=> "}'} [0x3200 resolution 24]
Ticker
On Fri, 2017-03-24 at 16:33 +0000, Mike Baggaley wrote:
Is it possible to not put POIs into the index, but still have them displayed? I would like to have gates and stiles on my map, but not have them searchable in the index. Is this possible?
Cheers, Mike
-----Original Message----- From: Gerd Petermann [mailto:GPetermann_muenchen@hotmail.com] Sent: 24 March 2017 16:25 To: Development list for mkgmap <mkgmap-dev@lists.mkgmap.org.uk> Subject: Re: [mkgmap-dev] RAM and mdr Europa ?
Hi Thomas,
I think it depends on the style. The more indexable objects you create and the longer the names, the more memory is needed. Andrzej suggested not to put POI with type 0x28 into the index. Do you think this would help to reduce size in your case? See this thread: http://gis.19327.n8.nabble.com/POI-indexing-problem-with-label-0x28 00 -tt5889 663.html
Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ?
Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de>;; In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX: -UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img.
and get the error.
[cid:part1.6A605C7E.D89F4F60@img2ms.de]
with mkgmap-r3864 it get the same error.
How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ...
thomas
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Ticker, global index is not used, unless you search for POI by name. Actually mkgmap doesn't put POI types 0x64.. - 0x66.. into global index. -- Best regards, Andrzej
Hi Thomas, since you have 10 GB of RAM for all of the tasks running on your computer, I doubt that 9800 MB for Java/mkgmap is actually feasable. With Win 7, I put away some 1200-1500 MB for the operating system. If a process gets more memory, swapping to disk will occur, which is a slow process, and the garbage collection might fail in such situations (well, not sure for Java, but I saw such situations with .Net). I do not know how much RAM will be used up by WIN 10, but I think replacing "/-Xmx9800m/" by "/-Xmx8500m/" could be worth a test; you could also (additionally) set the initial heap size to that amount ("/-Xms8500m/") . Bernhard Am 24.03.2017 um 17:07 schrieb Thomas Morgenstern:
Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start j/ava -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img./
and get the error.
with mkgmap-r3864 it get the same error.
How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ...
thomas
Hi, I found a solution for me: Now i use only the option -index and removed the option -x-splitt-name-index. in this configuration is 9800 MB RAM enough. thomas Am 24.03.2017 um 19:18 schrieb Bernhard Hiller:
Hi Thomas, since you have 10 GB of RAM for all of the tasks running on your computer, I doubt that 9800 MB for Java/mkgmap is actually feasable. With Win 7, I put away some 1200-1500 MB for the operating system. If a process gets more memory, swapping to disk will occur, which is a slow process, and the garbage collection might fail in such situations (well, not sure for Java, but I saw such situations with .Net). I do not know how much RAM will be used up by WIN 10, but I think replacing "/-Xmx9800m/" by "/-Xmx8500m/" could be worth a test; you could also (additionally) set the initial heap size to that amount ("/-Xms8500m/") . Bernhard
Am 24.03.2017 um 17:07 schrieb Thomas Morgenstern:
Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start j/ava -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img./
and get the error.
with mkgmap-r3864 it get the same error.
How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ...
thomas
mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
El 24/03/17 a las 17:07, Thomas Morgenstern escribió:
How many RAM must i have for Europa complete ?
2-3 months ago I had the same problem on a Linux machine with 8 GB RAM, but during the last weeks I've been able to build Europe index with -Xmx7500m. As Gerd suggested, it depends on your style.
Hi Thomas, maybe it helps: The problem occured while sorting the index entries for streets names. With option --x-split-name-index you have one entry for each word in the street name. I think this option can easily dup the number of entries and aso the required memory for the entries is higher. We've once tried to fix this partially with Mdr7.patch but it turned out to produce wrong entries in the index. I'll try again to find a better solution. In the mean time you may check how your style handles street names. Maybe you often use addlabel or you add words to the road names ? I've seen styles which add a default name for each unnamed object. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ? Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de> In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img. and get the error. [cid:part1.6A605C7E.D89F4F60@img2ms.de] with mkgmap-r3864 it get the same error. How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ... thomas
Hi Gerd, I have solved the problem. i do not longer use -x-split-name-index, but only -index. This decrease the RAM and my java heap space is great enough or that option. Rgeards Thomas Am 29.03.2017 um 09:27 schrieb Gerd Petermann:
Hi Thomas,
maybe it helps: The problem occured while sorting the index entries for streets names. With option --x-split-name-index you have one entry for each word in the street name. I think this option can easily dup the number of entries and aso the required memory for the entries is higher.
We've once tried to fix this partially with Mdr7.patch but it turned out to produce wrong entries in the index. I'll try again to find a better solution.
In the mean time you may check how your style handles street names. Maybe you often use addlabel or you add words to the road names ? I've seen styles which add a default name for each unnamed object.
Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ?
Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de> In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img.
and get the error.
[cid:part1.6A605C7E.D89F4F60@img2ms.de]
with mkgmap-r3864 it get the same error.
How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ...
thomas
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Thomas, I already understood that but I don't call this a solution ;-) My understanding is that the option is really helpfull in countries like Spain were many street names start with Rua. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Mittwoch, 29. März 2017 17:21:01 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] RAM and mdr Europa ? Hi Gerd, I have solved the problem. i do not longer use -x-split-name-index, but only -index. This decrease the RAM and my java heap space is great enough or that option. Rgeards Thomas Am 29.03.2017 um 09:27 schrieb Gerd Petermann: Hi Thomas, maybe it helps: The problem occured while sorting the index entries for streets names. With option --x-split-name-index you have one entry for each word in the street name. I think this option can easily dup the number of entries and aso the required memory for the entries is higher. We've once tried to fix this partially with Mdr7.patch but it turned out to produce wrong entries in the index. I'll try again to find a better solution. In the mean time you may check how your style handles street names. Maybe you often use addlabel or you add words to the road names ? I've seen styles which add a default name for each unnamed object. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de><mailto:webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ? Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de><http://www.Download.Geofabrik.de><http://www.Download.Geofabrik.de> In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img. and get the error. [cid:part1.6A605C7E.D89F4F60@img2ms.de] with mkgmap-r3864 it get the same error. How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ... thomas _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
I agree, it is not a really solution. But it is the only thing i can do with my 10 GB RAM. I will bee happy, if you found a algorythmus, which can use -x-split-name-index and works with my limited RAM, and avoids the OutOfMemory java heapspace error. By the way: With a smaller inputarea (Easteuropa or Skandinavia), 10 GB RAM is enough to use x-split-name-index, no error occurs. regards thomas Am 29.03.2017 um 18:08 schrieb Gerd Petermann:
Hi Thomas,
I already understood that but I don't call this a solution ;-) My understanding is that the option is really helpfull in countries like Spain were many street names start with Rua.
Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de> Gesendet: Mittwoch, 29. März 2017 17:21:01 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] RAM and mdr Europa ?
Hi Gerd,
I have solved the problem. i do not longer use -x-split-name-index, but only -index. This decrease the RAM and my java heap space is great enough or that option.
Rgeards Thomas
Am 29.03.2017 um 09:27 schrieb Gerd Petermann:
Hi Thomas,
maybe it helps: The problem occured while sorting the index entries for streets names. With option --x-split-name-index you have one entry for each word in the street name. I think this option can easily dup the number of entries and aso the required memory for the entries is higher.
We've once tried to fix this partially with Mdr7.patch but it turned out to produce wrong entries in the index. I'll try again to find a better solution.
In the mean time you may check how your style handles street names. Maybe you often use addlabel or you add words to the road names ? I've seen styles which add a default name for each unnamed object.
Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk><mailto:mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Thomas Morgenstern <webmaster@img2ms.de><mailto:webmaster@img2ms.de> Gesendet: Freitag, 24. März 2017 17:07:22 An: Development list for mkgmap Betreff: [mkgmap-dev] RAM and mdr Europa ?
Hi, I have a W10, 64 bit machine and 10 GB RAM. Since a few months i can not generate the mdr-file for Europa from www.Download.Geofabrik.de<http://www.Download.Geofabrik.de><http://www.Download.Geofabrik.de><http://www.Download.Geofabrik.de> In a first run i generate only all the maptiles. No Problem. in a second i will generate the overview, tdb and mdr. I start java -Xmx9800m -XX:-UseGCOverheadLimit jar mkgmap.jar code-page=1252 -family-id=1901 -x-split-name-index -index D:\Karten\Europa\*.img.
and get the error.
[cid:part1.6A605C7E.D89F4F60@img2ms.de]
with mkgmap-r3864 it get the same error.
How many RAM must i have for Europa complete ?. In august 2016 it was possible to create the mdr with 6 GB RAM. But the filesize is growm ...
thomas
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk<mailto:mkgmap-dev@lists.mkgmap.org.uk> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Thomas, have you tried bigger values for -Xmx option? Like for example -Xmx16G, I think java x64 can use swap file for heap. -- Best regards, Andrzej
I've posted a first patch, see http://gis.19327.n8.nabble.com/Patch-v1-reduce-peak-memory-usage-for-global-... Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Andrzej Popowski <popej@poczta.onet.pl> Gesendet: Mittwoch, 29. März 2017 23:02:03 An: mkgmap-dev@lists.mkgmap.org.uk Betreff: Re: [mkgmap-dev] RAM and mdr Europa ? Hi Thomas, have you tried bigger values for -Xmx option? Like for example -Xmx16G, I think java x64 can use swap file for heap. -- Best regards, Andrzej _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi
mkgmap contains sources to generate contour lines from SRTM data, but it seems to be very incomplete. The last significant changes in the source was in 2010, and I never heard that anybody uses options like --x-contours since I started to contribute to mkgmap.
All classes in packages named "optional" are not included in the download distribution. So it has never been available except if you compile the source yourself and include it. ..Steve
Hi Steve, only class GeoTiffDEM is optional, the active code is able to read *.hgt files and can produce ways with elevation data. I stumbled over it because it appears in MapperBasedMapDataSource.addBackground() which I plan to move to MapDetails so that we don't have to override it in many sources. I like the idea that mkgmap adds SRTM data "on the fly" instead of first creating huge OSM files, pass them through splitter and so on. No idea how much work would be needed to make the code work and how many poblems that would cause, esp. if we also try to download SRTM files automatically. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Steve Ratcliffe <steve@parabola.me.uk> Gesendet: Freitag, 24. März 2017 22:05:26 An: mkgmap-dev@lists.mkgmap.org.uk Betreff: Re: [mkgmap-dev] undocumented contour line feature Hi
mkgmap contains sources to generate contour lines from SRTM data, but it seems to be very incomplete. The last significant changes in the source was in 2010, and I never heard that anybody uses options like --x-contours since I started to contribute to mkgmap.
All classes in packages named "optional" are not included in the download distribution. So it has never been available except if you compile the source yourself and include it. ..Steve _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Gerd,
I like the idea that mkgmap adds SRTM data "on the fly" instead of first creating huge OSM files, pass them through splitter and so on.
It could be handy, but contours aren't evenly spread over map area. You will get big variation in tile size and no way to correct it. -- Best regards, Andrzej
Hi Andrzej, thanks, that's a good point against this idea. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces@lists.mkgmap.org.uk> im Auftrag von Andrzej Popowski <popej@poczta.onet.pl> Gesendet: Samstag, 25. März 2017 01:44:58 An: mkgmap-dev@lists.mkgmap.org.uk Betreff: Re: [mkgmap-dev] undocumented contour line feature Hi Gerd,
I like the idea that mkgmap adds SRTM data "on the fly" instead of first creating huge OSM files, pass them through splitter and so on.
It could be handy, but contours aren't evenly spread over map area. You will get big variation in tile size and no way to correct it. -- Best regards, Andrzej _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
participants (8)
-
Andrzej Popowski -
Bernhard Hiller -
Carlos Dávila -
Gerd Petermann -
Mike Baggaley -
Steve Ratcliffe -
Thomas Morgenstern -
Ticker Berkin