October 2018 - mkgmap-dev - The mkgmap lists

This file has too many entities in a block.
by <0174 19 Oct '18

19 Oct '18

Hi, I'm trying to solve this problem for some time already, but can't find the solution so I hope this is the right place to ask. I'm trying to split SRTM contours for Nepal with 10 m contours. It is not that much data, the .pbf file has just 375 MB. However when I try to run it: java -jar -Xms4G -Xmx4G ..\mkgmap\Splitter\splitter.jar --output-dir=./SRTM/ --output=pbf --max-threads=6 --status-freq=60 SRTM_NP.pbf it first starts to give warnings: Warning: Fileblock has body size too large and may be considered corrupt then errors: Exception in thread "worker-3" java.lang.Error: This file has too many entities in a block. Parsers will reject it. at crosby.binary.file.FileBlock.newInstance(Unknown Source) at crosby.binary.BinarySerializer.processBatch(Unknown Source) at uk.me.parabola.splitter.writer.BinaryMapWriter$PBFSerializer$Processor.checkLimit(BinaryMapWriter.java:385) at uk.me.parabola.splitter.writer.BinaryMapWriter$PBFSerializer$Processor.process(BinaryMapWriter.java:406) at uk.me.parabola.splitter.writer.BinaryMapWriter.write(BinaryMapWriter.java:515) at uk.me.parabola.splitter.writer.AbstractOSMWriter.write(AbstractOSMWriter.java:83) at uk.me.parabola.splitter.SplitProcessor$OSMWriterWorker.run(SplitProcessor.java:430) at java.lang.Thread.run(Unknown Source) and the resulting files are incomplete. I tried to lower the /--max-nodes/ parameter, but it just prolongs the process until I got to days of processing time. Do you have any idea what to tune to avoid this? I splitted files of similar size before, but Nepal seems to be a tough nut to crack. I have Oracle Java 1.8.0_191 64bit (but I had the problems with 32bit Java too). Thanks in advance, Vojta https://garmin.v0174.net

2 1

Re: [mkgmap-dev] Commit r4244: Reduce number of includes in default style
by Mike Baggaley 19 Oct '18

19 Oct '18

I see that this change adds route=ferry {set mkgmap:numbers = false } which was presumably in the include file. However, I notice that the lines for railways do not have this included, but do have road_class and road_speed set. Should set 'mkgmap:numbers = false' also be set for railways in the default style? (In my own style file, I do not have road_class or road_speed set for railway items, except for platforms, as I don't want to be routed along a railway line.) Regards, Mike

2 1

Commit r4245: correction: if precomp--sea option is used, closed ways with the tag natural=coastline where only processed as lines, not as polygons.
by svn commit 19 Oct '18

19 Oct '18

Version mkgmap-r4245 was committed by gerd on Fri, 19 Oct 2018 correction: if precomp--sea option is used, closed ways with the tag natural=coastline where only processed as lines, not as polygons. The code in SeaGenerator creates a copy of the original way, but it doesn't copy the tags, only the geometry. The copy has only two tags: mkgmap:removed_natural=coastline, mkgmap:stylefilter=polygon The problem is that the code also adds the tag mkgmap:stylefilter=polyline to the original way, so that it is not processed as a polygon. Now the original tags are copied, the natural tag is changed as shown above and mkgmap:stylefilter=polygon is added so that the copy is only processed by the polygon rules. http://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4245

3 2

Stuck on rendering a man_made = breakwater
by Joris Bo 19 Oct '18

19 Oct '18

Hello, I'm trying to render a man_made = breakwater polygon area and are struggling for a long time. I think it is a polygon (mkgmap:cache_area_size=5643.060) and should also be processed that way but for whatever reason it never passes the polygon rules only the lines-rules. So I can get a closed line around it but cannot fill it. The geofabric download is from today. https://www.openstreetmap.org/#map=15/52.9444/5.0429 First I thougt it's because the combination with natural = coastline and the precomp-sea option. At least removing the natural = coastline tag does not help I also tried to set set mkgmap:stylefilter = polygon within the lines file, hoping I could fool it to continue with the polygon rules But as far as I can see it never gets there. Lines file jbecho = true {echotags 'Line before breakwater'} #man_made = breakwater & natural = coastline { delete natural } man_made = breakwater & natural = coastline & is_closed() = true { set mkgmap:stylefilter = polygon } jbecho = true {echotags 'Line after set stylefilter test to polygon'} man_made = breakwater & is_closed() != true & area != yes [0x10a14 resolution 22 continue] jbecho = true {echotags 'Line after breakwater'} My lines rules file starts with man_made = * & osmid() = 53546926 {set jbecho = true} jbecho = true { echotags 'debug - lines - body start' } My polygon rules file starts with man_made = * & osmid() = 53546926 {set jbecho = true} jbecho = true { echotags 'debug - polygons - body start' } The logging Way 53546926 [jbecho=true, man_made=breakwater, mkgmap:cache_area_size=5643.060, mkgmap:stylefilter=polyline, natural=coastline, place=islet] debug - lines - body start Way 53546926 [jbecho=true, man_made=breakwater, mkgmap:cache_area_size=5643.060, mkgmap:stylefilter=polyline, natural=coastline, place=islet] Line before breakwater Way 53546926 [jbecho=true, man_made=breakwater, mkgmap:cache_area_size=5643.060, mkgmap:stylefilter=polygon, natural=coastline, place=islet] Line after set stylefilter test to polygon Way 53546926 [jbecho=true, man_made=breakwater, mkgmap:cache_area_size=5643.060, mkgmap:stylefilter=polygon, natural=coastline, place=islet] Line after breakwater Way 53546926 [jbecho=true, man_made=breakwater, mkgmap:cache_area_size=5643.060, mkgmap:stylefilter=polygon, natural=coastline, place=islet] debug - lines - body end So it never gets to the polygon rules file where I think it should go Could somebody hint me what I'm doing wrong? Kind regards, Joris

2 3

Testing for way id in style file
by Joris Bo 17 Oct '18

17 Oct '18

Hello, Question about testing for the object's id for echo purposes. If I use name = "Amsterdam" { echotags 'City of Amsterdam'} it will echo the id (let's say 123456789) to the output logging Is it also possible to test for the id itself ? for example something like id = 123456789 { echotags 'City of Amsterdam'} kind regards Joris

2 2

City search problem
by ValentinAK 17 Oct '18

17 Oct '18

Hello. I release daily assemblies of all countries that were part of the ex-USSR and several other countries ( maptourist.org <https://maptourist.org> ). The amount of data becomes very large and will soon reach 4GB of the maximum size of one gmapsupp container. Therefore, I decided to divide my assembly into two parts - Eastern and Western. I made the separation along the border (admin_level = 3). But I found a problem when searching for cities. Now I will try to explain what I discovered: I prepared two parts of the OSM data with a common border and compiled east-gmapsupp.img and west-gmapsupp.img. I use Splitter v591 & Mkgmap v4240. Splitter processing the western part of the data makes several rectangular areas. The data clipping boundary crossing several tiles. As a result, half the area of these tiles contains no data. The empty space of these tiles covers a non-empty map from the eastern part. Now I activate east-gmapsupp.img and west-gmapsupp.img in my Garmin Nuvi-1490 and on the empty space of the described western tiles, I get a problem when searching for all eastern cities in this area of overlap. Only the search for cities does not work. Address search and routing work fine. I tried the same and different FID. The problem is still here. I plan to compile more maps of many other countries, but this problem makes it difficult to use two adjacent maps simultaneously. What solution? Links for try this on my fresh files: https://maptourist.org/osm-garmin/gmapsupp-east-EN.zip <https://maptourist.org/osm-garmin/gmapsupp-east-EN.zip> https://maptourist.org/osm-garmin/gmapsupp-west-EN.zip <https://maptourist.org/osm-garmin/gmapsupp-west-EN.zip> Best regards Valentin <http://gis.19327.n8.nabble.com/file/t318348/City-search-problem.gif> -- Sent from: http://gis.19327.n8.nabble.com/Mkgmap-Development-f5324443.html

3 15

Build PrecompSeaGenerator by default?
by Thorsten Kukuk 15 Oct '18

15 Oct '18

Hi, as I build my precompiled sea data myself: can we build the PrecompSeaGenerator of mkgmap by default with the binary mkgmap jar? This would allow to use the default mkgmap jar and does not require to always rebuild it at my own. Thanks, Thorsten -- Thorsten Kukuk, Distinguished Engineer, Senior Architect SLES & MicroOS SUSE LINUX GmbH, Maxfeldstr. 5, 90409 Nuernberg, Germany GF: Felix Imendoerffer, Jane Smithard, Graham Norton, HRB 21284 (AG Nuernberg)

2 3

Server Down ?
by Manfred Haiduk 12 Oct '18

12 Oct '18

7 8

Re: [mkgmap-dev] Server Down ?
by manfred.haiduk 12 Oct '18

12 Oct '18

ok, i will check it ...Thanks Von meinem Samsung Gerät gesendet. -------- Ursprüngliche Nachricht -------- Von: Gerd Petermann <gpetermann_muenchen(a)hotmail.com> Datum: 12.10.2018 09:58 (GMT+01:00) An: Development list for mkgmap <mkgmap-dev(a)lists.mkgmap.org.uk> Betreff: Re: [mkgmap-dev] Server Down ? Hi Manfred, Unless you use a 32 bit Windows on a 64 PC I don't think that Linux offers any advantage here. If you use a 64 bit Windows make sure that you also use a 64 bit JRE. Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces(a)lists.mkgmap.org.uk> im Auftrag von manfred.haiduk <manfred.haiduk(a)freenet.de> Gesendet: Freitag, 12. Oktober 2018 09:49 An: Development list for mkgmap; lig fietser Betreff: Re: [mkgmap-dev] Server Down ? Some time ago, i tried this with the 'bounds' option of mkgmap and the other help stuff. For smaller regions it works but as i wan to do this for the whole Europe osm file, i have to realize, that my PC is to small (RAM) or the help stuff does not handle such an amount of data within Windows. So my option was, to get the sea and bound file from another source. Btw, is it worth to do all this (compiling a garmin suitable area from osm) with LINUX instead of Windows but with the same hardware ? Von meinem Samsung Gerät gesendet. -------- Ursprüngliche Nachricht -------- Von: Gerd Petermann <gpetermann_muenchen(a)hotmail.com> Datum: 12.10.2018 08:53 (GMT+01:00) An: lig fietser <ligfietser(a)hotmail.com>, Development list for mkgmap <mkgmap-dev(a)lists.mkgmap.org.uk> Betreff: Re: [mkgmap-dev] Server Down ? Hi all, Besides that I can only remind you that it is possible to calculate the data with mkgmap. Some weeks ago I've played with a faster implementation of the multipolygon cutting algo in the mp-cut branch, this esp. improved the performance of the precomp sea calculation (~50% faster), but my code got quite complex and still wasn't able to handle special cases like touching inner rings properly, a problem that appears in many complex OSM multipolygons. Not sure what to do with that code now. It adds a lot of complexity to the already complex mp handling. Maybe I'll revert the changes since 4236: http://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4236 and merge the previous improvements. Any comments? Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces(a)lists.mkgmap.org.uk> im Auftrag von lig fietser <ligfietser(a)hotmail.com> Gesendet: Freitag, 12. Oktober 2018 08:47 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Server Down ? The owner is Lambertus, you can mail him at osm at na1400 dot info _______________________________________________ mkgmap-dev mailing list mkgmap-dev(a)lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev </ligfietser(a)hotmail.com></mkgmap-dev-bounces(a)lists.mkgmap.org.uk> _______________________________________________ mkgmap-dev mailing list mkgmap-dev(a)lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev(a)lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

1 0

Re: [mkgmap-dev] Server Down ?
by manfred.haiduk 12 Oct '18

12 Oct '18

Some time ago, i tried this with the 'bounds' option of mkgmap and the other help stuff. For smaller regions it works but as i wan to do this for the whole Europe osm file, i have to realize, that my PC is to small (RAM) or the help stuff does not handle such an amount of data within Windows. So my option was, to get the sea and bound file from another source. Btw, is it worth to do all this (compiling a garmin suitable area from osm) with LINUX instead of Windows but with the same hardware ? Von meinem Samsung Gerät gesendet. -------- Ursprüngliche Nachricht -------- Von: Gerd Petermann <gpetermann_muenchen(a)hotmail.com> Datum: 12.10.2018 08:53 (GMT+01:00) An: lig fietser <ligfietser(a)hotmail.com>, Development list for mkgmap <mkgmap-dev(a)lists.mkgmap.org.uk> Betreff: Re: [mkgmap-dev] Server Down ? Hi all, Besides that I can only remind you that it is possible to calculate the data with mkgmap. Some weeks ago I've played with a faster implementation of the multipolygon cutting algo in the mp-cut branch, this esp. improved the performance of the precomp sea calculation (~50% faster), but my code got quite complex and still wasn't able to handle special cases like touching inner rings properly, a problem that appears in many complex OSM multipolygons. Not sure what to do with that code now. It adds a lot of complexity to the already complex mp handling. Maybe I'll revert the changes since 4236: http://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4236 and merge the previous improvements. Any comments? Gerd ________________________________________ Von: mkgmap-dev <mkgmap-dev-bounces(a)lists.mkgmap.org.uk> im Auftrag von lig fietser <ligfietser(a)hotmail.com> Gesendet: Freitag, 12. Oktober 2018 08:47 An: Development list for mkgmap Betreff: Re: [mkgmap-dev] Server Down ? The owner is Lambertus, you can mail him at osm at na1400 dot info _______________________________________________ mkgmap-dev mailing list mkgmap-dev(a)lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev </ligfietser(a)hotmail.com></mkgmap-dev-bounces(a)lists.mkgmap.org.uk> _______________________________________________ mkgmap-dev mailing list mkgmap-dev(a)lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

2 1