November 2014 - mkgmap-dev - The mkgmap lists

Commit: r3354: Crash on POI non-numeric address number
by svn commit 21 Nov '14

21 Nov '14

Version mkgmap-r3354 was committed by steve on Fri, 21 Nov 2014 Crash on POI non-numeric address number

1 0

Commit: r3353: Improve ConvertFilter.
by svn commit 20 Nov '14

20 Nov '14

Version mkgmap-r3353 was committed by steve on Thu, 20 Nov 2014 Improve ConvertFilter. The patch allows for length conversions between m, km, mi, ft and speed conversions of km/h (kmh, kmph), mph, knots. New ones can easily be added. It will also take into account any unit that already exists. So for example if you have ${val|m=>ft} Then val will be assumed to be in meters if there is no unit. val=10 --> 33 if a unit is given, then it converts from that, so if already in feet the value will be unchanged. val=10ft --> 10 val=10km --> 32,808 If it can't work out what to do then the value is unchanged. http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2014q4/021995.html

1 0

[Patch v3] style statistics
by Gerd Petermann 20 Nov '14

20 Nov '14

Hi Steve, I've changed the code to use a printStats message. The log configuration line is now uk.me.parabola.mkgmap.osmstyle.stats.level=INFO I don't see an easy way to use only one instance of StyleImpl, so I think the stats cannot be printed to stdout without heavy changes? @Steph: With r3352 I fixed the > "|}" is a little weird for me. issue. Compiled binary is here: http://files.mkgmap.org.uk/download/228/mkgmap.jar Gerd

1 0

Re: [mkgmap-dev] Assertion error with r3350
by Felix Hartmann 20 Nov '14

20 Nov '14

Location (.img and also .osm.pbf) http://openmtbmap.org/analysis.7z I think it happens also if you really just want to create a basic overview mapset.img / mapset.tdb. Not even need for search index. (otherwise I got a second different bug in mkgmap that more or less throws the same exception). there are three .tmp files generated - only the mdr.... .tmp file has some data (about 3MB) - the other are 0byte files. - just to give you an idea how far it gets. Sorry I forgot to add them into the download. Okay - here we go (don't mind the 7*.img - that doesn't change a thing): C:\OpenMTBMap\maps>start /low /b /wait java -jar -XX:StringTableSize=100003 -Xms6000M -Xmx10300M c:\openmtbmap\mkgmap.jar --max-jobs=8 "--generate-sea" "--latin1" "--precomp-sea=c:\openmtbmap\maps\sea.zip" "--style-file=c:\openmtbmap\openmtbmap_style" --nsis --index --levels="0:24, 1:23, 2:22, 3:21, 4:20, 5:19, 6:18" --overview-levels="7:17, 8:16, 9:15, 10:14, 11:13, 12:12" --adjust-turn-headings --add-pois-to-areas --reduce-point-density=3.4 --reduce-point-density-polygon=6 --housenumbers --link-pois-to-ways --ignore-turn-restrictions --polygon-size-limits="24:16, 23:14, 22:12, 21:11, 20:10, 19:9, 18:8, 17:7, 16:6, 15:5, 14:4, 13:3, 12:2, 11:0, 10:0" --description=openmtbmap_co --show-profiles=1 --location-autofill=bounds,is_in,nearest --bounds=c:\openmtbmap\maps\bounds.zip --route --country-abbr=co --country-name=colombia --mapname=64740000 --family-id=6474 --product-id=1 --series-name=openmtbmap_colombia_20.11.2014 --family-name=mtbmap_co_20.11.2014 --tdbfile --overview-mapname=mapsetc --keep-going --area-name="colombia_20.11.2014_openmtbmap.org" -c e:\openmtbmap\maps\template.colombia 7*.img 1>NUL Exception in thread "main" java.lang.IndexOutOfBoundsException: Index: 55528, Size: 16191 at java.util.ArrayList.rangeCheck(Unknown Source) at java.util.ArrayList.get(Unknown Source) at uk.me.parabola.imgfmt.app.lbl.LBLFileReader.readPoiInfo(LBLFileReader.java:414) at uk.me.parabola.imgfmt.app.lbl.LBLFileReader.<init>(LBLFileReader.java:75) at uk.me.parabola.mkgmap.combiners.FileInfo.lblInfo(FileInfo.java:326) at uk.me.parabola.mkgmap.combiners.FileInfo.lblInfo(FileInfo.java:313) at uk.me.parabola.mkgmap.combiners.FileInfo.imgInfo(FileInfo.java:259) at uk.me.parabola.mkgmap.combiners.FileInfo.getFileInfo(FileInfo.java:152) at uk.me.parabola.mkgmap.main.Main.endOptions(Main.java:540) at uk.me.parabola.mkgmap.CommandArgsReader.readArgs(CommandArgsReader.java:128) at uk.me.parabola.mkgmap.main.Main.mainStart(Main.java:134) at uk.me.parabola.mkgmap.main.Main.main(Main.java:105) On 20.11.2014 10:01, Gerd Petermann wrote: > Hi Felix, > > yes, I tried to reproduce it with Colombia yesterday but found > no problem. My 1st thought was an I/O error, but > that is unlikely now that two users have the problem. > > Gerd > > > > Date: Thu, 20 Nov 2014 09:58:41 +0100 > > From: extremecarver(a)gmail.com > > To: mkgmap-dev(a)lists.mkgmap.org.uk > > Subject: Re: [mkgmap-dev] Assertion error with r3350 > > > > oh - BTW - this error happens when compiling mapset.img and mapset.tdb. > > NOT when compiling the actual .img files. I can upload the columbia > > .img files if someone want to analyze what causes the crash.. (at least > > that's easier then on a continent map). > > On 19.11.2014 17:45, Carlos Dávila wrote: > > > I'm getting an assertion error compiling two of my maps (Colombia and > > > Venezuela) with mkgmap r3350 > > > Number of MapFailedExceptions: 0 > > > Exception in thread "main" java.lang.AssertionError: Invalid label > > > offset found 16091027 > > > at > > > > uk.me.parabola.imgfmt.app.lbl.LBLFileReader.fetchLabel(LBLFileReader.java:87) > > > at > > > > uk.me.parabola.imgfmt.app.lbl.LBLFileReader.readPoiInfo(LBLFileReader.java:394) > > > at > > > > uk.me.parabola.imgfmt.app.lbl.LBLFileReader.<init>(LBLFileReader.java:75) > > > at > > > uk.me.parabola.mkgmap.combiners.FileInfo.lblInfo(FileInfo.java:326) > > > at > > > uk.me.parabola.mkgmap.combiners.FileInfo.lblInfo(FileInfo.java:313) > > > at > > > uk.me.parabola.mkgmap.combiners.FileInfo.imgInfo(FileInfo.java:259) > > > at > > > > uk.me.parabola.mkgmap.combiners.FileInfo.getFileInfo(FileInfo.java:152) > > > at uk.me.parabola.mkgmap.main.Main.endOptions(Main.java:540) > > > at > > > > uk.me.parabola.mkgmap.CommandArgsReader.readArgs(CommandArgsReader.java:128) > > > at uk.me.parabola.mkgmap.main.Main.mainStart(Main.java:134) > > > at uk.me.parabola.mkgmap.main.Main.main(Main.java:105) > > > > > > My mkgmap command: > > > mkgmap.jar --bounds=bounds.zip --precomp-sea=sea.zip --max-jobs > > > --route --latin1 --code-page=1252 \ > > > --country-name=$PAIS --country-abbr=$ABR --area-name=$MAPA > > > --family-name="OpenStreetMap $MAPA" --family-id=1$FID --product-id=1 > > > --series-name="OSM-$MAPA" \ > > > --overview-mapname=$ABR-1$FID --overview-mapnumber=551${FID}000 > > > --name-tag-list=$NAMETAG --index --process-destination > --process-exits > > > --housenumbers \ > > > --remove-short-arcs=0 --reduce-point-density=4 > > > --reduce-point-density-polygon=8 --polygon-size-limits="24:12, 18:10, > > > 16:0" --add-pois-to-areas --adjust-turn-headings > --report-similar-arcs > > > --report-dead-ends=2 --link-pois-to-ways \ > > > --location-autofill=is_in,nearest --drive-on-$DRIVEON > > > --check-roundabouts --check-roundabout-flares > > > --license-file=license_ODbL.txt \ > > > --copyright-message="OpenStreetMap contributors, ODbL. See: > > > http://www.openstreetmap.org/copyright" --style=mio --check-styles -c > > > $pais.args > > > > > > Error also happens with default style > > > _______________________________________________ > > > mkgmap-dev mailing list > > > mkgmap-dev(a)lists.mkgmap.org.uk > > > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev > > > > -- > > keep on biking and discovering new trails > > > > Felix > > openmtbmap.org & www.velomap.org > > > > > > _______________________________________________ > > mkgmap-dev mailing list > > mkgmap-dev(a)lists.mkgmap.org.uk > > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev -- keep on biking and discovering new trails Felix openmtbmap.org & www.velomap.org

3 2

Re: [mkgmap-dev] Assertion error with r3350
by Gerd Petermann 20 Nov '14

20 Nov '14

From: gpetermann_muenchen(a)hotmail.com To: extremecarver(a)gmail.com Subject: RE: [mkgmap-dev] Assertion error with r3350 Date: Thu, 20 Nov 2014 11:05:40 +0100 Hi all, the problem is caused by this way: http://www.openstreetmap.org/way/313259878 or more specific by the tag <tag k="addr:housenumber" v=":702"/> If I change that to <tag k="addr:housenumber" v="702"/> mkgmap works. I am not sure where to fix that. Gerd Date: Thu, 20 Nov 2014 10:21:47 +0100 From: extremecarver(a)gmail.com To: gpetermann_muenchen(a)hotmail.com; mkgmap-dev(a)lists.mkgmap.org.uk Subject: Re: [mkgmap-dev] Assertion error with r3350 Location (.img and also .osm.pbf) http://openmtbmap.org/analysis.7z I think it happens also if you really just want to create a basic overview mapset.img / mapset.tdb. Not even need for search index. (otherwise I got a second different bug in mkgmap that more or less throws the same exception). there are three .tmp files generated - only the mdr.... .tmp file has some data (about 3MB) - the other are 0byte files. - just to give you an idea how far it gets. Sorry I forgot to add them into the download. Okay - here we go (don't mind the 7*.img - that doesn't change a thing): C:\OpenMTBMap\maps>start /low /b /wait java -jar -XX:StringTableSize=100003 -Xms6000M -Xmx10300M c:\openmtbmap\mkgmap.jar --max-jobs=8 "--generate-sea" "--latin1" "--precomp-sea=c:\openmtbmap\maps\sea.zip" "--style-file=c:\openmtbmap\openmtbmap_style" --nsis --index --levels="0:24, 1:23, 2:22, 3:21, 4:20, 5:19, 6:18" --overview-levels="7:17, 8:16, 9:15, 10:14, 11:13, 12:12" --adjust-turn-headings --add-pois-to-areas --reduce-point-density=3.4 --reduce-point-density-polygon=6 --housenumbers --link-pois-to-ways --ignore-turn-restrictions --polygon-size-limits="24:16, 23:14, 22:12, 21:11, 20:10, 19:9, 18:8, 17:7, 16:6, 15:5, 14:4, 13:3, 12:2, 11:0, 10:0" --description=openmtbmap_co --show-profiles=1 --location-autofill=bounds,is_in,nearest --bounds=c:\openmtbmap\maps\bounds.zip --route --country-abbr=co --country-name=colombia --mapname=64740000 --family-id=6474 --product-id=1 --series-name=openmtbmap_colombia_20.11.2014 --family-name=mtbmap_co_20.11.2014 --tdbfile --overview-mapname=mapsetc --keep-going --area-name="colombia_20.11.2014_openmtbmap.org" -c e:\openmtbmap\maps\template.colombia 7*.img 1>NUL Exception in thread "main" java.lang.IndexOutOfBoundsException: Index: 55528, Size: 16191 at java.util.ArrayList.rangeCheck(Unknown Source) at java.util.ArrayList.get(Unknown Source) at uk.me.parabola.imgfmt.app.lbl.LBLFileReader.readPoiInfo(LBLFileReader.java:414) at uk.me.parabola.imgfmt.app.lbl.LBLFileReader.<init>(LBLFileReader.java:75) at uk.me.parabola.mkgmap.combiners.FileInfo.lblInfo(FileInfo.java:326) at uk.me.parabola.mkgmap.combiners.FileInfo.lblInfo(FileInfo.java:313) at uk.me.parabola.mkgmap.combiners.FileInfo.imgInfo(FileInfo.java:259) at uk.me.parabola.mkgmap.combiners.FileInfo.getFileInfo(FileInfo.java:152) at uk.me.parabola.mkgmap.main.Main.endOptions(Main.java:540) at uk.me.parabola.mkgmap.CommandArgsReader.readArgs(CommandArgsReader.java:128) at uk.me.parabola.mkgmap.main.Main.mainStart(Main.java:134) at uk.me.parabola.mkgmap.main.Main.main(Main.java:105) On 20.11.2014 10:01, Gerd Petermann wrote: Hi Felix, yes, I tried to reproduce it with Colombia yesterday but found no problem. My 1st thought was an I/O error, but that is unlikely now that two users have the problem. Gerd > Date: Thu, 20 Nov 2014 09:58:41 +0100 > From: extremecarver(a)gmail.com > To: mkgmap-dev(a)lists.mkgmap.org.uk > Subject: Re: [mkgmap-dev] Assertion error with r3350 > > oh - BTW - this error happens when compiling mapset.img and mapset.tdb. > NOT when compiling the actual .img files. I can upload the columbia > .img files if someone want to analyze what causes the crash.. (at least > that's easier then on a continent map). > On 19.11.2014 17:45, Carlos Dávila wrote: > > I'm getting an assertion error compiling two of my maps (Colombia and > > Venezuela) with mkgmap r3350 > > Number of MapFailedExceptions: 0 > > Exception in thread "main" java.lang.AssertionError: Invalid label > > offset found 16091027 > > at > > uk.me.parabola.imgfmt.app.lbl.LBLFileReader.fetchLabel(LBLFileReader.java:87) > > at > > uk.me.parabola.imgfmt.app.lbl.LBLFileReader.readPoiInfo(LBLFileReader.java:394) > > at > > uk.me.parabola.imgfmt.app.lbl.LBLFileReader.<init>(LBLFileReader.java:75) > > at > > uk.me.parabola.mkgmap.combiners.FileInfo.lblInfo(FileInfo.java:326) > > at > > uk.me.parabola.mkgmap.combiners.FileInfo.lblInfo(FileInfo.java:313) > > at > > uk.me.parabola.mkgmap.combiners.FileInfo.imgInfo(FileInfo.java:259) > > at > > uk.me.parabola.mkgmap.combiners.FileInfo.getFileInfo(FileInfo.java:152) > > at uk.me.parabola.mkgmap.main.Main.endOptions(Main.java:540) > > at > > uk.me.parabola.mkgmap.CommandArgsReader.readArgs(CommandArgsReader.java:128) > > at uk.me.parabola.mkgmap.main.Main.mainStart(Main.java:134) > > at uk.me.parabola.mkgmap.main.Main.main(Main.java:105) > > > > My mkgmap command: > > mkgmap.jar --bounds=bounds.zip --precomp-sea=sea.zip --max-jobs > > --route --latin1 --code-page=1252 \ > > --country-name=$PAIS --country-abbr=$ABR --area-name=$MAPA > > --family-name="OpenStreetMap $MAPA" --family-id=1$FID --product-id=1 > > --series-name="OSM-$MAPA" \ > > --overview-mapname=$ABR-1$FID --overview-mapnumber=551${FID}000 > > --name-tag-list=$NAMETAG --index --process-destination --process-exits > > --housenumbers \ > > --remove-short-arcs=0 --reduce-point-density=4 > > --reduce-point-density-polygon=8 --polygon-size-limits="24:12, 18:10, > > 16:0" --add-pois-to-areas --adjust-turn-headings --report-similar-arcs > > --report-dead-ends=2 --link-pois-to-ways \ > > --location-autofill=is_in,nearest --drive-on-$DRIVEON > > --check-roundabouts --check-roundabout-flares > > --license-file=license_ODbL.txt \ > > --copyright-message="OpenStreetMap contributors, ODbL. See: > > http://www.openstreetmap.org/copyright" --style=mio --check-styles -c > > $pais.args > > > > Error also happens with default style > > _______________________________________________ > > mkgmap-dev mailing list > > mkgmap-dev(a)lists.mkgmap.org.uk > > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev > > -- > keep on biking and discovering new trails > > Felix > openmtbmap.org & www.velomap.org > > > _______________________________________________ > mkgmap-dev mailing list > mkgmap-dev(a)lists.mkgmap.org.uk > http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev -- keep on biking and discovering new trails Felix openmtbmap.org & www.velomap.org

2 1

Commit: r3352: fix toString(): remove extra " | " instead of only the last blank
by svn commit 20 Nov '14

20 Nov '14

Version mkgmap-r3352 was committed by gerd on Thu, 20 Nov 2014 fix toString(): remove extra " | " instead of only the last blank

1 0

# ignored
by nwillink 20 Nov '14

20 Nov '14

Hi I'm coming across a possible bug If I use highway=* & name ~ '.*[Ss]traße' [0x12 road_class=1 road_speed=1 resolution 24 continue] I get understandably the following error: Error in style: Error: (lines:80): Bad character in input, file probably not in utf-8 Could not open style default However, if I put a # infront of this line I still get the same error. #highway=* & name ~ '.*[Ss]traße' [0x12 road_class=1 road_speed=1 resolution 24 continue] The error only disappears if I remove the line r Nick -- View this message in context: http://gis.19327.n5.nabble.com/ignored-tp5824917.html Sent from the Mkgmap Development mailing list archive at Nabble.com.

2 2

[Patch v2] style statistics
by Gerd Petermann 20 Nov '14

20 Nov '14

Hi, the first version of the patch ignored the finalize rules. Attached is the 2nd version, the compiled binary is here: http://files.mkgmap.org.uk/download/227/mkgmap.jar Gerd

3 3

stats about style rules
by Gerd Petermann 20 Nov '14

20 Nov '14

Hi all, see also http://gis.19327.n5.nabble.com/Error-not-detected-tp5823898p5823965.html I've implemented a quick solution which reports how often a rule expression was evaluated and how often the evaluation returned true. I can think of many ways to report this info, so I started with the most simple format: <prefix> <style file> "stats (rule/evals/true)" <expression> /<numEval>/<numTrue> Attached is the patch that implements this and a sample configuration file for the logging containing this line: uk.me.parabola.mkgmap.osmstyle.StyleImpl.level=INFO The new option is activated with --report-style-stats. A compiled mkgmap binary can be found here: http://files.mkgmap.org.uk/download/226/mkgmap.jar Any comment is welcome! Gerd

2 2

FW: [Patch v2] style statistics
by Gerd Petermann 19 Nov '14

19 Nov '14

From: gpetermann_muenchen(a)hotmail.com To: herold(a)snafu.de Subject: RE: [mkgmap-dev] [Patch v2] style statistics Date: Wed, 19 Nov 2014 20:37:36 +0100 Hi Axel, thanks for the quick feedback. I also thought about printing all tag names used in the style. Maybe someone with know how in web programming is able to create an automated test, e.g. a script might look up each name in taginfo. Gerd Date: Wed, 19 Nov 2014 19:45:17 +0100 From: herold(a)snafu.de To: mkgmap-dev(a)lists.mkgmap.org.uk Subject: Re: [mkgmap-dev] [Patch v2] style statistics Gerd Petermann schrieb (19/11/14 -- 10:26): > the first version of the patch ignored the finalize rules. > Attached is the 2nd version, Hi Peter, this works like a charm for me and helped me to discover a typo in my polygon style file already right on the first run (I had /grasland/ instead of /grassland/). As expected this proved to be a really useful feature. Thanks! Viele Grüße, Axel. _______________________________________________ mkgmap-dev mailing list mkgmap-dev(a)lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

1 0