July 2011 - mkgmap-dev - The mkgmap lists

How to track an error in OSM data ? (and style's behavior error)
by David 31 Jul '11

31 Jul '11

Hello, I compiled r2009 with PBF format support and when I compile (with r2008 & r2009) Ireland PBF data from geofabrik I have a corrupted map at high detailed level (24) in Basecamp. The problem occurs with at least one "commercial" polygon in Belfast area. Some huge polygon are displayed above land and some sea parts. Do you know how I could find the bad polygon in source data (in OSM format, it is far more easier to read it with human eyes) ? Or is it a bug well defined ? I also found an error in a style file for forest polygons. You have to write the rules like this if you want the result expected : landuse=forest & wood=coniferous [0x54 resolution 18] landuse=forest & wood=decideous [0x50 resolution 18] landuse=forest & wood=mixed [0x55 resolution 18] landuse=forest & wood !=* [0x50 resolution 18] /*this line is applied if no data matches the ones above*/ and not like that : landuse=forest & wood=coniferous [0x54 resolution 18] landuse=forest & wood=decideous [0x50 resolution 18] landuse=forest & wood=mixed [0x55 resolution 18] landuse=forest [0x50 resolution 18]/*this line overrides the ones above*/ David PS : well done with country/administrative data.

3 2

Commit: r2008: Improve assignment of city, zip code, region and country information for address search.
by svn commit 30 Jul '11

30 Jul '11

Version 2008 was commited by wanmil on 2011-07-25 21:52:55 +0100 (Mon, 25 Jul 2011) Improve assignment of city, zip code, region and country information for address search. It is now possible to use the OSM boundary information to assign the location fields city, zip code, region and country. This is the merge of the locator branch so see that for more detailed info.

6 6

Question about splitter and ways going in and out of a tile
by Jean-Pierre Flori 29 Jul '11

29 Jul '11

Dear all, I'm currently building a contour map for france and spain from srtm data (with strm2osm or gdal tools). I'd like to use splitter to divide the huge osm file I produced. However I've got a problem with contour lines getting in and out of a tile and any help would be appreciated. I've tried to split similar tiles with osmosis and think the behavior in splitter is the same as in Osmosis with (or without anyway) clipIncompleteEntities. Ie when the way is written to a given tile, the nodes outside of the tile are dismissed. But now the way has a straight line between the point where the way gets out of the tile to the point where it gets back in. I managed to modify Osmosis so that it splits the way into different parts (just adding a somewhat random value to the way id, so that it does not collide with other ids), rather than writing a unique way with outside nodes dismissed. I'd like to know how splitter writes the ways into the different tiles and where to look in the source code so that I can easily modify the code and implement a similar behavior. Regards, -- Jean-Pierre Flori

2 1

Self-compiled r2008 doesn't work with PBF input
by Colin Smale 29 Jul '11

29 Jul '11

Hi, I am trying to switch over to mkgmap r2008 with splitter r179. If I use the jars from the download page it all works fine. But if I recompile mkgmap.jar (using Idea 10.5.1) from the r2008 sources I just get a bunch of errors in mkgmap.log, one for each input file: Error at line 1, col 1 Bad file format: 63240001.osm.pbf Error parsing file I notice my jar file is much smaller than the precompiled one (1173kb instead of 1684kb). My (experimental) changes are trivial by the way; the patch is listed below. I don't see how this change can cause this error. I know this problem has been reported before, and I have made sure I am using the right jar files by simply replacing mkgmap.jar with my version. Does anybody have any idea what might be going wrong? Thanks in advance, Colin Index: src/uk/me/parabola/mkgmap/osmstyle/StyledConverter.java =================================================================== --- src/uk/me/parabola/mkgmap/osmstyle/StyledConverter.java (revision 2008) +++ src/uk/me/parabola/mkgmap/osmstyle/StyledConverter.java (revision ) @@ -589,6 +589,9 @@ String ref = Label.squashSpaces(element.getTag("ref")); String int_ref = Label.squashSpaces(element.getTag("int_ref")); if(int_ref != null) { + // Colin Smale, July 2011 + // remove space from European route number to stop it being read as 'East' + int_ref = int_ref.replaceAll("E *","E"); if(ref == null) ref = int_ref; else @@ -615,13 +618,20 @@ private void elementSetup(MapElement ms, GType gt, Element element) { String name = Label.squashSpaces(element.getName()); String refs = combineRefs(element); - + + // Colin Smale, July 2011 + // if there are multiple entries in refs, separate them with / instead of ; + if (refs != null) + refs = refs.replace(";","/"); + // Insert display_name as first ref. // This causes display_name to be displayed in routing // directions, instead of only the ref. String displayName = Label.squashSpaces(element.getTag("display_name")); if (displayName != null) { + // Colin Smale: remove spaces after ; + displayName = displayName.replaceAll(" *; *",";"); // substitute '/' for ';' in display_name to avoid it // getting split below displayName = displayName.replace(";","/");

1 0

Re: [mkgmap-dev] Splitting srtm.osm fails
by Michael Prinzing 29 Jul '11

29 Jul '11

On Wed, 27 Jul 2011 09:58:43 +0200, Josef Latt wrote: >the easiest way for me would be 'splitter-r161'. Do you know, where to get? svn allows to specify the revision to checkout, so with svn co -r161 http://svn.mkgmap.org.uk/splitter/trunk you will get revision 161. Michael

2 1

merge lines
by Chris66 28 Jul '11

28 Jul '11

Hi, option merge-lines : "At the moment this option causes routing errors. Use only if routing is not needed in your map." Is this still the case ? Chris

1 0

Suggestion for more flexibility in locator part of mkgmap
by Cliff Nolan 28 Jul '11

28 Jul '11

Hi Greg, The only point I am getting at is that there is a big gap between admin_level=8 and admin_level=10 here http://wiki.openstreetmap.org/wiki/Ireland/Boundaries#Boundary_Types . So where would a village boundary fit in? Maybe I am misunderstanding something? Regards, Cliff

1 0

Map installation problem from r1971 onward
by Clifford Nolan 28 Jul '11

28 Jul '11

Hi, I downloaded ireland.osm.pbf, split it with the current (r171) splitter into two tiles. I compiled these with mkgmap, using --index etc, for address search. All appears to go fine and I can open the map in Basecamp on a Mac. But, as soon as I try to transfer the files to my Garmin unit with Mapinstall, I get an error asking me to make sure my unit is switched on and connected. This problem only started from r1971 (revisions 1970 and earlier are fine). There is no problem if just one map tile is transferred, even in the current revision of mkgmap - the problem is for multiple map tiles. Thanks, Cliff.

5 9

Re: [mkgmap-dev] Splitting srtm.osm fails
by Michael Prinzing 28 Jul '11

28 Jul '11

On Wed, 27 Jul 2011 19:39:38 +0200, WanMil wrote: >It is a regression if r161 works and r179 not so in this case the >problem should be tracked down. This is a known limitation of the current splitter. It can handle node IDs only up to something less than 2e09 because Java allows only 31 bit numbers as index for an array. Even if this could be solved, you would need huge amounts of memory to process data with node IDs starting at 2e09 (like the srtm data), because the amount of memory the splitter needs primilary depends on the max. node ID (and not on the number of nodes) in the data. If there are node IDs larger than about 1.7e09 the splitter needs even more memory than a 32 bit JVM can provide. Scott has explained this in http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2011q1/010598.html and http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2011q1/010629.html Michael >> Hi WanMil, >> >> the easiest way for me would be 'splitter-r161'. Do you know, where to get? >> >> BTW, the file with the srtm data is about 4,2 GB and has over 45 million >> nodes. >> >> Josef >> >> >> Am 26.07.2011 21:43, schrieb WanMil: >>> Hi Josef, >>> >>> I have googled for "splitter mkgmap IndexOutOfBoundsException" and found >>> a similar problem description: >>> http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2011q1/010627.html >>> >>> Maybe that helps? >>> >>> WanMil >>> >>>> No hints? >>>> >>>> Am 21.07.2011 08:36, schrieb Josef Latt: >>>>> Hi, >>>>> >>>>> I get srtm data with 'mono Srtm2Osm.exe -bounds1 47.2 5.8 55.2 15.1 >>>>> -step 20 -cat 100 20 -large -corrxy 0.0005 0.0005 -o srtm.osm' >>>>> >>>>> >>>>> Splitting (splitter-r179) the data with 'java -ea -Xmx2048M -jar >>>>> /home/jolatt/OSM/splitter/splitter.jar --mapid=21000001 --mixed=yes >>>>> --max-nodes=5000000 srtm.osm' into tiles I get the following error: >>>>> >>>>> >>>>> **** WARNING: the default output type has changed to pbf, use >>>>> --output=xml for .osm.gz files >>>>> >>>>> Elapsed time: 0s Memory: Current 59MB (1MB used, 58MB free) Max 1820MB >>>>> Time started: Thu Jul 21 08:22:09 CEST 2011 >>>>> Map is being split for resolution 13: >>>>> - area boundaries are aligned to 0x800 map units >>>>> - areas are multiples of 0x1000 map units wide and high >>>>> Processing srtm.osm >>>>> in 1 file >>>>> Time: Thu Jul 21 08:22:09 CEST 2011 >>>>> Exact map coverage is (53.99924039840698,5.800073146820068) to >>>>> (55.20007610321045,8.0000638961792) >>>>> Trimmed and rounded map coverage is (54.0087890625,6.9873046875) to >>>>> (55.2392578125,8.0419921875) >>>>> Splitting nodes into areas containing a maximum of 5.000.000 nodes each... >>>>> Area (54.0087890625,6.9873046875) to (55.2392578125,8.0419921875) >>>>> contains 2.629 nodes. DONE! >>>>> 1 areas: >>>>> Area 21000001 covers (0x266800,0x4f800) to (0x274800,0x5b800) >>>>> Writing out split osm files Thu Jul 21 08:22:09 CEST 2011 >>>>> Processing 1 areas in a single pass >>>>> (54.0087890625,6.9873046875) to (55.2392578125,8.0419921875) >>>>> Starting pass 1 of 1, processing 1 areas (21000001 to 21000001) >>>>> Making SparseMultiMap >>>>> Making SparseMultiMap >>>>> Processing srtm.osm >>>>> Exception in thread "main" java.lang.IndexOutOfBoundsException: Index >>>>> (31250001) is greater than or equal to list size (31250001) >>>>> at >>>>> it.unimi.dsi.fastutil.objects.ObjectArrayList.get(ObjectArrayList.java:258) >>>>> at >>>>> uk.me.parabola.splitter.SparseInt2ShortMapInline.put(SparseInt2ShortMapInline.java:128) >>>>> at >>>>> uk.me.parabola.splitter.SparseInt2ShortMultiMap$Inner.put(SparseInt2ShortMultiMap.java:81) >>>>> at >>>>> uk.me.parabola.splitter.SparseInt2ShortMultiMap.put(SparseInt2ShortMultiMap.java:31) >>>>> at >>>>> uk.me.parabola.splitter.SplitProcessor.writeNode(SplitProcessor.java:209) >>>>> at >>>>> uk.me.parabola.splitter.SplitProcessor.processNode(SplitProcessor.java:118) >>>>> at uk.me.parabola.splitter.OSMParser.endElement(OSMParser.java:243) >>>>> at >>>>> uk.me.parabola.splitter.AbstractXppParser.parse(AbstractXppParser.java:57) >>>>> at uk.me.parabola.splitter.Main.processMap(Main.java:412) >>>>> at uk.me.parabola.splitter.Main.writeAreas(Main.java:368) >>>>> at uk.me.parabola.splitter.Main.split(Main.java:190) >>>>> at uk.me.parabola.splitter.Main.start(Main.java:118) >>>>> at uk.me.parabola.splitter.Main.main(Main.java:107) >>>>> >>>>> >>>>> >>>>> I would try an older version of splitter, but where to download, or is >>>>> there another idea? >>>>> >>>>> Greetings >>>>> Josef Latt >>>>> >>>> >>> >>> _______________________________________________ >>> mkgmap-dev mailing list >>> mkgmap-dev(a)lists.mkgmap.org.uk >>> http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev >>> >> > >_______________________________________________ >mkgmap-dev mailing list >mkgmap-dev(a)lists.mkgmap.org.uk >http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

2 1

Splitting srtm.osm fails
by Josef Latt 27 Jul '11

27 Jul '11

Hi, I get srtm data with 'mono Srtm2Osm.exe -bounds1 47.2 5.8 55.2 15.1 -step 20 -cat 100 20 -large -corrxy 0.0005 0.0005 -o srtm.osm' Splitting (splitter-r179) the data with 'java -ea -Xmx2048M -jar /home/jolatt/OSM/splitter/splitter.jar --mapid=21000001 --mixed=yes --max-nodes=5000000 srtm.osm' into tiles I get the following error: **** WARNING: the default output type has changed to pbf, use --output=xml for .osm.gz files Elapsed time: 0s Memory: Current 59MB (1MB used, 58MB free) Max 1820MB Time started: Thu Jul 21 08:22:09 CEST 2011 Map is being split for resolution 13: - area boundaries are aligned to 0x800 map units - areas are multiples of 0x1000 map units wide and high Processing srtm.osm in 1 file Time: Thu Jul 21 08:22:09 CEST 2011 Exact map coverage is (53.99924039840698,5.800073146820068) to (55.20007610321045,8.0000638961792) Trimmed and rounded map coverage is (54.0087890625,6.9873046875) to (55.2392578125,8.0419921875) Splitting nodes into areas containing a maximum of 5.000.000 nodes each... Area (54.0087890625,6.9873046875) to (55.2392578125,8.0419921875) contains 2.629 nodes. DONE! 1 areas: Area 21000001 covers (0x266800,0x4f800) to (0x274800,0x5b800) Writing out split osm files Thu Jul 21 08:22:09 CEST 2011 Processing 1 areas in a single pass (54.0087890625,6.9873046875) to (55.2392578125,8.0419921875) Starting pass 1 of 1, processing 1 areas (21000001 to 21000001) Making SparseMultiMap Making SparseMultiMap Processing srtm.osm Exception in thread "main" java.lang.IndexOutOfBoundsException: Index (31250001) is greater than or equal to list size (31250001) at it.unimi.dsi.fastutil.objects.ObjectArrayList.get(ObjectArrayList.java:258) at uk.me.parabola.splitter.SparseInt2ShortMapInline.put(SparseInt2ShortMapInline.java:128) at uk.me.parabola.splitter.SparseInt2ShortMultiMap$Inner.put(SparseInt2ShortMultiMap.java:81) at uk.me.parabola.splitter.SparseInt2ShortMultiMap.put(SparseInt2ShortMultiMap.java:31) at uk.me.parabola.splitter.SplitProcessor.writeNode(SplitProcessor.java:209) at uk.me.parabola.splitter.SplitProcessor.processNode(SplitProcessor.java:118) at uk.me.parabola.splitter.OSMParser.endElement(OSMParser.java:243) at uk.me.parabola.splitter.AbstractXppParser.parse(AbstractXppParser.java:57) at uk.me.parabola.splitter.Main.processMap(Main.java:412) at uk.me.parabola.splitter.Main.writeAreas(Main.java:368) at uk.me.parabola.splitter.Main.split(Main.java:190) at uk.me.parabola.splitter.Main.start(Main.java:118) at uk.me.parabola.splitter.Main.main(Main.java:107) I would try an older version of splitter, but where to download, or is there another idea? Greetings Josef Latt -- PGP Schlüssel: 311D1055 http://keyserver.pgp.com

2 5