September 2010 - mkgmap-dev - The mkgmap lists

Binary format update
by Steve Ratcliffe 16 Sep '10

16 Sep '10

Hi The changes to read Scott Crosby's binary format are complete (for mkgmap itself) and I will merge them back soon. Before that it would be good for as many people as possible to try it out on their existing XML files, with the options that they normally use, since the code has been completely restructured. I've run a number of test that show that the results exactly the same between the new and current trunk version of mkgmap. I'm not so worried about testing the binary input, since it is new and won't affect anyone if there are bugs. It won't be that useful until splitter is able to output the format directly anyway. The amount of code required for the new format was very small once the existing code was restructured though and seem to work very well. The found actual time to read the file was cut in about half, however the time to read the input file is now a small percentage of the total run time of mkgmap, so the overall speed increase is small. The main benefit will be with the splitter and the disk space requirements. ..Steve

4 7

mkgmap r1688 regression
by Dmitry Marakasov 16 Sep '10

16 Sep '10

Hi! I've been using r1625 for some time and it worked pretty well. Recenly, however, I've found out r1688 was released and tried it out - it died on the same data r1625 worked fine with. Here's the data: http://gis-lab.info/data/osm/mosobl/mosobl.osm.bz2 Here's how I run it and what happens: --- mkgmap --gmapsupp \ --country-name=RUSSIA \ --country-abbr=RUS \ --charset=windows-1251 \ --code-page=1251 \ --draw-priority=40 \ --lower-case \ --route --drive-on-right \ mosobl.osm SEVERE (RoadNetwork): /pool/osm/mosobl-100906.osm: Road (http://www.openstreetmap.org/browse/way/63154562) contains zero length arc at http://www.openstreetmap.org/?mlat=55.73010&mlon=37.62594&zoom=17 SEVERE (RoadNetwork): /pool/osm/mosobl-100906.osm: Road (http://www.openstreetmap.org/browse/way/68767049) contains zero length arc at http://www.openstreetmap.org/?mlat=55.44124&mlon=37.49284&zoom=17 SEVERE (RoadNetwork): /pool/osm/mosobl-100906.osm: Road (http://www.openstreetmap.org/browse/way/64682647) contains zero length arc at http://www.openstreetmap.org/?mlat=55.81767&mlon=37.82732&zoom=17 SEVERE (RoadNetwork): /pool/osm/mosobl-100906.osm: Road (http://www.openstreetmap.org/browse/way/33854110) contains zero length arc at http://www.openstreetmap.org/?mlat=55.72693&mlon=37.41379&zoom=17 ... [a bunch of similar lines - these happened with 1625 as well] ... SEVERE (RoadNetwork): /pool/osm/mosobl-100906.osm: Road (http://www.openstreetmap.org/browse/way/71554133) contains zero length arc at http://www.openstreetmap.org/?mlat=57.04320&mlon=37.59828&zoom=17 SEVERE (RoadNetwork): /pool/osm/mosobl-100906.osm: Road (http://www.openstreetmap.org/browse/way/27706268) contains zero length arc at http://www.openstreetmap.org/?mlat=55.82280&mlon=37.58899&zoom=17 java.lang.IllegalArgumentException: InputStream cannot be null at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:120) at uk.me.parabola.mkgmap.build.LocatorConfig.loadConfig(LocatorConfig.java:70) at uk.me.parabola.mkgmap.build.LocatorConfig.<init>(LocatorConfig.java:47) at uk.me.parabola.mkgmap.build.Locator.<init>(Locator.java:68) at uk.me.parabola.mkgmap.build.MapBuilder.<init>(MapBuilder.java:101) at uk.me.parabola.mkgmap.main.MapMaker.makeMap(MapMaker.java:92) at uk.me.parabola.mkgmap.main.MapMaker.makeMap(MapMaker.java:61) at uk.me.parabola.mkgmap.main.Main$1.call(Main.java:189) at uk.me.parabola.mkgmap.main.Main$1.call(Main.java:186) at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:303) at java.util.concurrent.FutureTask.run(FutureTask.java:138) at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:885) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:907) at java.lang.Thread.run(Thread.java:619) --- gmapsupp.img, however, is generated and seems to be useable. Also, it'd be nice to have a changelog - I could not find a word on what's changed from 1625 to 1688. -- Dmitry Marakasov . 55B5 0596 FF1E 8D84 5F56 9510 D35A 80DD F9D2 F77D amdmi3(a)amdmi3.ru ..: jabber: amdmi3(a)jabber.ru http://www.amdmi3.ru

3 2

Index problem fixed
by Steve Ratcliffe 15 Sep '10

15 Sep '10

Hi I've just committed a fix for a problem building valid index files that was introduced in version r1671. Everyone having problems with the index should upgrade to r1691 (or downgrade to r1670 or lower!) ..Steve

3 5

Commit: r1692: Fix bug in constructing jar file introduced in 1688.
by svn commit 15 Sep '10

15 Sep '10

Version 1692 was commited by steve on 2010-09-15 12:25:41 +0100 (Wed, 15 Sep 2010) Fix bug in constructing jar file introduced in 1688. Causes problem like: java.lang.IllegalArgumentException: InputStream cannot be null at javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:117) at uk.me.parabola.mkgmap.build.LocatorConfig.loadConfig(LocatorConfig.java:70) at uk.me.parabola.mkgmap.build.LocatorConfig.<init>(LocatorConfig.java:47)

1 0

Proposal: Multipolygon handling and line based multipolygons
by WanMil 15 Sep '10

15 Sep '10

The latest question about the boundary handling of multipolygons encouraged me to start another try to fix the problem in mkgmap (please read http://www.mkgmap.org.uk/pipermail/mkgmap-dev/2010q3/008976.html) Now I have another idea. The problem is: The resulting multipolygons usually are used as polygons. But some should only be used for the line processing (country borders). The multipolygon algorithm creates artificial polygons which are annoying if you want to use them as lines: you get artificial borders inside your country. My solution: The mp algorithm adds a tag mkgmap:styleusage=polygon to all artificially created polygons. Additionally it duplicates all input ways of the multipolygon, tag them with the mp tags and add mkgmap:styleusage=line. The style handling now applies line rules only if the tag mkgmap:styleusage=line is set or if it is completely unset. The same with polygons. With this solution the style writer can decide on its own if he wants to use the polygon information or the line information of the multipolygon. 2nd advantage: the style writer need not to change any existing styles as this new feature is handled internally in mkgmap. 3rd advantage: the line information of properly tagged multipolygons could also be used if the multipolygon is not completely contained in the tile. This if often the case for country boundaries. The --process-boundary-relations option of mkgmap would become needless. I am not an expert in styles so maybe I have missed something?!? What do you think about my idea? WanMil

3 6

Commit: r1691: A path was being used inside the MDR file instead of the bare
by svn commit 15 Sep '10

15 Sep '10

Version 1691 was commited by steve on 2010-09-15 11:06:30 +0100 (Wed, 15 Sep 2010) A path was being used inside the MDR file instead of the bare name, leading to mapsource crash on use. Also introduced a path joining utility. Also renamed the mdr Utils class, because having two classes named Utils is annoying.

1 0

Commit: r1671: output dir
by svn commit 15 Sep '10

15 Sep '10

Version 1671 was commited by steve on 2010-09-02 20:58:10 +0100 (Thu, 02 Sep 2010) output dir

5 7

Commit: r1690: Sea polygons were being doubled.
by svn commit 14 Sep '10

14 Sep '10

Version 1690 was commited by steve on 2010-09-14 23:11:16 +0100 (Tue, 14 Sep 2010) BRANCH: binfmt Sea polygons were being doubled. Fix NPE on --generate-sea.

1 0

Commit: r1689: If the required protobuf jar files are not present, then don't give any
by svn commit 14 Sep '10

14 Sep '10

Version 1689 was commited by steve on 2010-09-14 16:09:50 +0100 (Tue, 14 Sep 2010) BRANCH: binfmt If the required protobuf jar files are not present, then don't give any errors. You will simply be unable to read the binary format. Make java -jar mkgmap.jar work if the jars are placed in the same directory as the mkgmap.jar

1 0

Commit: r1688: Be more specific about what goes into the distribution directory.
by svn commit 14 Sep '10

14 Sep '10

Version 1688 was commited by steve on 2010-09-14 15:53:34 +0100 (Tue, 14 Sep 2010) Be more specific about what goes into the distribution directory. Create an examples directory instead of copying all of resources which is now rather big and is confusing as people currently sometimes mistakenly think that it is used.

1 0