May 2014 - mkgmap-dev - The mkgmap lists

Dead Link in style manual
by Bernd Weigelt 31 May '14

31 May '14

Hi the link to the java docs on side 9 is dead i had to use this one http://docs.oracle.com/javase/7/docs/api/java/util/regex/Pattern.html Bernd

2 1

test data for splitter
by Gerd Petermann 31 May '14

31 May '14

Hi all, I still try to find a better split algo for splitter. Up to now it is kind of luck when it finds a good split. I've invested many hours, but I still don't fully understand under what circumstances splitter should stop searching for a (better) solution. It is still not possible to search all possible splits, so brute force search doesn't work. I also want to implement some kind of performance test to avoid the situation that I optimize the algo for some countries and produce worse results for others. If you observe bad results with splitter, please always send the densities-out.txt file and either the splitter.log or the options in use because with these rather small files I can reproduce the problem. Gerd

1 0

Splitter defaulting on Japan
by Felix Hartmann 31 May '14

31 May '14

Failed to calculate areas. See log for details. Where is the log saved? Do I need to provide it? Splitter not fully up to date - see compiled date (svn update just before)... I'll retry with up to date splitter still... c:\OpenMTBMap\maps>java -Xmx9600m -jar c:\openmtbmap\splitter.jar --precomp-sea=c:\openmtbmap\maps\sea.zip --max-nodes=1200000 --output=pbf "--keep-complete" --max-areas=255 --geonames-file=cities5000 --description=japan --mapid=65590000 c:\OpenMTBMa p\osmpbf_geofabrik\japan.o5m Splitter version unknown compiled 2014-05-28T18:16:29+0200 boundary-tags=use-exclude-list cache= description=japan geonames-file=cities5000 keep-complete=true mapid=65590000 max-areas=255 max-nodes=1200000 max-threads=8 (auto) mixed=false no-trim=false num-tiles= output=pbf output-dir= overlap=auto polygon-desc-file= polygon-file= precomp-sea=c:\openmtbmap\maps\sea.zip problem-file= problem-report= resolution=13 search-limit=1000000 split-file= status-freq=120 stop-after=dist write-kml= Elapsed time: 0s Memory: Current 184MB (2MB used, 182MB free) Max 8533MB Time started: Sat May 31 02:40:37 CEST 2014 Map is being split for resolution 13: - area boundaries are aligned to 0x800 map units (0.0439453125 degrees) - areas are multiples of 0x800 map units wide and high Processing c:\OpenMTBMap\osmpbf_geofabrik\japan.o5m Bounding box 122.56070000000001 20.08228 154.4709 45.80245 10'000'000 nodes processed... id=752184948 20'000'000 nodes processed... id=922482748 30'000'000 nodes processed... id=1233696234 40'000'000 nodes processed... id=1315824764 50'000'000 nodes processed... id=1421002430 60'000'000 nodes processed... id=1497506798 70'000'000 nodes processed... id=1751094845 80'000'000 nodes processed... id=2040104150 90'000'000 nodes processed... id=2350328457 in 1 file Time: Sat May 31 02:41:01 CEST 2014 Counting nodes of precompiled sea data ... Bounding box 144.84375 19.6875 145.546875 20.390625 Bounding box 135.703124999 20.390625 136.406249999 21.09375 Bounding box 144.84375 20.390625 145.546875 21.09375 Bounding box 122.34375000000001 23.90625 123.04687499900001 24.609375 ........ cut away here... ....... Bounding box 142.734375 45.703125 143.4375 46.40625 Bounding box 143.4375 45.703125 144.140625 46.40625 Bounding box 149.0625 45.703125 149.765625 46.40625 Bounding box 149.765625 45.703125 150.46875 46.40625 Bounding box 150.46875 45.703125 151.171875 46.40625 Added 835594 nodes from precompiled sea data. Precompiled sea data pass took 1797 ms Exact map coverage is (20.08227825164795,122.56068706512451) to (45.80243110656738,154.47088479995728) Rounded map coverage is (20.0390625,122.51953125) to (45.8349609375,154.51171875) Splitting nodes into areas containing a maximum of 1'200'000 nodes each... Highest node count in a single grid element is 205'139 Trying to find nice split for (20.0390625,122.51953125) to (45.8349609375,154.51171875) with 98'482'055 nodes searching for split with min-nodes 12000, learned 0 good partial solutions Split was not yet succesfull. Trying to remove large empty areas... Trying again with 1 trimmed partition(s), also allowing big empty parts. Solving partition (23.818359375,122.6953125) to (45.8349609375,153.0615234375) with 98'482'055 nodes Trying to find nice split for (23.818359375,122.6953125) to (45.8349609375,153.0615234375) with 98'482'055 nodes searching for split with min-nodes 12000, learned 0 good partial solutions Warning: No solution found for partition (23.818359375,122.6953125) to (45.8349609375,153.0615234375) with 98'482'055 nodes Final solution has 0 tile(s). The smallest node count is 9223372036854775807 (0 %), the worst aspect ratio is near -1.0 Failed to calculate areas. See log for details. Failed to calculate areas. Sorry. Cannot split the file without creating huge, almost empty, tiles. Please specify a bounding polygon with the --polygon-file parameter. Time finished: Sat May 31 02:41:04 CEST 2014

1 0

Commit: r3288: Style manual: change all link:http://...[] to drop the link: prefix.
by svn commit 30 May '14

30 May '14

Version mkgmap-r3288 was committed by steve on Fri, 30 May 2014 Style manual: change all link:http://...[] to drop the link: prefix. It is not required. Also in one case there was a double :: which was causing a single : to show up in the output. Colour the links in pdf output, to make them more obvious.

1 0

Commit: r3287: Update broken link to Regex spec.
by svn commit 29 May '14

29 May '14

Version mkgmap-r3287 was committed by steve on Thu, 29 May 2014 Update broken link to Regex spec. - Bernd Weigelt

1 0

Commit: r3285: Add some tests for existing variable filter working.
by svn commit 28 May '14

28 May '14

Version mkgmap-r3285 was committed by steve on Wed, 28 May 2014 Add some tests for existing variable filter working.

1 0

'ant dist' doesn't work for splitter
by Ben Konrath 28 May '14

28 May '14

Hi Gerd, 'ant dist' doesn't work for splitter since this commit: commit 3f2d290ab9df68cb32128951686fb7853e59f82c Author: gerd <gerd@838fabe5-b1a8-4b81-9896-7a84386980e9> Date: Thu May 22 06:24:27 2014 +0000 change build to (hopefully) make --version work again git-svn-id: http://svn.mkgmap.org.uk/splitter/trunk@389838fabe5-b1a8-4b81-9896-7a843869… I'm not sure if this problem is caused by my use of git (through the openstreetmap github mirror of splitter). In any case, I've attached a patch that seems to fix the problem but I'm not exactly sure if it's the right fix. Any thoughts? Thanks, Ben

3 3

new bicycle access rules
by Minko 26 May '14

26 May '14

This week a new tag has been approved, bicycle=use_sidepath https://wiki.openstreetmap.org/wiki/Proposed_features/use_sidepath This tag will be used on main highways with compulsory adjacent cycleways. There were a lot of objections to tag these with bicycle=no because there are also other ways with strictly forbidden bicycle signs, so this would form some 'softer' no than a 'hard' no. In mkgmap it should stay bicycle=no unless there is a better alternative (mkgmap:troughroute=no?). Suggestion to add this in the inc/access file: bicycle=private|bicycle=agricultural|bicycle=use_sidepath { set bicycle=no }

2 4

Problem with splitter r393
by Bernd Weigelt 26 May '14

26 May '14

Hi FYI: splitter r393 dies with following error, if i try to split my DACH-extract, all other extracts are not affected java.lang.ArrayIndexOutOfBoundsException: -184650 at uk.me.parabola.splitter.O5mMapParser.setStringRefPair(O5mMapParser.java:355) at uk.me.parabola.splitter.O5mMapParser.readAuthor(O5mMapParser.java:408) at uk.me.parabola.splitter.O5mMapParser.readVersionTsAuthor(O5mMapParser.java:372) at uk.me.parabola.splitter.O5mMapParser.readNode(O5mMapParser.java:251) at uk.me.parabola.splitter.O5mMapParser.readFile(O5mMapParser.java:187) at uk.me.parabola.splitter.O5mMapParser.parse(O5mMapParser.java:133) at uk.me.parabola.splitter.Main.processOSMFiles(Main.java:1362) at uk.me.parabola.splitter.Main.processMap(Main.java:874) at uk.me.parabola.splitter.Main.genProblemLists(Main.java:697) at uk.me.parabola.splitter.Main.partitionAreasForProblemListGenerator(Main.java:729) at uk.me.parabola.splitter.Main.split(Main.java:307) at uk.me.parabola.splitter.Main.start(Main.java:181) at uk.me.parabola.splitter.Main.main(Main.java:151) here are the log files http://files.mkgmap.org.uk/download/210/20140526_0900.zip Bernd -- amarok2 now playing:

3 11

[Patch v1] improve splitter
by Gerd Petermann 26 May '14

26 May '14

Hi all, I've finally found a way to test a lot more possible solutions in splitter in a reasonable time. As a result, splitting a single country like Germany is now done with a full search, means, all posible splits are tested and the best is chosen. For large files (e.g. Europe), the program can't search all possible solutions, but it still finds better ones than r389. This takes a bit more time than before, but is likely to find really good solutions. If needed, I can implement new options to allow stopping the search if e.g. a solution is found that has at least 85% of max-nodes in each tile. A few numbers: Split Germany with max-nodes=1200000 r 389: Solution is nice. Can't find a better solution: 164 tile(s) and a rating of 2756. The smallest node count is 903153, the worst aspect ratio is near 3.99 patched: Solution is nice. Can't find a better solution: 150 tile(s). The smallest node count is 1081130 (90 %), the worst aspect ratio is near 3.83 Split Germany with max-nodes=1000000 r389: Solution is nice. Can't find a better solution: 192 tile(s) and a rating of 3014. The smallest node count is 742452, the worst aspect ratio is near 3.9 patched: Solution is nice. Can't find a better solution: 181 tile(s). The smallest node count is 894244 (89 %), the worst aspect ratio is near 3.93 Please try with your workload and let me know the results. If you are not happy with the new result, please send the densities_out.txt and the splitter.log. A compiled binary is available here: http://files.mkgmap.org.uk/download/208/splitter.jar Gerd

3 6