On Wed, Mar 2, 2011 at 5:36 PM, Michael Prinzing <mipri@gmx.net> wrote:
Hi,
I am getting the splitter from svn, compiling and running it unter Windows XP SP3 using JDK 1.6.0_25. There are 2 problems if I am using a splitter version newer than r161 (tryed until r167 so far).
1.) germany.osm.pbf from geofabrik cannot be split --------------------------------------------------
Invoking the splitter with
java.exe -Xms256m -Xmx1536m -server -jar splitter.jar --resolution=14 --overlap=4000 --max-nodes=1200000 --max-areas=50 --geonames-file=cities1000.zip germany.osm.pbf
The data is split into 76 areas, so there are 2 passes to go.
BTW, there's no need to do two passes. Unlike prior versions, this version of the splitter will handle as many areas as you want to throw at it. I've done 6000 at once on my 4GB ram desktop. Frantisek Mantlik tracked down and fixed the problem with threads=1.
2.) File containing contour data cannot be processed ----------------------------------------------------
When generating my maps, I usually add data to draw contour lines. The file containing that data is available from http://osm.arndnet.de/contourdata.osm.gz (not my site!). It is in OSM format 0.5.
When buildig a map, I am combining this data with the OSM data (please note that the contour data file contains node IDs starting at 2^31, so they collide with the IDs from "real" OSM data if used unchanged). But even when I am trying to split this file without additional OSM data, the same as above happens and the splitter stops at the end of the first and only pass:
This won't work. The splitter is written in Java, where most standard Java classes and collections don't support indices that are 64 bits. This means that ID's more than 2**31 are too big and will be treated as negative by Java and blow up this code. The current array resize logic further limits this to node ID's less than somewhere around 1,750,000,000, but I just committed a fix to trunk that I think will extend this range to 1--1,999,999,999. You could help me find and fix any other issues if you could supply a small file with node ID's around 1,950,000,000.
Exception in thread "main" java.lang.ArrayIndexOutOfBoundsException: Start index (-30655339) is negative at it.unimi.dsi.fastutil.Arrays.ensureFromTo(Arrays.java:45) at it.unimi.dsi.fastutil.objects.ObjectArrays.ensureFromTo(ObjectArrays.java:351) at it.unimi.dsi.fastutil.objects.ObjectArrays.fill(ObjectArrays.java:313) at it.unimi.dsi.fastutil.objects.ObjectArrayList.size(ObjectArrayList.java:308)
Scott