splitter is extreme slow
Hi, since many month I'm using splitter for maps creation. Since this time, I use the same PC, so the hardware has not changed. I always was able to splitt the europe osm map. The splitting needed some minutes. I didn't check it, perhaps it were 15min, but in no case longer than 15min. 4 Days ago I started to create a new europe map, and until now the splitter is running, the harddisk is doing anything. The splitting needs over 75 hours and is still running. I can't remember that I changed the version of the splitter. Has there something changed at the osm data? is there something new and I have to update my splitter? Thanks, Marco
Hi,
since many month I'm using splitter for maps creation. Since this time, I use the same PC, so the hardware has not changed. I always was able to splitt the europe osm map. The splitting needed some minutes. I didn't check it, perhaps it were 15min, but in no case longer than 15min. 4 Days ago I started to create a new europe map, and until now the splitter is running, the harddisk is doing anything. The splitting needs over 75 hours and is still running. I can't remember that I changed the version of the splitter. Has there something changed at the osm data? is there something new and I have to update my splitter?
Here on the list is another thread 'error splitting binary files' some days old. There it looks, as if the binary data from geofabric has some problems. Maybe it is the same for you?
On 12/24/2010 11:15 AM, Johann Gail wrote:
4 Days ago I started to create a new europe map, and until now the splitter is running, the harddisk is doing anything. The splitting needs over 75 hours and is still running.
Here on the list is another thread 'error splitting binary files' some days old. There it looks, as if the binary data from geofabric has some problems. Maybe it is the same for you?
I had no problems splitting geofabrik's europe.osm.pbf downloaded at the 14th of December using splitter r161.
Hm, I'm using the europe.osm.gz file. I will try a new splitter version now. It's running since over 90 hours. Splitting the europe file. Marco Am 24.12.2010 12:05, schrieb Ralf Kleineisel:
On 12/24/2010 11:15 AM, Johann Gail wrote:
4 Days ago I started to create a new europe map, and until now the splitter is running, the harddisk is doing anything. The splitting needs over 75 hours and is still running. Here on the list is another thread 'error splitting binary files' some days old. There it looks, as if the binary data from geofabric has some problems. Maybe it is the same for you? I had no problems splitting geofabrik's europe.osm.pbf downloaded at the 14th of December using splitter r161.
mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
I was wrong, it's bz2, not gz. My pc needs around 7GB of java heap, were 4GB are available. The other 3GB are swapped, which takes this huge amount of time. Do you all have this probem with all splitter versions? Marco Am 24.12.2010 12:32, schrieb dom Team OiD:
Hm, I'm using the europe.osm.gz file. I will try a new splitter version now. It's running since over 90 hours. Splitting the europe file.
Marco
Am 24.12.2010 12:05, schrieb Ralf Kleineisel:
On 12/24/2010 11:15 AM, Johann Gail wrote:
4 Days ago I started to create a new europe map, and until now the splitter is running, the harddisk is doing anything. The splitting needs over 75 hours and is still running. Here on the list is another thread 'error splitting binary files' some days old. There it looks, as if the binary data from geofabric has some problems. Maybe it is the same for you? I had no problems splitting geofabrik's europe.osm.pbf downloaded at the 14th of December using splitter r161.
mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
I had a spare hour on Christmas Eve ;) so I tested this. Below is what I got on a 64 bit openSuSE 11.2 system with 4GB RAM and the latest Sun java. time java -Xmx2048M -jar splitter.jar --mapid=70000001 --max-nodes=1000000 europe.osm.pbf real 114m22.787s user 93m33.760s sys 3m43.717s This is using the splitter with pbf support that Steve posted to this group a few weeks ago Hope that helps Paul On 24/12/10 12:09, dom Team OiD wrote:
I was wrong, it's bz2, not gz. My pc needs around 7GB of java heap, were 4GB are available. The other 3GB are swapped, which takes this huge amount of time. Do you all have this probem with all splitter versions?
Marco
Am 24.12.2010 12:32, schrieb dom Team OiD:
Hm, I'm using the europe.osm.gz file. I will try a new splitter version now. It's running since over 90 hours. Splitting the europe file.
Marco
Am 24.12.2010 12:05, schrieb Ralf Kleineisel:
On 12/24/2010 11:15 AM, Johann Gail wrote:
4 Days ago I started to create a new europe map, and until now the splitter is running, the harddisk is doing anything. The splitting needs over 75 hours and is still running.
Here on the list is another thread 'error splitting binary files' some days old. There it looks, as if the binary data from geofabric has some problems. Maybe it is the same for you?
I had no problems splitting geofabrik's europe.osm.pbf downloaded at the 14th of December using splitter r161. _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
participants (4)
-
dom Team OiD -
Johann Gail -
Paul -
Ralf Kleineisel