Hi all, I need help for a slightly offtopic problem. I've got a (huge) list of addresses in CSV format. I want to add them to the pbf file from geofabrik before running splitter/mkgmap. Those addresses aren't in OSM. I converted the CSV file to an .osm file. The script produces the addresses with a negative osm id. I then use osmconvert : ./osmconvert geofabrik.osm.pbf addresses.osm --out-pbf -o=complete.pbf No error returned. The complete.pbf file is correctly processed by the splitter/mkgmap toolchain. But the map doesn't show the addresses. I tried to look for the problem : - The .osm file seems correct, it opens correctly in JOSM. - Converting the .osm file to .pbf format before merging doesn't help - Something funny : after merging, the .pbf file is slightly smaller than the geofabrik one. osmconvert does a more efficient job at creating pbf files ? I guess that the problem lies in the merging part but I didn't find any inspection tool for the pbf format. Can anybody help ? Paco.
Hi Paco, I suggest to try processing addresses.osm on its own first. Do you get the expected data in the img file? Is this still the case when you convert the file to pbf with osmconvert? Gerd
Date: Sun, 27 Jul 2014 22:10:49 +0200 From: paco.tyson@free.fr To: mkgmap-dev@lists.mkgmap.org.uk Subject: [mkgmap-dev] Merging pbf files before splitter/mkgmap fails
Hi all,
I need help for a slightly offtopic problem.
I've got a (huge) list of addresses in CSV format. I want to add them to the pbf file from geofabrik before running splitter/mkgmap. Those addresses aren't in OSM. I converted the CSV file to an .osm file. The script produces the addresses with a negative osm id. I then use osmconvert : ./osmconvert geofabrik.osm.pbf addresses.osm --out-pbf -o=complete.pbf No error returned. The complete.pbf file is correctly processed by the splitter/mkgmap toolchain. But the map doesn't show the addresses.
I tried to look for the problem : - The .osm file seems correct, it opens correctly in JOSM. - Converting the .osm file to .pbf format before merging doesn't help - Something funny : after merging, the .pbf file is slightly smaller than the geofabrik one. osmconvert does a more efficient job at creating pbf files ?
I guess that the problem lies in the merging part but I didn't find any inspection tool for the pbf format.
Can anybody help ?
Paco.
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hello Gerd, Following your advice, I tried processing my generated .pbf file (I replaced the usual geofabrik pbf file with this one) : it doesn't work, I only get a white rectangle in Basecamp. In the splitter log, I can see the map coverage is right. Splitter produces only one tile : [java] Number of stored ids: 121 580 require ca. 69.15 bytes per pair. 1899 chunks are used, the avg. number of values in one 64-chunk is 64. [java] Map details: bytes/overhead 18 990 / 8 389 034, overhead includes 1 arrays with 8 MB [java] RLE compresion info: compressed / uncompressed size / ratio: 1 899 / 121 520 / 99% [java] [java] Statistics for ways map: [java] Map is empty [java] JVM Memory Info: Current 167MB (119MB used, 48MB free) Max 683MB [java] Full Node tests: 0 [java] Quick Node tests: 121 580 [java] Thread worker-0 has finished [java] Distribution pass(es) took 3467 ms [java] Time finished: Sun Aug 03 10:41:08 CEST 2014 [java] Total time taken: 9s Using osmconvert to convert to osm format the splitter-produced pbf returns the original data. I assume that splitter processing is OK. Mkgmap runs without errors nor logs. Opening the final map in javawa shows the expected map coverage. I recall that mkgmap produces address data only if it finds a matching highway name, would that explain why the map is empty ? Can you confirm that mkgmap can process negative ids ? Thanks, Paco. ----- Mail original ----- De: "Gerd Petermann" <gpetermann_muenchen@hotmail.com> À: mkgmap-dev@lists.mkgmap.org.uk Envoyé: Lundi 28 Juillet 2014 06:46:49 Objet: Re: [mkgmap-dev] Merging pbf files before splitter/mkgmap fails Hi Paco, I suggest to try processing addresses.osm on its own first. Do you get the expected data in the img file? Is this still the case when you convert the file to pbf with osmconvert? Gerd
Date: Sun, 27 Jul 2014 22:10:49 +0200 From: paco.tyson@free.fr To: mkgmap-dev@lists.mkgmap.org.uk Subject: [mkgmap-dev] Merging pbf files before splitter/mkgmap fails
Hi all,
I need help for a slightly offtopic problem.
I've got a (huge) list of addresses in CSV format. I want to add them to the pbf file from geofabrik before running splitter/mkgmap. Those addresses aren't in OSM. I converted the CSV file to an .osm file. The script produces the addresses with a negative osm id. I then use osmconvert : ./osmconvert geofabrik.osm.pbf addresses.osm --out-pbf -o=complete.pbf No error returned. The complete.pbf file is correctly processed by the splitter/mkgmap toolchain. But the map doesn't show the addresses.
I tried to look for the problem : - The .osm file seems correct, it opens correctly in JOSM. - Converting the .osm file to .pbf format before merging doesn't help - Something funny : after merging, the .pbf file is slightly smaller than the geofabrik one. osmconvert does a more efficient job at creating pbf files ?
I guess that the problem lies in the merging part but I didn't find any inspection tool for the pbf format.
Can anybody help ?
Paco.
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
Hi Paco, yes, mkgmap can process negative ids. The question for me is what you expect when you merge the address data. If you expect an effect on housenumber search/navigation, you should make sure that your style sets the tags like mkgmap:street etc. Gerd paco.tyson wrote
Hello Gerd,
Following your advice, I tried processing my generated .pbf file (I replaced the usual geofabrik pbf file with this one) : it doesn't work, I only get a white rectangle in Basecamp.
In the splitter log, I can see the map coverage is right. Splitter produces only one tile :
[java] Number of stored ids: 121 580 require ca. 69.15 bytes per pair. 1899 chunks are used, the avg. number of values in one 64-chunk is 64. [java] Map details: bytes/overhead 18 990 / 8 389 034, overhead includes 1 arrays with 8 MB [java] RLE compresion info: compressed / uncompressed size / ratio: 1 899 / 121 520 / 99% [java] [java] Statistics for ways map: [java] Map is empty [java] JVM Memory Info: Current 167MB (119MB used, 48MB free) Max 683MB [java] Full Node tests: 0 [java] Quick Node tests: 121 580 [java] Thread worker-0 has finished [java] Distribution pass(es) took 3467 ms [java] Time finished: Sun Aug 03 10:41:08 CEST 2014 [java] Total time taken: 9s
Using osmconvert to convert to osm format the splitter-produced pbf returns the original data. I assume that splitter processing is OK.
Mkgmap runs without errors nor logs. Opening the final map in javawa shows the expected map coverage.
I recall that mkgmap produces address data only if it finds a matching highway name, would that explain why the map is empty ?
Can you confirm that mkgmap can process negative ids ?
Thanks, Paco.
----- Mail original ----- De: "Gerd Petermann" <
gpetermann_muenchen@
> À:
mkgmap-dev@.org
Envoyé: Lundi 28 Juillet 2014 06:46:49 Objet: Re: [mkgmap-dev] Merging pbf files before splitter/mkgmap fails
Hi Paco,
I suggest to try processing addresses.osm on its own first. Do you get the expected data in the img file? Is this still the case when you convert the file to pbf with osmconvert?
Gerd
Date: Sun, 27 Jul 2014 22:10:49 +0200 From:
paco.tyson@
To:
mkgmap-dev@.org
Subject: [mkgmap-dev] Merging pbf files before splitter/mkgmap fails
Hi all,
I need help for a slightly offtopic problem.
I've got a (huge) list of addresses in CSV format. I want to add them to the pbf file from geofabrik before running splitter/mkgmap. Those addresses aren't in OSM. I converted the CSV file to an .osm file. The script produces the addresses with a negative osm id. I then use osmconvert : ./osmconvert geofabrik.osm.pbf addresses.osm --out-pbf -o=complete.pbf No error returned. The complete.pbf file is correctly processed by the splitter/mkgmap toolchain. But the map doesn't show the addresses.
I tried to look for the problem : - The .osm file seems correct, it opens correctly in JOSM. - Converting the .osm file to .pbf format before merging doesn't help - Something funny : after merging, the .pbf file is slightly smaller than the geofabrik one. osmconvert does a more efficient job at creating pbf files ?
I guess that the problem lies in the merging part but I didn't find any inspection tool for the pbf format.
Can anybody help ?
Paco.
_______________________________________________ mkgmap-dev mailing list
mkgmap-dev@.org
_______________________________________________ mkgmap-dev mailing list
mkgmap-dev@.org
http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list
mkgmap-dev@.org
-- View this message in context: http://gis.19327.n5.nabble.com/Merging-pbf-files-before-splitter-mkgmap-fail... Sent from the Mkgmap Development mailing list archive at Nabble.com.
Gerd, Yes, I want to use these addresses for search/navigation. My idea is to merge them with the pbf source file when building a garmin map. My style is OK, addresses coming from OSM can be searched/navigated to. So what could be wrong ? How can I investigate this issue ? Paco ----- Mail original ----- De: "GerdP" <gpetermann_muenchen@hotmail.com> À: mkgmap-dev@lists.mkgmap.org.uk Envoyé: Dimanche 3 Août 2014 12:28:37 Objet: Re: [mkgmap-dev] Merging pbf files before splitter/mkgmap fails Hi Paco, yes, mkgmap can process negative ids. The question for me is what you expect when you merge the address data. If you expect an effect on housenumber search/navigation, you should make sure that your style sets the tags like mkgmap:street etc. Gerd
Hi Paco, I think you have to enable the log. Attached is a sample config file: logging.properties <http://gis.19327.n5.nabble.com/file/n5813518/logging.properties> Use it like this: java -Dlog.config=logging.properties -jar mkgmap.jar ... If you do this with a small input file, once merged with the address data, once without, you should get two different mkgmap.log files. Gerd paco.tyson wrote
Gerd,
Yes, I want to use these addresses for search/navigation. My idea is to merge them with the pbf source file when building a garmin map. My style is OK, addresses coming from OSM can be searched/navigated to. So what could be wrong ? How can I investigate this issue ?
Paco
----- Mail original ----- De: "GerdP" <
gpetermann_muenchen@
> À:
mkgmap-dev@.org
Envoyé: Dimanche 3 Août 2014 12:28:37 Objet: Re: [mkgmap-dev] Merging pbf files before splitter/mkgmap fails
Hi Paco,
yes, mkgmap can process negative ids. The question for me is what you expect when you merge the address data. If you expect an effect on housenumber search/navigation, you should make sure that your style sets the tags like mkgmap:street etc.
Gerd
_______________________________________________ mkgmap-dev mailing list
mkgmap-dev@.org
-- View this message in context: http://gis.19327.n5.nabble.com/Merging-pbf-files-before-splitter-mkgmap-fail... Sent from the Mkgmap Development mailing list archive at Nabble.com.
participants (3)
-
Gerd Petermann -
GerdP
-
paco.tyson＠free.fr