Problem transferring maps from Mapsource

I don’t know if this has been raised before as I am new to the list, but when I try the latest version of mkgmap (r2328) with the latest version of Mapsource (6.16.3) I am unable to transfer maps to a device from Mapsource. I am using Windows 7 service pack 1, 64 bit. If I overwrite with an older version of mkgmap (r2168) I no longer have the problem. I have tried the older version R2316 and got the same problem. I have no problem installing the map into Mapsource, and it shows fine when it is in there. But as soon as I try to select the tiles that cover the British Isles to transfer to device; I get the error as shown in the screenshot attached. I wanted the later version to try out the pre-compiled sea polygons feature, as I have had problems with flooding when combining data previously. The command in the batch file for compiling the maps is. . . java -Xmx5000M -jar mkgmap.jar --index --tdbfile --route --keep-going --generate-sea=multipolygon,close-gaps=1000 --mapname=56710001 --family-id=42 --family-name="ukmapnik" --series-name="ukmapnik"--description="OsmUKMapnik" --remove-short-arcs --add-pois-to-areas --nsis --drive-on-left --overview-mapname="OsmUKMapnik" --style-file=mapnik_styles/mapnik *.osm.pbf uknik.TYP If anyone can shed any light on the problem I would be grateful. Cheers, Geoff.

I don’t know if this has been raised before as I am new to the list, but when I try the latest version of mkgmap (r2328) with the latest version of Mapsource (6.16.3) I am unable to transfer maps to a device from Mapsource. I am using Windows 7 service pack 1, 64 bit. If I overwrite with an older version of mkgmap (r2168) I no longer have the problem. I have tried the older version R2316 and got the same problem. I have been seeing a similar error with mapinstall (on a mac). I have been building maps, installing them (mapmanager?), viewing with basecamp, and sending to device (including selecting tiles from osm, topo_nx, and others for one img file). But sometime in the last few months, I started getting errors where mapinstall wouldn't let me select tiles from osm and said there was a problem. I haven't figured this out.

To try and narrow the problem down, I will start downloading the previous releases of mkgmap until I find when it starts to fail with the latest version of Mapsource. aighes, I guess you are using a different version of Mapsource. I just tried to see if I could download an older version from Garmin, but only the latest version seems to be available there. Cheers, Geoff. -----Original Message----- From: Greg Troxel Sent: Wednesday, September 05, 2012 7:12 PM To: Geoff Sherlock Cc: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource

No...I tried it with 6.16.3 also with Win 7 64bit. I could send a map to my Oregon300 without any problem. Map was generated with r2328. Henning Am 05.09.2012 20:35, schrieb Geoff Sherlock:
aighes, I guess you are using a different version of Mapsource. I just tried to see if I could download an older version from Garmin, but only the latest version seems to be available there.

Hhhmmm! Curiouser and curiouser. r2274 of mkgmap works fine. I have tried downloading 6.16.3 of Mapsource again. Reinstalled it, but it still failed to transfer maps with mkgmap r2316 - with the same error. I guess it is with my system if Henning is fine with a very similar system. I am not too worried about it (i.e. low priority); as I can generate maps from Mapsource with r2274. Just means I can't use pre-compiled sea polygons. Regards, Geoff. -----Original Message----- From: aighes Sent: Wednesday, September 05, 2012 7:36 PM To: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource No...I tried it with 6.16.3 also with Win 7 64bit. I could send a map to my Oregon300 without any problem. Map was generated with r2328. Henning Am 05.09.2012 20:35, schrieb Geoff Sherlock:
aighes, I guess you are using a different version of Mapsource. I just tried to see if I could download an older version from Garmin, but only the latest version seems to be available there.
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Geoff, I have had a similar problem with Mapsource 6.16.3, and the crash occurs at a lower zoom level. Luckily I found an old version 6.14.1 which appears to be stable. Am using r2328 Best regards, Dan On 05-Sep-12 9:38 PM, Geoff Sherlock wrote:
Hhhmmm! Curiouser and curiouser.
r2274 of mkgmap works fine.
I have tried downloading 6.16.3 of Mapsource again. Reinstalled it, but it still failed to transfer maps with mkgmap r2316 - with the same error.
I guess it is with my system if Henning is fine with a very similar system. I am not too worried about it (i.e. low priority); as I can generate maps from Mapsource with r2274. Just means I can't use pre-compiled sea polygons.
Regards, Geoff.
-----Original Message----- From: aighes Sent: Wednesday, September 05, 2012 7:36 PM To: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource
No...I tried it with 6.16.3 also with Win 7 64bit. I could send a map to my Oregon300 without any problem. Map was generated with r2328.
Henning
Am 05.09.2012 20:35, schrieb Geoff Sherlock:
aighes, I guess you are using a different version of Mapsource. I just tried to see if I could download an older version from Garmin, but only the latest version seems to be available there.
mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

It could be, that it depends on the system it's installed. I have one user reporting me, that Mapsource is crashing for him, on something that works fine for me. Both Mapsource 6.16.3.... On 05.09.2012 21:38, Geoff Sherlock wrote:
Hhhmmm! Curiouser and curiouser.
r2274 of mkgmap works fine.
I have tried downloading 6.16.3 of Mapsource again. Reinstalled it, but it still failed to transfer maps with mkgmap r2316 - with the same error.
I guess it is with my system if Henning is fine with a very similar system. I am not too worried about it (i.e. low priority); as I can generate maps from Mapsource with r2274. Just means I can't use pre-compiled sea polygons.
Regards, Geoff.
-----Original Message----- From: aighes Sent: Wednesday, September 05, 2012 7:36 PM To: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource
No...I tried it with 6.16.3 also with Win 7 64bit. I could send a map to my Oregon300 without any problem. Map was generated with r2328.
Henning
Am 05.09.2012 20:35, schrieb Geoff Sherlock:
aighes, I guess you are using a different version of Mapsource. I just tried to see if I could download an older version from Garmin, but only the latest version seems to be available there.
mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
-- keep on biking and discovering new trails Felix openmtbmap.org & www.velomap.org

On 05/09/12 20:38, Geoff Sherlock wrote:
Hhhmmm! Curiouser and curiouser.
r2274 of mkgmap works fine.
I have tried downloading 6.16.3 of Mapsource again. Reinstalled it, but it still failed to transfer maps with mkgmap r2316 - with the same error.
I guess it is with my system if Henning is fine with a very similar system. I am not too worried about it (i.e. low priority); as I can generate maps from Mapsource with r2274. Just means I can't use pre-compiled sea polygons.
There have been problems that only show when you select particular map tiles before. You could select any one tile and it would work, whereas selecting two or three might work or not depending on which tiles you picked. Is that is what is happening? I would guess that it is a problem with the index and the changes that affected the index in the version range you mention are: 2169 2176, 2210 and 2306. So far you have the latest version that works is 2274 and the earliest version that fails is 2316 - is that right? If you have time to try more then r2210 and r2306 would be good ones to try. Best wishes ..Steve

Not quite Steve. It is happening as soon as I try and mark a map (error pops up as soon as I remove my finger from the mouse button - and hangs Mapsource), but just tried using r2328 marking just one tile and it still fails. I have no further time at the moment, but I will check the other revisions you mentioned tomorrow as I think you are probably onto something with the index (had only tested none branch revisions previously). You are correct when I said of the revisions tested, r2274 worked, r2316 was the first I saw it fail. I had not checked other revisions bar the top 3 none branch as it worked with r2274. Thanks, Geoff. On September 06, 2012 11:55 PM Steve Ratcliffe wrote: -----Original Message----- From: Steve Ratcliffe Sent: Thursday, September 06, 2012 11:55 PM To: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource On 05/09/12 20:38, Geoff Sherlock wrote:
Hhhmmm! Curiouser and curiouser.
r2274 of mkgmap works fine.
I have tried downloading 6.16.3 of Mapsource again. Reinstalled it, but it still failed to transfer maps with mkgmap r2316 - with the same error.
I guess it is with my system if Henning is fine with a very similar system. I am not too worried about it (i.e. low priority); as I can generate maps from Mapsource with r2274. Just means I can't use pre-compiled sea polygons.
There have been problems that only show when you select particular map tiles before. You could select any one tile and it would work, whereas selecting two or three might work or not depending on which tiles you picked. Is that is what is happening? I would guess that it is a problem with the index and the changes that affected the index in the version range you mention are: 2169 2176, 2210 and 2306. So far you have the latest version that works is 2274 and the earliest version that fails is 2316 - is that right? If you have time to try more then r2210 and r2306 would be good ones to try. Best wishes ..Steve _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

On 07/09/12 07:33, Geoff Sherlock wrote:
Not quite Steve. It is happening as soon as I try and mark a map (error pops up as soon as I remove my finger from the mouse button - and hangs
Ahh, OK. Well it maybe something else then. I think that the MPL_MAPDIRECTORY error usually means that it cannot find a particular file, so that is another thing to look out for; missing or incomplete files. I would remove the --keep-going option since it hides problems. Even if it is just your environment, we can probably fix the problem as long as the exact revision where it goes wrong can be found. ..Steve

Well I tested the latest build after removing the --keep-going option as suggested and adding --verbose; but as can be seen from the attached output no errors were seen, and the problem still exists. I went to download r2210 and r2306 today but they are not on the download site. As I have only recently looked into mkgmap development, I only downloaded the source to start looking into it last week. So it is going to take me a while to get set up to use SVN to retrieve those two versions for testing. Hopefully apache is a lot easier to install than the last time I had to do it many years ago on a linux server. Regards, Geoff. On Friday, September 07, 2012 3:53 PM, Steve Ratcliffe wrote: -----Original Message----- From: Steve Ratcliffe Sent: Friday, September 07, 2012 3:53 PM To: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource On 07/09/12 07:33, Geoff Sherlock wrote:
Not quite Steve. It is happening as soon as I try and mark a map (error pops up as soon as I remove my finger from the mouse button - and hangs
Ahh, OK. Well it maybe something else then. I think that the MPL_MAPDIRECTORY error usually means that it cannot find a particular file, so that is another thing to look out for; missing or incomplete files. I would remove the --keep-going option since it hides problems. Even if it is just your environment, we can probably fix the problem as long as the exact revision where it goes wrong can be found. ..Steve _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

On 09/09/12 16:38, Geoff Sherlock wrote:
--verbose; but as can be seen from the attached output no errors were seen, ...
Just noticed, but there *is* an error in the attached output. Not sure how it is happening, perhaps there is a file resources\LocatorConfig.xml from where you are running mkgmap from that is in an invalid format. I created r2210 and r2306 although they will disappear again sometime tonight. I can easily create or upload any version you need. ..Steve

Thanks Steve, I got the revisions and I'm currently testing them - I'll post the results tomorrow. Cheers, Geoff. On Monday, September 10, 2012 9:35 PM, Steve Ratcliffe wrote: -----Original Message----- From: Steve Ratcliffe Sent: Monday, September 10, 2012 9:35 PM To: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource On 09/09/12 16:38, Geoff Sherlock wrote:
--verbose; but as can be seen from the attached output no errors were seen, ...
Just noticed, but there *is* an error in the attached output. Not sure how it is happening, perhaps there is a file resources\LocatorConfig.xml from where you are running mkgmap from that is in an invalid format. I created r2210 and r2306 although they will disappear again sometime tonight. I can easily create or upload any version you need. ..Steve _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Apologies, I have seen the error "Invalid byte 2 of 2-byte UTF-8 sequence. at. . ."; ever since I first started using mkgmap almost a year ago, but it never seemed to cause any problems so I grew to ignore it. I copied LocatorConfig.xml from the current source and that error is now cleared. Anyway I have now completed testing mkgmap, and it is showing no errors on execution, here are the results. . . r2210 - Works fine. r2306 - Fails - same problem, unable to select single/multiple tile(s) in Mapsource without it crashing. Output from mkgmap for r2306: C:\Geoff\Walks\OSM\mkgmap>java -Xmx5000M -jar mkgmap.jar --max-jobs --verbose -- index --tdbfile --route --generate-sea=multipolygon,close-gaps=1000 --mapname=56 710001 --family-id=42 --family-name="ukmapnik" --series-name="ukmapnik"--descrip tion="OsmUKMapnik" --remove-short-arcs --add-pois-to-areas --nsis --drive-on-lef t --overview-mapname="OsmUKMapnik" --style-file=mapnik_styles/mapnik *.osm.pbf u knik.TYP Time started: Tue Sep 11 09:32:45 BST 2012 Time finished: Tue Sep 11 09:39:05 BST 2012 Total time taken: 380007ms So r2306 is the first revision that fails, and r2210 is the last time it works correctly. Cheers, Geoff. -----Original Message----- From: Geoff Sherlock Sent: Monday, September 10, 2012 11:23 PM To: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource Thanks Steve, I got the revisions and I'm currently testing them - I'll post the results tomorrow. Cheers, Geoff. On Monday, September 10, 2012 9:35 PM, Steve Ratcliffe wrote: -----Original Message----- From: Steve Ratcliffe Sent: Monday, September 10, 2012 9:35 PM To: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource On 09/09/12 16:38, Geoff Sherlock wrote:
--verbose; but as can be seen from the attached output no errors were seen, ...
Just noticed, but there *is* an error in the attached output. Not sure how it is happening, perhaps there is a file resources\LocatorConfig.xml from where you are running mkgmap from that is in an invalid format. I created r2210 and r2306 although they will disappear again sometime tonight. I can easily create or upload any version you need. ..Steve _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Hi Geoff
So r2306 is the first revision that fails, and r2210 is the last time it works correctly.
Thanks that is useful, but still a big range. I should have added the version just before 2306, because 2306 was a large change so we need to rule it out. if that still fails then I have no more guesses as to what it might be so the next revision to try is somewhere half way between 2210 and 2306. So I've created 2271 and 2298, hope you have time to try them out. Thanks, ..Steve

Steve Ratcliffe <steve@parabola.me.uk> writes:
Hi Geoff
So r2306 is the first revision that fails, and r2210 is the last time it works correctly.
Thanks that is useful, but still a big range.
I should have added the version just before 2306, because 2306 was a large change so we need to rule it out.
if that still fails then I have no more guesses as to what it might be so the next revision to try is somewhere half way between 2210 and 2306.
So I've created 2271 and 2298, hope you have time to try them out.
I'm having an issue too, but I ran 'svn log' and it seems that while there are many revision numbers, there are far fewer commits under mkgmap, maybe 12ish. I will report back when I have some real data, but for the last few months I've been unable to select mkgmap-built maps in mapinstall (on mac). That used to work fine.

Hi
I'm having an issue too, but I ran 'svn log' and it seems that while there are many revision numbers, there are far fewer commits under mkgmap, maybe 12ish. I will report back when I have some real data, but for the last few months I've been unable to select mkgmap-built maps in mapinstall (on mac). That used to work fine.
Since you use a mac the problem may not be the same of course, but do you build your maps without --latin1 or --code-page? It's not confirmed fully yet, but I noticed Geoff was not using a code-page and he has now narrowed the versions down to ones where this seems to be a likely problem. ..Steve

Steve Ratcliffe <steve@parabola.me.uk> writes:
Since you use a mac the problem may not be the same of course, but do you build your maps without --latin1 or --code-page? It's not confirmed fully yet, but I noticed Geoff was not using a code-page and he has now narrowed the versions down to ones where this seems to be a likely problem.
Probably. I don't remember trying to add that. In general, I think it's a bug that one needs to give all these arguments to mkgmap. I would think that with no explicit arguments, the current best practice for making a map from OSM data should happen. It sounds like there is a bugfix for not using --latin1. I can try to narrow down the range further, or if that fix is put on trunk try it out and report back.

Hi Greg, The simplest way to test if it is the same error is to try the --latin1 flag using the lastest (r2328) version of mkgmap. If this works then it will be the same problem I was getting; which Steve now has a fix for. Once it has been confirmed that the fix does not affect any other functionality it will be committed; and any future versions of mkgmap will no longer need the latin1 or code-page set. Regards, Geoff. -----Original Message----- From: Greg Troxel Sent: Sunday, September 16, 2012 12:00 AM To: Steve Ratcliffe Cc: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

On Sep 16, 2012, at 0533 , Geoff Sherlock wrote:
The simplest way to test if it is the same error is to try the --latin1 flag using the lastest (r2328) version of mkgmap. If this works then it will be the same problem I was getting; which Steve now has a fix for. Once it has been confirmed that the fix does not affect any other functionality it will be committed; and any future versions of mkgmap will no longer need the latin1 or code-page set.
I went back to svn trunk (r2328), and added --latin1. I rebuilt (us-northeast extract, plus parcel data for my town). MapInstall now permits selecting the tiles from the OSM build, and I'm sending a combination of those, contour lines, and proprietary data to an etrex vista HCx right now, which seems to be proceeding normally. Thanks to you and Steve for figuring out and fixing this. I read the documentation, and understand now that code-page is dependent on target device. I wonder though if --latin1 should be default, if it's supported by most non-ancient devices. (I do have a GPS V, but I haven't tried to build maps for it in a really long time!)

Hi
I read the documentation, and understand now that code-page is dependent on target device. I wonder though if --latin1 should be default, if it's supported by most non-ancient devices. (I do have a GPS V, but I haven't tried to build maps for it in a really long time!)
I think it would be OK these days to have latin1 as a default, and I wouldn't have any objection to changing it if that's what everyone wanted. But on the other hand the current default is fine too. It has a smaller file size and works everywhere. ..Steve

latin1 is for Western Europe. Therefore I think the default is better than anything - let's face it (for population) the default should be Chinese - but so far it is not supported as far as I can tell. The default tries more than the rest; to be understandable. So I say keep the default. Cheers, Geoff. -----Original Message----- From: Steve Ratcliffe Sent: Monday, September 17, 2012 9:05 PM To: Development list for mkgmap Subject: Re: [mkgmap-dev] Problem transferring maps from Mapsource Hi
I read the documentation, and understand now that code-page is dependent on target device. I wonder though if --latin1 should be default, if it's supported by most non-ancient devices. (I do have a GPS V, but I haven't tried to build maps for it in a really long time!)
I think it would be OK these days to have latin1 as a default, and I wouldn't have any objection to changing it if that's what everyone wanted. But on the other hand the current default is fine too. It has a smaller file size and works everywhere. ..Steve _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev

Hi
It sounds like there is a bugfix for not using --latin1. I can try to narrow down the range further, or if that fix is put on trunk try it out and report back.
Yes you do not need --latin1, its just that the bug wasn't present if you did use it. Please try the fixed version at http://files.mkgmap.org.uk/download/68/mkgmap.jar which will work for you if your problem is the same as Geoff's. ..Steve

Hi Geoff Thanks to your help, I figured out what the problem was and was able to reproduce it. It happens when the map and index is built without --latin1 or --code-page. Attached is a fix that works for me. A ready built version is at: http://files.mkgmap.org.uk/download/68/mkgmap.jar ..Steve

Hi I've expanded the patch, because I found that the sort order parameters were not set correctly with the gmapsupp option either. Here it is if anyone wants to give it a whirl before I commit it, which I plan to do soon. ..Steve
participants (6)
-
aighes
-
amcar
-
Felix Hartmann
-
Geoff Sherlock
-
Greg Troxel
-
Steve Ratcliffe