Hi I've been working on implementing unicode sorting so that we can have a global index that supports address search with full unicode support. I've tested with a map mixing Germany and Poland and it seems to work at first sight, but I'm sure someone will find a bug quickly enough :) Get the latest from the unicode branch at the bottom of the download page: http://www.mkgmap.org.uk/download/mkgmap-unicode-r3284.zip try with --code-page=65001 to enable unicode. It should be OK with Greek, Arabic and Cyrillic characters too. But not with Chinese characters at the moment. ..Steve
Hi Steve, this is a great news! I have compiled map of Europe. It looks good and search works correctly in Mapsource. I haven't tested thoroughly but I have tried address search and city search in several languages. Search index for Europe is about 420MB. When compiling I got some messages, like: missing page ? (4e00) missing page ? (5546) missing page ? (57ce) missing page ? (7c73) missing page ? (5170) missing page ? (7b2c) missing page ? (4e00) missing page ? (5546) missing page ? (57ce) no page ? (671d) no page ? (9633) no page ? (516c) no page ? (56ed) no page ? (6d77) no page ? (738b) no page ? (6d77) no page ? (738b) no page ? (767e) -- Best regards, Andrzej
Hi Andrzej
this is a great news!
Thanks for testing, I appologise that I did not see your reply earlier - spam filtering gone wrong!
I have compiled map of Europe. It looks good and search works correctly in Mapsource. I haven't tested thoroughly but I have tried address search and city search in several languages.
Great!
When compiling I got some messages, like:
missing page ? (4e00) missing page ? (5546) [...]
This is debugging for characters that are not recognised. These are usually Chinese/Japanese/Korean characters. I don't exactly know how to deal with these, I assume that there sort positions are determined algorithmically rather than by being included in the SRT file. I have no way to test, so they will remain unsupported for the time being. ..Steve
Hi, I replaced --latin1 with --code-page=65001 for testing. No problem with Costa Rica (for 2 styles). But I got issues with Auvergne (a French region) ! Here is the output (mkgmap-r3288) : finished check-styles java.lang.AssertionError at uk.me.parabola.imgfmt.app.srt.Sort.createSortKey(Sort.java:214) at uk.me.parabola.imgfmt.app.srt.Sort.createSortKey(Sort.java:258) at uk.me.parabola.imgfmt.app.lbl.PlacesFile.sortCities(PlacesFile.java:378) at uk.me.parabola.imgfmt.app.lbl.PlacesFile.allPOIsDone(PlacesFile.java:313) at uk.me.parabola.imgfmt.app.lbl.LBLFile.allPOIsDone(LBLFile.java:211) at uk.me.parabola.mkgmap.build.MapBuilder.processPOIs(MapBuilder.java:549) at uk.me.parabola.mkgmap.build.MapBuilder.makeMap(MapBuilder.java:213) at uk.me.parabola.mkgmap.main.MapMaker.makeMap(MapMaker.java:120) at uk.me.parabola.mkgmap.main.MapMaker.makeMap(MapMaker.java:69) at uk.me.parabola.mkgmap.main.Main$1.call(Main.java:253) at uk.me.parabola.mkgmap.main.Main$1.call(Main.java:249) at java.util.concurrent.FutureTask.run(FutureTask.java:262) at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) at java.lang.Thread.run(Thread.java:744) Exiting - if you want to carry on regardless, use the --keep-going option Number of ExitExceptions: 1 Time finished: Mon Jun 02 15:11:34 GFT 2014 Total time taken: 21243ms No problem with --latin1. Need more ? Options ? Files ? Steph
Hi
I replaced --latin1 with --code-page=65001 for testing. No problem with Costa Rica (for 2 styles). But I got issues with Auvergne (a French region) ! Here is the output (mkgmap-r3288) :
finished check-styles java.lang.AssertionError at uk.me.parabola.imgfmt.app.srt.Sort.createSortKey(Sort.java:214) at uk.me.parabola.imgfmt.app.srt.Sort.createSortKey(Sort.java:258) at uk.me.parabola.imgfmt.app.lbl.PlacesFile.sortCities(PlacesFile.java:378)
This is from the main release of mkgmap. I will fix this, since it shouldn't crash. Or maybe the fix is to merge the unicode branch! However for the new working unicode support you need a version from the unicode branch such as mkgmap-unicode-r3286.zip http://www.mkgmap.org.uk/download/mkgmap-unicode-r3286.zip If there are any problems with this one, then please let me know. Best wishes ..Steve
Le 02/06/2014 18:21, Steve Ratcliffe a écrit :
Hi
I replaced --latin1 with --code-page=65001 for testing. No problem with Costa Rica (for 2 styles). But I got issues with Auvergne (a French region) ! Here is the output (mkgmap-r3288) :
finished check-styles java.lang.AssertionError at uk.me.parabola.imgfmt.app.srt.Sort.createSortKey(Sort.java:214) at uk.me.parabola.imgfmt.app.srt.Sort.createSortKey(Sort.java:258) at uk.me.parabola.imgfmt.app.lbl.PlacesFile.sortCities(PlacesFile.java:378)
This is from the main release of mkgmap. I will fix this, since it shouldn't crash. Or maybe the fix is to merge the unicode branch!
However for the new working unicode support you need a version from the unicode branch such as mkgmap-unicode-r3286.zip
http://www.mkgmap.org.uk/download/mkgmap-unicode-r3286.zip
If there are any problems with this one, then please let me know.
OK with mkgmap-unicode-r3286. The map is made. Looks right. Thanks. Steph
Hi Has anyone tried out the new Unicode support for searching yet? Any bugs, comments? ..Steve
I've been working on implementing unicode sorting so that we can have a global index that supports address search with full unicode support.
I've tested with a map mixing Germany and Poland and it seems to work at first sight, but I'm sure someone will find a bug quickly enough :)
Get the latest from the unicode branch at the bottom of the download page: http://www.mkgmap.org.uk/download/mkgmap-unicode-r3284.zip
try with --code-page=65001 to enable unicode.
It should be OK with Greek, Arabic and Cyrillic characters too. But not with Chinese characters at the moment.
..Steve _______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk http://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev
participants (3)
-
Andrzej Popowski -
Steve Ratcliffe -
Stéphane MARTIN