August 2021 - mkgmap-dev - The mkgmap lists

Re: [mkgmap-dev] Embedding raster maps
by Oliver Eichler 25 Jan '22

25 Jan '22

Hi Steve, thanks for the file. On my device nothing is visible at all. But that's kind of an information, too. There is no way to circle down bugs by simply skipping the extended part. Probably it is still some missing encoding. In the Isle of Man map (and others) there is much more information in the RGN header. Note the values in the "filling bytes". And there seems to be an additional section after the extended point2 section. I called it offset1/length2. --- RGN header --- size 007D type 47 41 52 4D 49 4E 20 52 47 4E | GARMIN RGN byte0x0000000C 01 flag 00 year 2010 month 7 day 21 hour 9 minute 53 second 6 offset1 0000D54E length1 00000000 offset_polyg2 0000D54E length_polyg2 00001A1F byte0x00000025_0x00000038 02 00 00 00 00 00 00 00 FF 00 00 20 FD FC 03 00 00 00 00 00 offset_polyl2 0000EF6D length_polyl2 00000000 byte0x00000041_0x00000054 00 00 00 00 00 00 00 00 3F 00 00 20 FD 0F 00 00 00 00 00 00 offset_point2 0000EF6D length_point2 00000000 byte0x0000005D_0x00000070 00 00 00 00 00 00 00 00 FF 07 00 20 3F F7 3F 00 00 00 00 00 offset2 0000EF6D length2 0000020B unknown 000000E3 This section has a variable length in different sub-files. The unknown value E3 can be E5, too. It doesn't seem to be a record size. I had a look at several sections. They are not completely random, thus there seem to be no "compression". However the patterns do not ring a bell for me. I copied a couple of them into a file and loaded it into my cloud share: https://www.magentacloud.de/share/s429h1z-r6 Maybe one of you has an idea what it's about. I also uploaded my current version of the test map with a single raster map tile. It does not show. Top left coordinate is N46° 57.768 E011° 47.484. Sadly I am stuck here and I am running out of quality time to concentrate on the topic. I also have to update QMapShack's decoding. While reading the mkgmap source code I noticed a lot of new stuff that is not covered by the decoder. Cheers Oliver

4 6

Creating gmapsupp.img fails with: Cannot invoke "String.endsWith(String)" because the return value of "uk.me.parabola.mkgmap.main.Main$FilenameTask.getFilename()" is null
by Felix Hartmann 14 Sep '21

14 Sep '21

Partly related to the other problem - if I run mkgmap on the splitted files - I get this error. All .img files seem to be fine, but the gmpsupp.img is created with 0 bit size. This is not happening every time I resplit tiles. In this case two tiles were joined by osmconvert - and splitter splits it into three tiles. Then all .img files are created correctly, but the mapset.tdb / mapset.img files are not created - and the gmapsupp.img has 0 size, the gmapi files is also not created. I guess this happens because splitter somehow made a melange of the two input files into three? I really think the only thing missing in resplitting the too big tiles from mkgmap is an appropriate keep-complete mode - that keeps each input tile complete - but does not join input tiles. So osmconvert merging the input tiles is a bad idea even though it mostly works. C:\openmtbmap\maps>start /belownormal /b /wait java -jar -XX:+AggressiveHeap -XX:StringTableSize=1000003 -Xms5000M -Xmx43000M C:\openmtbmap\mkgmap.jar --max-jobs=12 --order-by-decreasing-area --code-page=1251 "--style-file=C:\openmtbmap\buildings_style" --levels="0:24, 1:23, 2:22, 3:21" --ignore-osm-bounds --ignore-turn-restrictions --merge-lines --allow-reverse-merge --transparent --draw-priority=28 --add-pois-to-areas --simplify-polygons=23:4,22:7,21:8 --copyright-file="C:\openmtbmap\openmtbmap_svn\copyrightopm.txt" --license-file="C:\openmtbmap\openmtbmap_svn\licenseopm.txt" --add-boundary-nodes-at-admin-boundaries=2 --poi-excl-index=0x6405,0x4316,0x2f00 --ignore-fixme-values --polygon-size-limits="24:16, 23:14, 22:12, 21:11" --ignore-turn-restrictions --description=buildings_ru --country-abbr=ru --country-name=russia --mapname=85800000 --family-id=8580 --product-id=1 --series-name="buildings_russia_31.08.2021_NU_Local" --family-name="buildings_ru_31.08.2021_NU_Local" --tdbfile --gmapi --gmapsupp --overview-mapname=mapsetb --keep-going --area-name="russia_31.08.2021_NU_Local_buildings" -c D:\openmtbmap\maps\template.russiab buildru.typ [0.005s][warning][gc,ergo] NewSize was set larger than initial heap size, will use initial heap size. Mkgmap version 4806M Time started: Tue Aug 31 21:00:52 CEST 2021 SEVERE (Main): D:\openmtbmap\maps\85800012.o5m: input file 'D:\openmtbmap\maps\85800012.o5m' doesn't exist SEVERE (Main): D:\openmtbmap\maps\85800024.o5m: input file 'D:\openmtbmap\maps\85800024.o5m' doesn't exist Number of MapFailedExceptions: 0 Exception in thread "main" java.lang.NullPointerException: Cannot invoke "String.endsWith(String)" because the return value of "uk.me.parabola.mkgmap.main.Main$FilenameTask.getFilename()" is null at uk.me.parabola.mkgmap.main.Main.endOptions(Main.java:620) at uk.me.parabola.mkgmap.CommandArgsReader.readArgs(CommandArgsReader.java:126) at uk.me.parabola.mkgmap.main.Main.mainStart(Main.java:146) at uk.me.parabola.mkgmap.main.Main.main(Main.java:117) -- Felix Hartman - Openmtbmap.org & VeloMap.org

2 7

Error when running splitter with several input files, could there be keep-complete=single mode?
by Felix Hartmann 02 Sep '21

02 Sep '21

I split france.osm.pbf with D:\openmtbmap\maps>if france == legend start /belownormal /b /wait java -jar -XX:+AggressiveHeap -Xms1000m -Xmx3800m C:\openmtbmap\splitter.jar --max-nodes=9600000 --max-threads=12 --search-limit=1000000 --output=pbf "--keep-complete" --max-areas=1024 --geonames-file=D:\openmtbmap\osmpbf_geofabrik\cities5000.zip --description=france --mapid=83910000 france.osm 1>NUL Then I compiled the map using mgkamp.jar - and want to resplit all remaining files that did not compile with smaller max-nodes value. However splitter.jar chokes if I pass several files... Is there any way to have splitter just working with several files without trying to merge them? I just need the files split to the new max-nodes value and incrementing the map id. If I pass only one file at a time, it is a PITA to script this (is already hard enough figuring out the new map-id and creating a list of the tiles). D:\openmtbmap\maps>if yes EQU yes start /belownormal /b /wait java -XX:+AggressiveHeap -Xms5000M -Xmx54000M -jar C:\openmtbmap\splitter.jar --max-nodes=4800000 --max-threads=12 --search-limit=1000000 --output=pbf --geonames-file=D:\openmtbmap\osmpbf_geofabrik\cities5000.zip --description=france --mapid=83910046 "83910015.osm.pbf" "83910025.osm.pbf" "83910026.osm.pbf" "83910042.osm.pbf" 1>NUL Warning: --keep-complete is only used for the first input file. Further files must use higher ids. Error: Node ids are not sorted. Use e.g. osmosis to sort the input data. This is not supported with keep-complete=true or --problem-list uk.me.parabola.splitter.SplitFailedException: Node ids are not sorted at uk.me.parabola.splitter.MultiTileProcessor.storeCoord(MultiTileProcessor.java:497) at uk.me.parabola.splitter.MultiTileProcessor.processNode(MultiTileProcessor.java:126) at uk.me.parabola.splitter.AbstractMapProcessor.consume(AbstractMapProcessor.java:82) at uk.me.parabola.splitter.OSMFileHandler.execute(OSMFileHandler.java:157) at uk.me.parabola.splitter.ProblemLists.calcMultiTileElements(ProblemLists.java:255) at uk.me.parabola.splitter.Main.useProblemLists(Main.java:503) at uk.me.parabola.splitter.Main.start(Main.java:127) at uk.me.parabola.splitter.Main.main(Main.java:81) The option to first join the files with osmconvert - is a PITA - as you cannot parse several osm.pbf files to osmconvert (it only supports joining osm or o5m files). The option to supply splitter.jar with each file on it's own - is also a PITA that would require horrendous for loops because after each split you need to check which new map-id to use for the next file! So it would be great to have a keep-complete option that for each input file, but not for all input files, uses keep-complete. Actually I think this should be the default mode when supplying several input files. Even if mkgmap actually cannot run this in parallel / multithreading it would be way better than parsing each file on it's own... Or am I dumbstruck in finding a way to resplit too big input files? -- Felix Hartman - Openmtbmap.org & VeloMap.org

4 9

user value
by Enrico Rossini 24 Aug '21

24 Aug '21

Hi, there is a way to extract in the files style the name of the mapper (user) of an element (simply a node)? for example: natural=tree mapped by user demon_box how can I extract the value demon_box in the style files? There is a mkgmap function to do this? Thanks very much. demon_box --enrico ᐧ

2 1

using wildcard for a tag
by brad 19 Aug '21

19 Aug '21

Is there someway to use a wildcard on the left side of a tag test? These both work: ref=* { addlabel '${ref|part:;:1}'} ref:usfs=* { addlabel '${ref|part:;:1}'} But the first one doesn't find ref:usfs Is there a way to make it general, such as: ref*=* { addlabel '${ref|part:;:1}'} That fails with an error

2 1

--version
by lig fietser 14 Aug '21

14 Aug '21

Hi, If I run the command java -jar mkgmap.jar --version it will print a double version in the output, like this Map created with Mkgmap version 4805 4805 I've used a quite outdated mkgmap version (mkgmap-r4285) whose only output was: 4285 How can I get rid of the double 4805 4805?

2 2

Bridge type code
by 7770 14 Aug '21

14 Aug '21

Hi. I am thinking on drawing a symbol for bridges on trails, but not for larger highways. The style would be selecting somthing like: highway=path & bridge=yes. I would create a type image for that, but the question is if there is any good type code, i looked up that 0x6401 might be a good choise, can anyone comment on this, is this a good choise or are there type codes that are better suited for my situation? Regards Karl

4 6

Commit r4806: missing brackets: fix NullPointerException when option --pois-to-areas-placement is used with invalid args like
by svn commit 10 Aug '21

10 Aug '21

Version mkgmap-r4806 was committed by gerd on Tue, 10 Aug 2021 missing brackets: fix NullPointerException when option --pois-to-areas-placement is used with invalid args like --pois-to-areas-placement=abc= or with placeholder like in --pois-to-areas-placement=shop=*;amentity=* Error was introduced with r4285 (bad refactoring) http://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4806

1 0

Bad tile around East London / Greenwich
by jan meisters 08 Aug '21

08 Aug '21

Hi all, since some time my map has a bad tile around East London (Greenwich). I´ve checked earlier revisions of splitter and mkgmap, and decreased splitter´s max-nodes - without success. Problem seems to be in my style, which is based on OpenFietsMap. With the original OFM-style the error is rendered as well, but not with the mkgmap default style. But I´ve got no clue where to look for the mistake - anyone has got a hint for me? https://files.mkgmap.org.uk/download/516/bad_tile-east_london.jpg Jan

4 13

Commit r4805: split route center if last offset in TableC (route restrictions) size is >= 0x8000
by svn commit 07 Aug '21

07 Aug '21

Version mkgmap-r4805 was committed by gerd on Sat, 07 Aug 2021 split route center if last offset in TableC (route restrictions) size is >= 0x8000 Alternative would be to add code to support table offsets >= 0x8000 (3 bytes), but Garmin doesn't to use this and thus this might not even be supported. http://www.mkgmap.org.uk/websvn/revision.php?repname=mkgmap&rev=4805

1 0