Hi Gerd Patch attached that handles UTF16 surrogate pairs so that mkgmap style filters substring and highway-shield give correct results, the LBL trimming leaves the correct amount and neither end up with 1/2 a character. I've looked through all the substring operations and I don't think any others will cause problems. There might just be a few str.length() and str.charAt() or other indexing that might need attention but this would require a lot more searching. I've left the handling for MALFORMED_INPUT so these shouldn't matter. Ticker On Wed, 2021-12-29 at 09:16 +0000, Ticker Berkin wrote:
Hi Gerd
I'll look at this sometime. I while ago I found something in one of the MDR sections (probably the short strings) that handled something like this.
Ticker
On Tue, 2021-12-28 at 13:22 +0000, Gerd Petermann wrote:
Hi Ticker,
okay, maybe you find time to implement a better solution. I've committed the patch with r4838.
@Arndt: Please check if this solves the problems with your maps. Not sure about this because you said mkgmap stops without any reaction while this problem was a loop.
Gerd
_______________________________________________ mkgmap-dev mailing list mkgmap-dev@lists.mkgmap.org.uk https://www.mkgmap.org.uk/mailman/listinfo/mkgmap-dev