updating to Unicode 15.1

[lemire]

Unicode 16 came out in September 2024. We can update to it, but our tests cannot pass because IdnaTestV2 is still at Unicode 15. See web-platform-tests/wpt#48301

However, we can try 15.1.0.

Previously, "\u1E9E" would map to double-s and it now maps to "xn--zca". I have added a test for this specific change. This is the change that triggers the failures in ada-url/ada#794

[anonrig]

It seems the new changes are from Unicode 15.1

[lemire]

It seems the new changes are from Unicode 15.1

Hmmm. Ok. Let us try.

[lemire]

@anonrig Please consider this PR. It might do what we need.

Note that we need to be careful when releasing because we are bumping the Unicode version which will definitively break some things for some people.

[anonrig]

@anonrig Please consider this PR. It might do what we need.

Note that we need to be careful when releasing because we are bumping the Unicode version which will definitively break some things for some people.

We can release this version as as part of Ada v3.0. Since it's a major version, we might get away with any breakings due to the unicode bump

[anonrig]

@lemire it seems windows is unhappy

[anonrig]

Amazing work!

[lemire]

it seems windows is unhappy

I coded a workaround.