vocab : add \p{M} to lookaheads in Tekken and GPT-4o pre-tokenizer regexes (#30845)

tests : make MoE router selection independent of the backend noise (#30818)

• tests : make MoE router selection independent of the backend noise

The router scores are in the range [0, 1), so a random draw can leave the
last expert (or expert group) still selected and the first one dropped tied
within the noise between the backends. They then route a token to different
experts and the logits differ by 4e-3 instead of the usual 5e-7.

Beam is the only arch here with a real top-k (8 experts, 2 used) and a group
top-k (4 groups, 2 used), so it is the only one that hits this: 2 of 20 seeds
failed on an M2 Ultra, the other MoE archs select 2 of 2 and cannot tie.

Fill the selection bias with a ramp of step 2 to give every expert a score
range of its own, which turns the top-k into a function of the expert index
alone. The bias affects only the selection, the weights still come from the
unbiased probs, so the MoE output keeps its magnitude. Beam now matches the
CPU reference within 4e-7 for all of 160 seeds.

Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)

• tests : tell the CPU and the GPU of an Apple SoC apart in the device table

Both devices report the same description ("Apple M2 Ultra" here), so the
device column of the test table had two indistinguishable rows and a failing
row did not say whether the Metal device or the host CPU produced it.

Add the device name, which is also what -b takes, unless the description
already is the name.

Assisted-by: pi:llama.cpp/ggml-org/Qwen3.8-Flash-Next-GGUF (MacBook, M5 Max, 128GB)

hexagon: update to snapdragon-toolchain v0.8 and enable hexagon v85 (#30854)

• hex-build: bump toolchain, enable v85

• hex-build: bump toolchain to v0.8 in the CI and build scripts

• hex-build: add a little python script for swiv needed on some iot devices

• hex-build: fix flake8 warnings

• hex-arch: update version cap to v85

• hex-inspect: flexible TOOLS_ROOT

• hex-build: update to snake_case naming

• hex-build: update leftover old toolchain refs

• hex-target: update build and run scripts to support ubuntu with adb transport

sycl: fix compiler warnings - missing prototypes, dead code, extra semicolons (#30271)

sycl : fix get_rows on reordered quantized weights (#30430)

Co-authored-by: Sam sam@garagellm.tail7dd858.ts.net

mtmd : match the transformers Qwen-VL resize (#30736)

server: add --connect, allow p2p access to server outside LAN (#28277)

• init

• wip

• wire it up

• make it clear that it's experimental

• add props.connect_code

• nits

• fix windows build

• server: do not advertise a connect code without the tunnel

--connect-code on its own had no effect other than being served in
/props, so the Web UI showed a remote access code that no tunnel was
serving. Clear it when --connect is off, and say so once at startup.

The teardown comment claimed that terminate() closes the child stdout.
It does not: the log thread leaves fgets() only once every writer of
that pipe is gone, so a descendant of llama-connect would block the
join forever. Describe the real contract instead.

Also restore the --reasoning-preserve default in the generated docs.

• Update tools/connect/CMakeLists.txt

Co-authored-by: Adrien Gallouët angt@huggingface.co

• server: dial llama-connect on the bound port and a reachable host

Pass ctx_http.port so --port 0 and the GCP override work, pick the
dial host from --host (wildcards map to loopback, IPv6 is bracketed)
and refuse --connect when only unix sockets are bound.

Co-authored-by: Pascal admin@serveurperso.com
Co-authored-by: Adrien Gallouët angt@huggingface.co

hybrid dna tokenizer fixes (#30825)

• vocab : support Carbon-14B HybridDNA tokenizer

Carbon-14B auto-tags untagged DNA runs and uses N-padded tail tokens
(tail=pad_n). Also strip whitespace inside tags and handle a stray
like the HF tokenizer.

• convert : fix special tokens and merges for older Carbon models

Carbon-500M/3B/8B don't register the Qwen added tokens and ship no
tokenizer.json, so take the token types, merges and special ids from the
base tokenizer.

• Update conversion/base.py

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

• Update src/llama-vocab.cpp

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

• Update src/llama-vocab.cpp

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

• Update src/llama-vocab.cpp

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

• Update conversion/base.py

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

• Update conversion/base.py

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

• Update conversion/base.py

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

• address review comments

• Update src/llama-vocab.cpp

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

Co-authored-by: Sigbjørn Skjæret sigbjorn.skjaeret@scala.com

opencl: add cooperative-k dp4a gemm for q4_0, q4_k and q6_k (#30741)

• opencl: add cooperative-k dp4a GEMM for q4_0

• opencl: add cooperative-k dp4a GEMM for q4_k

• opencl: add cooperative-k dp4a GEMM for q6_k

• opencl: fix alignment

opencl: add get_rows for i32, cpy for i32 and f32 (#30756)

• opencl: support i32 GET_ROWS

• opencl: support i32 and f32 copy conversions