Splash 1.7.0-m1 for M1/M2: upstream 1.7.0, faster decode with several requests at once, and the Neural Engine pair is now calibrated by itself.
curl -fsSL https://github.com/paperniuk/splash/releases/download/1.7.0-m1/install-m1.sh | sh
Already on 1.6.1-m1.x? Run the same line; it installs next to it and switches splash-m1 to the new one. Desktop app: download Splash-1.7.0-m1.dmg and replace the old Splash.app (same first-open steps as before).
The first start of each model takes longer once: Splash 1.7 measures decode on your Mac, and on the dense 27B the Neural Engine split is calibrated again, now with its pair of chunks (about 5 minutes on an M1 Max). Later starts reuse it. Persistent caches from 1.6.x start cold once.
From upstream 1.7.0: draft trees and prompt-lookup candidates verified in one pass, INT8 cached states (about a third of the size), KV that keeps decoding while it spills to SSD, --host unix:PATH, --reasoning-effort, --chat-template-file. Details in Inco's notes: https://github.com/incoai/splash/releases/tag/1.7.0
New on M1/M2:
- The Neural Engine pair from 1.6.1-m1.1 no longer needs a share by hand. The first start times it and keeps it for prompts of 769 rows or more, single chunks below (#66 by @wtfsayo, the follow-up to #64). On an M1 Max it picked 0.74 on the 27B MLX and 0.79 on UD-Q5_K_M.
- MLX 4-bit decode on the register tile is faster: affine units split by a fitted wave law (#69) and fp16 subnormal operands in the 4-bit chains (#70), both by @wtfsayo.
- Short appends prefill faster where a projection has too few tiles for the GPU: the M1/M2 prefill tile now splits K there (#73 by @ghisguth). On Flash-Next a 128-token append to a 16.7K history answers in 691 ms instead of 758, a 384-token one in 1392 instead of 1487, and decode with 2 and 4 requests at once is 5 to 6% faster.
- Flash-Next's IQ2_XXS and IQ2_S experts (the UD-IQ1_S pack) run on the column tile in 8-row decode passes (#72 by @ghisguth). Not timed here, the UD-IQ1_S pack is not downloaded.
- Port fixes for 1.7's 16-row trees: MoE MMA tiles now address rows from their tile's first grouped row, and a decode step of three or four lanes (48 or 64 rows) on the prefill MMA tile reads and writes its own rows only. Without them the MoE decode tests gave wrong values at four lanes and the engine's decode warm-up of three or four lanes failed.
M1 Max 64 GB, packaged builds, ABBA (two runs each), --max-cache-disk 0, greedy, reasoning off, 400 tokens on four short code prompts. Decode tok/s at 1 request / 2 at once / 4 at once, cold prefill tok/s at 2.1K / 16.7K tokens, 1.6.1-m1.1 -> 1.7.0-m1:
| Model |
1 |
2 |
4 |
prefill 2.1K |
prefill 16.7K |
| 27B MLX 4-bit |
57.0 -> 60.5 (+6%) |
62.5 -> 70.8 (+13%) |
65.4 -> 80.0 (+22%) |
209 -> 218 (+4%) |
199 -> 227 (+14%) |
| 27B UD-Q5_K_M |
49.5 -> 49.0 (-1%) |
57.0 -> 59.7 (+5%) |
63.4 -> 70.0 (+10%) |
199 -> 209 (+5%) |
193 -> 224 (+16%) |
| Flash-Next Q2_0 |
81.1 -> 81.4 |
101.1 -> 100.7 |
113.3 -> 124.0 (+9%) |
459 -> 449 (-2%) |
434 -> 422 (-3%) |
This table is without #72 and #73. Flash-Next's cold prefill is 2 to 3% slower than on 1.6.1-m1.1; not tracked down yet. With #72 and #73 on top (same Mac, ABBA against the table's build): Flash-Next decode at 2 / 4 requests 97.0 -> 101.5 / 116.5 -> 123.6 tok/s, appends of 128 / 384 tokens on a 16.7K history 758 -> 691 ms / 1487 -> 1392 ms; 27B UD-Q5_K_M prefill 2.1K 202 -> 209 tok/s; 27B MLX unchanged. One request on Flash-Next moves by up to 10% per prompt either way, since #73 changes prefill sums and with them the greedy text; a decode cycle's GPU time stays within 1.3%.
Thank you: @wtfsayo for #66, #69 and #70, @ghisguth for #72 and #73.
Not fixed yet: decode slowing down after about a day of uptime with "growth paused" in the log (#63).
Checks on an M1 Max 64 GB: test-engine-metal passes in full (shader validation, with the ane-ffn kernels, split, faults and program), and the CPU and Python tests pass. The packaged build answers text, a cached follow-up and an image correctly with the 27B MLX 4-bit, 27B UD-Q5_K_M and Flash-Next Q2_0 at default settings, and Flash-Next with --expert-memory 16G.
This is an unofficial community port. Splash, its models and draft models are built by Inco (https://github.com/incoai/splash); official Splash runs on M3 and newer.
Built from commit dac0b207 (branch apple7-m1-1.7) on macOS 26.7.3 with Apple clang 21.0.0.
| File |
SHA-256 |
splash-1.7.0-m1-arm64-macos26.tar.gz |
852e7427a85e27dfaadcab1928bf13b5abffbb148940b5e193ca4750f546a561 |
Splash-1.7.0-m1.dmg |
bd3faf1a3d1023d8494fbed3958ce1a75bfc808ad3594e814a69b3739744f724 |
install-m1.sh |
2a19e4f8ba59a57f23b8a1c5a4892b93c4c33165f9b826a13a84c65fd5b1b39e |
engine splash |
894b5a1027851475c0caca5c163948f15c1c59827dd841d64a607d894e5cd068 |
splash.metallib |
753551182071b8e5df17757c7d14d906525f37c0cdfdb6e58c04ca885ecd7881 |