A from-scratch C++/SYCL inference engine that beats llama.cpp on Intel Arc — on prefill and decode, across eight model architectures.
Dense-model decode on a single card is Mach X's known weak axis — llama.cpp's SYCL kernel edges the Qwen3.6-27B decode loop (15.2 vs 23.2 tok/s). It's the one place a competitor is faster, and it's flagged in amber above rather than buried. Every other bar on this page is a win, and the fix (a faster dense-decode GEMV) is the next lever, not a mystery.
Speed only counts if the output is right. “Bit-exact” is the strongest correctness claim there is: the engine produces output that is byte-for-byte identical to a trusted reference — the same tokens, down to the same bits — not merely “close.” It proves the speed didn't come from quietly cutting numerical corners.