Serving DeepSeek-V4-Flash-0731 in Tensor Parallel Across Two DGX Sparks

Fri, 31 Jul 2026 00:00:00 +0000

DeepSeek published DeepSeek-V4-Flash-0731 today — the official release superseding the preview, “only re-post-trained” on the same architecture, but with a large jump in agentic capability:

Benchmark	V4-Flash-0731	V4-Flash (Preview)	V4-Pro (Preview)
Terminal Bench 2.1	82.7	61.8	72.1
Cybergym	76.7	38.7	52.7
DeepSWE	54.4	7.3	12.8
Toolathlon-Verified	70.3	49.7	55.9
DSBench-Hard	59.6	25.8	31.1

Notably it beats V4-Pro-Preview on every one of those, despite a much smaller activated parameter count — and it comes with a speculative-decoding module attached out of the box. I have two GB10 DGX Sparks wired together over ConnectX-7 for exactly this kind of thing, so this post is the tensor-parallel deployment recipe: what’s actually in the checkpoint, whether it fits, the launch flags, and the trap that will wedge a fresh multi-node deployment if you skip it.

Quantization on Alessandro Sangiorgi — GPU Performance Engineer

Serving DeepSeek-V4-Flash-0731 in Tensor Parallel Across Two DGX Sparks