NOTICE 3.1 KB

1234567891011121314151617181920212223242526272829303132333435363738394041424344454647
  1. DeepSeek-V4.1-Flash on 3x NVIDIA DGX Spark
  2. Copyright (C) 2026 zurih
  3. This repository (start.sh, stop.sh, boot.py changes, adapter/, scripts/, files/,
  4. runtime glue, documentation) is free software: you can redistribute it and/or
  5. modify it under the terms of the GNU Affero General Public License as published
  6. by the Free Software Foundation, either version 3 of the License, or (at your
  7. option) any later version. See LICENSE. It is distributed WITHOUT ANY WARRANTY;
  8. see the License for details.
  9. Third-party components and their licences:
  10. - The recipe skeleton (boot.py, benchmarks/, tests/, the Engram row-store idea and
  11. the Docker layout) originates from 0xSero/deepseek-v4.1-flash-4x-rtx-pro-6000,
  12. MIT License, Copyright (c) 2026 0xSero. The MIT notice is retained in
  13. LICENSE.upstream-MIT as that licence requires; the combined work is offered
  14. under the AGPL-3.0-or-later.
  15. - adapter/verify_cap.py, block_verify.py, draft_head_fp8.py, engram_prefetch.py,
  16. draft_tau.py, folded_result_fence.py, autotune_keep.py and wo_a_w8.py (with their
  17. tests) originate from knapcio/DeepSeek-V4.1-Flash-4x-DGX-Spark-TP4 (commit 4d8f4c0),
  18. AGPL-3.0-or-later. wo_a_w8.py and autotune_keep.py were modified here (TP3 group
  19. count, dev-dsv41 bridge, draft/DROP fix, autotune cache fixes); see README.md,
  20. Attribution.
  21. - runtime/flash_mla_sm120.py is derived from SGLang and remains under the Apache
  22. License 2.0 (LICENSE.sglang); the page-split changes are distributed under the
  23. same terms.
  24. - The TP4 production line (docs/tp4.md: the other adapters, Dockerfile.canary,
  25. Dockerfile.canary-roce, scripts/fetch_runtime.sh, scripts/ring_mesh/, scripts/qeval*.py)
  26. is contributed from knapcio/DeepSeek-V4.1-Flash-4x-DGX-Spark-TP4, AGPL-3.0-or-later.
  27. In it: adapter/indexer_chunked*.py backport sgl-project/sglang#39187 (Apache License
  28. 2.0); adapter/spark_prefill_dense.py and runtime/sglang-rocenante.patch are rhys101's
  29. SG18 helper and SG17 overlay (rhys101/DeepSeek-V4.1-Flash-vLLM-DGX-Spark-8, MIT);
  30. runtime/flash_mla_sm120.canary.py is runtime/flash_mla_sm120.py re-applied to the
  31. SGLang dsv4.1 branch kernel file (Apache License 2.0).
  32. - Fetched at image build, not stored here (runtime/sources.manifest pins each commit
  33. and sha256): the SGLang dsv4.1 branch tree (Apache License 2.0); b12x at the SG17
  34. revision and b12x main, renamed b12x_next and patched (local-inference-lab/b12x,
  35. Apache License 2.0; the LICENSE file is installed next to each copy in the image);
  36. b12x.comm.roce_ring, the path-aware RoCEnante package of FujitsuPolycom/sparkring
  37. (commit f16b5f4), itself derived from local-inference-lab/b12x (RoCEnante, PR 295),
  38. Apache License 2.0, with the local changes in scripts/roce_ring-sparkring-f16b5f4.patch
  39. (origin: runtime/b12x/roce_ring-provenance.json). scripts/ring_mesh/plan.py drives
  40. sparkring's fabric planner and the units run sparkring's RDMA-TX marker; neither is
  41. vendored here (both come from a sparkring checkout, Apache License 2.0).
  42. - SGLang, FlashInfer, DeepGEMM, PyTorch, NVIDIA components and the DeepSeek model
  43. retain their respective upstream licences. This repository does not
  44. redistribute model weights.