2025
NVIDIA DGX Spark as household-scale AI baseline
NVIDIA (hardware specification); independent reviews for real-world power and performance figures
The first commercially available desktop unit with enough unified memory to run serious open-weight models entirely locally, at a household-affordable price and power envelope.
Demonstrated
- 01A single desktop unit can hold and run open-weight models in the tens-of-billions-of-parameters range locally.
- 02Independent reviewers measured idle draw around 35–40W and typical inference load around 170W — well under the 240W ceiling.
- 03List pricing sits in the £3,999–£4,699 band depending on configuration.
Not demonstrated
- 01Sustained multi-user household workloads over months of real use (no long-run field data yet).
- 02Direct like-for-like FP4 vs FP16/FP8 throughput comparison against datacentre GPUs for the same task.
- 03Repairability or long-term maintainability under household (non-datacentre) conditions.
How it works — A unified memory architecture lets the CPU and GPU share the same 128GB pool, avoiding the classic consumer-GPU ceiling where VRAM (typically 16–24GB) forces model size or precision compromises.
Why Solystopia cares — This is the first machine in the Hearthmind trajectory: the concrete answer to "can a household afford and power meaningful local AI capability" without appeal to hypothetical future hardware.
Practical constraints
- 01Capital cost: £3,999–£4,699 up front, no financing model assumed.
- 02Electricity: continuous idle draw plus load draw, metered against local tariff.
- 03Knowledge: household needs baseline comfort installing and maintaining a local model runner.
- 04Maintenance: no long-run reliability data yet from household (rather than datacentre) use.
- 05Regulation: none currently anticipated for personal-use household compute.
Readiness — TRL 8–9 (commercially available, shipping product) for the hardware; TRL 4–6 for validated household-scale daily-use workflows built on top of it.
What would need to happen next
- 01Independent long-run (6–12 month) household reliability and maintenance data.
- 02Published tokens/kWh benchmarks specific to Spark hardware (not extrapolated from Apple Silicon or RTX 4090 figures).
- 03A published open model-selection guide matched to 128GB unified memory.
- 04Comparative capital-efficiency data against a self-built alternative (e.g. used enterprise GPUs).
- 05Documented solar/battery coupling case studies at household scale.
Related work
- 01Apple Silicon unified-memory local inference (comparable architecture, different ecosystem).
- 02Consumer GPU (RTX 4090-class) local inference (higher power draw, lower unified memory).
Questions worth investigating
- 01What is the actual measured tokens/kWh for common open models on Spark hardware, under household (not benchmark-lab) conditions?
- 02How does capital efficiency (£/petaFLOP) compare to a self-assembled used-hardware alternative?
- 03What is the realistic multi-year maintenance burden for a household without a systems administrator?
- 04At what household size or workload does a Spark stop being sufficient, and a neighbourhood-scale node become justified?
Sources, primary first
- DGX Spark hardware specification — NVIDIAVendor spec
- DGX Spark systems and pricing — GPUsmithIndependent test
- DGX Spark review: specs and performance — GPUsmithIndependent test
- NVIDIA DGX Spark power draw under load — A-BotsIndependent test