Small Startup path
You want to run one big open model for your product, as cheaply as it can honestly be run.
The model: Tencent Hy3
295 billion params × 1 GB = 295 GB, +20% working room = 354 GB required
The build
Small Startup Build
4 × RTX PRO 6000 Blackwell Workstation Edition
| Total memory | 384 GB |
|---|---|
| Total price | $53,000 |
| Total power | 2,400 W |
| NVLink between units? | No — PCIe only |
2,400 W continuous draw.
- Homes: 2,400 W ÷ 1,200 W per home ≈ 2 homes worth of power, all the time.
- EV batteries per day: (2,400 W × 24 hours ÷ 1,000) ÷ 90 kWh per battery ≈ 0.6 EV batteries every single day.
384 GB total vs 354 GB required — that's only 30 GB of headroom. This is the cheapest honest build, not a comfortable one.
These four cards have no NVLink between them — they're stacked over PCIe, not clustered the way datacenter hardware is. See how clusters work →