Local Models Build Guides

Link Description
Mikubox Triple-P40 build For about $1K you can run 70B at 8192 context and 6-bits.
Mikubox Triple P40 Replication Anon's experience following the original Mikubox Triple-P40 build
Miqumaxx box Richfag cpumaxxing rig.
High-Bandwidth AMD Server Build for Local LLM Inference Updated copy of the original Miqumaxx guide.
V100MAXX A Retard VRAMlet's Guide to Infinitely Scalable Compute.
V100MAXXING This serves as a companion to the original V100MAXX rentry.
Tetobox Tetobox 32 or 48GB vram Dual or Triple A770 Setup Guide
Edit

Pub: 10 May 2024 21:48 UTC

Edit: 02 Mar 2026 22:25 UTC

Views: 39335