►Recent Highlights from the Previous Thread: https://boards.4chan.org/g/thread/102478048#p102478048

--Qwen 2.5 not worth it for RP, Minitron 8B better, avoid benchmaxing: https://boards.4chan.org/g/thread/102478048#p102480431 https://boards.4chan.org/g/thread/102478048#p102480494
--Compute power vs. bandwidth in LLM training and inference: https://boards.4chan.org/g/thread/102478048#p102480152 https://boards.4chan.org/g/thread/102478048#p102480171
--AI hardware guide suggestion and resource provided: https://boards.4chan.org/g/thread/102478048#p102479765 https://boards.4chan.org/g/thread/102478048#p102479821
--AI accelerator PCIe cards discussion: https://boards.4chan.org/g/thread/102478048#p102479195 https://boards.4chan.org/g/thread/102478048#p102479242 https://boards.4chan.org/g/thread/102478048#p102479312 https://boards.4chan.org/g/thread/102478048#p102479338 https://boards.4chan.org/g/thread/102478048#p102479343 https://boards.4chan.org/g/thread/102478048#p102479379 https://boards.4chan.org/g/thread/102478048#p102479434 https://boards.4chan.org/g/thread/102478048#p102479414
--Qwen 2.5 release and potential applications: https://boards.4chan.org/g/thread/102478048#p102479928 https://boards.4chan.org/g/thread/102478048#p102479966 https://boards.4chan.org/g/thread/102478048#p102480044 https://boards.4chan.org/g/thread/102478048#p102480128 https://boards.4chan.org/g/thread/102478048#p102480143 https://boards.4chan.org/g/thread/102478048#p102480047 https://boards.4chan.org/g/thread/102478048#p102480065 https://boards.4chan.org/g/thread/102478048#p102480049 https://boards.4chan.org/g/thread/102478048#p102480074 https://boards.4chan.org/g/thread/102478048#p102480213
--OpenRouter Qwen 2.5 72B benchmark results: https://boards.4chan.org/g/thread/102478048#p102479724
--Mistral Nemo models still best for 24GB, unless Qwen gets good fine-tune: https://boards.4chan.org/g/thread/102478048#p102479478 https://boards.4chan.org/g/thread/102478048#p102479547
--Anon is considering building a cluster with Orange Pi 5 Pro devices which have a dedicated NPU: https://boards.4chan.org/g/thread/102478048#p102479263 https://boards.4chan.org/g/thread/102478048#p102479350 https://boards.4chan.org/g/thread/102478048#p102479817 https://boards.4chan.org/g/thread/102478048#p102479964 https://boards.4chan.org/g/thread/102478048#p102480010 https://boards.4chan.org/g/thread/102478048#p102479767 https://boards.4chan.org/g/thread/102478048#p102479801 https://boards.4chan.org/g/thread/102478048#p102479923 https://boards.4chan.org/g/thread/102478048#p102480147 https://boards.4chan.org/g/thread/102478048#p102480157 https://boards.4chan.org/g/thread/102478048#p102480175
--2060 and Ryzen 3600 insufficient for 30b+, consider RTX 3090 and high RAM: https://boards.4chan.org/g/thread/102478048#p102478936 https://boards.4chan.org/g/thread/102478048#p102479244 https://boards.4chan.org/g/thread/102478048#p102479260 https://boards.4chan.org/g/thread/102478048#p102479287 https://boards.4chan.org/g/thread/102478048#p102479570 https://boards.4chan.org/g/thread/102478048#p102479586
--Miku (free space): https://boards.4chan.org/g/thread/102478048#p102478511 https://boards.4chan.org/g/thread/102478048#p102479698 https://boards.4chan.org/g/thread/102478048#p102479918

►Recent Highlight Posts from the Previous Thread: https://boards.4chan.org/g/thread/102478048#p102478163 https://boards.4chan.org/g/thread/102478048#p102478475