Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Do you have a write up available on your build? A friend is looking for a similar solution where they can offer an API/service for internal use.


Not really much to write up.

Insert 2-4 $1200 r9700 GPUs in a Linux 7.0.0+ machine with 64GB+ of DDR4-5 memory, fire up llama.cpp, and connect with any OpenAI compatible tools.

A free public anonymous LLM like BigPickle can easily set up the software for you if in doubt.




Consider applying for YC's Fall 2026 batch! Applications are open till July 27.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: