Turn any Mac or GPU into an OpenAI-compatible inference node. One-command setup, automatic HTTPS, model management, and distributed request routing.
Python 26
Python bindings for llama.cpp
Python
Forked from ggml-org/llama.cpp
LLM inference in C/C++
C++
Loading…
There was an error while loading. Please reload this page.