Serge Homepage, Documentation and Downloads – Alpaca Model Chat Interface – News Fast Delivery
Serge is a chat interface based on llama.cpp for running alpaca models. Fully self-hosted, no API key required. Fits in 4GB RAM and runs on CPU. SvelteKit front end Redis for storing chat records and parameters FastAPI + langchain for API, wrapping calls to llama.cpp with python bindings use Setting up […]