Open-source LLM load balancer and serving platform for hosting LLMs
Fast and efficient unstructured data extraction
The best way to use and work with blocks
CLI proxy that reduces LLM token consumption
Distributed LLM and StableDiffusion inference
Korvus is a search SDK that unifies the entire RAG pipeline
LangChain for Rust, the easiest way to write LLM-based programs
The AI framework that adds the engineering to prompt engineering
Instant, controllable, local pre-trained AI models in Rust
An ecosystem of Rust libraries for working with large language models