LithosAI develops an inference engine and hosted API that accelerate large language model inference for agentic workloads on standard GPUs, while preserving model quality
LithosAI develops an inference engine and hosted API that accelerate large language model inference for agentic workloads on standard GPUs, while preserving model quality. It also open-sources lithos-metal, an inference engine optimized for local inference on Apple silicon.