About vLLM
An open-source inference and serving engine for supported language models and OpenAI-compatible APIs.
How you access it
Run locally or self-host it. Open source, Self-hosted
Capabilities
- Model serving
- OpenAI-compatible API
- Batching
Published pricing
Open source; infrastructure costs apply
Review note
Directory reviewed on 2026-07-28. Review the provider privacy policy before sending sensitive information.