NOTETo set up an LLM Provider, navigate to Settings → Integrations and click Add New Integration. LLM Provider integrations are managed by organization admins.
How it works
- Register a provider with its endpoint and credentials, and select which models to expose. For most providers, Datafold fetches the available model list automatically once credentials are entered.
- Models appear in Datafold’s model pickers, labeled with the integration name.
- Credentials are resolved at request time. Editing an integration’s key or endpoint takes effect on the next request.
- Credentials are encrypted at rest and never returned by the API — secret fields are masked on read and kept unchanged when a masked value is re-submitted.
- Costs are tracked automatically. Datafold tracks token usage and estimated spend per model.
Supported providers
OpenAI-compatible (universal)
OpenAI
Anthropic
Google Gemini
Azure AI Foundry
AWS Bedrock
Google Vertex AI
Databricks
Snowflake Cortex
/chat/completions protocol — Together, Fireworks, Groq, OpenRouter, Mistral, vLLM, LM Studio, Ollama, and most other inference services — works through the universal OpenAI-compatible provider.
