Table of Contents
Overview
BYOLLM (Bring Your Own LLM) lets you connect your own or preferred large language model credentials to the platform, rather than consuming AI capabilities and being billed for LLM usage, as part of your subscription.
Please note that BYOLLM is available to customers on Enterprise packages only.
What this means for you
| Standard (bundled AI) | BYOLLM | |
|---|---|---|
| LLM costs | Included in subscription | Billed to your provider account |
| Model selection | Managed by us | Controlled by you |
| Rate limits | Shared platform limits | Your provider limits apply |
| Provider contract | Ours | Yours |
With BYOLLM active, the platform acts as the compliance intelligence layer - you bring the compute.
Which Features Does BYOLLM Apply To?
BYOLLM applies to all current and future AI capabilities on the platform. You do not need to configure it separately for each feature. BYOLLM covers all AI functionality available to your account.
Supported Providers
- OpenAI (e.g. GPT-4o, GPT-4 Turbo)
- Anthropic (e.g. Claude Sonnet, Claude Haiku)
- Azure OpenAI Service
- Self-hosted models (contact your Account Manager to confirm compatibility)
- Not listed? Just ask us!
Frequently Asked Questions
Do I need separate BYOLLM credentials for each AI feature?
No. One set of credentials applies to all AI capabilities on your account.
What happens if my BYOLLM credentials expire or are revoked?
AI features will become unavailable until a valid key is reconnected.
Can I switch providers later?
Yes. You can update or replace your BYOLLM credentials at any time.
Will BYOLLM affect my subscription cost?
BYOLLM changes how LLM usage is billed. Costs are charged directly from your platform subscription to your provider account. Speak to your account manager for details on how this affects your specific plan.
What data is sent to the LLM provider?
Only content submitted to AI-powered capabilities is processed via inference calls. Please refer to your LLM provider's data processing terms for information on how they handle this data, and contact your account manager if you have specific data residency requirements.
Was this article helpful?
That’s Great!
Thank you for your feedback
Sorry! We couldn't be helpful
Thank you for your feedback
Feedback sent
We appreciate your effort and will try to fix the article