EKB not only brings you the latest and most popular models available, we enable you to connect to your own custom model with our “Bring Your Own Keys” (BYOK) feature. This gives you the ability to create custom Agents and test how they respond or complete the tasks you give them so that you can use the LLM that produces the best results for your use case. In this article you’ll learn about the different LLMs that are available and how to connect your own custom LLM to your Agents. Your agents can use two types of models:Documentation Index
Fetch the complete documentation index at: https://ai-kb.automationanywhere.com/llms.txt
Use this file to discover all available pages before exploring further.
Predefined Models
Custom Models (BYOK)
Predefined Models

Available Models by Provider
All available models are visible in the model selector dropdown when configuring your agent. Models are organized by provider and show their cost, capabilities, and availability status.Anthropic
Anthropic
| Model | Description |
|---|---|
| Anthropic Haiku 4.5 | Fast, compact model for lightweight tasks |
| Claude 3 Haiku | Fast and efficient Claude model |
| Claude 4 Sonnet | Balanced performance and speed |
| Claude 4.5 Sonnet | Enhanced reasoning and capabilities |
| Claude Sonnet 4.6 | Latest Claude Sonnet release |
OpenAI
OpenAI
| Model | Description |
|---|---|
| GPT-4o | Latest GPT-4 model with improved performance and faster responses |
| GPT-4o-mini | Lightweight version of GPT-4o |
| GPT 4.1 | GPT-4 generation with improved capabilities |
| GPT 4.1 Mini | Compact GPT 4.1 variant |
| GPT 4.1 Nano | Ultra-lightweight GPT 4.1 variant |
| GPT 5 | Latest flagship GPT model |
| GPT 5 Mini | Compact GPT 5 variant |
| GPT 5 Nano | Ultra-lightweight GPT 5 variant |
| Gpt 5.1 | GPT 5 incremental update |
| GPT 5.2 | GPT 5 incremental update |
| GPT 5.5 | GPT 5 incremental update |
| GPT-5.4 | GPT 5 incremental update |
| GPT-5.4 mini | Compact GPT-5.4 variant |
| GPT-5.4 nano | Ultra-lightweight GPT-5.4 variant |
| O1 Mini | Advanced reasoning model optimized for complex problem-solving |
| o3-mini | Compact reasoning model |
| Gemma2 9b | Open-weight model available via OpenAI-compatible endpoint |
| Llama 4 Maverick | High-capability Llama 4 variant |
| Llama 4 Scout | Efficient Llama 4 variant |
Google
| Model | Description |
|---|---|
| Gemini 2.0 Flash | Fast, multimodal Google model |
| Gemini 2.0 Flash Lite | Lightweight variant of Gemini 2.0 Flash |
| Gemini 2.5 Flash Preview | Preview of the next-generation Gemini Flash model |
DeepSeek
DeepSeek
| Model | Description |
|---|---|
| DeepSeek Chat | Advanced reasoning and conversational model |
Model Selection
Model Information
Each predefined model shows:| Field | Description |
|---|---|
| Model Name | Display name (e.g., “GPT-4o”) |
| Provider | API provider (OpenAI, Anthropic, Google AI) |
| Cost | Credits per use |
| Status | Available or requires upgrade |
Custom Models (BYOK)
Bring Your Own Key (BYOK) allows you to configure custom models using your own API keys. This gives you:Cost Control
Model Flexibility
Custom Endpoints
Provider Choice
Supported Providers
OpenAI
OpenAI
| Field | Value |
|---|---|
| API Key | Your OpenAI API key |
| API URL | https://api.openai.com/v1 (default) |
| Model Name | e.g., gpt-4, gpt-3.5-turbo |
Anthropic
Anthropic
| Field | Value |
|---|---|
| API Key | Your Anthropic API key |
| API URL | https://api.anthropic.com (default) |
| Model Name | e.g., claude-3-5-sonnet-20241022 |
Google AI
Google AI
| Field | Value |
|---|---|
| API Key | Your Google AI API key |
| API URL | https://generativelanguage.googleapis.com/ (default) |
| Model Name | e.g., gemini-pro |
OpenRouter
OpenRouter
| Field | Value |
|---|---|
| API Key | Your OpenRouter API key |
| API URL | OpenRouter endpoint |
| Model Name | Any model available on OpenRouter |
AWS Bedrock
AWS Bedrock
| Field | Value |
|---|---|
| AWS Credentials | Configured separately |
| API URL | Bedrock endpoint |
| Model Name | Bedrock model identifier |
Custom Endpoints
Custom Endpoints
| Field | Value |
|---|---|
| API Key | Your custom API key (if required) |
| API URL | Your custom endpoint URL |
| Model Name | Your model identifier |
Adding Custom Models
Fill in the model details
| Field | Description |
|---|---|
| Model Name | The exact model name as recognized by the API (e.g., gpt-4, claude-3-5-sonnet-20241022) |
| Model Provider | Select the provider from the dropdown (OpenAI, Anthropic, Azure, Google AI, OpenRouter, AWS Bedrock, Custom, etc.) |
| API Key | Your API key for the selected provider. Stored securely. |
| API URL | The API endpoint URL |
| Timeout | Timeout for API requests. Default is 300s. Increase for long-running reasoning models. |
| Max Input Tokens | Maximum input tokens. Default is 3000. Adjust based on your model’s capabilities. |
| Max Response Tokens | Maximum response tokens. Default is 1000. Adjust based on your needs and model limits. |
Using Custom Models
Selecting a Custom Model
Managing Custom Models
Viewing Custom Models
Viewing Custom Models
- Go to Agents → Edit Agent → General tab.
- Click the Custom tab in the AI Models section.
- See all your custom models listed.
Editing Custom Models
Editing Custom Models
- Find the model in the Custom models list.
- Click the Edit icon (three dots menu).
- Modify configuration settings.
- Click Save to update.
Deleting Custom Models
Deleting Custom Models
- Find the model in the Custom models list.
- Click the Delete icon (three dots menu).
- Confirm deletion.
- The model is removed from your project.
Model Configuration Examples
Best Practices
API Key Security
API Key Security
- Never Share Keys - Keep API keys confidential
- Use Environment Variables - For development, use secure storage
- Rotate Keys Regularly - Update keys periodically
- Monitor Usage - Track API usage to detect issues
Model Selection
Model Selection
- Match Use Case - Choose models appropriate for your task
- Consider Cost - Balance performance and cost
- Test Performance - Evaluate model quality for your needs
- Monitor Limits - Watch token limits and quotas
Configuration
Configuration
- Accurate Model Names - Use exact model identifiers
- Correct URLs - Verify API endpoint URLs
- Appropriate Limits - Set realistic token limits
- Test Connections - Verify model connectivity
Cost Management
Cost Management
- Track Usage - Monitor API usage and costs
- Set Budgets - Configure spending limits if available
- Optimize Tokens - Use appropriate token limits
- Review Regularly - Audit model usage periodically
Troubleshooting
Model Not Available — Custom model doesn't appear in dropdown
Model Not Available — Custom model doesn't appear in dropdown
- Model not saved correctly
- API key invalid
- Model configuration error
- Verify model was saved successfully
- Check API key is correct
- Review model configuration
- Refresh the page
API Key Errors — Invalid API key or authentication errors
API Key Errors — Invalid API key or authentication errors
- Incorrect API key
- Expired API key
- Wrong API provider selected
- Key doesn’t have required permissions
- Verify API key is correct
- Check key hasn’t expired
- Confirm correct provider selected
- Ensure key has necessary permissions
Connection Failures — Cannot connect to model endpoint
Connection Failures — Cannot connect to model endpoint
- Incorrect API URL
- Network connectivity issues
- Endpoint not accessible
- Firewall blocking connection
- Verify API URL is correct
- Check network connectivity
- Ensure endpoint is accessible
- Review firewall rules
Token Limit Errors — Token limit exceeded
Token Limit Errors — Token limit exceeded
- Input too long
- Response limit too high
- Model limits exceeded
- Reduce input length
- Lower max response tokens
- Check model’s actual limits
- Split large inputs
Model Compatibility
Different models support different features:| Feature | Supported Models |
|---|---|
| Streaming | Most models |
| Function Calling | OpenAI and Anthropic models |
| Vision | GPT-4 Vision, Claude 3, Gemini Pro Vision |
| Long Context | Claude 3.5 Sonnet, GPT-4 Turbo |
API Key Management
Getting API Keys
OpenAI
OpenAI
- Go to OpenAI Platform.
- Navigate to API Keys.
- Create a new secret key.
- Copy the key (starts with
sk-).
Anthropic
Anthropic
- Go to Anthropic Console.
- Navigate to API Keys.
- Create a new key.
- Copy the key (starts with
sk-ant-).
Google AI
Google AI
- Go to Google AI Studio.
- Create a new API key.
- Copy the key.
OpenRouter
OpenRouter
- Go to OpenRouter.
- Navigate to Keys.
- Create a new key.
- Copy the key.
Key Security
- Store Securely - Keys are encrypted in the database
- Don’t Share - Never share API keys
- Rotate Regularly - Update keys periodically
- Monitor Usage - Watch for unauthorized use
Cost Considerations
Predefined Models
- Costs managed by EKB
- Billed through your EKB subscription
- Credits-based pricing
- Transparent pricing model
Custom Models (BYOK)
- You pay directly to the provider
- No additional EKB fees
- Full control over costs
- Direct billing from provider
- Choose the right model - Use the appropriate model for your task.
- Optimize prompts - Reduce token usage where possible.
- Set limits - Configure max tokens appropriately.
- Monitor usage - Track API usage regularly.