Skip to main content

Documentation Index

Fetch the complete documentation index at: https://ai-kb.automationanywhere.com/llms.txt

Use this file to discover all available pages before exploring further.

EKB not only brings you the latest and most popular models available, we enable you to connect to your own custom model with our “Bring Your Own Keys” (BYOK) feature. This gives you the ability to create custom Agents and test how they respond or complete the tasks you give them so that you can use the LLM that produces the best results for your use case. In this article you’ll learn about the different LLMs that are available and how to connect your own custom LLM to your Agents. Your agents can use two types of models:

Predefined Models

Pre-configured models available to all users — no API key required.

Custom Models (BYOK)

Models you configure with your own API keys for full cost control and flexibility.

Predefined Models

Predefined Models Predefined models are available by default and don’t require API key configuration. These models are managed by EKB and are ready to use. EKB provides access to a wide range of models from leading AI providers, including OpenAI, Anthropic, Google AI, and more. The full list of available models is displayed in the model selector when configuring your agent.

Available Models by Provider

All available models are visible in the model selector dropdown when configuring your agent. Models are organized by provider and show their cost, capabilities, and availability status.
ModelDescription
Anthropic Haiku 4.5Fast, compact model for lightweight tasks
Claude 3 HaikuFast and efficient Claude model
Claude 4 SonnetBalanced performance and speed
Claude 4.5 SonnetEnhanced reasoning and capabilities
Claude Sonnet 4.6Latest Claude Sonnet release
ModelDescription
GPT-4oLatest GPT-4 model with improved performance and faster responses
GPT-4o-miniLightweight version of GPT-4o
GPT 4.1GPT-4 generation with improved capabilities
GPT 4.1 MiniCompact GPT 4.1 variant
GPT 4.1 NanoUltra-lightweight GPT 4.1 variant
GPT 5Latest flagship GPT model
GPT 5 MiniCompact GPT 5 variant
GPT 5 NanoUltra-lightweight GPT 5 variant
Gpt 5.1GPT 5 incremental update
GPT 5.2GPT 5 incremental update
GPT 5.5GPT 5 incremental update
GPT-5.4GPT 5 incremental update
GPT-5.4 miniCompact GPT-5.4 variant
GPT-5.4 nanoUltra-lightweight GPT-5.4 variant
O1 MiniAdvanced reasoning model optimized for complex problem-solving
o3-miniCompact reasoning model
Gemma2 9bOpen-weight model available via OpenAI-compatible endpoint
Llama 4 MaverickHigh-capability Llama 4 variant
Llama 4 ScoutEfficient Llama 4 variant
ModelDescription
Gemini 2.0 FlashFast, multimodal Google model
Gemini 2.0 Flash LiteLightweight variant of Gemini 2.0 Flash
Gemini 2.5 Flash PreviewPreview of the next-generation Gemini Flash model
ModelDescription
DeepSeek ChatAdvanced reasoning and conversational model

Model Selection

1

Navigate to Agents

Go to Agents in the sidebar.
2

Open an agent

Create a new agent or select an existing one.
3

Go to the General tab

Open the General tab in the agent configuration.
4

Select a model

Find the Model drop-down selector next to the agent’s name and select a predefined model from the dropdown.

Model Information

Each predefined model shows:
FieldDescription
Model NameDisplay name (e.g., “GPT-4o”)
ProviderAPI provider (OpenAI, Anthropic, Google AI)
CostCredits per use
StatusAvailable or requires upgrade

Custom Models (BYOK)

Bring Your Own Key (BYOK) allows you to configure custom models using your own API keys. This gives you:

Cost Control

Use your own API keys and billing.

Model Flexibility

Access models not available in the predefined list.

Custom Endpoints

Connect to private or custom model endpoints.

Provider Choice

Use any compatible API provider.

Supported Providers

Supports standard OpenAI API models, Azure OpenAI endpoints, and custom OpenAI-compatible endpoints.
FieldValue
API KeyYour OpenAI API key
API URLhttps://api.openai.com/v1 (default)
Model Namee.g., gpt-4, gpt-3.5-turbo
Supports Claude models via Anthropic API and custom Anthropic-compatible endpoints.
FieldValue
API KeyYour Anthropic API key
API URLhttps://api.anthropic.com (default)
Model Namee.g., claude-3-5-sonnet-20241022
Supports Gemini models via Google AI API and custom Google AI endpoints.
FieldValue
API KeyYour Google AI API key
API URLhttps://generativelanguage.googleapis.com/ (default)
Model Namee.g., gemini-pro
Provides access to multiple model providers through a unified API for various models.
FieldValue
API KeyYour OpenRouter API key
API URLOpenRouter endpoint
Model NameAny model available on OpenRouter
Supports Amazon Bedrock models and various foundation models.
FieldValue
AWS CredentialsConfigured separately
API URLBedrock endpoint
Model NameBedrock model identifier
Supports any OpenAI-compatible API endpoint, including private deployments and self-hosted models.
FieldValue
API KeyYour custom API key (if required)
API URLYour custom endpoint URL
Model NameYour model identifier

Adding Custom Models

1

Navigate to Agents

Go to Agents in the sidebar.
2

Open an agent

Create a new agent or select an existing one to edit.
3

Go to the Settings tab

Open the Settings tab in the agent configuration.
4

Open Custom Models

Scroll to the Custom Models section and click +Add Model.
5

Fill in the model details

The model configuration modal will open. Enter the following:
FieldDescription
Model NameThe exact model name as recognized by the API (e.g., gpt-4, claude-3-5-sonnet-20241022)
Model ProviderSelect the provider from the dropdown (OpenAI, Anthropic, Azure, Google AI, OpenRouter, AWS Bedrock, Custom, etc.)
API KeyYour API key for the selected provider. Stored securely.
API URLThe API endpoint URL
TimeoutTimeout for API requests. Default is 300s. Increase for long-running reasoning models.
Max Input TokensMaximum input tokens. Default is 3000. Adjust based on your model’s capabilities.
Max Response TokensMaximum response tokens. Default is 1000. Adjust based on your needs and model limits.
6

Create the model

Click Create. EK will validate the API connection and model configuration. If successful, the model will be saved and available for use in your agents.

Using Custom Models

Selecting a Custom Model

1

Open the General tab

In the agent editor, go to the General tab and find the Model section.
2

Choose your custom model

The dropdown shows both predefined and custom models. Custom models are marked or shown in a separate section. Select your custom model.
Custom models are project-specific. They are available to all agents in the project, and each project can have its own set of custom models.

Managing Custom Models

  1. Go to AgentsEdit AgentGeneral tab.
  2. Click the Custom tab in the AI Models section.
  3. See all your custom models listed.
  1. Find the model in the Custom models list.
  2. Click the Edit icon (three dots menu).
  3. Modify configuration settings.
  4. Click Save to update.
Editing the API key will replace the existing key. Make sure you have the correct key before saving.
  1. Find the model in the Custom models list.
  2. Click the Delete icon (three dots menu).
  3. Confirm deletion.
  4. The model is removed from your project.
Deleting a custom model will affect all agents using that model. Make sure to update those agents first.

Model Configuration Examples

{
  "model_name": "My GPT-4",
  "version": "gpt-4",
  "api_provider": "openai",
  "api_type": "openai",
  "api_key": "sk-...",
  "api_url": "https://api.openai.com/v1",
  "max_input_tokens": 60000,
  "max_response_tokens": 4096
}

Best Practices

  • Never Share Keys - Keep API keys confidential
  • Use Environment Variables - For development, use secure storage
  • Rotate Keys Regularly - Update keys periodically
  • Monitor Usage - Track API usage to detect issues
  • Match Use Case - Choose models appropriate for your task
  • Consider Cost - Balance performance and cost
  • Test Performance - Evaluate model quality for your needs
  • Monitor Limits - Watch token limits and quotas
  • Accurate Model Names - Use exact model identifiers
  • Correct URLs - Verify API endpoint URLs
  • Appropriate Limits - Set realistic token limits
  • Test Connections - Verify model connectivity
  • Track Usage - Monitor API usage and costs
  • Set Budgets - Configure spending limits if available
  • Optimize Tokens - Use appropriate token limits
  • Review Regularly - Audit model usage periodically

Troubleshooting

Possible causes:
  • Model not saved correctly
  • API key invalid
  • Model configuration error
Solutions:
  • Verify model was saved successfully
  • Check API key is correct
  • Review model configuration
  • Refresh the page
Possible causes:
  • Incorrect API key
  • Expired API key
  • Wrong API provider selected
  • Key doesn’t have required permissions
Solutions:
  • Verify API key is correct
  • Check key hasn’t expired
  • Confirm correct provider selected
  • Ensure key has necessary permissions
Possible causes:
  • Incorrect API URL
  • Network connectivity issues
  • Endpoint not accessible
  • Firewall blocking connection
Solutions:
  • Verify API URL is correct
  • Check network connectivity
  • Ensure endpoint is accessible
  • Review firewall rules
Possible causes:
  • Input too long
  • Response limit too high
  • Model limits exceeded
Solutions:
  • Reduce input length
  • Lower max response tokens
  • Check model’s actual limits
  • Split large inputs

Model Compatibility

When using Knowledge Base v2, only OpenAI (openai, azure) and Anthropic models are supported. Other providers are not compatible with Knowledge Base v2.
Different models support different features:
FeatureSupported Models
StreamingMost models
Function CallingOpenAI and Anthropic models
VisionGPT-4 Vision, Claude 3, Gemini Pro Vision
Long ContextClaude 3.5 Sonnet, GPT-4 Turbo

API Key Management

Getting API Keys

  1. Go to OpenAI Platform.
  2. Navigate to API Keys.
  3. Create a new secret key.
  4. Copy the key (starts with sk-).
  1. Go to Anthropic Console.
  2. Navigate to API Keys.
  3. Create a new key.
  4. Copy the key (starts with sk-ant-).
  1. Go to Google AI Studio.
  2. Create a new API key.
  3. Copy the key.
  1. Go to OpenRouter.
  2. Navigate to Keys.
  3. Create a new key.
  4. Copy the key.

Key Security

  • Store Securely - Keys are encrypted in the database
  • Don’t Share - Never share API keys
  • Rotate Regularly - Update keys periodically
  • Monitor Usage - Watch for unauthorized use

Cost Considerations

Predefined Models

  • Costs managed by EKB
  • Billed through your EKB subscription
  • Credits-based pricing
  • Transparent pricing model

Custom Models (BYOK)

  • You pay directly to the provider
  • No additional EKB fees
  • Full control over costs
  • Direct billing from provider
Cost optimization tips:
  • Choose the right model - Use the appropriate model for your task.
  • Optimize prompts - Reduce token usage where possible.
  • Set limits - Configure max tokens appropriately.
  • Monitor usage - Track API usage regularly.