Providers

Model Registry supports multiple providers. Currently, the following providers are supported:

• OpenAI
• Anthropic
• Google Gemini
• Groq
• AWS Bedrock
• Azure OpenAI
• DeepSeek
• OpenAI Compatible (OpenRouter etc.,)

Creating a Provider

A New model provider can be created by clicking on Add LLM Provider button in the top right corner of the FloTorch Console.

You will be presented with a provider configuration form. You can configure the following:

• Name - The name of the provider.
• Description - The description of the provider.
• Provider - The type of the provider (OpenAI, Anthropic, Google Gemini, Groq, AWS Bedrock, Azure OpenAI, DeepSeek, OpenAI Compatible)

Depending on the provider type, you will be presented with a set of configuration fields to configure the provider.

Once the provider is created, you can see the provider in the Model Providers page. You can directly make Gateway, use this provider using model name as provider/<provider-name>

Editing a Provider

Providers can be edited using the Actions dropdown in the Model Providers table.

1. Identify the provider you want to edit.
2. Click on Actions dropdown and select Configure to edit the provider.

You will be presented with a provider configuration form. You can update the provider configuration and click on Update to update the provider.

Deleting a Provider

Deleting a provider is not supported at the moment.