Agents

Creating an Agent

To create an agent, you need to click on Create FloTorch Agent button in the top right corner of the FloTorch Console. Provide a name and description for the agent. Agent name should be unique and can only contain alphanumeric characters and dashes (a-z, A-Z, 0-9, -).

Once an agent is created, you will be navigated to the version configuration page, meanwhile your agent will appear in the Agents list.

When an agent is created, a default version 1 is created automatically and is set in Draft state. You need to configure the agent version and publish it to make it available for use through Gateway.

Agent Versions

Agent versions are the individual configurations of an agent. Each agent can have multiple versions. Each version can have different model configurations, agent details, tools, and schema settings. Once an agent version is published, it is immutable and cannot be changed.

A new version can be created by clicking on New Version button in the top right corner of the FloTorch Console or on the Agent version configuration page by clicking on the three dots button beside the Publish button which will open a dropdown containing Create new version.

A new copy of any published or draft version (make a revision) can be created.

To create a copy of a published version, click on the Make a Revision button which is located in the top right of the page.

To create a copy of a draft version, click on the three dots button, which will open a dropdown, then select the Make a Revision option.

Configuring an Agent Version

Agent versions can be configured using the instructions below:

1. Identify the agent you want to configure from the Agents table.
2. Click on the Actions dropdown button and select View Versions.
3. You will see a list of Agent versions in a slideover table.
4. Click on any version number to open that agent version configuration page, or click on a particular row to navigate to the latest agent version configuration page for that agent.

You will be presented with an agent configuration canvas. You can configure the following:

• Input Schema - A set of rules or policies to control the input of the agent. Define the expected structure and validation rules for incoming data.
• Model - Select the FloTorch Model to use for this agent. The model directs the processed input to the appropriate AI model based on defined logic.
• Agent Details - Manages core agent configuration including:
  • Goal: Define the agent’s primary objective
  • System Prompt: Set the system-level instructions for the agent
  • Sync Settings: Configure sync behavior with syncEnabled and syncInterval options
• Tools - Pre-created MCP (Model Context Protocol) tools that can be integrated with your agent to extend its capabilities.
• Output Schema - A set of rules or policies to control the output of the agent. Define the expected structure and validation rules for outgoing responses.

Once the agent version is configured, you can publish it to make it available for use through Gateway.

Publishing an Agent Version

Agent versions can be published using the Publish button which is located in the top right corner of the agent version canvas.

Once you click the Publish button, a new form will be opened in a slideover which contains a summary field for the version and a “Mark as Latest” checkbox.

If you check the “Mark as Latest” checkbox, the current published version will be marked as the latest version for the agent.

To publish already created versions which are in draft mode, click on the History button which is located before the Publish/Make a Revision button. A slideover will open with the agent version list table. Click on the Publish button for unpublished versions, and click on the Mark as Latest button to mark that version as the latest version for the agent.

Once an agent version is published, it is immutable and cannot be changed. To make modifications, you must create a revision (copy) of the published version.

The published agent can be used through the Gateway API in an OpenAI-compatible format as flotorch/<agent-name>:<version>

Publishing Latest Version of an Agent

You can publish the latest version of an agent by selecting a particular version:

1. Identify the agent you want to publish the latest version of.
2. Click on the Actions dropdown and select Publish Latest to publish the latest version of the agent.
3. You will be presented with a slideover with a dropdown list of versions. Select the version you want to publish as latest and click on Publish to publish the latest version of the agent.

Similarly, you can publish the latest by clicking on View Versions in the Actions menu. The slideover will open with the agent versions list, where you can publish or mark a version as latest.

Once the latest version is published, it is tagged as published and can be used through the Gateway API as flotorch/<agent-name> without specifying the version. The system will automatically route requests to the latest published version.

Interacting with the Agent

To interact with the agent and test it, the agent must be published first.

1. Identify the published agent in the Agents table.
2. Click on the Code icon (typically </>) in the agent’s table row.
3. A code snippet slideover will open showing example code in multiple languages.
4. You can copy Python, TypeScript, or cURL code examples and test them in your own environment.

These code examples demonstrate how to make API calls to your published agent using the FloTorch Gateway, including proper authentication and request formatting.

Agent API Usage

Using a Specific Version:

curl -X POST https://gateway.flotorch.com/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "flotorch/my-agent:2",
    "messages": [
      {"role": "user", "content": "Hello"}
    ]
  }'

Using the Latest Version:

curl -X POST https://gateway.flotorch.com/v1/chat/completions \
  -H "Authorization: Bearer YOUR_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "flotorch/my-agent",
    "messages": [
      {"role": "user", "content": "Hello"}
    ]
  }'

Best Practices

• Test Thoroughly: Always test draft versions before publishing
• Version Summaries: Provide clear summaries when publishing to track changes
• Mark Latest Carefully: Only mark stable, well-tested versions as latest
• Use Descriptive Names: Name agents clearly to indicate their purpose
• Configure Tools: Select appropriate MCP tools to extend agent capabilities
• Schema Validation: Use input and output schemas to ensure data quality
• Sync Settings: Configure sync settings appropriately based on your use case
• Version Management: Keep track of which versions are in production use