Skip to main content

evalstudio connector

Manage connector configurations for bridging EvalStudio to external API endpoints. Connectors define how to connect to target systems like LangGraph Dev API.

Usage​

evalstudio connector <command> [options]

Commands​

create​

Create a new connector configuration.

evalstudio connector create <name> [options]
OptionDescription
--type <type>Connector type: langgraph (required)
--base-url <url>Base URL for the API endpoint (required)
--header <key:value>Custom header as key:value pair (repeatable)
--config <json>Configuration as JSON string
--jsonOutput as JSON

Example:

# LangGraph connector (assistantId is required in config)
evalstudio connector create "LangGraph Dev" \
--type langgraph \
--base-url http://localhost:8123 \
--header "X-API-Key:my-key" \
--config '{"assistantId": "my-assistant"}'

Output:

Connector created successfully
ID: 987fcdeb-51a2-3bc4-d567-890123456789
Name: LangGraph Dev
Type: langgraph
Base URL: http://localhost:8123
Headers: X-API-Key: my-k...y-key
Config: {"assistantId":"my-assistant"}
Created: 2026-01-29T10:00:00.000Z

list​

List connector configurations.

evalstudio connector list [options]
OptionDescription
--jsonOutput as JSON

Example:

evalstudio connector list

Output:

Connectors:
-----------
LangGraph Dev (987fcdeb-51a2-3bc4-d567-890123456789)
Type: langgraph
Base URL: http://localhost:8123

show​

Show connector details.

evalstudio connector show <identifier> [options]

The identifier can be the connector ID or name.

OptionDescription
--jsonOutput as JSON

Example:

evalstudio connector show "LangGraph Dev"

Output:

Connector: LangGraph Dev
-----------
ID: 987fcdeb-51a2-3bc4-d567-890123456789
Name: LangGraph Dev
Type: langgraph
Base URL: http://localhost:8123
Headers: X-API-Key: my-k...y-key
Config: {"assistantId":"my-assistant"}
Created: 2026-01-29T10:00:00.000Z
Updated: 2026-01-29T10:00:00.000Z

update​

Update a connector configuration.

evalstudio connector update <identifier> [options]
OptionDescription
-n, --name <name>New connector name
--type <type>New connector type (langgraph)
--base-url <url>New base URL
--header <key:value>Custom header as key:value pair (repeatable, replaces existing)
--config <json>New configuration as JSON string
--jsonOutput as JSON

Example:

evalstudio connector update 987fcdeb-51a2-3bc4-d567-890123456789 \
--base-url http://localhost:8124 \
--header "X-API-Key:new-key" \
--config '{"assistantId": "new-assistant"}'

delete​

Delete a connector configuration.

evalstudio connector delete <identifier> [options]
OptionDescription
--jsonOutput as JSON

Example:

evalstudio connector delete 987fcdeb-51a2-3bc4-d567-890123456789

Output:

Connector "LangGraph Dev" deleted successfully

types​

List available connector types.

evalstudio connector types [options]
OptionDescription
--jsonOutput as JSON

Example:

evalstudio connector types

Output:

Available Connector Types:
--------------------------
langgraph
LangGraph Dev API connector for langgraph-backed agents

JSON Output​

All commands support --json for machine-readable output:

evalstudio connector list --json
[
{
"id": "987fcdeb-51a2-3bc4-d567-890123456789",
"name": "LangGraph Dev",
"type": "langgraph",
"baseUrl": "http://localhost:8123",
"headers": {
"X-API-Key": "lg-dev-key"
},
"config": {
"assistantId": "my-assistant"
},
"createdAt": "2026-01-29T10:00:00.000Z",
"updatedAt": "2026-01-29T10:00:00.000Z"
}
]