Streaming Hub
Streaming Hub 0.1

AI Services

Configure AI providers and use their models in Streaming Hub automations.

Alpha

Providers and profiles

AI Services stores provider configuration in profiles. A profile selects a driver, base URL, model, headers and request defaults used by AI features.

Supported drivers

DriverUse
OpenAI CompatibleServices that expose compatible chat-completions and model-list endpoints, including a configured LM Studio server.
OllamaOllama chat and model-list endpoints.
Anthropic ClaudeAnthropic Messages API and model listing.

Configure a profile

  1. Open AI Services settings.
  2. Create or select a profile.
  3. Select the provider driver.
  4. Enter the base URL and authentication headers required by the provider.
  5. Refresh models and select a model.
  6. Apply the profile and run a test request.

LM Studio

Run the LM Studio local server and use an OpenAI Compatible profile. The common local base URL is http://127.0.0.1:1234, but the actual address must match the server configuration.

Automation use

AI Steps can send messages, select response format behavior and store returned text in Runtime variables or project variables. Parameters such as temperature, maximum tokens and top-p are translated according to the selected driver.

Context and privacy

Review prompts, context files and conversation history before sending a request. A remote provider receives the content included in that request. See Execution context for the difference between per-run data and persistent storage.

Limitations

Compatible providers can implement only part of an API. Model listing, structured response formats or thinking controls may not be supported by every server or model.

Troubleshooting

Verify that the provider server is running, the base URL is reachable, the selected model exists and required authentication headers are present. Inspect AI entries in the Log panel for HTTP status and timeout information.

Related