AI

AI connections

Ask AI about this page

What it is

By default, Akollo's AI features use the models Akollo provides. An admin can instead connect an AI provider with your organization's own key ("bring your own key") and choose which of that provider's models does which job.

Supported providers: OpenRouter, Anthropic, OpenAI, Google AI, Azure OpenAI, Amazon Bedrock and Google Vertex AI, plus your own model server, directly or through the AI Connector.

Where an AI request goes

Adding a connection

Open the connections page

Open Settings › AI › Connections.

Enter the provider and key

Under Add a connection, pick the Provider, give the connection a Name and paste the API key. For Azure OpenAI and Vertex AI, also enter the Address your provider gives you. For Amazon Bedrock, enter the Region (for example eu-central-1).

Choose which data may go through it

Under Data allowed, pick one level: Public data only, Up to internal data or Up to confidential data. The most sensitive (restricted) data never goes to an outside provider. Information marked restricted stays on the institution's own server. Then choose Add connection.

Data levelCan go through an outside connection?
PublicYes, at every level
InternalYes, with Up to internal data or Up to confidential data
ConfidentialYes, only with Up to confidential data
RestrictedNever. It stays on the institution's own server

Note

The key is stored encrypted and is never shown again, not even to admins. To change it, use Replace key, then test the connection again.

Testing and activating

Find models

Find models lists the models your key can use.

Test a model

Test runs a short check on the model you choose: answers in Turkish, structured answers and using a tool. You can activate the connection only after it passes.

Activate

Activate turns the connection on. In live organizations, another admin has to approve the activation on the same page. Until then the connection shows Waiting for a second admin. The other admin chooses Approve activation or Reject. The person who asked cannot approve it.

Connection status
StatusMeaning
DraftAdded, not yet active. Find models and test it here.
Waiting for a second adminActivation requested in a live organization. Another admin decides.
ActiveIn use. Its tested models can be chosen for jobs.
DisabledTurned off for good.

Your own model server

If your organization runs its own model server (for example llama.cpp or vLLM), add it as Own model server with its HTTPS address. A key is optional.

  • The address must be on your installation's list of allowed destinations.
  • Akollo never connects to private or reserved addresses unless the installation allows that server.
  • From a cloud installation, an address on the institution's private network is not accepted as an outside connection. Use the AI Connector instead.

AI Connector

If the model server is inside a closed network, use the AI Connector. It is a small program that runs next to the model server and connects out to Akollo, so no inbound connection is needed.

Create the connector

Under Add an AI Connector, give it a name.

Copy the token

Copy the token that appears. It is shown only once.

Start the connector

Start the connector next to your model server with that token. The connection card shows whether the connector is online.

AI Connector: only outbound connections

Warning

New token replaces the token. The old one stops working at once, so restart the connector with the new token.

Choosing models for jobs

Under Which model does which job, choose for each job either the models Akollo provides or a model of an active connection, then choose Save. The jobs are:

  • Routing
  • Safety check
  • Everyday answers
  • Planning and complex work
  • Search

Only active connections, and the models their test found, can be chosen. Until you add a connection, AI runs on the models Akollo provides.

Costs

Requests through your own connection are billed to you by the provider. They do not use your organization's Akollo AI tokens.

Usage page with the AI input tokens meter selected and a budget field
Usage: Akollo AI tokens are metered here. Requests through your own connection do not count against them.

Turning a connection off

Disable turns a connection off for good. Jobs that used it go back to the models Akollo provides.

Who can manage connections

Organization owners and admins. Every change is recorded with who made it and when. In a support session, the connections can be viewed but not changed.

FAQ

On this page