How to use LLM (Large Language Models)
You can integrate with various large language models (LLMs) by following this procedure.
Integration Type: Large Language Models
This integration allows you to connect any model that supports an OpenAI-like API. This includes models from providers like OpenAI (e.g., GPT-4), Azure, Mistral, and others.
Step 1: Add LLM Integration
- Go to the Integrations section in the platform’s left menu
- Locate the Large Language Models (LLM) integration type
- Click Add +
- Fill in the following fields:
| Field | Description |
|---|---|
| Name, Description | Custom name and description of the integration |
| OpenAI-compatible API URL | Base API URL of the LLM provider |
Examples:
- OpenAI:
https://api.openai.com/v1 - DeepInfra:
https://api.deepinfra.com/v1/openai|
| Access Token | API key issued by the provider |
| Model Name | Name of the model (e.g., gpt-4, gpt-3.5-turbo, llama-2-70b) |
| Model Temperature | Generation parameter (range: 0 to 1) controlling the model’s creativity |
About Model Temperature
| Value | Model Behavior |
|---|---|
| 0.0 | Highly accurate and deterministic responses. No creativity. Ideal for technical tasks and instructions. |
| 0.7 | Balanced mode: a good compromise between accuracy and creativity. This is the default value. |
| 1.0 | Highly creative and unpredictable responses. Suitable for conversations, ideas, stories, and marketing. |