How to use LLM (Large Language Models)
You can integrate with various large language models (LLMs) by following this procedure.
Integration Type: Large Language Models
This integration allows you to connect any model that supports an OpenAI-like API. This includes models from providers like OpenAI (for example, GPT-4), Azure, Mistral, and others.
Add LLM Integration
- Go to Settings > Connectivity.
- Open AI Models > Large Language Model (LLM).
- Select Add +.
- Enter the following information:
| Field | Description |
|---|---|
| Name, Description | Custom name and description of the integration |
| OpenAI-compatible API URL | Base API URL of the LLM provider Examples: - OpenAI: https://api.openai.com/v1 - DeepInfra: https://api.deepinfra.com/v1/openai |
| Access Token | API key issued by the provider |
| Model Name | Name of the model (for example, gpt-4, gpt-3.5-turbo, llama-2-70b) |
| Model Temperature | Generation parameter (range: 0 to 1) controlling the model’s creativity |
About Model Temperature
| Value | Model Behavior |
|---|---|
| 0.0 | Highly accurate and deterministic responses. No creativity. Ideal for technical tasks and instructions. |
| 0.7 | Balanced mode: a good compromise between accuracy and creativity. This is the default value. |
| 1.0 | Highly creative and unpredictable responses. Suitable for conversations, ideas, stories, and marketing. |