Groq

Groq is a natively supported Large Language Model (LLM) provider in ChatFrame, known for its exceptional speed powered by the Groq LPU™ (Language Processing Unit).

Configuration

ChatFrame uses the Bring Your Own Key (BYOK) model for Groq.

  1. Obtain API Key: Get your API key from the Groq Console.
  2. Open ChatFrame Settings: Navigate to the Providers tab in the ChatFrame settings.
  3. Select Groq: Choose the Groq provider from the list.
  4. Enter Key: Paste your secret API key into the designated field.

Supported Models

Once configured, you will be able to access the high-speed models hosted on the Groq platform, which typically include:

  • Llama 3
  • Mixtral 8x7B

Performance

The Groq LPU™ is designed for low-latency inference, making it an excellent choice for real-time, highly responsive chat interactions within ChatFrame.

Groq. Developer Documentation. https://console.groq.com/keys