Groq

Groq runs open-source LLMs on custom LPU hardware for ultra-fast inference. The fastest LLM option available.

Setup

  1. Sign up at console.groq.com.
  2. Create an API key.
  3. In OpenTypeless settings, select Groq and paste the API key.

Speed

Groq's LPU hardware delivers responses in milliseconds. If you want the fastest polishing experience, Groq is unmatched.