infobro
Writing & Content57Image59Video34Audio & Voice36Chat & Assistants45Productivity65Coding & Development46Agents & Automation36Marketing & SEO26Sales & Support54Business & Finance102Operations21Data & Research31Education27Design27Health & Life38

Groq vs Together AI

Pricing, features, platforms and who each one suits — side by side.

GGroqFreemiumVisit site
TTogether AIPaidVisit site
VS
G

Choose Groq if…

  • you want a free plan to start with
  • you're in its core audience: ai application developers, startups building llm products
T

Choose Together AI if…

  • you're in its core audience: ai startups, ml engineers

Side by side

Feature Groq Together AI
Pricing modelFreemiumPaid
Starting price——
Free plan
Free trial
API
Open source
PlatformsWeb, APIWeb, API
CompanyGroqTogether AI
Full feature lists

G Groq

  • OpenAI-compatible API endpoint
  • Text generation and reasoning models
  • Speech-to-text and text-to-speech
  • Vision and OCR support
  • Tool use with built-in, remote MCP and local tools
  • Structured outputs and prompt caching
  • Performance, Flex and Batch service tiers
  • Dedicated bare-metal LPU capacity for enterprises

T Together AI

  • Serverless pay-per-token inference for open-source models
  • Batch inference up to 30 billion tokens per model
  • Provisioned throughput with 99% uptime SLA
  • Dedicated single-tenant model and container endpoints
  • On-demand and reserved NVIDIA H100, H200, B200, B300 clusters
  • LoRA and full fine-tuning with SFT and DPO
  • Code sandboxes and code interpreter for agents
  • Managed storage with zero egress fees

Their home pages

What each vendor shows first: the pitch, the plans and the sign-up.

Groq home page
G Groq · groq.com
Together AI home page
T Together AI · together.ai

What you'd pay

The cheapest plan that fits, per month, billed yearly where the plan offers it.

Groq

FreeFree
DeveloperUsage-based

Together AI

Serverless InferenceFrom $0.15 / $0.60 per 1M input/output tokens (gpt-oss-120B)
GPU Clusters (on-demand)$3.99/GPU-hour (H100)
Dedicated Inference$5.49/GPU-hour (H100)
Fine-tuningFrom $0.34 per 1M training tokens (Qwen3.5 9B SFT)
Provisioned ThroughputCustom

Price changes we've recorded

We re-read each pricing page every month and log what changed.

Groq

No changes since we started tracking.

Together AI

  1. Nov 8, 2026Serverless Inference: $0 → $0.15; New plan: GPU Clusters (on-demand) ($3.99); New plan: Dedicated Inference ($5.49); New plan: Fine-tuning ($0.34); Provisioned Throughput: Per PTU per minute → Custom; Plan dropped: Dedicated Inference (On-demand); Plan dropped: Dedicated Inference (Reserved)

Strengths and limitations

Groq

  • Drop-in OpenAI-compatible API
  • Free plan available
  • Covers text, speech, vision and tool use in one API
  • 13 data centers across four continents
  • Free plan has lower rate limits than Developer plan
  • Batch and Flex processing require the Developer plan

Together AI

  • Large catalog of open-source models across text, image, audio and video
  • Published per-token and per-GPU-hour prices
  • Path from serverless to dedicated and reserved capacity
  • Managed storage has no egress fees
  • Reserved GPU and dedicated capacity require contacting sales
  • Fine-tuning jobs carry minimum charges (e.g. $4–$60)
  • Usage-based billing makes monthly costs harder to predict

More comparisons

Other options to consider

F
Fireworks AI websiteF

Inference and fine-tuning platform for open AI models, for developers and teams

From $8/mo
F
Fireworks AI website
From $8/mo
F

Inference and fine-tuning platform for open AI models, for developers and teams

LLM APIs & Model HostingAPI
O
OpenRouter websiteO

One OpenAI-compatible API to reach hundreds of AI models across 80+ providers

Freemium
O
OpenRouter website
Freemium
O

One OpenAI-compatible API to reach hundreds of AI models across 80+ providers

LLM APIs & Model HostingFree planAPI
R
Replicate websiteR

Run, fine-tune and deploy open-source ML models through a cloud API

Paid
R
Replicate website
Paid
R

Run, fine-tune and deploy open-source ML models through a cloud API

Developer Tools & APIsAPI
D
DeepSeek websiteD

AI chat assistant and low-cost LLM API for consumers and developers

Freemium
D
DeepSeek website
Freemium
D

AI chat assistant and low-cost LLM API for consumers and developers

AI ChatbotsFree planAPI
M
Mistral websiteM

Open-weight AI models, chat and coding agent you can run on your own infrastructure

Free, from $14.99/mo
M
Mistral website
Free, from $14.99/mo
M

Open-weight AI models, chat and coding agent you can run on your own infrastructure

Local & Open ModelsFree planAPIOpen source
O
Ollama websiteO

Run open AI models locally or in the cloud on macOS, Windows and Linux

Free, from $16.67/mo
O
Ollama website
Free, from $16.67/mo
O

Run open AI models locally or in the cloud on macOS, Windows and Linux

Local & Open ModelsFree planAPIOpen source

Facts from each vendor's public pages. Editorial policy