Laying out the streets…STEP 1 OF 3

Throttle · House #21,995

Smart routing for LLM inference, save thousands on API costs

In the Controlling AI token cost neighborhood (AI and agents). In town since 25 Sept 2026.

Nobody has claimed this house yet. Tablif records every new product and gives it a house; when its owner claims it, the lights go on.

Is this yours? Claim it

What Tablif read on Throttle's site

Throttle describes itself as: “Throttle Smart routing for LLM inference, save thousands on API costs”

What it is

Calls itself “CLI”.

  • Calls itself: CLI
“…open-source CLI · MIT · runs on your machine”

What it costs

Monthly subscription. A free tier, free forever. No yearly plan. 4 prices listed on its pages, from $0 to $50.

  • Monthly: yes
  • Yearly: no
  • Free plan: free forever
  • Price: 4 prices, from $0 to $50
“$0 forever · MIT”
“$50 $19 / month · launch price”

Who it sells to

Sells to businesses. Built for small businesses.

  • Sells to: businesses
  • Company size: small businesses
“Built for startups and companies already paying $1000+/month on inference.”

How it runs

A command-line tool for MacBook. Runs locally and works offline. Distributed through the PyPI. Offers an API. Open source. AI is the core of the product.

  • Kind: cli
  • Runs on: MacBook
  • Runs where: on the device, offline
  • Distributed via: PyPI
  • API: yes
  • Open source: yes
  • AI role: core to the product
“…open-source CLI · MIT · runs on your machine”
“…llama3.2:3b on local Ollama, MacBook. 5 requests.”

What it works with

Names Claude, LMDeploy and 4 more on its pages.

  • Names: Claude · LMDeploy · Ollama · +3
“Throttle sits between your code and Claude/OpenAI, automatically routes requests to cheaper models when quality isn't sacrificed”
“…vLLM SGLang Ollama LMDeploy”

What it offers as proof

Live, no waitlist. Claims “1,206 valid requests”. Trying it asks for an email.

  • Number claimed: 1,206 valid requests
  • Instant signup: yes
  • Trial asks for: an email address
“Get Pro early access →”
“Leave an email and what you run. You’ll hear from the person building it, and your setup shapes what ships first. No card today.”

Sources

Tablif read these pages, last on 7 Oct 2026. Everything above is what the product says about itself; Tablif does not verify every claim.

Similar products in Tablif Town

Explore Tablif Town