An Inside Look at the Relay Market Powering Token Resellers and Fraud Fascinating investigation by Matt Lenhard into the market that has grown up around reselling LLM tokens at a discount by pooling API keys from various sources. This looks to be mostly a thing in China. Resellers sell access to an LLM proxy that offers significant discounts on regular API pricing, which they achieve by abusing free trials, proxying through unprotected support bots, or sometimes through stolen credit cards or ✦ AI generated
Matt Lenhard investigated the emerging market where LLM tokens are resold at a discount through pooled API keys.
Author: Fascinating investigation by Matt Lenhard into the market that has grown up around reselling LLM tokens at a discount by pooling API keys from various sources.
Customers of token resellers are motivated by cost savings, circumventing geographic blocks, and gathering training data for model distillation.
Author: The buyers are seeking cheap tokens, avoiding geo-restrictions, and in some cases collecting data for model distillation.
extends · 2
The author calls on LLM vendors to implement better spending controls, allowing users to set hard dollar caps that immediately stop API access.
Author: LLM vendors really need to get better at offering strict caps for their API keys. I want my LLM apps to stop working the moment they hit a dollar threshold I've set for a period of time.
The relay market is primarily based in China, where resellers exploit free trials, unprotected support bots, stolen credit cards, and chargebacks to offer steep discounts.
Author: This looks to be mostly a thing in China. Resellers sell access to an LLM proxy that offers significant discounts on regular API pricing, which they achieve by abusing free trials, proxying through unprotected support bots, or sometimes through stolen credit cards or chargeback attacks.
explains mechanism · 2
The author expresses heightened caution about exposing LLM applications publicly, given that a whole ecosystem now profits from finding and exploiting unprotected endpoints.
Author: I've been cautious about exposing my own LLM-driven applications publicly out of fear of abuse leading to big token bills. The existence of this marketplace makes me even more cautious: there's now an entire ecosystem that can profit from finding a new unprotected endpoint to exploit.
Resellers rely on open-source API proxy tools like one-api and new-api, which are legitimate products repurposed for pooling credentials.
Author: The software they are using for these proxies is open source - mostly one-api and its more actively developed fork new-api, both legitimate API proxy products which can be used to load balance requests across a pool of API credentials.
provides context · 2