Developer tools1 sources·Published

Mock LLM API server for developers stress-testing LLM app infrastructure

Teams building LLM-powered apps need to load-test their own gateways, queues, and streaming paths but can't afford to burn real token spend on the provider APIs. They end up hand-rolling mock servers. A drop-in, API-compatible fake LLM endpoint with configurable streaming, latency, errors, and rate limits would let them test infra for free.

Score 781 sources

Competition check

Still open

We searched

llm mock serveropenai api mockmock llm api

Found · 143 repos · 787784 packages

Direct open-source competition is light and search intent is narrow, but the broad adjacent package ecosystem means generic mocking utilities are easy to assemble, so entry is only defensible with a maintained, infrastructure-grade mock covering realistic latency, rate limits, and failure modes. Discussion heat is hot enough to confirm recurring pain, making this worth entering for a focused tool

Light open-source competitionVery high discussion

Signal strength

Why this is worth a look — three verifiable signals, not a black-box score.

  • Cross-source

    1 independent platforms · 1 related discussions

    Weak

  • Discussion heat

    Discussion heat very high · 525 Hacker News mentions

    Strong

  • Freshness

    64 days ago

    Medium

Related topics

LLM API mockingOpenAIAnthropicload testingdeveloper tooling

Summaries are AI-generated from public discussions.