Skip to content
@zerogpu

ZeroGPU

Distributed AI inference infrastructure. Lower cost, lower latency, infinite scale.

ZeroGPU logo

ZeroGPU

Distributed AI inference for geo-aware edge compute.
Run production workloads with lower cost and lower latency — horizontal scale across edge devices, one familiar API surface.

Open ZeroGPU platform   ZeroGPU website   ZeroGPU documentation

npm version PyPI version Router repository stars ZeroGPU SDK monorepo

ZeroGPU platform — Get Started, project and API keys, and multi-language request snippets


Why ZeroGPU

  • Lower cost — Inference on idle edge compute instead of always renting centralized GPU capacity.
  • Geo-aware routing — Requests land on nearby capacity so latency stays predictable for real users.
  • Edge-native models — Nano language models (NLMs) tuned for edge and cloud, not only downsized cloud stacks.
  • OpenAI-compatible API — POST /v1/responses and POST /v1/chat/completions with request shapes you already know.
  • Cloud fallback — When edge is unavailable, the same API path falls back to cloud without a second integration story.
  • Typed SDKs — Official clients on npm (zerogpu-api) and PyPI (pip install zerogpu-api → import zerogpu), plus Go, Ruby, Java, Rust, C#, PHP, and Swift in the SDK monorepo.

API at a glance

Base URL https://api.zerogpu.ai/v1
Primary paths POST /v1/responses · POST /v1/chat/completions
Headers x-api-key, Content-Type: application/json (optional: x-project-id)
Reference Responses API · Chat completions
curl https://api.zerogpu.ai/v1/responses \
  -H "x-api-key: $ZEROGPU_API_KEY" \
  -H "Content-Type: application/json" \
  -d '{
    "model": "llama-3.1-8b-instruct-fast",
    "input": "Summarize: NASA announced that its Artemis III mission is now scheduled for late 2026 ..."
  }'

Set ZEROGPU_API_KEY the same way you do in the platform dashboard snippets. Full authentication, models, and error semantics live in docs.zerogpu.ai.


Highlighted repositories

Repository What you’ll find there
zerogpu/SDK Official Fern-generated API clients, smoke tests, and publishing workflows for npm/PyPI packages.
zerogpu/docs Documentation source and deep links into docs.zerogpu.ai.
zerogpu/zerogpu-router Task router for AI agents — Claude Code and OpenClaw plugins that offload summarization, classification, PII redaction, and extraction to nano models via the zerogpu CLI, with per-call cost savings.

Pinned Loading

  1. docs docs Public

    ZeroGPU documentation

    MDX 3 1

Repositories

Showing 10 of 24 repositories
  • docs Public

    ZeroGPU documentation

    zerogpu/docs's past year of commit activity
    MDX 3 MIT 1 0 0 Updated Nov 19, 2026
  • n8n-nodes-zerogpu Public

    Official ZeroGPU nodes for n8n. ZeroGPU is a compute-efficient inference provider for apps and agents — purpose-built small and nano language models on an edge network that run the repeatable tasks frontier models shouldn’t, ~10x faster and 50%+ cheaper. Auto-scaling, with zero GPU infrastructure. Plug in and you’re live.

    zerogpu/n8n-nodes-zerogpu's past year of commit activity
    TypeScript 0 MIT 0 0 0 Updated Nov 13, 2026
  • models.dev Public Forked from anomalyco/models.dev

    An open-source database of AI models.

    zerogpu/models.dev's past year of commit activity
    TypeScript 0 MIT 2,128 0 0 Updated Nov 13, 2026
  • zerogpu-router Public

    Cut inference costs without dumbing down your agent.

    zerogpu/zerogpu-router's past year of commit activity
    Python 60 MIT 9 0 0 Updated Nov 12, 2026
  • cookbook Public

    Examples, end-2-end tutorials and apps built using ZeroGPU

    zerogpu/cookbook's past year of commit activity
    1 0 0 0 Updated Nov 3, 2026
  • ai Public Forked from vercel/ai

    The AI Toolkit for TypeScript. From the creators of Next.js, the AI SDK is a free open-source library for building AI-powered applications and agents

    zerogpu/ai's past year of commit activity
    TypeScript 0 6,347 0 0 Updated Nov 2, 2026
  • sprites-connectors Public Forked from superfly/sprites-connectors

    Community API connectors for Fly.io Sprites: create a connector for any service you want to use on your Sprite.

    zerogpu/sprites-connectors's past year of commit activity
    JavaScript 0 2 0 0 Updated Oct 30, 2026
  • ai-sdk-provider Public

    AI SDK provider for ZeroGPU, a compute-efficient inference provider for apps and agents: purpose-built small and nano language models on an edge network that run the repeatable tasks frontier models shouldn’t, ~10x faster and 50%+ cheaper. Auto-scaling, with zero GPU infrastructure. Plug in and you’re live.

    zerogpu/ai-sdk-provider's past year of commit activity
    TypeScript 0 MIT 0 0 0 Updated Oct 30, 2026
  • langchain-zerogpu Public

    LangChain tools for ZeroGPU's nano language models — classify, summarize, extract PII, and more.

    zerogpu/langchain-zerogpu's past year of commit activity
    Python 1 MIT 0 0 0 Updated Oct 29, 2026
  • cli Public

    Terminal CLI for ZeroGPU — an ultra-fast, compute-efficient inference provider for apps and agents. Purpose-built small and nano models on an edge network, with zero GPU infrastructure, serverless, and auto-scaling built in.

    zerogpu/cli's past year of commit activity
    TypeScript 1 MIT 1 0 0 Updated Oct 29, 2026

People

This organization has no public members. You must be a member to see who’s a part of this organization.