mirror of
https://github.com/Routstr/routstr-core.git
synced 2026-07-22 12:22:20 +00:00
701c351ce7
When adjust_payment_for_tokens raised during a streaming finalize, the code hardcoded total_msats=0 — giving users free inference and leaking the reserved balance (never released). This was the most critical billing bug still live on main. Changes: - Add _safe_finalize_billing helper that logs at CRITICAL, releases the reserved_balance (atomic clamp-to-zero pattern matching auth.py), and returns a non-zero cost dict using the reserved max_cost as best-effort - Replace all 6 zero-cost fallback sites in base.py: - handle_streaming_chat_completion main finalize - handle_streaming_chat_completion finalize_db_only - handle_streaming_chat_completion finalize_without_usage - handle_streaming_messages_completion main finalize - handle_streaming_messages_completion finalize_db_only - handle_streaming_messages_completion finalize_without_usage - Narrow except clauses from catch-all Exception to specific types (SQLAlchemyError, UpstreamError, OSError) so transient DB hiccups no longer silently result in free service - Log at CRITICAL (was ERROR) so operators are alerted to money leaks - Add 9 functional tests in test_zero_cost_fallback_fix.py covering: non-zero cost return, CRITICAL logging, reserved balance release, child key release, release failure handling, narrow exception types All 5 existing RED tests in test_zero_cost_fallback.py now pass. Full suite: 975 passed, 13 skipped, 0 failures.
Routstr Payment Proxy
Routstr is a decentralized protocol for permissionless, private, and censorship-resistant AI inference. It combines Nostr for discovery and Cashu for private Bitcoin micropayments.
This repo contains Routstr Core: a FastAPI-based reverse proxy that sits in front of OpenAI-compatible APIs and handles pay-per-request billing.
Start Here
- Overview: https://docs.routstr.com/overview/
- Provider Guide: https://docs.routstr.com/provider/quickstart/
- User Guide: https://docs.routstr.com/user-guide/introduction/
Basic Usage
If you are a user/developer, you just point an OpenAI-compatible SDK at a Routstr node and pay with a Cashu token.
OpenAI SDK
from openai import OpenAI
client = OpenAI(
base_url="https://api.routstr.com/v1",
api_key="cashuBo2FteCJodHRwczovL21...",
)
response = client.chat.completions.create(
model="gpt-5-nano",
messages=[{"role": "user", "content": "hello"}],
)
print(response.choices[0].message.content)
cURL
curl https://api.routstr.com/v1/chat/completions \
-H "Content-Type: application/json" \
-H "x-cashu: cashuBo2FteCJodHRwczovL21..." \
-d '{
"model": "gpt-5-nano",
"messages": [{"role": "user", "content": "hello"}]
}'
Quick Start (Docker)
If you are a node runner, start a Routstr Core instance using Docker Compose:
-
Prepare your
.env:ADMIN_PASSWORD=mysecretpassword NAME="My AI Node" DESCRIPTION="Fast access to models" NSEC=yournsec RECEIVE_LN_ADDRESS=yourname@wallet.com -
Start the services:
docker compose up -d -
Configure: Open http://localhost:8000/admin/ to connect your AI providers and set pricing.
For full instructions, see the Provider Quick Start Guide.
Development
make setup
cp .env.example .env
fastapi run routstr