The cost-aware
LLM Gateway.
Route requests to any provider with real-time cost tracking, request-level budget controls, and full observability.
import OpenAI from "openai";
const client = new OpenAI({
apiKey: process.env.PRICE_PER_TOKEN_KEY,
baseURL: "https://gateway.pricepertoken.com/v1"
});
const response = await client.chat.completions.create({
model: "gpt-4o",
messages: [
{ role: "user", content: "Summarize this quarter's sales report" }
]
});
console.log(response.choices[0].message.content);What you can do
Cost Tracking
Every request returns cost metadata. Tag requests by user, team, or feature to track spend across any dimension.
track-costs.ts
const response = await client.chat.completions.create({
model: "gpt-4o",
messages: [{ role: "user", content: prompt }],
metadata: {
user_id: "user_123",
team_id: "engineering",
feature_id: "chat-support"
}
});
// Response includes cost breakdown
console.log(response.usage.cost); // $0.0034
console.log(response.usage.input_cost); // $0.0012
console.log(response.usage.output_cost); // $0.0022