Open Source.
The middleware, tooling, and runtime libraries we ship publicly. All MIT or Apache-2 licensed, all production-tested.
inceptslab/edge-trace
v1.8.0OpenTelemetry-compatible tracing for LLM pipelines with causal sampling.
Rust★ 4.2kinceptslab/prompt-c
v0.9.4A typed DSL for prompts. Catches hallucination bugs at build time.
TypeScript★ 2.7kinceptslab/paged-kv
v2.3.1Drop-in PagedAttention KV-cache allocator for vLLM and TGI.
CUDA / C++★ 6.1kinceptslab/wasm-auth
v1.1.247KB WebAssembly auth middleware. Cold-start under 1ms.
Rust★ 1.9kinceptslab/speculator
v0.6.0Distillation pipeline for training speculative decoding drafters.
Python★ 3.4kinceptslab/rsc-cdn
v0.3.0CDN configuration presets for React Server Components streaming.
TypeScript★ 892