Tech deep-dive

What enterprise licensing sells: multi-request batching and tiered confidential compute

Inference Runtime · Mr F series · 2026.07.31

Single-user peak tok/s is not enough for licensing. Concurrency and batching matter for multi-tenant serving; TEE/CC must be hardware-tiered—never blank GPU-CC promises on GeForce.

When the deal moves from “look at a bench” to technical licensing / embedding, model-name differences alone rarely close. Enterprises buy capabilities open-source single-user paths do not default to—and that can be written into an acceptance annex.

Multi-request batching: many OSS/desktop narratives optimize single-session peaks. APIs and token factories care how throughput, tail latency, and GPU utilization behave under concurrency. Week-1 single-card A/B still proves the engine; licensing packs should add agreed-concurrency batching and soak.

Confidential compute must be tiered: host TEE (broader), NVIDIA GPU CC (only on qualifying SKUs—not GeForce 4090/5090), and weaker provenance/attestation routes. Roadmap-not-shipped features are not SKUs.

GTM: cloud/token-factory standards lead with batching; OEM/joint hardware leads with tiered trust.

Quotable: enterprise differentiation is often concurrency behavior plus hardware-honest proof—not another model name.

#/mrf · https://aipat.dev/reports/

Disclaimer: indicative ≠ SLA. contact@aipat.dev