Flagship cross-encoder reranker. Highest accuracy on messy enterprise corpora — contracts, tickets, policies and long-form documents.
- Params
- 1.1B
- Context
- 8k tokens / pair
- NDCG@10
- 0.7625
- P90 latency
- ~80 ms @ top-50
Best for: Enterprise search, RAG, agent retrieval
Balanced reranker for high-QPS workloads. Near-flagship quality at roughly half the compute per query.
- Params
- 440M
- Context
- 4k tokens / pair
- NDCG@10
- 0.7563
- P90 latency
- ~42 ms @ top-50
Best for: High-volume search, voice + real-time agents
CarraRank-Mini
carrarank-mini
RerankerEdge-class reranker for latency-critical paths. Runs comfortably on CPU or a shared GPU slice.
- Params
- 110M
- Context
- 2k tokens / pair
- NDCG@10
- 0.7218
- P90 latency
- ~14 ms @ top-50
Best for: On-device, in-VPC, ultra low-latency
Domain-tuned dense embeddings for enterprise corpora. Trained to separate near-duplicate policy and contract language.
- Dimensions
- 1536 (Matryoshka 256/768/1536)
- Context
- 8k tokens
- Languages
- 28
- Throughput
- ~2.4k docs/s per GPU
Best for: Primary index for RAG and semantic search
Compact embeddings for large indexes where storage and recall cost dominate. Drop-in with the same tokenizer as CarraEmbed-L.
- Dimensions
- 384
- Context
- 2k tokens
- Languages
- 28
- Throughput
- ~9k docs/s per GPU
Best for: Billion-scale indexes, first-stage recall
CarraEmbed-Code
carraembed-code
EmbeddingCode and runbook embeddings trained on repositories, SOPs and internal wikis — symbol-aware, not just prose-aware.
- Dimensions
- 1024
- Context
- 16k tokens
- Languages
- 19 programming
- Throughput
- ~1.8k files/s per GPU
Best for: Internal code search, engineering agents
CarraTune-Extract
carratune-extract
CustomStructured extraction fine-tunes: pull typed fields out of claims, invoices, leases and statements with schema-constrained decoding.
- Base
- Open-weight 3B / 8B
- Output
- JSON schema enforced
- Training data
- 500–5,000 labelled docs
- Turnaround
- 2–3 weeks to production
Best for: Claims, underwriting, AP/AR, lease abstraction
CarraTune-Classify
carratune-classify
CustomRouting, triage and scoring models trained on your own labels and outcomes — deterministic, cheap and auditable.
- Base
- Open-weight 0.5B / 3B
- Labels
- Up to 512 classes
- Latency
- ~9 ms per item
- Eval
- Versioned golden set
Best for: Ticket routing, intent, risk and lead scoring
The serving runtime behind every model above: batching, quantization, KV reuse and autoscaling tuned for enterprise concurrency.
- Runtimes
- GPU, CPU, WASM edge
- Quantization
- FP8 / INT8 / INT4
- Deploy
- Cloud, VPC, on-prem
- SLA
- 99.9% with burst headroom
Best for: Anywhere you need the weights close to the data