CarraZero Models

The model catalog behind CarraZero.

Nine specialized models across four families — rerankers, embeddings, custom fine-tunes and the runtime that serves them. Specs, latency and pricing, in the open.

Reranker

3 models

Embedding

3 models

Custom

2 models

Inference

1 model

Catalog

Every CarraZero model.

Pick the smallest model that clears your quality bar. We will tell you which one that is after the benchmark — including when the answer is a model you already run.

CarraRank-2

carrarank-2

Reranker

Flagship cross-encoder reranker. Highest accuracy on messy enterprise corpora — contracts, tickets, policies and long-form documents.

Params
1.1B
Context
8k tokens / pair
NDCG@10
0.7625
P90 latency
~80 ms @ top-50

Best for: Enterprise search, RAG, agent retrieval

CarraRank-1

carrarank-1

Reranker

Balanced reranker for high-QPS workloads. Near-flagship quality at roughly half the compute per query.

Params
440M
Context
4k tokens / pair
NDCG@10
0.7563
P90 latency
~42 ms @ top-50

Best for: High-volume search, voice + real-time agents

CarraRank-Mini

carrarank-mini

Reranker

Edge-class reranker for latency-critical paths. Runs comfortably on CPU or a shared GPU slice.

Params
110M
Context
2k tokens / pair
NDCG@10
0.7218
P90 latency
~14 ms @ top-50

Best for: On-device, in-VPC, ultra low-latency

CarraEmbed-L

carraembed-l

Embedding

Domain-tuned dense embeddings for enterprise corpora. Trained to separate near-duplicate policy and contract language.

Dimensions
1536 (Matryoshka 256/768/1536)
Context
8k tokens
Languages
28
Throughput
~2.4k docs/s per GPU

Best for: Primary index for RAG and semantic search

CarraEmbed-S

carraembed-s

Embedding

Compact embeddings for large indexes where storage and recall cost dominate. Drop-in with the same tokenizer as CarraEmbed-L.

Dimensions
384
Context
2k tokens
Languages
28
Throughput
~9k docs/s per GPU

Best for: Billion-scale indexes, first-stage recall

CarraEmbed-Code

carraembed-code

Embedding

Code and runbook embeddings trained on repositories, SOPs and internal wikis — symbol-aware, not just prose-aware.

Dimensions
1024
Context
16k tokens
Languages
19 programming
Throughput
~1.8k files/s per GPU

Best for: Internal code search, engineering agents

CarraTune-Extract

carratune-extract

Custom

Structured extraction fine-tunes: pull typed fields out of claims, invoices, leases and statements with schema-constrained decoding.

Base
Open-weight 3B / 8B
Output
JSON schema enforced
Training data
500–5,000 labelled docs
Turnaround
2–3 weeks to production

Best for: Claims, underwriting, AP/AR, lease abstraction

CarraTune-Classify

carratune-classify

Custom

Routing, triage and scoring models trained on your own labels and outcomes — deterministic, cheap and auditable.

Base
Open-weight 0.5B / 3B
Labels
Up to 512 classes
Latency
~9 ms per item
Eval
Versioned golden set

Best for: Ticket routing, intent, risk and lead scoring

CarraServe

carraserve

Inference

The serving runtime behind every model above: batching, quantization, KV reuse and autoscaling tuned for enterprise concurrency.

Runtimes
GPU, CPU, WASM edge
Quantization
FP8 / INT8 / INT4
Deploy
Cloud, VPC, on-prem
SLA
99.9% with burst headroom

Best for: Anywhere you need the weights close to the data

Lifecycle

How a CarraZero model reaches production.

01

Benchmark

We run your corpus and queries against your current stack and every CarraZero candidate.

02

Tune

Hard-negative mining and training against your judgements, not a public leaderboard.

03

Evaluate

A frozen golden set, versioned with the model, so quality regressions are visible before release.

04

Deploy

One API, your cloud, your VPC or on-prem — with shadow traffic before cutover.

Pricing

Priced per unit of work, not per seat.

Rerankers

from $0.04

per 1k documents ranked

Volume tiers from 10M documents/month. Mini is priced at a third of flagship.

Embeddings

from $0.012

per 1M tokens

Batch indexing discounts apply above 500M tokens/month.

Custom models

from $12k

per model, then usage

Includes data curation, training, eval harness and two tuning rounds.

Self-hosted

Annual licence

unlimited inference

Open weights in your VPC or on-prem. You keep the weights after term.

Indicative list pricing. Committed-use and self-hosted terms are quoted after the benchmark, once we know which model you actually need.

API

One client, every model.

Rerank

from carrazero import CarraZero

client = CarraZero()

ranked = client.models.rerank(
    model="carrarank-2",
    query="Which vendor contracts renew in Q3?",
    documents=docs,
    top_n=10,
)

Embed

from carrazero import CarraZero

client = CarraZero()

vectors = client.models.embed(
    model="carraembed-l",
    inputs=chunks,
    dimensions=768,
    input_type="document",
)

Tell us the query your stack keeps getting wrong.

We'll pick the model, run the benchmark on your corpus and show you the numbers in a week.

Schedule your intro call