Needlepath · The Context Relevance Engine

Stop paying for stale chat history and making your AI responses worse.

AI agents pile up state: documents, tool results, approvals, history. Sending it all makes answers worse and bills bigger, and rewriting it with another AI is slow and loses details. Needlepath selects what matters before every model call... in milliseconds, with results proven on public, industry-standard tests.

SELECTION FIELD · LIVE v1 · in-process
packet: 8,192 / 8,192 tokens · 23.1% removed at 8K
+4.99 points
better answers
than sending full context, statistically significant on the public benchmark
32%
fewer input tokens
needed than full context; 23.1% at 8K and 37.3% at 16K context windows in public benchmark runs
8.5 to 14.5 ms
better context selection
with no second model deployment in the loop
$15.67 vs $24.53
lower cost
vs full context for better results
Backed & built with NVIDIA Inception Google for Startups AWS Activate Babson Butler Launchpad ND Labs
The Idea

Every model call gets a briefing. The question is who prepares it.

Before every call, something decides what the model reads. There are four ways to prepare that packet:

OPTION A

Send the complete file

The answer is in there, but buried, and you pay for every page.

OPTION B

Rewrite it shorter

A summary fits nicely, but exact names, numbers, and order details can vanish in the rewrite.

OPTION C

Heavyweight selection

Picking pages beats rewriting them, but this needs its own expensive machine and takes seconds per question.

NEEDLEPATH

A focused packet of originals

Original records, untouched, selected in milliseconds. And when the whole file is what the moment needs, it hands over the whole file.

The Scoreboard

Better answers than sending everything.

One matched public exam (RULER), five ways to prepare the packet, two context lengths. Higher is better.

RULER 8K / 16K CONTEXT NEEDLEPATH8K16K
Needlepath's focused packet
54%
49%
The complete file
48%
45%
Compress-then-retrieve
43%
42%
Heavyweight selection
38%
41%
Rewritten summary
33%
32%
+5.8pp / +4.7pp
Above full context at 8K / 16K. "pp" is percentage points: the direct gap in accuracy.
First of five
Needlepath scored above every other tested configuration at both lengths; the pure-compression arm scored below full context at both.
23.1% / 37.3%
Input tokens removed at 8K / 16K in the tested runs, without rewriting a single record.

Method: same questions, same model family, official scoring paths, paired statistics. Each method ran at its own recommended settings. Per-item results and reproducibility artifacts are published for inspection.

Suites: RULER · BFCL · SQuAD v2. Scoring: the benchmarks' official code, no house grading. Statistics: McNemar + bootstrap CIs. Artifacts: sha256 manifests.

Where The Wins Come From

The same public exam, task by task.

Per-task results from the flagship public run. Every number carries its own statistical label, and we never blend them into a composite score.

WIN

Finding one buried fact

+12 points at 8K, +15 at 16K

Statistically significant at both sizes.

WIN

Many needles, one answer

+13 points at both sizes

A consistent gain.

WIN

Counting and extraction

+7 to +18 points across sizes

Task-level gains at both context lengths.

WIN

Hard multi-key lookups

+12 points at 8K

Statistically significant.

HONESTY

Long-document QA

Statistically even with sending everything, within a few points in both directions.

HONESTY

Conservative by design

Keeps more or steps aside where order, forms, or answerability need coverage.

The Contests

Four contests. The same public exams. Official scorers.

All four ran on public, industry-standard tests, scored by the official scoring code.

CONTEST 1

When the decisive fact is buried

The critical detail sits deep inside a 100-message thread. Sending everything put the answer in the room, surrounded by noise that cost money and competed for the model's attention. The rewrite lost exact wording and scored below sending everything.

Needlepath's focused packet beat them all, including the complete file.
CONTEST 2

When the answer cannot wait

A live conversation, where every pause is visible. The heavyweight systems took one to over thirty seconds to decide what to keep.

Needlepath decided in about a hundredth of a second.
CONTEST 3

When every field must remain exact

Orders, forms, controlled documents. A summary can be almost right and operationally wrong: a dropped decimal breaks the order.

Needlepath matched the complete file's accuracy, with forms preserved exactly.
CONTEST 4

When the complete file is the right packet

Some work needs the entire history. Needlepath is the only contestant with a tested gate for exactly this: it detects those workloads and hands over exactly what you would have sent anyway, at no extra cost.

Wrong optimization is worse than no optimization. This engine acts on that.
The Difference

Where Needlepath acts, and where it stands aside.

Three disclosed cases, all in the public results. Honesty is the feature no compressor ships.

NO-OP BY DESIGN

Clean single-document inputs: nothing to select, so Needlepath does nothing, by design.

SCOPE BOUNDARY

Distractors inside a single record: Needlepath selects among records, it does not edit within them.

STAND-DOWN GATE

Agent loops where the whole history is load-bearing: the gate detects this per workload and stands aside, handing over exactly what you would have sent anyway, at no extra cost.

Wins where winning is possible. Does no harm everywhere else.
AGENT LOOPS (APPWORLD)

Stood aside on 100% of steps; the model received the full history unchanged.

FACTUAL QA (TRUTHFULQA)

Zero changed answers across configurations.

Before you commit to anything, Needlepath watches your real workloads in shadow mode and tells you honestly how much it would save, and where it would choose not to act.
Speed

Milliseconds inside the loop.

The context decision, measured per item on the public benchmark, excluding model time.

Needlepath
8.5 to 14.5 ms
per decision, in-process measurement
Compress-then-retrieve
1.13 to 2.16 s
per item at 8K / 16K
Heavyweight selection
3.24 to 6.93 s
per item, on a dedicated GPU
Rewritten summary
12.6 to 32.4 s
per item at 8K / 16K
How It Works

A selection layer, not a compressor.

01

Parse the objective

Evaluate the immediate request: task intent, tool intent, output type, entities.

02

Calculate relevance

Fast filters identify the records most relevant to the current task, in 8.5 to 14.5 ms per decision, with no model call.

03

Route the state

Ship the relevant records intact, preserve required evidence exactly, and pass the full context through when the workload calls for it.

Not a reranker: rerankers order retrieved documents; Needlepath decides what enters the model call at all, across documents, tool results, memory, and workflow state. Not compression: nothing is rewritten.
HOSTED API · SINGLE ENDPOINT · STATELESS
POST /v1/context/select
{
  "task":            { "query": "resolve the customer's refund request", "intent": "tool_call" },
  "records":         [ ...documents, tool results, history... ],
  "constraints":     { "max_selected_tokens": 8000 },
  "operating_point": "np-2026-07-r1",  // immutable, versioned label
  "mode":            "shadow"   // evaluate without changing what you send
}
Two Ways To Run It

In our cloud, or inside yours.

Start hosted in an afternoon, or keep everything inside your network. Same engine, same results, your call.

HOSTED SDK

Drop in. One API key.

Install the SDK, point it at your workload, and Needlepath prepares the context before every model call. Start in shadow mode: watch the savings before changing anything you send.

  • TypeScript and Python clients
  • Fast and intelligent context preparation
  • Shadow mode first: zero-risk evaluation
  • Transparent pricing
Sign up to save spend and improve outcomes
ON-PREM DEPLOYMENT

Runs where your data lives.

Deployed into your VPC or data center, tuned for your workloads. Context never leaves your network, and the selection path sits next to your models.

  • Isolated deployment in your cloud or data center
  • Higher throughput with lower latency
  • Dedicated support
Book a 30-min call
Team

Hyperscale operators and engineers who built and shipped agentic infrastructure at billion-dollar revenue scale. We are building Next Moca because we know what the next ten years of enterprise AI actually need.

Kiran Kashalkar
Kiran Kashalkar
Co-CEO & Co-Founder

Repeat builder. Co-founded and served as CTO of Green Piñata Toys (acquired). Director of Engineering at Oracle (OCI) and Brightcove, with prior leadership roles at Juniper, Cisco, and others. Built and scaled world-scale services for customers like ByteDance and HBO. Architect behind Next Moca's agentic orchestration and infrastructure layers. MBA (Babson), M.S. Computer Science (Penn State), B.E. Computer Engineering (University of Mumbai).

ex-CTO Green Piñataex-Director Oracle · BrightcoveCisco · JuniperBabson MBA · Penn State MS
Swanand Rao
Swanand Rao
Co-CEO & Co-Founder

Product-driven inventor with a track record of bootstrapping new products, blending deep engineering with go-to-market focus. Director of Product at Adobe, with prior leadership roles at Microsoft, Oracle, and others. Holds multiple patents in distributed systems. Architect behind Next Moca's agentic foundations and core AI services. Executive MBA (Michigan Ross), M.S. Computer Science (USC), B.E. Computer Engineering (University of Mumbai).

ex-Director AdobeMicrosoft · OracleDistributed-systems patentsRoss EMBA · USC MS
Paru Somashekar
Paru Somashekar
Founding Member of Technical Staff · Agent Experiences

Engineering and UX leader with 25+ years at Sun Microsystems and Oracle. Founding Member of Technical Staff at Next Moca, leading Agent Experiences. Recognized expertise in UI/UX architecture, data security, and full-stack engineering. Building the intuitive, secure interfaces that bridge human creativity with intelligent automation.

Founding MTSSun · OracleUI/UX architectureFull-stack engineering
Backed by

Operators who built and shipped enterprise platforms at billion-dollar scale. They're betting on Next Moca because they've lived the problem we're solving.

Namita Dhallan
Namita Dhallan
Lead investor · Managing Partner, ND Labs

Ran product and strategy at Brightcove (CPO) and Ellucian (CPO) over two decades of enterprise SaaS leadership. Now Managing Partner at ND Labs and lead investor in Next Moca.

ND Labsex-CPO Brightcoveex-CPO EllucianEnterprise SaaS
Rohit Puri
Rohit Puri, Ph.D.
Advisor · VP of Engineering ML Platform, Capital One

Head of ML Platform at Capital One, operating production AI infrastructure for one of the largest regulated U.S. banks. Ph.D. in EECS from UC Berkeley, M.S. from UIUC, and B.Tech. from IIT Bombay.

Capital One ML HeadUC Berkeley Ph.D.Regulated enterprises
Make It Real

Make every token earn its place.

Pick one high-volume workflow. Replay your own traces, with and without Needlepath, same model. Read the report: answer quality, tokens removed, cost saved, and where it chose to stand aside.

or

kiran@nextmoca.com · swanand@nextmoca.com · Boston, MA · Palo Alto, CA

"Wrong optimization is worse than no optimization."