Needlepath · The Context Relevance Engine

Stop paying for stale chat history and making your AI responses worse.

AI agents pile up state: documents, tool results, approvals, history. Sending it all makes answers worse and bills bigger, and rewriting it with another AI is slow and loses details. Needlepath selects what matters before every model call... in milliseconds, with results proven on public, industry-standard tests.

SELECTION FIELD · LIVE v1 · in-process
packet: 8,192 / 8,192 tokens · 32.7% removed
+4.62 pp
better answers
than sending full-context
32.7%
fewer input tokens
than sending full context
8.5 to 14.5 ms
better context selection
with no second model deployment in the loop
$15.67 vs $23.29
lower cost
vs full context for better results
Backed & built with NVIDIA Inception Google for Startups AWS Activate Babson Butler Launchpad ND Labs
The Idea

Every model call gets a briefing. The question is who prepares it.

Before every call, something decides what the model reads. There are four ways to prepare that packet:

OPTION A

Send the complete file

The answer is in there, but buried, and you pay for every page.

OPTION B

Rewrite it shorter

A summary fits nicely, but exact names, numbers, and order details can vanish in the rewrite.

OPTION C

Heavyweight selection

Picking pages beats rewriting them, but it puts another heavyweight system in the loop for every question.

NEEDLEPATH

A focused packet of originals

Original records, untouched, selected in milliseconds. And when the whole file is what the moment needs, it hands over the whole file.

The Scoreboard

Better answers than sending everything.

Needlepath vs full context, measured on a public benchmark.

+4.62 pp
better answers than sending full-context
32.7%
fewer input tokens than sending full context. Nothing rewritten.
$15.67 vs $23.29
Same work, published test.
Full methodology and research available on request.
Request research access
The Contests

Four contests. The same public exams. Official scorers.

All four ran on public, industry-standard tests, scored by the official scoring code.

CONTEST 1

When the decisive fact is buried

The critical detail sits deep inside a 100-message thread. Sending everything put the answer in the room, surrounded by noise that cost money and competed for the model's attention.

Needlepath's focused packet beat them all, including the complete file.
CONTEST 2

When the answer cannot wait

A live conversation, where every pause is visible. Other preparation methods took from one to over thirty seconds to decide what to keep.

Needlepath decided in about a hundredth of a second.
CONTEST 3

When every field must remain exact

Orders, forms, controlled documents. A summary can be almost right and operationally wrong: a dropped decimal breaks the order.

Needlepath matched the complete file's accuracy, with forms preserved exactly.
CONTEST 4

When the complete file is the right packet

Some work needs the entire history. Needlepath ships a tested gate for exactly this: it detects those workloads and hands over exactly what you would have sent anyway, at no extra cost.

Wrong optimization is worse than no optimization. This engine acts on that.
The Difference

Where Needlepath acts, and where it stands aside.

Three disclosed cases, all in the public results. Honesty is the feature no compressor ships.

NO-OP BY DESIGN

Clean single-document inputs: nothing to select, so Needlepath does nothing, by design.

SCOPE BOUNDARY

Distractors inside a single record: Needlepath selects among records, it does not edit within them.

STAND-DOWN GATE

Agent loops where the whole history is load-bearing: the gate detects this per workload and stands aside, handing over exactly what you would have sent anyway, at no extra cost.

Wins where winning is possible. Does no harm everywhere else.
AGENT LOOPS (APPWORLD)

Stood aside on 100% of steps; the model received the full history unchanged.

FACTUAL QA (TRUTHFULQA)

Zero changed answers across configurations.

Before you commit to anything, Needlepath watches your real workloads in shadow mode and tells you honestly how much it would save, and where it would choose not to act.
By Task

The same public exam, task by task.

Per-task results, each measured against sending everything.

WIN

Finding one buried fact

+12 points at 8K, +15 at 16K

Statistically significant at both sizes.

WIN

Many needles, one answer

+13 points at both sizes

A consistent gain.

WIN

Counting and extraction

+7 to +18 points across sizes

Task-level gains at both context lengths.

WIN

Hard multi-key lookups

+12 points at 8K

Statistically significant.

HONESTY

Long-document QA

Statistically even with sending everything, within a few points in both directions.

HONESTY

Conservative by design

Keeps more or steps aside where order, forms, or answerability need coverage.

Speed And Cost

Milliseconds inside the loop.

The context decision, measured per item on the public benchmark, excluding model time.

Needlepath
8.5 to 14.5 ms
mean per decision, in-process measurement; only CPU
Others
1.13 to 32.4 s
mean per item, across items at 8K / 16K; even with some requiring GPU

Same work: $15.67 with Needlepath vs $23.29 sending everything.

How It Works

A selection layer, not a compressor.

01

Parse the objective

Evaluate the immediate request: task intent, tool intent, output type, entities.

02

Calculate relevance

Fast filters identify the records most relevant to the current task, in 8.5 to 14.5 ms per decision, with no model call.

03

Route the state

Ship the relevant records intact, preserve required evidence exactly, and pass the full context through when the workload calls for it.

Not a reranker: rerankers order retrieved documents; Needlepath decides what enters the model call at all, across documents, tool results, memory, and workflow state. Not compression: nothing is rewritten.
HOSTED API · SINGLE ENDPOINT · STATELESS
POST /v1/context/select
{
  "task":            { "query": "resolve the customer's refund request", "intent": "tool_call" },
  "records":         [ ...documents, tool results, history... ],
  "constraints":     { "max_selected_tokens": 8000 },
  "operating_point": "np-2026-07-r1",  // immutable, versioned label
  "mode":            "shadow"   // evaluate without changing what you send
}
Two Ways To Run It

In our cloud, or inside yours.

Start hosted in an afternoon, or keep everything inside your network. Same engine, same results, your call.

HOSTED SDK

Drop in. One API key.

Install the SDK, point it at your workload, and Needlepath prepares the context before every model call. Start in shadow mode: watch the savings before changing anything you send.

  • TypeScript and Python clients
  • Fast and intelligent context preparation
  • Shadow mode first: zero-risk evaluation
  • Transparent pricing
Sign up to save spend and improve outcomes
ON-PREM DEPLOYMENT

Runs where your data lives.

Deployed into your VPC or data center, tuned for your workloads. Context never leaves your network, and the selection path sits next to your models.

  • Isolated deployment in your cloud or data center
  • Higher throughput with lower latency
  • Dedicated support
Book a 30-min call
Team

Hyperscale operators and engineers who built and shipped agentic infrastructure at billion-dollar revenue scale. We are building Next Moca because we know what the next ten years of enterprise AI actually need.

Kiran Kashalkar
Kiran Kashalkar
Co-CEO & Co-Founder

Repeat builder. Co-founded and served as CTO of Green Piñata Toys (acquired). Director of Engineering at Oracle (OCI) and Brightcove, with prior leadership roles at Juniper, Cisco, and others. Built and scaled world-scale services for customers like ByteDance and HBO. Architect behind Next Moca's agentic orchestration and infrastructure layers. MBA (Babson), M.S. Computer Science (Penn State), B.E. Computer Engineering (University of Mumbai).

ex-CTO Green Piñataex-Director Oracle · BrightcoveCisco · JuniperBabson MBA · Penn State MS
Swanand Rao
Swanand Rao
Co-CEO & Co-Founder

Product-driven inventor with a track record of bootstrapping new products, blending deep engineering with go-to-market focus. Director of Product at Adobe, with prior leadership roles at Microsoft, Oracle, and others. Holds multiple patents in distributed systems. Architect behind Next Moca's agentic foundations and core AI services. Executive MBA (Michigan Ross), M.S. Computer Science (USC), B.E. Computer Engineering (University of Mumbai).

ex-Director AdobeMicrosoft · OracleDistributed-systems patentsRoss EMBA · USC MS
Paru Somashekar
Paru Somashekar
Founding Member of Technical Staff · Agent Experiences

Engineering and UX leader with 25+ years at Sun Microsystems and Oracle. Founding Member of Technical Staff at Next Moca, leading Agent Experiences. Recognized expertise in UI/UX architecture, data security, and full-stack engineering. Building the intuitive, secure interfaces that bridge human creativity with intelligent automation.

Founding MTSSun · OracleUI/UX architectureFull-stack engineering
Backed by

Operators who built and shipped enterprise platforms at billion-dollar scale. They're betting on Next Moca because they've lived the problem we're solving.

Namita Dhallan
Namita Dhallan
Lead investor · Managing Partner, ND Labs

Ran product and strategy at Brightcove (CPO) and Ellucian (CPO) over two decades of enterprise SaaS leadership. Now Managing Partner at ND Labs and lead investor in Next Moca.

ND Labsex-CPO Brightcoveex-CPO EllucianEnterprise SaaS
Rohit Puri
Rohit Puri, Ph.D.
Advisor · VP of Engineering ML Platform, Capital One

Head of ML Platform at Capital One, operating production AI infrastructure for one of the largest regulated U.S. banks. Ph.D. in EECS from UC Berkeley, M.S. from UIUC, and B.Tech. from IIT Bombay.

Capital One ML HeadUC Berkeley Ph.D.Regulated enterprises
Make It Real

Make every token earn its place.

See your own number before you spend anything. Shadow mode runs on one workflow: your traffic, your number, no commitment. The report: answer quality, tokens removed, cost saved.

or

Technical buyer? Request research access for the full methodology and benchmark material.

kiran@nextmoca.com · swanand@nextmoca.com · Boston, MA · Palo Alto, CA

"Wrong optimization is worse than no optimization."