Introducing EdgeRock · Open weights. Fixed-capacity history.

Meet the model ↗
Rock Matrix / World-State intelligence

Reason longer.Keep memoryconstant.

Intelligence should keep moving without carrying an ever-growing history. We build models that turn experience into a compact, persistent World-State.

Open weightsText + visionBounded history state
82.9%

AIME 2024–2026 mean pass@1

Reported mathematical reasoning result for EdgeRock-4B.

99.1%

Less attention KV at 256K context

72 MiB vs 8 GiB for Qwen3.5-4B. Configuration-derived BF16 cache per sequence, excluding weights and recurrent state.

4B

One open text-and-vision model

Reasoning, coding, visual understanding and instruction following. See the report ↗

01 / The memory problem

A longer horizon.
A smaller footprint.

A conversation can grow. Its memory budget does not have to.

World-State combines a recurrent summary, a local attention window and reusable memory anchors. New observations update a fixed-capacity state instead of extending an unbounded attention cache.

Inside World-State
Attention KV / Per sequence / BF16
Fixed versus growing attention memoryConfiguration-derived attention KV. EdgeRock stays at 72 MiB. Qwen3.5-4B grows from 128 MiB at 4K tokens to 8 GiB at 256K. Both axes use logarithmic spacing. 8 GiB1 GiB128 MiB64 MiB 4K16K64K256K
256K
EdgeRock-4B72 MiB
Qwen3.5-4B8 GiB
Drag to compare cache size. This is an architecture calculation, not total GPU allocation or a guarantee of accuracy at every context length. Technical report ↗

Meet EdgeRock.

Available with open weights

A compact model with room to think.

Our first World-State model brings 4B text-and-vision capability to a bounded history architecture. Built from Qwen3.5-4B, EdgeRock retains 96.3% of its source model’s reported AIME score while replacing growing full-attention history.

4B parametersText + visionRMA architecture
World-State / A fixed space for new experience
64 cells · same capacity

Illustration of bounded state updates; cells are schematic.

01 / Continuous

Recurrent state

Carry a compact summary forward, one observation at a time.

02 / Immediate

Local attention

Keep recent details available inside a fixed 1,024-token window.

03 / Selective

Memory anchors

Read useful older information from a reusable pool of 1,024 anchors per KV group.

02 / A connected research agenda

From model memory
to the machine.

Better intelligence needs more than a smaller checkpoint. We explore how state, generation and hardware can be designed together.

01

EdgeRock

Open model

Fixed-capacity history for reasoning across text and vision. The first step in the World-State research program.

Explore the architecture
02

DiffusionRock

Research direction

Use a shared World-State to condition block-parallel generation. Explore more useful work per generation step.

Explore the research
03

SiliconRock

Architecture research

Co-design fixed weights, fixed state and a specialized execution path. A million tokens per second per user is a design target, not a measured EdgeRock result.

Explore model-to-silicon
03 / Where this could lead

Intelligence that stays
close to the work.

Illustrative workflow / Agent systems
Plan→EdgeRock
Execute + remember
→Verify
A compact worker. A persistent working state.

More work between
the big decisions.

Let a frontier model set direction while compact World-State workers handle repeated subtasks. Keep the loop responsive as the work continues.

Explore agent collaboration
Illustrative deployment / Device intelligence

A world of devices.
A predictable memory budget.

Bring useful model behavior closer to local data and constrained hardware. Start with our Android text-inference development preview.

Explore device development

Application diagrams describe proposed workflows, rather than customer deployments. Device support and validation vary by runtime.

Give your next idea
a World-State.

Evaluate a model, explore a research question, or shape a deployment together.

Talk to Rock Matrix