Shredstream

Shredstream

Shredstream is a raw data stream that exposes shreds already propagated by validators as part of Solana’s Turbine dissemination layer.

It provides a direct, low-latency view of validator-propagated block data without interpretation, reconstruction, or execution semantics.

Shredstream reflects only what has already been disseminated by validators and introduces no additional assumptions.

Purpose

Shredstream is designed to:

  • expose shreds as they appear on the validator propagation path

  • provide the earliest possible view of network-visible block data

  • serve as a foundational data source for higher-level systems

Shredstream does not interpret, validate, execute, or reorder data.

Position in the data pipeline

Shredstream operates at the lowest level of the Shiroi data pipeline.

It consumes shreds from validator propagation and exposes them exactly as observed, forming the base layer upon which higher-level abstractions are built:

  • Optimistic Entry Stream (OES) interprets and reconstructs entries on top of Shredstream

  • Execution-aware systems (e.g. BBM) consume these interpretations for decision-making

Shredstream itself remains agnostic to execution and ordering.

Data semantics

Data emitted by Shredstream:

  • has already been propagated by validators

  • may be incomplete at any given moment

  • may be superseded by later shreds for the same slot

  • may ultimately be dropped due to fork selection

Shredstream makes no guarantees beyond faithful exposure of propagated data.

Latency characteristics

Shredstream prioritizes minimal and predictable latency.

It avoids aggregation, shared state, and cross-shard coordination on the hot path, allowing it to remain stable under network congestion.

Latency improvements are achieved through proximity to validator propagation rather than speculative reconstruction.

Scope and non-goals

Shredstream:

  • is not an execution feed

  • does not provide optimistic views

  • does not enforce ordering

  • does not participate in consensus

  • does not replace RPC interfaces

Its sole responsibility is exposing validator-propagated shreds.

Relationship to Optimistic Entry Stream

Shredstream is the input layer for the Optimistic Entry Stream.

While Shredstream exposes raw propagated shreds, OES builds optimistic PoH Entries and execution-aware interpretations on top of this data.

The separation ensures that optimism is explicit and isolated to higher layers.

Summary

  • Shredstream exposes raw shreds propagated by validators

  • Operates as the lowest-level data layer

  • Introduces no execution or optimistic semantics

  • Serves as the foundation for OES and execution-aware systems

Last updated