Tech Bytes
Backend Infrastructure

Supabase Storage Overhaul: 14x Faster Object Listing

Dillip Chowdary

Mar 15, 2026

Supabase has announced a fundamental re-architecture of its storage engine, delivering listing speeds up to **14.8x faster** for applications managing tens of millions of objects.

As AI-native applications generate massive amounts of unstructured data—from agentic reasoning logs to vector embeddings—the traditional method of listing objects via a prefixes table has become a critical bottleneck. Supabase's new engine solves this by implementing a **Hybrid Skip-Scan Algorithm**, which bypasses redundant index entries and treats the S3-compatible metadata layer like a high-performance relational query.

The Technical Breakthrough: Skip-Scan over B-Trees

In standard Postgres-backed storage, listing files in a folder requires a full index scan of all objects sharing a prefix. For a bucket with 60 million rows, this can take seconds. The new Supabase approach utilizes a skip-scan (also known as a loose index scan). Instead of reading every row, the engine jumps to the next unique prefix in the index, drastically reducing the number of disk I/O operations. This results in sub-100ms response times for folder navigation, even in the most bloated "agent-slop" directories.

Multigres: The 2.5x Parser Speedup

Alongside the storage update, Supabase has transitioned to **Multigres**, a new high-performance Postgres parser. Previous versions relied on cgo-based wrappers for the native C parser, which introduced significant overhead during concurrent requests. Multigres is a pure-Rust implementation that is **2.5x faster** at parsing complex queries. For developers building real-time dashboards or high-frequency agentic monitors, this means lower CPU utilization and higher request throughput across the board.

Supabase Storage Technical Specs:

  • Algorithm: Hybrid Skip-Scan (O(log N) complexity for folder listing).
  • Scale: Optimized for buckets exceeding 100M objects.
  • Log Drains: Native support for Postgres, Auth, and Edge Function log exports.
  • Parser: Multigres (Rust-native) with 250% throughput gain.

Log Drains for Pro Plans

In a major win for observability, Supabase has also unlocked **Log Drains** for all Pro plan users. Developers can now export their Postgres logs, Auth events, and Edge Function executions directly to external providers like **Datadog**, **New Relic**, and **Sentry**. This integration is essential for security auditing in the age of agentic AI, allowing teams to monitor for prompt injection attempts and anomalous data exfiltration patterns in real-time.

Conclusion: Infrastructure for the Intelligence Age

The Supabase storage overhaul is a clear sign that the "backend-as-a-service" market is maturing to meet the demands of AI-scale workloads. By solving the object listing bottleneck and providing industrial-grade observability, Supabase is positioning itself as the primary choice for startups that need Postgres flexibility without the traditional scaling "taxes." In 2026, the database is no longer just a place to store data—it is the **high-performance substrate** upon which the world's most capable agents are built.

Build for Performance

Join our infrastructure newsletter for weekly technical signals and performance optimization guides for the modern backend stack.