Data Availability is Not Data Storage

Recall this grade school experience: you raise your hand and ask, “Can I go to the bathroom?” To which your teacher responds with “I don’t know. Can you?” Might seem far fetched, but this is a perfect entry point to understanding the difference between data availability and data storage.

Let's bring this analogy close to the subject at hand and say Google Drive is acting like your teacher. You upload a photo, and the next day, you want to show that photo to a friend. You ask Google, “Can you show me the photo I uploaded yesterday?”

Imagine if Google responded, “I mean, I have it available. I can show you that photo,” and then just sent you a face cutout from the photo as proof.

You would rightfully be a bit confused. You asked to download your photo, not proof from Google that they have your photo.

The thing is, that’s the core function data availability blockchains perform. All we ask is that they provide us with proof that the chain has the data available if we need it. We don’t actually want to download all of the data from them unless we have to.

Data availability chains like Avail allow users (other blockchains) to upload data, and at a later date, simply check that all their data is available without actually retrieving the contents of the data itself. 

Read more: Unlocking the Modular Blockchain Future

This is a very different task from what data storage blockchains like Arweave, IPFS, Filecoin, and Sia are asked to perform.

Where decentralized storage chains like Arweave allow end users to store and retrieve files on the Arweave blockchain, Avail is designed to allow other chains to store their chain's activity on the Avail blockchain.

Light clients benefit the most from using Avail. They actually have a goal of never downloading data at all if they don’t have to. The more data they need to download, the more resource intensive it is to be a light client. 

Read more: Understanding Avail & Modular Blockchains through Metaphors

Avail can provide a mathematical proof that, "the data you're looking for is still here if you need it."

While that explains the differences between storage and availability, the question remains: why would you want just a guarantee of availability at all? The answer is security.

Proof that the data is around - that the data is available - is enough for light clients to be certain that no one's hiding any suspicious activity. If it's available, it's definitionally not hidden. Knowing it’s not hidden is all these light clients are looking for, because hidden data is what allows for "data withholding attacks".

What Are Data Withholding Attacks

Data withholding attacks describe a scenario where malicious validators vote to add a block containing invalid, or missing transactions to a chain. While full nodes can immediately see that the block contains an error, light clients can be fooled since they look only at block headers which are written in part by the validators.

One fix would be for light clients to download all of a block's data in order to verify correctness. But this would turn the light client into a full node, increasing resource requirements to participate in the network.

A better fix? Blockchains can upload their transaction data to Avail. Avail processes uploaded data using things like erasure coding, and KZG commitments. In this processing step, light clients are incredibly likely to find missing data by requesting a few random kilobytes from each block.

The process of sampling those few random kilobytes can be thought of as light clients checking to make sure Avail is not lying when it says it has the data available. By sampling, they ask, “Do you have all the transaction data available if I were to need it?”. If the first few samples come back positive, the light client can be statistically certain that the rest of the data is there if needed.

This lets light clients reach guarantees of data availability all on their own without the need to trust validators, and without making themselves subject to data withholding attacks.

Contrast Avail’s use with decentralized storage. Users of storage services ask, "Hey, I want to see my photo," and they expect to have all of that data explicitly retrieved and returned.

All that is to say that Avail does not compete with decentralized storage providers like Arweave, IPFS, or Filecoin.

The Avail testnet is already live with updated versions on the way. As Polygon works toward the Avail mainnet, we’re interested in partnering with any teams looking to implement data availability solutions on their chains.

If you want to learn more about Avail, or just want to ask us a question directly, we would love to hear from you. Check out our repository, join our Discord server, or email us at [email protected]

Let’s bring the world to Ethereum!

Website | Twitter | Ecosystem Twitter| Developer Twitter | Studios Twitter | Telegram | Reddit | Discord| Instagram | Facebook | LinkedIn

More from the Polygon Blog
Green Blockchain Summit 2.0: Agenda at a Glance 

Ethereum’s shift to Proof of Stake consensus, known as the Merge, has dramatically cut Polygon’s carbon dioxide emissions, opening the path to going beyond being carbon negative and toward empowering others to do the same. The conversation has shifted from blockchain sustainability to blockchain as a sustainability solution.  Join us for the second chapter of […]

Read More
Robinhood Selects Polygon to Launch Web3 Wallet Beta

Today, we are thrilled to announce that Robinhood has chosen Polygon as the first blockchain network to support its newly launched Web3 wallet. The Robinhood Wallet beta is now live for 10,000 iOS customers out of 1+ million who signed up for the waitlist in May. Together, Polygon and Robinhood are opening access to decentralized […]

Read More
What Is a zkEVM?

Zero-knowledge (ZK) tech is one of the most prominent and promising paths to scaling Ethereum. One popular use of ZK proofs to scale Ethereum is what’s known as a zkEVM (zero-knowledge Ethereum Virtual Machine). So what is a zkEVM, and how does it help us make Ethereum cheaper and more efficient to use? Understanding the […]

Read More
Polygon-Powered Icetea Labs Accelerator Launches With 6 Startups

Polygon has teamed up with Alpha Venture DAO and Icetea Labs to launch the inaugural Icetea Labs Accelerator Program for blockchain startups.  Working in a tight three-way partnership, Polygon is co-creating an accelerator to funnel resources, mentorship, education, and business acumen to promising Web3 companies from around the world. The startups selected for the accelerator […]

Read More
Apply to Polygon Bootcamp Africa and Kickstart Your Web3 Developer Journey

Applications are open for Polygon Bootcamp Africa, launched in partnership with Xend Finance! The eight-week intensive educational course and hackathon combo will put developers in Africa on the Web3 map.  This is Polygon’s biggest step in providing resources to developers, builders, and creators in Africa, and it comes during an important time.  An internet and […]

Read More
Starbucks Taps Polygon for Its 'Starbucks® Odyssey' Web3 Experience 

Today, we are thrilled to announce that Starbucks Coffee Company is working with Polygon to provide the blockchain technology to build its recently announced Web3 experience, Starbucks Odyssey. As a result of the partnership, this new Web3-powered experience will allow Starbucks Rewards loyalty program members and Starbucks partners (employees) in the United States to earn […]

Read More
Polygon Sponsors Moralis x Google 2022 ‘Defining DeFi’ Hackathon

Polygon has teamed up with Moralis and Google Cloud as an official Gold-Tier-Sponsor for the Moralis x Google 2022 Defining DeFi Hackathon!  From Oct. 3 to Nov. 11, hundreds of developers around the world will build the DeFi applications of their dreams, competing for prizes, bounties, and rewards from a pool of $155,000, with $50,000 […]

Read More
Polygon and OCEEF Bring Deep Sea Exploration to Web3

Entertainment can help people become more aware of and responsive to the problems we face. That's why Polygon has joined forces with the Ocean Conservation Exploration and Education Foundation (OCEEF) to advance ocean literacy by finding new and engaging ways to give people exposure to deep sea missions. The shared goal of this effort is […]

Read More
PolygonInsights - WEEK39

Hola readers! We announced Polygon Bootcamp Africa, an eight-week intensive educational course and hackathon combo, in partnership with Xend Finance, Polygon-based carbon compensation project Coorest has become the first Web3 initiative to have an officially verified carbon standard, and Quadrata, a passport network bringing the identity and compliance layer to public blockchains, is integrating its […]

Read More