All Segments
a16z Podcast | The Storage Renaissance
14 segments available
As we enter a new era of distributed computing -- and of big data, in the form of machine and deep learning -- storage becomes (even more) important. It might not be sexy, but storage is what makes the internet and cloud computing go round and round: "Without storage, we wouldn't have databases; without databases, we wouldn't have big data; we wouldn't have analytics ... we wouldn't have anything because information needs to be stored, and it needs to be retrieved." This is especially complicated by the fact that more and more computing is happening at the edge, as with autonomous car sensing. Clearly, storage is important. But now it's also undergoing a renaissance as it becomes faster, cheaper, and more in-memory. What does this mean for all the big players in the storage ecosystem? For CIOs and IT departments? For any company competing on data, whether it's in analyzing it or owning it? And for that matter: What is data, really? Beyond the existential questions, this episode of the a16z Podcast -- with a16z partner Peter Levine; Alluxio (formerly Tachyon) founder and CEO Haoyuan Li (“HY”); and storage industry analyst Mike Matchett of The Taneja Group -- covers all this and more. It even tries to make storage, er, great again.
Segments Timeline
The Importance of Storage
In this segment, the hosts introduce the topic of storage and its critical role in computing. They emphasize that storage is often overlooked but is essential for the functioning of the internet and cloud computing. Without storage, databases and analytics wouldn't exist, highlighting the transformative period storage is currently undergoing.
"hi everyone welcome to the a6 & Z podcast I am sonal today's episode is all about storage with the cost of system memory decreasing memory for boat storage and compute will be the exact same thing so ..."
Data's Gravity and Momentum
The discussion shifts to the concept of data having gravity and momentum. The speakers explain that while compute can be ephemeral, data must have a persistent footprint. This segment explores the complexities of managing data and the evolving nature of storage solutions in response to increasing data demands.
"just have to ask why should we care about storage I feel like it's the dark underbelly of computing that no one really cares about look I mean while storage may be the underbelly without storage compu..."
The Evolution of Storage Solutions
This segment delves into the evolution of storage solutions, from basic block devices to modern object storage. The speakers discuss the innovations in open-source storage and the impact of major cloud providers on the storage landscape, emphasizing the need for new solutions to handle the growing data volumes.
"really the critical piece to get right wait what do you mean when you say that data has gravity and momentum data has to live somewhere you know compute can be spun up in a cloud it's a little ephemer..."
The New Era of Data Collection
The conversation highlights the shift in data collection methods, moving from human input to sensor-driven data acquisition, particularly in autonomous vehicles. This segment underscores the exponential growth of data and the challenges it presents for storage and processing.
"about information and data there's a an entirely new phenomena that's really just kicked in relative to what is data what is data that's a very existential question well up until right now compute dat..."
Cost and Performance of Storage
In this segment, the speakers discuss how mobile technology is influencing storage costs and performance. They predict a future where traditional storage methods like disk drives and SSDs may become obsolete, leading to a renaissance in memory-centric data systems that are faster and cheaper.
"stored in process so that's sort of that's sort of point one on what's happening secondly a mobile supply chain is influencing the data center and influencing the cost curves in the data center for st..."
The Role of In-Memory Processing
The discussion focuses on the significance of in-memory processing for machine learning applications. The speakers explain how in-memory data structures can accelerate computations, making machine learning more efficient and effective in handling large datasets.
"computing I totally grew and actually just add one more points to that is that we actually should view memory as a frontier of storage exactly it's a tier of store exactly I would argue that it is the..."
Challenges of Data Management
This segment addresses the complexities of managing data across various storage systems. The speakers highlight the difficulties organizations face in integrating and accessing data from disparate sources, emphasizing the need for improved data management strategies.
"optimized with how I organize my architecture and only store the data once only compute data once in one place to draw a fine point here we are we are entering a new world of distributed computing and..."
The Future of Distributed Computing
The conversation shifts to the future of distributed computing and its implications for data storage. The speakers discuss how data will be processed closer to where it is generated, particularly in edge computing scenarios, and the challenges this presents for traditional storage models.
"different storage systems easily and manage them efficiently so this just because they have a hodgepodge of like all these different storage systems or is it that it's just buried in the same place bu..."
The Need for Unified Storage Solutions
In this segment, the speakers discuss the necessity for unified storage solutions that can integrate various data sources. They emphasize the importance of creating a cohesive data environment to facilitate better analysis and decision-making across organizations.
"access the data from different storage systems in the most effective manner what's pausing that for a quick moment why does in-memory aspect matter so one one side is of course about performance and p..."
Machine Learning and Data-Driven Insights
The discussion highlights the role of machine learning in transforming data into actionable insights. The speakers explain how advancements in storage and processing capabilities are enabling organizations to leverage data for predictive analytics and real-time decision-making.
"having much more in process high fidelity storage that is this new tier and this exact is you know this is exactly what's causing what I would argue this renaissance to occur over the next several yea..."
The Shift in IT Departments
This segment explores how IT departments are evolving in response to the growing importance of data. The speakers discuss the cultural shift towards viewing IT as a service provider and the need for IT professionals to become data experts to support business objectives.
"so if I know this fascinating in terms of the evolution of computing but the question I have is how does this actually affect people like how does it change for better or worse their their work on the..."
The Holy Grail of Predictive Analytics
The conversation centers around the desire for predictive analytics in organizations. The speakers emphasize that the ability to forecast future events based on data is the ultimate goal for businesses, highlighting the transformative potential of advanced storage and processing technologies.
"we're seeing yeah I mean you need a new abstraction layer when there's a whole when there's an old world and you have a new world and you don't need to be stuck into this old model of how you in this ..."
The Storage Renaissance
In this concluding segment, the speakers summarize the key points discussed throughout the podcast. They reflect on the ongoing storage renaissance, driven by advancements in memory technology and the increasing importance of data in business strategy.
"unification or the silo issues so that's also a one direction while trying is this something we're seeing beyond one company like what's sort of the broad industry level view of all this there's certa..."
Looking Ahead: Data Rights and Access
The final discussion focuses on the future implications of data rights and access in the context of the Internet of Things. The speakers warn of potential data poverty for companies that fail to secure their data rights, emphasizing the need for strategic planning in data management.
"infrastructure and the idea of being able to bring machine learning and really leverage a company's data sets in a myriad of ways they have to become experts in that data in those applications because..."