Where in the software stack should we compress data? My answer is, do compression as high in the storage stack where it works well. The storage stack In other words, if an application data can do its own compression, let it compress. Compression relies on reducing redundancies in the data set - if something can … Continue reading Where to do it? Compression
Month: December 2020
Where to do it? Layers in the storage stack
Storage operations, such as compression, tiering, and replication, may happen throughout the "storage stack", and in some cases the same general operation could happen in more than one layer of the stack. When there is a choice, choosing correctly can make a big difference in performance and scalability. But before I talk about these different … Continue reading Where to do it? Layers in the storage stack