A correlation-aware data placement strategy for key-value stores

Key-value stores hold the unprecedented bulk of the data produced by applications such as social networks. Their scalability and availability requirements often outweigh sacri cing richer data and pro- cessing models, and even elementary data consistency. Moreover, existing key-value stores have onl...

Full description

Bibliographic Details
Main Author: Vilaça, Ricardo (author)
Other Authors: Oliveira, Rui Carlos Mendes de (author), Pereira, José, 1973- (author)
Format: conferencePaper
Language:eng
Published: 2011
Subjects:
Online Access:http://hdl.handle.net/1822/14988
Country:Portugal
Oai:oai:repositorium.sdum.uminho.pt:1822/14988
Description
Summary:Key-value stores hold the unprecedented bulk of the data produced by applications such as social networks. Their scalability and availability requirements often outweigh sacri cing richer data and pro- cessing models, and even elementary data consistency. Moreover, existing key-value stores have only random or order based placement strategies. In this paper we exploit arbitrary data relations easily expressed by the application to foster data locality and improve the performance of com- plex queries common in social network read-intensive workloads. We present a novel data placement strategy, supporting dynamic tags, based on multidimensional locality-preserving mappings. We compare our data placement strategy with the ones used in existing key-value stores under the workload of a typical social network appli- cation and show that the proposed correlation-aware data placement strategy o ers a major improvement on the system's overall response time and network requirements.