Effective data deduplication schemes using replica management in cloud storage

Abstract

In cloud computing, data deduplication is a specialized data compression technique for removing duplicate copies of repeated data. The approach to minimize data replication in cloud storage is one of the challenging issues in processing text data. The amount of digital data has been increasing exponentially. There is a need to reduce the amount of storage space by storing the repeated data efficiently. An effective approaches of different deduplication schemes have been proposed in this research work at the target level in order to reduce the storage space in the cloud. Identification of popular and unpopular files from huge amounts of text corpus is carried out for ordering, therefore efficient storage utilization happens by minimizing the replications in multiple instances. The data privacy of cloud storage is also enhanced by secure deduplication with efficient and reliable key management system. The approaches used for deduplication to build effective cloud data storage in cloud computing are Text Intersection Deduplication System (TIDS), Secure Deduplication in Cloud Storage with Efficient Multilevel Key Management (SDCM), Feedback Deduplication System(FDS) and Document Weight Deduplication System (DWDS). Initially, text intersection deduplication system (TIDS) is proposed for minimizing the data replications in cloud storage. This technique is used to detect popular and unpopular files from the text corpus using its intersection levels, which takes two retrieval levels. After the intersection process, popular text files will be kept in all instances of cloud and unpopular files will be removed from all the secondary servers except primary server, which saves 57.61 % storage space. In the SDCM approach, data security levels are enhanced using secure deduplication with reliable and multiple key systems. Only authorized users are allowed to access the cloud services provided by this approach. Proof of ownership (PoW) is implemented to check the authorized users using inline deduplication. Encryption and decryption between file accessing in cloud is done by using two level key systems. newline