Optimizing cloud infrastructure efficiency through advanced multimedia data deduplication techniques

Abstract

Organizations worldwide commonly utilize cloud infrastructure to manage large volumes of data, making the optimization of storage crucial for enhancing cloud performance. One effective optimization technique is data deduplication, which identifies duplicate objects and ensures that only one copy of unique data is stored in the cloud. While several deduplication schemes currently exist, there is a pressing need to improve efficiency in cloud storage through innovative approaches. In this paper, we propose a new system model designed to facilitate an efficient deduplication process. Our algorithm, called deduplication in cloud infrastructure (DCI), offers a systematic and effective method for handling deduplication challenges related to redundant data storage. DCI focuses on hash generation, metadata comparison, and pointer-based deduplication, providing a comprehensive strategy for optimizing cloud storage resources and minimizing duplication. This ultimately enhances both the efficiency and cost-effectiveness of cloud-based data management. A simulation study using CloudSim and the Hadoop distributed file system (HDFS) simulator demonstrates that the proposed deduplication method is effective. Experimental results show that our algorithm outperforms many existing solutions, achieving the highest deduplication ratio of 6.7 and saving 85.09% of storage space due to its efficient deduplication approach. The proposed system can be used in cloud infrastructures for efficiency.