Containerized image deduplication on edge using BLOCKCHAIN for optimized cloud storage
摘要
The six most popular benefits of cloud computing have revolutionized how IT companies and startups develop strategies to run their businesses. Instead of setting up and maintaining data centers and servers, companies can consume IT resources on-demand from the cloud, paying only for what they use, thereby eliminating capital expenditure. Storage cost optimization is paramount, and one effective approach is avoiding duplicate data storage. Data deduplication techniques incorporating security are critical in this context. Performing deduplication checks at the edge before storing data on the cloud offloads computation from cloud servers, reducing costs and improving efficiency. This paper proposes an Edge-Cloud Collaborative Deduplication Framework where edge servers run containerized deduplication applications aided by a blockchain-based hash table. Experimental evaluation on a cluster of four commodity edge nodes shows the proposed system can save an average of 48% cloud storage memory by avoiding duplicates. The deduplication execution time scales linearly with image size, demonstrating stable performance without memory bottlenecks. Additionally, containerization enables seamless deployment and auto-scaling, ensuring high availability and agility. These results confirm the framework’s effectiveness in optimizing cloud storage costs while preserving data security and ownership.