For Project Enquiry +91 9962 067 067

ORCHESTRATING BULK DATA TRANSFERS ACROSS GEO-DISTRIBUTED DATACENTERS

ABSTRACT

            In this paper we study about cloud providers to host multiple datacenters around the globe, significant demands exist for inter-datacenter data transfers in large volumes, e.g., migration of big data. A challenge arises on how to schedule the bulk data transfers at different urgency levels, in order to fully utilize the available inter-datacenter bandwidth. The Software Defined Networking paradigm has emerged recently which decouples the control plane from the data paths, enabling potential global optimization of data routing in a network. This paper aims to design a dynamic, highly efficient bulk data transfer service in a geo-distributed datacenter system, and engineer its design and solution algorithms closely within SDN architecture. We model data transfer demands as delay tolerant migration requests with different finishing deadlines. An optimal chunk routing optimization model is formulated to solve for the best chunk transfer schedules over time. We build an SDN system based on the Beacon platform and Open Flow APIs, and carefully engineer our bulk data transfer algorithms in the system. Extensive real-world experiments are carried out to compare the three algorithms as well as those from the existing literature, in terms of routing optimality, computational delay and overhead.

EXISTING SYSTEM	PROPOSED SYSTEM
EXISTING CONCEPT:- In the existing system we build an SDN system based on the Beacon platform and Open Flow APIs, and carefully engineer our bulk data transfer algorithms in the system.   Extensive real-world experiments are carried out to compare the three algorithms as well as those from the existing literature, in terms of routing optimality, computational delay and overhead.	PROPOSED CONCEPT:- In the proposed system We have implemented a prototype bulk data transfer (BDT) system based on the Open Flow framework.   The BDT system resides above the transport layer in the network stack, with no special requirements on the lower transport layer and network layer protocols, where the standard TCP/IP stack is adopted.
EXISTING ALGORITHM:- centralized optimization algorithm	PROPOSED ALGORITHM:- bandwidth-reserving algorithm, dynamically-adjusting algorithm
TECHNIQUE DEFNITION:- We build an SDN system based on the Beacon platform and OpenFlow APIs, and carefully engineer our bulk data transfer algorithms in the system. Extensive real-world experiments are carried out to compare the three algorithms as well as those from the existing literature, in terms of routing optimality, computational delay and overhead.	TECHNIQUE DEFNITION:- It applies the time expansion graph technique which is later adopted by Postcard whose computation overhead prevents the scheduling from happening as frequently as ours.
DRAWBACKS:- Exploit lower power cost, and enable service robustness in the face of network/power failures.	ADVANTAGES: Reliable and efficient underlying bulk data transfer service in an inter-datacenter network.