Journal Title : International Journal of Modern Trends in Engineering and Science
Paper Title : CLUSTER FORMATION BASED ON MAP REDUCE TECHNIQUE APPLIED IN CLOUD ENVIRONMENT FOR RESOURCE MANAGEMENT SYSTEM
Volume 04 Issue 03 2017
ISSN no: 2348-3121
Page no: 73-76
Abstract – CLOUD computing shows a work of fiction way to supplement the current utilization and delivery model for IT services based on the Internet, by providing for dynamically scalable and often virtualized resources as a service over the Internet. We tackle the problem of dynamic resource management for a large-scale cloud environment. We honor the resource Share problem as that of dynamically maximizing the cloud utility under CPU and memory Constriction. We extend gossip protocol and map reduce framework to provide an efficient heuristic solution for the complete problem, which includes minimizing the cost for dynamic adapting a Share. The protocol continuously executes on dynamic, local input and does not require global synchronization. We propose architecture to allocate resources to a Map Reduce cluster in the Cloud. In Map Reduce, the Map function process the input in the form of key/value pairs to generate intermediate key/value pairs, and the Reduce function process all intermediate values associated with the same intermediate key generated by the Map function. In heterogeneous environments where the time to process a task varies depending on nodes, it is sometimes better to pick a remote task that runs faster on the node. Hence, we need to consider both the time required to read and the time needed to process the data, to pick the best task for the node. We achieve a metric of share in a heterogeneous cluster to realize a scheduling scheme that achieves high Concert and Fairness.
Keywords –Cloud Computing, Distributed Management, Re-source Share, Gossip Protocols
- R. Yanggratoke, F. Wuhib, and R. Stadler, “Gossip-based resource Share for green computing in large clouds,” in 2011 International Conference on Network and Service Management.
- Open Stack LLC, http://www.openstack.org, Feb. 2012.
- http://www.ibm.com/software/webserver/appserv/virtualenterprise /, Feb. 2012, “IBM Web Sphere Application Server,”
- VMware, http://www.cloudfoundry.com/, Feb. 2012.
- Amazon Web Services LLC, http://aws.amazon.com/ec2/, Feb. 2012.
- Google Inc., http://code.google.com/appengine/, Feb. 2012.
- Microsoft Inc., http://www.microsoft.com/windowsazure/, Feb. 2012.
- M. Jelasity, A. Montresor, and O. Babaoglu, “Gossip-based aggregation in large dynamic networks,” ACM Trans. Computer Syst., vol. 23, no. 3,pp. 219–252, 2005.
- “T-Man: gossip-based fast overlay topology construction,” Computer Networks, vol. 53, no. 13, pp. 2321–2339, 2009.
- F. Wuhib, R. Stadler, and M. Spreitzer, “Gossip-based resource management for cloud Environments,” in 2010 International Conference on Network and Service Management.
- F. Wuhib, M. Dam, R. Stadler, and A. Clem, “Robust monitoring of network-wide aggregates through gossiping,” IEEE Trans. Network and Service Management, vol. 6, no. 2, pp. 95–109, June 2009.
- F. Wuhib, M. Dam, and R. Stadler, “A gossiping protocol for detecting global threshold crossings,” IEEE Trans. Network and Service Management, vol. 7, no. 1, pp. 42–57, Mar. 2010.
- Z. Gong, X. Gu, and J. Wilkes, “PRESS: Predictive Elastic Resource Scaling for cloud systems,” in 2010 International Conference on Network and Service Management.
- D. Carrera, M. Steinder, I. Whalley, J. Torres, and E. Ayguade, “Utility based placement of dynamic web applications with sprite goals,” in2008 IEEE Network Operations and Management Symposium.
- S. Voulgaris, D. Gavidia, and M. van Steen, “CYCLON: in expensive membership management for unstructured p2p overlays,” J. Network and Systems Management, vol. 13, no. 2, pp. 197–217, 2005.
- C. Tang, M. Steinder, M. Spreitzer, and G. Pacifici, “A scalable application placement controller for enterprise data centers,” in 2007, International Conference on World Wide Web.