A New Efficient Cloud Model for Data Intensive Application

A New Efficient Cloud Model for Data Intensive Application

Rama Satish K V

Contact

Dr. N P Kavya

Contact

A New Efficient Cloud Model for Data Intensive Application

Article Fingerprint

ReserarchID

CSTBDIVRD

A New Efficient Cloud Model for Data Intensive Application Banner

AI TAKEAWAY

Connecting with the Eternal Ground

Abstract

Cloud computing play an important role in data intensive application since it provide a consistent performance over time and it provide scalability and good fault tolerant mechanism. Hadoop provide a scalable data intensive map reduce architecture. Hadoop map task are executed on large cluster and consumes lot of energy and resources. Executing these tasks requires lot of resource and energy which are expensive so minimizing the cost and resource is critical for a map reduce application. So here in this paper we propose a new novel efficient cloud structure algorithm for data processing or computation on azure cloud. Here we propose an efficient BSP based dynamic scheduling algorithm for iterative MapReduce for data intensive application on Microsoft azure cloud platform. Our framework can be used on different domain application such as data analysis, medical research, dataminining etc… Here we analyze the performance of our system by using a co-located cashing on the worker role and how it is improving the performance of data intensive application over Hadoop map reduce data intrinsic application. The experimental result shows that our proposed framework properly utilizes cloud infrastructure service (management overheads, bandwith bottleneck) and it is high scalable, fault tolerant and efficient.

References

26 Cites in Article

Reference Format

M Armbrust,A Fox,R Griffith,A Joseph,R Katz,A Konwinski,G Lee,D Patterson,A Rabkin,I Stoica,M Zaharia (2009). Above the Clouds: A Berkeley View of Cloud Computing.
M Dikaiakos,D Katsaros,P Mehra,G Pallis,A Vakali (2009). Cloud Computing: Distributed Internet Computing for IT and Scientific Research.
R Buyya,C Yeo,S Venugopal,J Broberg,I Brandic (2009). Cloud Computing and Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility.
Sameer Wadkar,Madhu Siddalingaiah (2013). Monitoring Hadoop.
Kashi Vishwanath,Nachiappan Nagappan (2010). Characterizing cloud computing hardware reliability.
B Schroeder,G Gibson (2007). Disk Failures in the Real World: What Does an MTTF of 1,000,000 Hours Mean to You?.
Feng Wang,Jie Qiu,Jie Yang,Bo Dong,Xinhui Li,Ying Li (2009). Hadoop high availability through metadata replication.
Wenhao Li,Yun Yang,Jinjun Chen,Dong Yuan (2012). A Cost-Effective Mechanism for Cloud Data Reliability Management Based on Proactive Replica Checking.
C Reddy (2012). A CIM (Common Information Model) Based Management Model for Clouds.
Shimon Ifrah (2013). Installing a Docker Host on an Amazon EC2 Instance.
Rini Kaushik,Milind Bhandarkar,Klara Nahrstedt (2010). Evaluation and Analysis of GreenHDFS: A Self-Adaptive, Energy-Conserving Variant of the Hadoop Distributed File System.
Benjamin Moseley,Anirban Dasgupta,Ravi Kumar,Tamás Sarlós (2011). On scheduling in map-reduce and flow-shops.
Lena Mashayekhy,Mahyar Nejad,Daniel Grosu (2013). A truthful approximation mechanism for autonomic virtual machine provisioning and allocation in clouds.
Mahyar Nejad,Lena Mashayekhy,Daniel Grosu (2013). A Family of Truthful Greedy Mechanisms for Dynamic Virtual Machine Provisioning and Allocation in Clouds.
Balaji Palanisamy,Aameek Singh,Ling Liu (2014). Cost-Effective Resource Provisioning for MapReduce in a Cloud.
T Hacker,K Mahadik (2011). Flexible resource allocation for reliable virtual cluster computing systems.
Thomas Sandholm,Kevin Lai (2009). MapReduce optimization using regulated dynamic prioritization.
Xite Wang,Derong Shen,Ge Yu,Tiezheng Nie,Yue Kou (2013). A Throughput Driven Task Scheduler for Improving MapReduce Performance in Job-Intensive Environments.
Zujie Ren,Jian Wan,Weisong Shi,Xianghua Xu,Min Zhou (2014). Workload Analysis, Implications, and Optimization on a Production Hadoop Cluster: A Case Study on Taobao.
Mario Pastorelli,Antonio Barbuzzi,Damiano Carra,Matteo Dell'amico,Pietro Michiardi (2013). HFSP: Size-based scheduling for Hadoop.
H Chang,M Kodialam,R Kompella,T Lakshman,M Lee,S Mukherjee (2011). Scheduling in mapreduce-like systems for fast completion time.
Changjian Wang,Yuxing Peng,Junyi Liu,Mingxing Tang,Guangming Liu,Jinghua Feng,Pengfei You (2014). Optimal Task Scheduling in MapReduce.
Qi Chen,Cheng Liu,Zhen Xiao (2014). Improving MapReduce Performance Using Smart Speculative Execution Strategy.
Yang Wang,Wei Shi (2014). Budget-Driven Scheduling Algorithms for Batches of MapReduce Jobs in Heterogeneous Clouds.
Amrit Pal,Sanjay Agrawal (2014). An experimental approach towards big data for analyzing memory utilization on a hadoop cluster using HDFS and MapReduce.
Fan Yuanquan,Wu Weiguo,Chen Xu Yunlong,Heng Improving Map Reduce Performance by Balancing Skewed Loads.

Download References

Funding

No external funding was declared for this work.

Conflict of Interest

The authors declare no conflict of interest.

Ethical Approval

No ethics committee approval was required for this article type.

Data Availability

Not applicable for this article.

How to Cite This Article

Rama Satish K V. 2015. \u201cA New Efficient Cloud Model for Data Intensive Application\u201d. Global Journal of Computer Science and Technology - B: Cloud & Distributed GJCST-B Volume 15 (GJCST Volume 15 Issue B1): .

More Citation Formats

Select Citation Style:

Download Citation

Download Article

GJCST Volume 15 Issue B1
Pg. 19- 30

Explore Journals Explore Volume Read This Issue

Journal Specifications

Crossref Journal DOI 10.17406/gjcst

Print ISSN 0975-4350

e-ISSN 0975-4172

Keywords

Not Found

Classification

C.2.1, E.1

Submission ReceivedDecember 16, 2014
Peer Review Double Blind
Handling Editor
Accepted January 3, 2015
Published January 15, 2015

Version of record

v1.2

Issue date

March 17, 2015

Language

Experiance in AR

Explore published articles in an immersive Augmented Reality environment. Our platform converts research papers into interactive 3D books, allowing readers to view and interact with content using AR and VR compatible devices.

View in VR

Read in 3D

Your published article is automatically converted into a realistic 3D book. Flip through pages and read research papers in a more engaging and interactive format.

View in 3D

Article Matrices

Total Score: 107

Country: India

Subject: Global Journal of Computer Science and Technology - B: Cloud & Distributed

Authors: Rama Satish K V, Dr. N P Kavya (PhD/Dr. count: 1)

View Count (all-time): 290

Total Views (Real + Logic): 8306

Total Downloads (simulated): 2277

Publish Date: 2015 03, Tue

Monthly Totals (Real + Logic):

Month 1: 57 views
Month 2: 65 views
Month 3: 60 views
Month 4: 44 views
Month 5: 31 views
Month 6: 22 views
Month 7: 34 views
Month 8: 41 views
Month 9: 42 views
Month 10: 36 views
Month 11: 37 views
Month 12: 43 views
Month 13: 15 views
Month 14: 23 views
Month 15: 37 views
Month 16: 17 views
Month 17: 42 views
Month 18: 23 views
Month 19: 18 views
Month 20: 24 views
Month 21: 30 views
Month 22: 30 views
Month 23: 42 views
Month 24: 27 views
Month 25: 38 views
Month 26: 30 views
Month 27: 26 views
Month 28: 41 views
Month 29: 22 views
Month 30: 42 views
Month 31: 46 views
Month 32: 10 views
Month 33: 16 views
Month 34: 16 views
Month 35: 38 views
Month 36: 34 views
Month 37: 27 views
Month 38: 26 views
Month 39: 45 views
Month 40: 10 views
Month 41: 32 views
Month 42: 18 views
Month 43: 35 views
Month 44: 24 views
Month 45: 28 views
Month 46: 30 views
Month 47: 22 views
Month 48: 17 views
Month 49: 39 views
Month 50: 44 views
Month 51: 37 views
Month 52: 37 views
Month 53: 17 views
Month 54: 32 views
Month 55: 33 views
Month 56: 29 views
Month 57: 29 views
Month 58: 26 views
Month 59: 11 views
Month 60: 29 views
Month 61: 43 views
Month 62: 23 views
Month 63: 37 views
Month 64: 23 views
Month 65: 20 views
Month 66: 21 views
Month 67: 47 views
Month 68: 16 views
Month 69: 35 views
Month 70: 18 views
Month 71: 16 views
Month 72: 29 views
Month 73: 42 views
Month 74: 40 views
Month 75: 43 views
Month 76: 13 views
Month 77: 31 views
Month 78: 36 views
Month 79: 18 views
Month 80: 40 views
Month 81: 34 views
Month 82: 34 views
Month 83: 26 views
Month 84: 28 views
Month 85: 11 views
Month 86: 23 views
Month 87: 26 views
Month 88: 50 views
Month 89: 22 views
Month 90: 27 views
Month 91: 33 views
Month 92: 28 views
Month 93: 32 views
Month 94: 24 views
Month 95: 22 views
Month 96: 41 views
Month 97: 37 views
Month 98: 42 views
Month 99: 28 views
Month 100: 29 views
Month 101: 33 views
Month 102: 26 views
Month 103: 29 views
Month 104: 35 views
Month 105: 30 views
Month 106: 37 views
Month 107: 37 views
Month 108: 27 views
Month 109: 37 views
Month 110: 27 views
Month 111: 33 views
Month 112: 33 views
Month 113: 27 views
Month 114: 31 views
Month 115: 36 views
Month 116: 21 views
Month 117: 35 views
Month 118: 32 views
Month 119: 41 views
Month 120: 32 views
Month 121: 30 views
Month 122: 38 views
Month 123: 39 views
Month 124: 19 views
Month 125: 32 views
Month 126: 28 views
Month 127: 45 views
Month 128: 31 views
Month 129: 38 views
Month 130: 48 views
Month 131: 30 views
Month 132: 66 views
Month 133: 57 views
Month 134: 35 views

Total Views: 8306

Total Downloads: 2277

2026 Trends

Published Article

Our website is actively being updated, and changes may occur frequently. Please clear your browser cache if needed. For feedback or error reporting, please email [email protected]