A New Efficient Cloud Model for Data Intensive Application

1
Rama Satish K V
Rama Satish K V
2
Dr. N P Kavya
Dr. N P Kavya

Send Message

To: Author

GJCST Volume 15 Issue B1

Article Fingerprint

ReserarchID

CSTBDIVRD

A New Efficient Cloud Model for Data Intensive Application Banner
  • English
  • Afrikaans
  • Albanian
  • Amharic
  • Arabic
  • Armenian
  • Azerbaijani
  • Basque
  • Belarusian
  • Bengali
  • Bosnian
  • Bulgarian
  • Catalan
  • Cebuano
  • Chichewa
  • Chinese (Simplified)
  • Chinese (Traditional)
  • Corsican
  • Croatian
  • Czech
  • Danish
  • Dutch
  • Esperanto
  • Estonian
  • Filipino
  • Finnish
  • French
  • Frisian
  • Galician
  • Georgian
  • German
  • Greek
  • Gujarati
  • Haitian Creole
  • Hausa
  • Hawaiian
  • Hebrew
  • Hindi
  • Hmong
  • Hungarian
  • Icelandic
  • Igbo
  • Indonesian
  • Irish
  • Italian
  • Japanese
  • Javanese
  • Kannada
  • Kazakh
  • Khmer
  • Korean
  • Kurdish (Kurmanji)
  • Kyrgyz
  • Lao
  • Latin
  • Latvian
  • Lithuanian
  • Luxembourgish
  • Macedonian
  • Malagasy
  • Malay
  • Malayalam
  • Maltese
  • Maori
  • Marathi
  • Mongolian
  • Myanmar (Burmese)
  • Nepali
  • Norwegian
  • Pashto
  • Persian
  • Polish
  • Portuguese
  • Punjabi
  • Romanian
  • Russian
  • Samoan
  • Scots Gaelic
  • Serbian
  • Sesotho
  • Shona
  • Sindhi
  • Sinhala
  • Slovak
  • Slovenian
  • Somali
  • Spanish
  • Sundanese
  • Swahili
  • Swedish
  • Tajik
  • Tamil
  • Telugu
  • Thai
  • Turkish
  • Ukrainian
  • Urdu
  • Uzbek
  • Vietnamese
  • Welsh
  • Xhosa
  • Yiddish
  • Yoruba
  • Zulu

Cloud computing play an important role in data intensive application since it provide a consistent performance over time and it provide scalability and good fault tolerant mechanism. Hadoop provide a scalable data intensive map reduce architecture. Hadoop map task are executed on large cluster and consumes lot of energy and resources. Executing these tasks requires lot of resource and energy which are expensive so minimizing the cost and resource is critical for a map reduce application. So here in this paper we propose a new novel efficient cloud structure algorithm for data processing or computation on azure cloud. Here we propose an efficient BSP based dynamic scheduling algorithm for iterative MapReduce for data intensive application on Microsoft azure cloud platform. Our framework can be used on different domain application such as data analysis, medical research, dataminining etc… Here we analyze the performance of our system by using a co-located cashing on the worker role and how it is improving the performance of data intensive application over Hadoop map reduce data intrinsic application. The experimental result shows that our proposed framework properly utilizes cloud infrastructure service (management overheads, bandwith bottleneck) and it is high scalable, fault tolerant and efficient.

26 Cites in Articles

References

  1. M Armbrust,A Fox,R Griffith,A Joseph,R Katz,A Konwinski,G Lee,D Patterson,A Rabkin,I Stoica,M Zaharia (2009). Above the Clouds: A Berkeley View of Cloud Computing.
  2. M Dikaiakos,D Katsaros,P Mehra,G Pallis,A Vakali (2009). Cloud Computing: Distributed Internet Computing for IT and Scientific Research.
  3. R Buyya,C Yeo,S Venugopal,J Broberg,I Brandic (2009). Cloud Computing and Emerging IT Platforms: Vision, Hype, and Reality for Delivering Computing as the 5th Utility.
  4. Sameer Wadkar,Madhu Siddalingaiah (2013). Monitoring Hadoop.
  5. Kashi Vishwanath,Nachiappan Nagappan (2010). Characterizing cloud computing hardware reliability.
  6. B Schroeder,G Gibson (2007). Disk Failures in the Real World: What Does an MTTF of 1,000,000 Hours Mean to You?.
  7. Feng Wang,Jie Qiu,Jie Yang,Bo Dong,Xinhui Li,Ying Li (2009). Hadoop high availability through metadata replication.
  8. Wenhao Li,Yun Yang,Jinjun Chen,Dong Yuan (2012). A Cost-Effective Mechanism for Cloud Data Reliability Management Based on Proactive Replica Checking.
  9. C Reddy (2012). A CIM (Common Information Model) Based Management Model for Clouds.
  10. Shimon Ifrah (2013). Installing a Docker Host on an Amazon EC2 Instance.
  11. Rini Kaushik,Milind Bhandarkar,Klara Nahrstedt (2010). Evaluation and Analysis of GreenHDFS: A Self-Adaptive, Energy-Conserving Variant of the Hadoop Distributed File System.
  12. Benjamin Moseley,Anirban Dasgupta,Ravi Kumar,Tamás Sarlós (2011). On scheduling in map-reduce and flow-shops.
  13. Lena Mashayekhy,Mahyar Nejad,Daniel Grosu (2013). A truthful approximation mechanism for autonomic virtual machine provisioning and allocation in clouds.
  14. Mahyar Nejad,Lena Mashayekhy,Daniel Grosu (2013). A Family of Truthful Greedy Mechanisms for Dynamic Virtual Machine Provisioning and Allocation in Clouds.
  15. Balaji Palanisamy,Aameek Singh,Ling Liu (2014). Cost-Effective Resource Provisioning for MapReduce in a Cloud.
  16. T Hacker,K Mahadik (2011). Flexible resource allocation for reliable virtual cluster computing systems.
  17. Thomas Sandholm,Kevin Lai (2009). MapReduce optimization using regulated dynamic prioritization.
  18. Xite Wang,Derong Shen,Ge Yu,Tiezheng Nie,Yue Kou (2013). A Throughput Driven Task Scheduler for Improving MapReduce Performance in Job-Intensive Environments.
  19. Zujie Ren,Jian Wan,Weisong Shi,Xianghua Xu,Min Zhou (2014). Workload Analysis, Implications, and Optimization on a Production Hadoop Cluster: A Case Study on Taobao.
  20. Mario Pastorelli,Antonio Barbuzzi,Damiano Carra,Matteo Dell'amico,Pietro Michiardi (2013). HFSP: Size-based scheduling for Hadoop.
  21. H Chang,M Kodialam,R Kompella,T Lakshman,M Lee,S Mukherjee (2011). Scheduling in mapreduce-like systems for fast completion time.
  22. Changjian Wang,Yuxing Peng,Junyi Liu,Mingxing Tang,Guangming Liu,Jinghua Feng,Pengfei You (2014). Optimal Task Scheduling in MapReduce.
  23. Qi Chen,Cheng Liu,Zhen Xiao (2014). Improving MapReduce Performance Using Smart Speculative Execution Strategy.
  24. Yang Wang,Wei Shi (2014). Budget-Driven Scheduling Algorithms for Batches of MapReduce Jobs in Heterogeneous Clouds.
  25. Amrit Pal,Sanjay Agrawal (2014). An experimental approach towards big data for analyzing memory utilization on a hadoop cluster using HDFS and MapReduce.
  26. Fan Yuanquan,Wu Weiguo,Chen Xu Yunlong,Heng Improving Map Reduce Performance by Balancing Skewed Loads.

Funding

No external funding was declared for this work.

Conflict of Interest

The authors declare no conflict of interest.

Ethical Approval

No ethics committee approval was required for this article type.

Data Availability

Not applicable for this article.

Rama Satish K V. 2015. \u201cA New Efficient Cloud Model for Data Intensive Application\u201d. Global Journal of Computer Science and Technology - B: Cloud & Distributed GJCST-B Volume 15 (GJCST Volume 15 Issue B1): .

Download Citation

Issue Cover
GJCST Volume 15 Issue B1
Pg. 19- 30
Journal Specifications

Crossref Journal DOI 10.17406/gjcst

Print ISSN 0975-4350

e-ISSN 0975-4172

Keywords
Classification
C.2.1, E.1
Version of record

v1.2

Issue date

March 17, 2015

Language

English

Experiance in AR

The methods for personal identification and authentication are no exception.

Read in 3D

The methods for personal identification and authentication are no exception.

Article Matrices
Total Views: 8250
Total Downloads: 2205
2026 Trends
Research Identity (RIN)
Related Research

Published Article

Cloud computing play an important role in data intensive application since it provide a consistent performance over time and it provide scalability and good fault tolerant mechanism. Hadoop provide a scalable data intensive map reduce architecture. Hadoop map task are executed on large cluster and consumes lot of energy and resources. Executing these tasks requires lot of resource and energy which are expensive so minimizing the cost and resource is critical for a map reduce application. So here in this paper we propose a new novel efficient cloud structure algorithm for data processing or computation on azure cloud. Here we propose an efficient BSP based dynamic scheduling algorithm for iterative MapReduce for data intensive application on Microsoft azure cloud platform. Our framework can be used on different domain application such as data analysis, medical research, dataminining etc… Here we analyze the performance of our system by using a co-located cashing on the worker role and how it is improving the performance of data intensive application over Hadoop map reduce data intrinsic application. The experimental result shows that our proposed framework properly utilizes cloud infrastructure service (management overheads, bandwith bottleneck) and it is high scalable, fault tolerant and efficient.

Our website is actively being updated, and changes may occur frequently. Please clear your browser cache if needed. For feedback or error reporting, please email [email protected]
×

This Page is Under Development

We are currently updating this article page for a better experience.

Request Access

Please fill out the form below to request access to this research paper. Your request will be reviewed by the editorial or author team.
X

Quote and Order Details

Contact Person

Invoice Address

Notes or Comments

This is the heading

Lorem ipsum dolor sit amet, consectetur adipiscing elit. Ut elit tellus, luctus nec ullamcorper mattis, pulvinar dapibus leo.

High-quality academic research articles on global topics and journals.

A New Efficient Cloud Model for Data Intensive Application

Rama Satish K V
Rama Satish K V
Dr. N P Kavya
Dr. N P Kavya

Research Journals