Analysing Apache Web Logs using Hadoop Cluster

Authors

  • R. Anandha Jothi Student, IFET College of Engineering, Gangarampalaiyam, India
  • R. Parthiban Assistant Professor, IFET College of Engineering, Gangarampalaiyam, India

DOI:

https://doi.org/10.53555/cse.v2i3.542

Keywords:

ANALYSING, APACHE, WEB, LOGS, USING, HADOOP, CLUSTER

Abstract

Today each and every domain have more impact in web. Without web and its applications nothing can be done. In web, the volume of data that are arriving, storing and retrieving is huge. As log files over the web are outsized, storage becomes a limit wherein effective techniques such as virtual database prove to be ineffectual for the same. Based on the, popularity of the products, websites etc. the trend pattern of that particular product or web site is analyzed.Hadoop offers a large scale spread consignment processing infrastructure that provides adequate data storing, distributive and analogous handling, segregation of process and fault tolerant on occurrences of data loss. Here, the semistructured data is practiced using Hadoop. Map reduce algorithm and HDFS (Hadoop Distributed File Systems) are used for analysing of any web site. 

Downloads

Download data is not yet available.

References

Q. Yang, “Introduction to the IEEE Transactions on Big Data”, IEEE Transactions on Big data, no. 1, vol. 1, pp. 2-14, January 2015.

S. Chen, Q. Wang, G. Yu and Y. Zhang, “i2MapReduce: Incremental MapReduce for Mining Evolving Big Data”, IEEE transactions on Knowledge and Data Engineering, vol. 27, no. 7, pp. 1906-1919, July 2015.

Hashem, I. Yaqoob, S. Mokhtar, A. Gani and S. Khan, “The rise of “big data” on cloudcomputing: Review and open research issues”, Elsevier, no. 47, pp. 98-115, 2015.

C. Chen, W. Myounggyu , R. Stoleru and G. G. Xie, “Energy-Efficient Fault-Tolerant Data Storage and Processing in Mobile Cloud”, IEEE Transactions on cloud computing, pp. 28-41, March 2015.

D. Dahiphale, R. Karve, A. V. Vasilakos, H. Liu, “An Advanced MapReduce: Cloud MapReduce, Enhancements and Applications”, IEEE Transactions on Network and service Management, pp. 101-115, April 2014.

Downloads

Published

2016-03-31

How to Cite

Jothi, R. A., & Parthiban, R. (2016). Analysing Apache Web Logs using Hadoop Cluster. International Journal For Research In Advanced Computer Science And Engineering, 2(3), 40–46. https://doi.org/10.53555/cse.v2i3.542