Sentiment Analysis on Big Data Using Hadoop

Abstract

Big Data is the term for collection of data sets so large&complex that it becomes difficult to process using onhand Database Management tools or traditional data processing applications. In this paper we take Twitter as an example to perform sentiment analysis. Twitter, one of the largest social media site receives millions of tweets every day on variety of important issues. This huge amount of raw data can be used for industrial , Social, Economic, Government policies or business purpose by organizing according to our requirement and processing. Hadoop is one of the best tool options for twitter data analysis as it works for distributed Big data , Streaming data , Time Stamped data , text data etc. This paper discuss how to use FLUME and HIVE tool for twitter post analysis. FLUME is used to extract real time twitter data into HDFS. Hive which is SQL like query language is used for some extraction and analysis.