GitHub / BhagyashriT / DICLAB2-DataAggregationBigDataAnalysisAndVisualization

Collected data about from three sources, one opinion-based social media in twitter, research data in New York Times, and the third is the common crawl data for the same topic or key phrase, and from similar time periods. Processed the three data sets collected individually using classical big data methods like Map Reduce in Google Dataproc Clusters. And then compared the outcomes using popular visualization methods in tableau.

JSON API: http://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/BhagyashriT%2FDICLAB2-DataAggregationBigDataAnalysisAndVisualization

Topics: commoncrawl, crawler, dataproc, google, mapreduce, nytimes-apis, tableau, twitter-api

• Files
• Readme
• Dependencies