Fork me on GitHub
 
 

Big data for Download & Experiment

Written by Aravind H.U on Jul 9, 2014

If you are passionate about BigData and want to learn and experiment the indexing and parsing big data, your primary requirement is some huge freely available data.

When I started to learn Hadoop, I found these free data sources where you can download and experiment and gather insights by using a statistical language like R or you can give this as an input to a mapreduce task which you have developed for practice.

AWS public datasets

http://aws.amazon.com/datasets

Public Data Sets on AWS provides a centralized repository of public data sets that can be seamlessly integrated into AWS cloud-based applications. AWS is hosting the public data sets at no charge for the community, and like all AWS services, users pay only for the compute and storage they use for their own applications.

Infochimps free datasets

http://www.infochimps.com/datasets

You can find lot of public datasets such as US censes data to learn and experiment Bigdata technologies.

Wikipedia

http://en.wikipedia.org/wiki/Wikipedia:Database_download

Phew, I didn't knew that wikipedia database is available for public to download for free of cost. Its massively huge so please try if you have good internet speed.

The list had lot of links by the time of this writing, but now people are aware of analytics so it is very difficult to get any valuable data to process and experiment.

Share this:

Disclaimer

I hope that you won’t object if I occasionally use contractions and the less formal “you” instead of “one” in my posts presented here. That makes writing it easier for me and ensures a less formal atmosphere.

I attempt to post articles here as carefully as possible, but I cannot guarantee absolute freedom from errors in general at this time. Please bear with me. If you would like to help me please contact me

The information contained in this website is for general information purposes only. I try to keep the information up to date and correct, I make no representations or warranties of any kind, express or implied, about the completeness, accuracy, reliability, suitability or availability with respect to the website or the information, products, services, or related graphics contained on the website for any purpose.

Any reliance you place on such information is therefore strictly at your own risk.

×