Folder structure of a tar file - year/month/hour This shell script will unzip the tar file which consists of tweets from twitter. it will unzip the tar, and the hour bz2s and form a single json file for each day The output of this script is a json file which has tweets from a single day