Text data analysis

In watershed management, we deal with many digital data, such as meteorology, hydrology, topography, etc. Many of them are described in "text" files. Therefore, skills of handling text files are important and useful.

You may think "Oh, I can do it with Excel". Yes, sometimes. But in sometimes, Excel takes too much effort. We need a substitute approach for such cases. Let's learn it.

Our exercise uses meteorology data observed in our campus of University of Tsukuba (CRiED):

http://www.ied.tsukuba.ac.jp/~hojyo/archives1.1/monthly/

The data is described as one file for each month. Download all data of all months from 2010 to 2017.

Exercise 1: Get all data of the year 2010.

Exercise 1': Do the same thing for the years from 2010 to 2017.

Exercise 2: The data format is described in this document:

http://www.ied.tsukuba.ac.jp/wordpress/wp-content/uploads/other_files/data_list.txt

Extract daily average temperature of each day in August 2010.

Exercise 3: Extract daily average temperature of each day from January 2010 to December 2010.

Exercise 3': Do the same thing for the years from 2010 to 2017.

Exercise 4: Draw a graph of Exercise 3.

Exercise 4': Do the same thing for the years from 2010 to 2017.

Exercise 5: Get the yearly average, maximum, and minimum daily temperature of 2010.

Exercise 5': Do the same thing for the years from 2010 to 2017.

Exercise 6: Get the yearly average, maximum, and minimum hourly temperature of 2010.

Exercise 6': Do the same thing for the years from 2010 to 2017.