Skip to content

Week 03 (W48 Nov30) Global Climate Dataset

Jump to bottom
magiob edited this page Nov 28, 2016 · 44 revisions

Week 03 (W48 Nov30) Global Climate Dataset

1 - Summary

2 - Dataset Stats

Global Climate Data (GCD) : Main Dataset

  • Number of files: 100.791
  • Format: .dly files (Complete Works Wordprocessing Template)
  • Size: 26.5 GB
  • Features: 46
  • Source Date: 1763 - 2015

World Bank (WB) : Complementary Dataset

  • Number of files: 1
  • Format: .csv
  • Size: ~15 MB
  • Features: 82
  • Source Date: 1960 - 2015

3 - Goals Achieved This Week

  • Merged the datasets GCD and WB from 1960 to 2015

4 - Merging of Datasets

We extracted the data of the 5 core features (Tmax, Tmin, PRCP, SNOW, SNWD) of the GCD dataset for the 7 biggest cities of India (Week 02) with 43.87% missing values. At the same time we extracted all features of the WB dataset with missing values 49.19%. We converted the data to yearly average for GCD and kept the data from 1960 to 2015. Finally we merged both datasets into one data frame with common index (years). Below is the visualization of our dataframe, that shows the missing values. This visualization accommodates up to 50 labeled variables. Past that range labels begin to overlap or become unreadable, and by default large displays omit them.

[photo of missing]

We observe that we have a big amount of data missing from the cities of India, which results into less accurate conclusions based on data. Further we will try to interpolate some of the missing values of the features.

5 - Interpolation of Missing Values

6 - Analysis of Temperature and Precipitation of India's four biggest cities

Mumbai

The Climate of Mumbai is a tropical wet and dry climate. Mumbai's climate can be best described as moderately hot with high level of humidity. Its coastal nature and tropical location ensure temperatures won't fluctuate much throughout the year. The climate station of Mumbai is station IN012070800 (Bombay santacruz).

  • Average Maximum Temperature for Mumbai(santacruz) The Data for Maximum Temperature (TMAX) is available for the years 1957 - 1962 , then from 1973 - 2015. The Graph Below represents the mean average maximum temperature for all the available years(1957-1962,1973-2015)

Average Maximum Temperature of Mumbai(santacruz)(Celcius) Average Maximum Temperature of Mumbai(santacruz)(Celcius)

Let's examine the percentage change from 1957 to 2015: The Graph below represents the average maximum temperature for Mumbai in the intervals of ten. In 1957, the TMAX was 30.91 degrees Celsius and in 2015 it was 33.27. Average Maximum Temperature in intervals of 10 Average Maximum Temperature in intervals of 10

The percentage change of mean maximum temperature = 33.27-30.91/33.27 * 100 = 7.093 %. Let's examine the data distribution for maximum temperature for Mumbai: The histogram below represents the data distribution of max. temperature for Mumbai with 10 bins. Also, the red color line at 31.99 degrees Celsius is the mean of overall data. The maximum distribution of data is around mean from 31.5 to 32.5.

Histogram for mumbai(Data Distribution for max temperature) Histogram for Mumbai (Data Distribution for max temperature)

  • Average Minimum Temperature for Mumbai(santacruz)

The Data for Minimum Temperature (TMIN)is available for the years 1957 - 1962 , then from 1973 - 2015. The Graph Below represents the mean average minimum temperature for all the available years(1957-1962,1973-2015).

Average Minimum Temperature for Mumbai Average Minimum Temperature for Mumbai

Let's examine the percentage change from 1957 to 2015: The Graph below represents the average minimum temperature for Mumbai in the intervals of ten. In 1957 ,the TMIN was 23.92 Celsius and in 2015 it was 24.42.

AVG_MINIMUM TEMPERATURE(IN INTERVALS OF 10) Average Minimum Temperature (In intervals of 10)

The percentage change of mean minimum temperature = 24.42 - 23.92/24.42 * 100 = 2.04 %. Let's examine the data distribution for minimum temperature for Mumbai santacruz: The histogram below represents the data distribution of min. temperature for Mumbai with 10 bins. Also, the red color line at 23.04 Celsius is the mean of overall data. The maximum distribution of data is ON left side of mean from 22 to 23.

Histogram for mumbai(Data Distribution for min temperature) Histogram for Mumbai (Data Distribution for min temperature)

  • Average Precipitation for Mumbai(santacruz) The Data for Precipitation (PRCP) is available for the years 1957 - 1962, then from 1973 - 2015. The Graph Below is represents the mean average maximum temperature for all the available years (1957-1962,1973-2015).

Average precipitation for mumbai for all the years Let's examine the percentage change from 1957 to 2015:

The Graph below represents the average maximum temperature for Mumbai in the intervals of ten. In 1957,the TMAX was 26.73 and in 2015 it was 29.44.

Average precipitaion(years in the interval of 10) Average Precipitation (years in the interval of 10)

The percentage change of mean maximum temperature = 29.44 - 26.73/29.44 * 100 = 9.2 %

Let's examine the data distribution for Precipitation for Mumbai (santacruz): The histogram below represents the data distribution of precipitation for Mumbai with 10 bins. Also, the red color line at 27.36 is the mean of overall data. The maximum distribution of data is on the left side of mean from 26.5 to 28.

Histogram for mumbai(Data Distribution for precipitation) Histogram for Mumbai(Data Distribution for precipitation)

In conclusion, the mean maximum average temperatures is about 31.99°C (90 °F), while the average minimums are 23.05°C (77 °F). Average precipitation is 27.36 cm.The report according to the Indira Gandhi Institute of Development Research, Mumbai. About 7.1 million people in India would be affected by submergence of coastal lands if temperatures rise by 2 degree Celsius. The economic loss, quite naturally, would be high in urban zones such as Mumbai and Chennai. Studies conclude that Mumbai alone could suffer loses up to $48 billion due to projected submergence. Below is the concluding graph which represents TMAX, TMIN and PRCP together for Mumbai: Red line: TMAX Yellow line: TMIN Blue bars: Precipitation

MAX TEMPERATURE(RED),MINIMUM TEMPERATURE(YELLOW), PRECIPITATION(BLUE) Max Temperature (red), Minimum Temperature (yellow), Precipitation (blue)

2. Bangalore: South part of India

Bangalore has a tropical savanna climate (Köppen climate classification Aw) with distinct wet and dry seasons. Due to its high elevation, Bangalore usually enjoys a more moderate climate throughout the year, although occasional heat waves can make summer somewhat uncomfortable. The climate station of Bangalore station IN009010100 (Bangalore).

  • Average Maximum Temperature for Bangalore The Data for Maximum Temperature (TMAX) is available for the years from 1973 - 2015. The Graph Below is represent the mean average maximum temperature for all the available years(1973-2015)

Average Maximum Temperature of Bangalore(Celcius) Average Maximum Temperature of Bangalore (Celsius)

Let's examine the percentage change from 1973 to 2015: The Graph below represents the average maximum temperature for Bangalore in the intervals of ten. In 1973 ,the TMAX was 27.8 Celsius and in 2015 it was 30.25.

Average Maximum Temperature in intervals of 10 Average Maximum Temperature in intervals of 10

The percentage change of mean maximum temperature =( 30.25 - 27.8/30.25) * 100 = 8.09%. Let's examine the data distribution for maximum temperature for Bangalore Station : The histogram below represents the data distribution of max. temperature for Mumbai with 10 bins. Also, the red color line at 29.55 Celsius is the mean of overall data. The maximum distribution of data is around mean from 29.25 to 30.

Histogram for BANGALORE(Data Distribution for max temperature) Histogram for BANGALORE(Data Distribution for max temperature)

  • Average Minimum Temperature for Bangalore The Data for Minimum Temperature (TMIN) is available for the years from 1973 - 2015. The Graph Below is represents the mean average minimum temperature for all the available years (1973-2015).

Averga Minimum Temperature for Bangalore Average Minimum Temperature for Bangalore

Let's examine the percentage change from 1973 to 2015: The Graph below represents the average minimum temperature for Mumbai in the intervals of ten. In 1973, the TMIN was 18.48 Celsius and in 2015 it was 19.88.

AVG_MINIMUM TEMPERATURE(IN INTERVALS OF 10) Average minimum temperature (in intervals of 10)

The percentage change of mean minimum temperature = 19.88 - 18.48/19.88 * 100 = 7.04%. Let's examine the data distribution for minimum temperature for BANGALORE : The histogram below represents the data distribution of min. temperature for Bangalore with 10 bins. Also, the red color line at 19.01 Celsius is the mean of overall data. The maximum distribution of data is ON left side of mean from 19 to 19.5

Histogram for Bangalore(Data Distribution for min temperature) Histogram for Bangalore (Data Distribution for min temperature)

  • Average Precipitation for Bangalore The Data for Precipitation (PRCP) is available for the years 1957 - 1962 , then from 1973 - 2015. The Graph Below is represents the mean average maximum temperature for all the available years (1957-1962,1973-2015).

Average precipitation for mumbai for all the years Average precipitation for Mumbai for all the years

Let's examine the percentage change from 1957 to 2015: The Graph below represents the average maximum temperature for Mumbai in the intervals of ten. In 1957, the TMAX was 26.73 and in 2015 it was 29.44.

Average precipitation(years in the interval of 10) Average precipitation (years in the interval of 10)

The percentage change of mean maximum temperature = 29.44 - 26.73/29.44 * 100 = 9.2 %. Let's examine the data distribution for Precipitation for Mumbai: The histogram below represents the data distribution of precipitation for Mumbai with 10 bins. Also, the red color line at 27.36 is the mean of overall data. The maximum distribution of data is on the left side of mean from 26.5 to 28.

Histogram for mumbai(Data Distribution for precipitation) Histogram for Mumbai(Data Distribution for precipitation)

In conclusion, The mean maximum average temperatures is about 31.99°C (90 °F), while the average minimums are 23.05 °C (77 °F). Average precipitation is 27.36 cm. The report according to the Indira Gandhi Institute of Development Research, Mumbai. About 7.1 million people in India would be affected by submergence of coastal lands if temperatures rise by 2 degree Celsius. The economic loss, quite naturally, would be high in urban zones such as Mumbai and Chennai. Studies conclude that Mumbai alone could suffer loses up to $48 billion due to projected submergence. Below is the Concluding graph which represents TMAX, TMIN and PRCP together for Mumbai : Red line: TMAX Yellow line: TMIN Blue bars: Precipitation

MAX TEMPERATURE(RED),MINIMUM TEMPERATURE(YELLOW), PRECIPITATION(BLUE) Max Temperature (red), Minimum Temperature (yellow), Precipitation (blue)

8 - Next Week Goals

  • Correlate data from the two datasets
  • Apply interpolation to missing values
  • Extend PCA, spectrum analysis

9 - Presentation Link

References

  1. Menne, M.J., I. Durre, R.S. Vose, B.E. Gleason, and T.G. Houston, 2012: An overview of the Global Historical Climatology Network-Daily Database. Journal of Atmospheric and Oceanic Technology, 29, 897-910, doi:10.1175/JTECH-D-11-00103.1.
  2. Menne, M.J., I. Durre, B. Korzeniewski, S. McNeal, K. Thomas, X. Yin, S. Anthony, R. Ray, R.S. Vose, B.E.Gleason, and T.G. Houston, 2012: Global Historical Climatology Network - Daily (GHCN-Daily), Version 3. [indicate subset used following decimal, e.g. Version 3.12]. NOAA National Climatic Data Center. http://doi.org/10.7289/V5D21VHZ
  3. http://data.worldbank.org
  4. https://www.co2.earth/global-co2-emissions

Clone this wiki locally