RepRes_analysis.Rmd

---
title: "Harm From Severe Weather Events To Population Health And Economy In United States"
author: "JZstats"
date: "4/26/2020"
output: md_document
always_allow_html: true
---

<font size="2">[read the SYNOPSIS](#ind-3--SYNOPSIS)</font>  

<br>  
<br>  


***  
# 1 TABLE OF CONTENTS {#ind-1--TABLE-OF-CONTENTS}  
***  

* [1 TABLE OF CONTENTS](#ind-1--TABLE-OF-CONTENTS)  
* [2 PROLOGUE](#ind-2--PROLOGUE)  
  * [2.1 About The Assignment](#ind-2-1--About-The-Assignment)  
  * [2.2 About The Main Script](#ind-2-2--About-The-Main-Script)  
  * [2.3 About The Report](#ind-2-3--About-The-Report)  
* [3 SYNOPSIS](#ind-3--SYNOPSIS)  
* [4 STORM EVENTS DATASET](#ind-4--STORM-EVENTS-DATASET)  
  * [4.1 General Informations](#ind-4-1--General-Informations)  
  * [4.2 Points Of Interest](#ind-4-2--Points-Of-Interest)  
    * [4.2.1 Changes in the composition of weather event types](#ind-4-2-1--Changes-in-the-composition-of-weather-event-types)  
    * [4.2.2 Eligibility criteria for inclusion of weather events in the dataset](#ind-4-2-2--Eligibility-criteria-for-inclusion-of-weather-events-in-the-dataset)
* [5 PRELIMINARY ACTIVITIES](#ind-5--PRELIMINARY-ACTIVITIES)  
  * [5.1 Set The Random Seed](#ind-5-1--Set-The-Random-Seed)  
  * [5.2 Load All Required Libraries](#ind-5-2--Load-All-Required-Libraries)  
  * [5.3 Create All Required Directories](#ind-5-3--Create-All-Required-Directories)  
  * [5.4 Access The File With The Raw Data](#ind-5-4--Access-The-File-With-The-Raw-Data)  
* [6 DATA PROCESSING](#ind-6--DATA-PROCESSING)  
  * [6.1 Load The Raw Data In R](#ind-6-1--Load-The-Raw-Data-In_R)  
    * [6.1.1 Create the table with the raw data](#ind-6-1-1--Create-the-table-with-the-raw-data)  
    * [6.1.2 Conduct post validation for the table with the raw data](#ind-6-1-2--Conduct-post-validation-for-the-table-with-the-raw-data)  
    * [6.1.3 Overview of the table with the raw data](#ind-6-1-3--Overview-of-the-table-with-the-raw-data)  
  * [6.2 Preprocess The Raw Data](#ind-6-2--Preprocess-The-Raw-Data)  
    * [6.2.1 Verify the prerequisites for the selected variables](#ind-6-2-1--Verify-the-prerequisites-for-the-selected-variables)  
      * [6.2.1.1 Verify the coercibility of the values for the selected variables](#ind-6-2-1-1--Verify-the-coercibility-for-the-values-at-the-selected-variables)  
      * [6.2.1.2 Verify the uniqueness of the key values](#ind-6-2-1-2--Verify-the-uniqueness-of-the-key-values)  
    * [6.2.2 Create the table with the preprocessed data](#ind-6-2-2--Create-the-table-with-the-preprocessed-data)  
    * [6.2.3 Conduct post validation for the table with the preprocessed data](#ind-6-2-3--Conduct-post-validation-for-the-table-with-the-preprocessed-data)  
    * [6.2.4 Overview of the table with the preprocessed data](#ind-6-2-4--Overview-of-the-table-with-the-preprocessed-data)  
  * [6.3 Extract The Target Data Subset](#ind-6-3--Extract-The-Target-Data-Subset)  
    * [6.3.1 Identify the target subset of observations](#ind-6-3-1--Identify-the-target-subset-of-observations)  
      * [6.3.1.1 Verify the consistency of date format](#ind-6-3-1-1--Verify-the-consistency-of-date-format)  
      * [6.3.1.2 Identify the eligible observations](#ind-6-3-1-2--Identify-the-eligible-observations)  
    * [6.3.2 Create the table with the target data subset](#ind-6-3-2--Create-the-table-with-the-target-data-subset)  
    * [6.3.3 Conduct post validation for the table with the target data subset](#ind-6-3-3--Conduct-post-validation-for-the-table-with-the-target-data-subset)  
    * [6.3.4 Overview of the table with the target data subset](#ind-6-3-4--Overview-of-the-table-with-the-target-data-subset)  
  * [6.4 Conduct In-Record Data Validation](#ind-6-4--Conduct-In-Record-Data-Validation)  
    * [6.4.1 Introduce information from the Strom Data Documentation](#ind-6-4-1--Introduce-information-from-the-Strom-Data-Documentation)  
      * [6.4.1.1 Valid values for the EVTYPE variable](#ind-6-4-1-1--Valid-values-for-the-EVTYPE-variable)  
      * [6.4.1.2 Valid values for the PROPDMGEXP variable](#ind-6-4-1-2--Valid-values-for-the-PROPDMGEX-variable)  
      * [6.4.1.3 Valid values for the CROPDMGEXP variable](#ind-6-4-1-3--Valid-values-for-the-CROPDMGEX-variable)  
    * [6.4.2 Conduct in-record data validation for each variable](#ind-6-4-2--Conduct-in-record-data-validation-for-each-variable)  
    * [6.4.3 Create the table with the in-record validated data](#ind-6-4-3--Create-the-table-with-the-in-record-validated-data)  
    * [6.4.4 Conduct post validation for the table with the in-record validated data](#ind-6-4-4--Conduct-post-validation-for-the-table-with-the-in-record-validated-data)  
    * [6.4.5 Overview of the table with the in-record validated data](#ind-6-4-5--Overview-of-the-table-with-the-in-record-validated-data)  
  * [6.5 Impute Missing Values](#ind-6-5--Impute-Missing-Values)  
    * [6.5.1 Impute missing values at the variable EVTYPE](#ind-6-5-1--Impute-missing-values-at-the-variable-EVTYPE)  
      * [6.5.1.1 Examine the invalid values from the variable EVTYPE](#ind-6-5-1-1--Examine-the-invalid-values-from-the-variable-EVTYPE)  
      * [6.5.1.2 Associate plausible substitutions to the invalid values from the variable EVTYPE](#ind-6-5-1-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-EVTYPE)  
      * [6.5.1.3 Identify the imputable missing values at the variable EVTYPE](#ind-6-5-1-3--Identify-the-imputable-missing-values-at-the-variable-EVTYPE)  
      * [6.5.1.4 Substitute the imputable missing values at the variable EVTYPE](#ind-6-5-1-4--Substitute-the-imputable-missing-values-at-the-variable-EVTYPE)  
    * [6.5.2 Impute missing values at the variable PROPDMGEXP](#ind-6-5-2--Impute-missing-values-at-the-variable-PROPDMGEXP)  
      * [6.5.2.1 Examine the invalid values from the variable PROPDMGEXP](#ind-6-5-2-1--Examine-the-invalid-values-from-the-variable-PROPDMGEXP)     
      * [6.5.2.2 Associate plausible substitutions to the invalid values from the variable PROPDMGEXP](#ind-6-5-2-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-PROPDMGEXP)  
      * [6.5.2.3 Identify the imputable missing values at the variable PROPDMGEXP](#ind-6-5-2-3--Identify-the-imputable-missing-values-at-the-variable-PROPDMGEXP)  
      * [6.5.2.4 Substitute the imputable missing values at the variable PROPDMGEXP](#ind-6-5-2-4--Substitute-the-imputable-missing-values-at-the-variable-PROPDMGEXP)  
    * [6.5.3 Impute missing values at the variable CROPDMGEXP](#ind-6-5-3--Impute-missing-values-at-the-variable-CROPDMGEXP)  
      * [6.5.3.1 Examine the invalid values from the variable CROPDMGEXP](#ind-6-5-3-1--Examine-the-invalid-values-from-the-variable-CROPDMGEXP)     
      * [6.5.3.2 Associate plausible substitutions to the invalid values from the variable CROPDMGEXP](#ind-6-5-3-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-CROPDMGEXP)  
      * [6.5.3.3 Identify the imputable missing values at the variable CROPDMGEXP](#ind-6-5-3-3--Identify-the-imputable-missing-values-at-the-variable-CROPDMGEXP)  
      * [6.5.3.4 Substitute the imputable missing values at the variable CROPDMGEXP](#ind-6-5-3-4--Substitute-the-imputable-missing-values-at-the-variable-CROPDMGEXP)  
    * [6.5.4 Conduct post validation for the table with the imputed data](#ind-6-5-4--Conduct-post-validation-for-the-table-with-the-imputed-data)  
    * [6.5.5 Overview of the table with the imputed data](#ind-6-5-5--Overview-of-the-table-with-the-imputed-data)  
  * [6.6 Conduct Cross-Record Data Validation](#ind-6-6--Conduct-Cross-Record-Data-Validation)  
    * [6.6.1 Identify all valid observations](#ind-6-6-1--Identify-all-valid-observations)  
    * [6.6.2 Create the table with the cross-record validated data](#ind-6-6-2--Create-the-table-with-the-cross-record-validated-data)  
    * [6.6.3 Conduct post validation for table with the cross-record validated data](#ind-6-6-3--Conduct-post-validation-for-table-with-the-cross-record-validated-data)  
    * [6.6.4 Overview of the table with the cross-record validated data](#ind-6-6-4--Overview-of-the-table-with-the-cross-record-validated-data)  
  * [6.7 Produce The Processed Data](#ind-6-7--Produce-The-Processed-Data)  
    * [6.7.1 Create the table with the processed data](#ind-6-7-1--Create-the-table-with-the-processed-data)  
    * [6.7.2 Conduct post validation for the table with the processed data](#ind-6-7-2--Conduct-post-validation-for-the-table-with-the-processed-data)  
* [7 PROCESSED DATA](#ind-7--PROCESSED-DATA)  
  * [7.1 Information For The Table With The Processed Data](#ind-7-1--Information-For-The-Table-With-The-Processed-Data)  
  * [7.2 Overview Of The Table With The Processed Data](#ind-7-2--Overview-Of-The-Table-With-The-Processed-Data)  
  * [7.3 Export The Table With The Processed Data](#ind-7-3--Export-The-Table-With-The-Processed-Data)  
* [8 HARM ON POPULATION HEALTH](#ind-8--HARM-ON-POPULATION-HEALTH)  
  * [8.1 Harm On Population Health With Respect To Fatalities By Each Weather Event Type](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)  
    * [8.1.1 Extract the target data for harm on population health with respect to fatalities](#ind-8-1-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-fatalities)  
    * [8.1.2 Process the target data for harm on population health with respect to fatalities](#ind-8-1-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-fatalities)  
    * [8.1.3 Summarize the processed data for harm on population health with respect to fatalities by each weather event type](#ind-8-1-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)  
    * [8.1.4 Visualize the results of the summary for the harm on population health with respect to fatalities by each weather event type](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)  
      * [8.1.4.1 Create the components of Multiplot 1.1](#ind-8-1-4-1--Create-the-components-of-Multiplot-1-1)  
        * [8.1.4.1.1 Create The Plot 1.1.1](#ind-8-1-4-1-1--Create-The-Plot-1-1-1)  
        * [8.1.4.1.2 Create The Plot 1.1.2](#ind-8-1-4-1-2--Create-The-Plot-1-1-2)  
        * [8.1.4.1.3 Create The Plot 1.1.3](#ind-8-1-4-1-3--Create-The-Plot-1-1-3)  
        * [8.1.4.1.4 Create The Plot 1.1.4](#ind-8-1-4-1-4--Create-The-Plot-1-1-4)  
      * [8.1.4.2 Compose the Multiplot 1.1](#ind-8-1-4-2--Compose-the-Multiplot-1-1)  
   * [8.2 Harm On Population Health With Respect To Injuries By Each Weather Event Type](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)  
     * [8.2.1 Extract the target data for harm on population health with respect to injuries](#ind-8-2-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-injuries)  
     * [8.2.2 Process the target data for harm on population health with respect to injuries](#ind-8-2-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-injuries)  
     * [8.2.3 Summarize the processed data for harm on population health with respect to injuries by each weather event type](#ind-8-2-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)  
     * [8.2.4 Visualize the results of the summary for the harm on population health with respect to injuries by each weather event type](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)  
       * [8.2.4.1 Create the components of Multiplot 1.2](#ind-8-2-4-1--Create-the-components-of-Multiplot-1-2)  
         * [8.2.4.1.1 Create The Plot 1.2.1](#ind-8-2-4-1-1--Create-The-Plot-1-2-1)  
         * [8.2.4.1.2 Create The Plot 1.2.2](#ind-8-2-4-1-2--Create-The-Plot-1-2-2)  
         * [8.2.4.1.3 Create The Plot 1.2.3](#ind-8-2-4-1-3--Create-The-Plot-1-2-3)  
         * [8.2.4.1.4 Create The Plot 1.2.4](#ind-8-2-4-1-4--Create-The-Plot-1-2-4)  
       * [8.2.4.2 Compose the Multiplot 1.2](#ind-8-2-4-2--Compose-the-Multiplot-1-2)  
  * [8.3 Harm On Population Health With Respect To Casualties By Each Weather Event Type](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)  
    * [8.3.1 Extract the target data for harm on population health with respect to casualties](#ind-8-3-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-casualties)  
    * [8.3.2 Process the target data for harm on population health with respect to casualties](#ind-8-3-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-casualties)  
    * [8.3.3 Summarize the processed data for harm on population health with respect to casualties by each weather event type](#ind-8-3-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)  
    * [8.3.4 Visualize the results of the summary for the harm on population health with respect to casualties by each weather event type](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)  
      * [8.3.4.1 Create the components of Multiplot 1.3](#ind-8-3-4-1--Create-the-components-of-Multiplot-1-3)  
        * [8.3.4.1.1 Create The Plot 1.3.1](#ind-8-3-4-1-1--Create-The-Plot-1-3-1)  
        * [8.3.4.1.2 Create The Plot 1.3.2](#ind-8-3-4-1-2--Create-The-Plot-1-3-2)  
        * [8.3.4.1.3 Create The Plot 1.3.3](#ind-8-3-4-1-3--Create-The-Plot-1-3-3)  
        * [8.3.4.1.4 Create The Plot 1.3.4](#ind-8-3-4-1-4--Create-The-Plot-1-3-4)  
      * [8.3.4.2 Compose the Multiplot 1.3](#ind-8-3-4-2--Compose-the-Multiplot-1-3)  
* [9 HARM ON ECONOMY](#ind-9--HARM-ON-ECONOMY)  
  * [9.1 Harm On Economy With Respect To Property Damage By Each Weather Event Type](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)  
    * [9.1.1 Extract the target data for harm on economy with respect to property damage](#ind-9-1-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-property-damage)  
    * [9.1.2 Process the target data for harm on economy with respect to property damage](#ind-9-1-2--Process-the-target-data-for-harm-on-economy-with-respect-to-property-damage)  
    * [9.1.3 Summarize the processed data for harm on economy with respect to property damage by each weather event type](#ind-9-1-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)  
    * [9.1.4 Visualize the results of the summary for the harm on economy with respect to property damage by each weather event type](#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)  
      * [9.1.4.1 Create the components of Multiplot 2.1](#ind-9-1-4-1--Create-the-components-of-Multiplot-2-1)  
        * [9.1.4.1.1 Create The Plot 2.1.1](#ind-9-1-4-1-1--Create-The-Plot-2-1-1)  
        * [9.1.4.1.2 Create The Plot 2.1.2](#ind-9-1-4-1-2--Create-The-Plot-2-1-2)  
        * [9.1.4.1.3 Create The Plot 2.1.3](#ind-9-1-4-1-3--Create-The-Plot-2-1-3)  
        * [9.1.4.1.4 Create The Plot 2.1.4](#ind-9-1-4-1-4--Create-The-Plot-2-1-4)  
      * [9.1.4.2 Compose the Multiplot 2.1](#ind-9-1-4-2--Compose-the-Multiplot-2-1)  
  * [9.2 Harm On Economy With Respect To Crop Damage By Each Weather Event Type](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)  
    * [9.2.1 Extract the target data for harm on economy with respect to crop damage](#ind-9-2-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-crop-damage)  
    * [9.2.2 Process the target data for harm on economy with respect to crop damage](#ind-9-2-2--Process-the-target-data-for-harm-on-economy-with-respect-to-crop-damage)  
    * [9.2.3 Summarize the processed data for harm on economy with respect to crop damage by each weather event type](#ind-9-2-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)  
    * [9.2.4 Visualize the results of the summary for the harm on economy with respect to crop damage by each weather event type](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)  
      * [9.2.4.1 Create the components of Multiplot 2.2](#ind-9-2-4-1--Create-the-components-of-Multiplot-2-2)  
        * [9.2.4.1.1 Create The Plot 2.2.1](#ind-9-2-4-1-1--Create-The-Plot-2-2-1)  
        * [9.2.4.1.2 Create The Plot 2.2.2](#ind-9-2-4-1-2--Create-The-Plot-2-2-2)  
        * [9.2.4.1.3 Create The Plot 2.2.3](#ind-9-2-4-1-3--Create-The-Plot-2-2-3)  
        * [9.2.4.1.4 Create The Plot 2.2.4](#ind-9-2-4-1-4--Create-The-Plot-2-2-4)  
      * [9.2.4.2 Compose the Multiplot 2.2](#ind-9-2-4-2--Compose-the-Multiplot-2-2)  
  * [9.3 Harm On Economy With Respect To Economic Damage By Each Weather Event Type](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)  
    * [9.3.1 Extract the target data for harm on economy with respect to economic damage](#ind-9-3-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-economic-damage)  
    * [9.3.2 Process the target data for harm on economy with respect to economic damage](#ind-9-3-2--Process-the-target-data-for-harm-on-economy-with-respect-to-economic-damage)  
    * [9.3.3 Summarize the processed data for harm on economy with respect to economic damage by each weather event type](#ind-9-3-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)  
    * [9.3.4 Visualize the results of the summary for the harm on economy with respect to economic damage by each weather event type](#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)  
      * [9.3.4.1 Create the components of Multiplot 2.3](#ind-9-3-4-1--Create-the-components-of-Multiplot-2-3)  
        * [9.3.4.1.1 Create The Plot 2.3.1](#ind-9-3-4-1-1--Create-The-Plot-2-3-1)  
        * [9.3.4.1.2 Create The Plot 2.3.2](#ind-9-3-4-1-2--Create-The-Plot-2-3-2)  
        * [9.3.4.1.3 Create The Plot 2.3.3](#ind-9-3-4-1-3--Create-The-Plot-2-3-3)  
        * [9.3.4.1.4 Create The Plot 2.3.4](#ind-9-3-4-1-4--Create-The-Plot-2-3-4)  
      * [9.3.4.2 Compose the Multiplot 2.3](#ind-9-3-4-2--Compose-the-Multiplot-2-3)  
* [10 RESULTS](#ind-10--RESULTS)  
  * [10.1 Question 1: Across the United States, which types of events 
  (as indicated in the EVTYPE variable) are most harmful 
  with respect to population health?](#ind-10-1--results-harm-on-population-health)  
    * [10.1.1 Overview of results for the harm on population health](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health)  
    * [10.1.2 Most harmful event types with respect to fatalities](#ind-10-1-2--Most-harmful-weather-event-types-with-respect-to-fatalities)  
    * [10.1.3 Most harmful event types with respect to injuries](#ind-10-1-3--Most-harmful-weather-event-types-with-respect-to-injuries)  
    * [10.1.4 Most harmful event types with respect to casualties](#ind-10-1-4--Most-harmful-weather-event-types-with-respect-to-casualties)  
  * [10.2 Question 2 : Across the United States, which types of events 
  have the greatest economic consequences?](#ind-10-2--results-harm-on-economy)  
    * [10.2.1 Overview of results for the harm on economy](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy)  
    * [10.2.2 Most harmful event types with respect to property damage](#ind-10-2-2--Most-harmful-weather-event-types-with-respect-to-property-damage)  
    * [10.2.3 Most harmful event types with respect to crop damage](#ind-10-2-3--Most-harmful-weather-event-types-with-respect-to-crop-damage)  
    * [10.2.4 Most harmful event types with respect to economic damage](#ind-10-2-4--Most-harmful-weather-event-types-with-respect-to-economic-damage)  
* [11 REPRODUCIBILITY DETAILS](#ind-11--REPRODUCIBILITY-DETAILS)  
  * [11.1 Session Info](#ind-11-1--Session-Info)  
  * [11.2 Options](#ind-11-2--Options)  
  * [11.3 MD5 Checksums](#ind-11-3--MD5-Checksums)  
    * [11.3.1 Create a utility function to export MD5 checksums](#ind-11-3-1--Create-a-utility-function-to-export-MD5-checksums)  
    * [11.3.2 MD5 checksum of the input file with the unprocessed data](#ind-11-3-2--MD5-checksum-of-the-input-file-with-the-unprocessed-data)  
    * [11.3.3 MD5 checksum of the output file with the processed data](#ind-11-3-3--MD5-checksum-for-the-output-file-with-the-processed-data)  
    * [11.3.4 MD5 checksum of the output files with the results](#ind-11-3-4--MD5-checksum-of-the-output-files-with-the-results)  
  * [11.4 Random Seed](#ind-11-4--Random-Seed)  
* [12 LICENSE](#ind-12--LICENSE)  
* [13 REFERENCES](#ind-13--REFERENCES)  

<br>  

<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  


      



***  
# 2 PROLOGUE {#ind-2--PROLOGUE}  
***  

To provide some context for the reader 
with respect to *what this is all about*, 
some general information was included:  

* [2.1 About The Assignment](#ind-2-1--About-The-Assignment)  
* [2.2 About The Main Script](#ind-2-2--About-The-Main-Script)  
* [2.3 About The Report](#ind-2-3--About-The-Report)  

A summary for the analysis was not included in this chapter, 
but can be found at the chapter [SYNOPSIS](#ind-3--SYNOPSIS).

<br>  

<font size="1">[back to start of this chapter](#ind-2--PROLOGUE)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

## 2.1 About The Assignment {#ind-2-1--About-The-Assignment}  

This project was created for the 2nd peer-graded assignment of:  

> Course 5: Reproducible Research,  
> from Data Science Specialization,  
> by Johns Hopkins University,  
> at Coursera   

The course is taught by:  

* Jeff Leek, PhD  
* Roger D. Peng, PhD  
* Brian Caffo, PhD  

As putted by the teachers of the course:  

> The basic goal of this assignment is to explore the NOAA Storm Database 
and answer some basic questions about severe weather events. 
You must use the database to answer the questions below 
and show the code for your entire analysis. 
Your analysis can consist of tables, figures, or other summaries. 
You may use any R package you want to support your analysis.


The assignment requests to address 2 questions:

> Your data analysis must address the following questions:  
>  
> **Question 1:** Across the United States, which types of events 
(as indicated in the EVTYPE variable) are most harmful with respect to 
population health?  
>  
> **Question 2:** Across the United States, which types of events have 
the greatest economic consequences?  

based on the observation from the [supplied dataset
](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2):

> The data for this assignment come in the form of a comma-separated-value file 
compressed via the bzip2 algorithm to reduce its size.  

Some quite general guidelines and a tip were provided:

> Consider writing your report as if it were to be read by a government or 
municipal manager who might be responsible for preparing for severe weather events
and will need to prioritize resources for different types of events.
However, there is no need to make any specific recommendations in your report.  

> The events in the database start in the year 1950 and end in November 2011. 
In the earlier years of the database there are generally fewer events recorded, 
most likely due to a lack of good records. More recent years should be considered 
more complete.  

It was deliberately decided to adopt a more educational approach 
aiming to produce a well-justified and self-explained product 
that can serve as guide to a beginner on how a basic pipeline 
can be constructed in order to obtain a report with an analysis from scratch.  

**All the requirements for the assignment were followed, with one exception:**  

* __due to the book-like structure 
that was adopted for the report 
it was considered more appropriate 
to include the [SYNOPSIS](#ind-3--SYNOPSIS) 
not immediately after the title, 
but as a separate chapter after the 
[PROLOGUE](#ind-2--PROLOGUE)__  

<br>  

<font size="1">[back to start of this section](#ind-2-1--About-The-Assignment)</font>  
<font size="1">[back to start of this chapter](#ind-2--PROLOGUE)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 2.2 About The Main Script {#ind-2-2--About-The-Main-Script}  

In the github repository 
https://github.com/jzstats/Reproducible-Research--2nd-Assignment, 
that hosts all the material relevant to this project 
the main script [RepRes_____analysis.Rmd
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/RepRes_analysis.Rmd) 
that contains the code used to conduct the analysis can be found.  

When *knitted* directly from RStudio, it produces the Markdown file 
[RepRes_____analysis.md
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/RepRes_analysis.md)
with the analysis. 

In addition, it was rendered with the script [render_____RepRes_analysis.R
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/render_____RepRes_analysis.R), 
(as explained at the following section of this chapter, 
[2.3 About The Report](#ind-2-3--About-The-Report))
to produce a *bookdown* variation 
that was uploaded to Rpubs and used to populate the 
[webpage](https://jzstats.github.io/Reproducible-Research--2nd-Assignment/) 
that was created to showcase this project.  

<br>  

<font size="1">[back to start of this section](#ind-2-2--About-The-Main-Script)</font>  
<font size="1">[back to start of this chapter](#ind-2--PROLOGUE)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 2.3 About The Report {#ind-2-3--About-The-Report}  

The main Rmd file, [RepRes_analysis.Rmd
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/RepRes_analysis.Rmd) 
that contains the code to conduct the analysis 
and produces the Markdown document [RepRes_analysis.md
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/RepRes_analysis.md) 
was rendered with the script [render\_\_\_\_\_RepRes_analysis.R
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/render\_\_\_\_\_RepRes_analysis.R) 
to create a *bookdown* version of the report with the analysis, 
that are hosted at the [webpage
](https://jzstats.github.io/Reproducible-Research--2nd-Assignment/) 
created to showcase the this project:  

* [Report
](https://jzstats.github.io/Reproducible-Research--2nd-Assignment/Report.html)  
  * A more visually appealing and practical 
  (due to the sidepanel with contents that contains) 
  book-like version of the report powered by the [rmdformats
  ](https://cran.rstudio.com/web/packages/rmdformats/index.html) library. 
  It was produced by rendering the [RepRes_analysis.Rmd
  ](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/RepRes_analysis.Rmd) 
  with the script [render\_\_\_\_\_RepRes_analysis.R
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/render\_\_\_\_\_RepRes_analysis.R) . 
  This is the version that was uploaded to RPubs at this [link
  ](https://rpubs.com/JZstats/Reproducible-Research--2nd-Assignment).  

<br>  

<font size="1">[back to start of this section](#ind-2-3--About-The-Report)</font>  
<font size="1">[back to start of this chapter](#ind-2--PROLOGUE)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 3 SYNOPSIS {#ind-3--SYNOPSIS}  
***  

The U.S. National Oceanic and Atmospheric Administration's (NOAA) 
*Storm Events Database*, was explored to identify 
the most harmful weather event types, 
among the weather phenomena defined in 
_NATIONAL WEATHER SERVICE INSTRUCTION 10-1605, AUGUST 17, 2007 (*at chapter 7*)_,
with respect to population health and economy.  

The raw data was loaded in R from the supplied file, 
preproccessed, 
the target data subset was extracted, 
in-record validation was conducted, 
the majority of missing values were imputed 
(via a deterministic and conservative approach), 
the observations were cross validated 
and finally the table with the processed data was created, 
which contained all information needed 
to address the two questions of interest:  

  1. Across the United States, which types of events 
  (as indicated in the EVTYPE variable) 
  are most harmful with respect to population health?  
  2. Across the United States, 
  which types of events have the greatest economic consequences?  

For the first question, 
the harm on population health by each weather event type was 
evaluated (separately) based on the average impact of the observations 
that resulted in non-zero damage over each of the three perspectives 
(fatalities, injuries and casualties) that were considered to be of importance.  

Similarly for the second question,
the harm on economy by each weather event type was 
evaluated (separately) based on the average impact from the observations 
that resulted in non-zero damage over each of the three perspectives 
(property damage, crop damage and economic damage) 
that were considered to be of importance.

Although for both questions 
the main criterion to rank the included weather event types 
(from the most harmful to the least) for each perspective
was the overall average damage observed 
(with respect to each perspective) 
based on the observations that caused non-zero damage, 
the average for the 90% of cases with lowest impact 
versus the average for the 10% of cases with the highest impact 
(for each of the included weather event types) 
was reported to provide a more complete and insightful 'picture' 
of the consequences observed by each weather event type, 
due to the fact that for all perspectives, 
the majority of weather event types were highly positively skewed.  

The analysis was structured, performed and documented in such way 
that fortifies the reproducibility of the report 
and explains every required detail so that even the non-expert 
can follow the procedure and understand the thought process 
behind the decision making at each stage.  

<br>  

<font size="1">[back to start of this chapter](#ind-3--SYNOPSIS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 4 STORM EVENTS DATASET {#ind-4--STORM-EVENTS-DATASET}  
***  

To conduct the analysis for this project, 
the file with the raw data [repdata_data_StormData.csv.bz2
](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2) 
was used, 
which contains data from the *Storm Events Dataset*
gathered and made publicly available 
by U.S. National Oceanic and Atmospheric Administration (NOAA). 

Some [general information](#ind-4-1--General-Informations) 
as well as two [points of interest](#ind-4-2--Points-Of-Interest) 
about the dataset:  

* [4.2.1 Changes in the composition of weather event types
](#ind-4-2-1--Changes-in-the-composition-of-weather-event-types)  
* [4.2.2 Eligibility criteria for inclusion of weather events in the dataset
](#ind-4-2-2--Eligibility-criteria-for-inclusion-of-weather-events-in-the-dataset)  
  
were discussed to provide the nessecary insights 
in order to understand why the decisions which govern 
the approach adopted in this analysis were made.

<br>  

<font size="1">[back to start of this chapter](#ind-4--STORM-EVENTS-DATASET)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

## 4.1 General Informations {#ind-4-1--General-Informations}  

The version of the dataset used in this analysis 
contains observations for the severe weather events 
that happened (or more accurately begun) 
from January 1950 to November 2011 at United States.  

Further details about the dataset (which was used in this analysis) 
can be accessed by the supplemental material 
provided at the instructions of the assignment:  

* [NATIONAL WEATHER SERVICE INSTRUCTION 10-1605 (AUGUST 17, 2007)
](https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2Fpd01016005curr.pdf) 
(also available at the GitHub repository created to support this project through 
[this link
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/supplemental_information/NATIONAL%20WEATHER%20SERVICE%20INSTRUCTION%2010-1605%20(AUGUST%2017%2C%202007).pdf))  

* [Storm Data Faq Page](https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2FNCDC%20Storm%20Events-FAQ%20Page.pdf) 
(also available at the GitHub repository created to support this project through 
[this link
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/supplemental_information/NCDC%20Storm%20Events-FAQ%20Page.pdf))  

For additional information on the Storm Events Dataset, 
as well as an updated and cleaner version of the data, 
with observations from January 1950 up to January 2020
(at the time this report was produced, 
but it is expected to continue updating),
it is recommended to visit and explore:   

* [NOAA's Storm Events Dataset official wepbage](https://www.ncdc.noaa.gov/stormevents)  

Finally, a document with detailed information for the history of the dataset, 
was available at [NOAA's Storm Events Dataset wepbage for the version history](https://www.ncdc.noaa.gov/stormevents/versions.jsp):  

* [The History of the Storm Events Database
](https://www1.ncdc.noaa.gov/pub/data/swdi/stormevents/The-History-of-the-Storm-Events-Database.docx) 
(also available at the GitHub repository created to support this project through 
[this link
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/supplemental_information/The-History-of-the-Storm-Events-Database.docx))  

<br>  

<font size="1">[back to start of this section](#ind-4-1--General-Informations)</font>  
<font size="1">[back to start of this chapter](#ind-4--STORM-EVENTS-DATASET)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 4.2 Points Of Interest {#ind-4-2--Points-Of-Interest}  

In order to understand why some of the decisions 
which govern the approach adopted in this analysis were made, 
it is essential to take into account 
two crucial facts with respect to the observations recorded in the dataset:  

  * [4.2.1 Changes in the composition of weather event types
  ](#ind-4-2-1--Changes-in-the-composition-of-weather-event-types)  
    * Both the composition of the weather events types
    that were recorded in the dataset 
    and the way the data was entered in the system 
    (the data entry procedure and the database software)
    changed several times across the years.  
  * [4.2.2 Eligibility criteria for inclusion of weather events in the dataset
  ](#ind-4-2-2--Eligibility-criteria-for-inclusion-of-weather-events-in-the-dataset)  
    * Not every weather event that occurred 
    in the period that the dataset spans,
    was automatically eligible to be recorded in the dataset. 
    Only those that have caused harm (either to population health or to economy)  
    or have gathered public interest were recorded.  

<br>  

<font size="1">[back to start of this section](#ind-4-2--Points-Of-Interest)</font>  
<font size="1">[back to start of this chapter](#ind-4--STORM-EVENTS-DATASET)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 4.2.1 Changes in the composition of weather event types {#ind-4-2-1--Changes-in-the-composition-of-weather-event-types}  

Through the years, as the publicity of the dataset soared, 
several aspects governing the data collection procedure changed 
in order to expand, enrich and fortify the quality of the data.  

As a result the number of defined weather event types 
that were collected increased several times starting from just one (*TORNADO*) 
for the first few years and expanding into 48 defined weather event times 
at the time the dataset used in this analysis was created. 
Consequently there are inconsistencies in the the composition of weather event types 
between different periods that could affect the integrity of the analysis.  

Furthermore for the period 1996 up to 2000 
while the weather event types that were being recorded 
had already been significantly increased, 
the values for the weather event type entries were entered 
though a free text field 
resulting in more than 950 different unique entries.  

For this reason **it was decided to use for the analysis 
only the part with observations since January 2001**, 
for which as a result of the introduction of a drop down menu 
and the removal of the free text field
for the entries of the weather event type values, 
the majority of observations don't suffer from such problems 
and the weather event types contained include the majority 
of the latest defined weather event types.  

<br>  

<font size="1">[back to start of this subsection](#ind-4-2-1--Changes-in-the-composition-of-weather-event-types)</font>  
<font size="1">[back to start of this section](#ind-4-2--Points-Of-Interest)</font>  
<font size="1">[back to start of this chapter](#ind-4--STORM-EVENTS-DATASET)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 4.2.2 Eligibility criteria for inclusion of weather events in the dataset {#ind-4-2-2--Eligibility-criteria-for-inclusion-of-weather-events-in-the-dataset}  

Out of all weather events that happened 
in the period from January 2001 to November 2011 at United States 
and were classified as one of the types that were recorded 
(at the period they occurred), 
only those in the subset that belonged 
to at least one of the following three groups 
were eligible to be included in the dataset:  

  1. The occurrence of storms and other significant weather phenomena 
  having sufficient intensity to cause loss of life, injuries, 
  significant property damage, and/or disruption to commerce.  
  2. Rare, unusual, weather phenomena that generate media attention.  
  3. Other significant meteorological events, 
  such as record maximum or minimum temperatures or precipitation 
  that occur in connection with another event.  

An important implication of the above policy must be highlighted:  

* From all the weather phenomena that happened 
in the period from January 2001 to November 2011 at United States 
and were of a type that was recorded at the time they occurred,
the dataset contains only the subset with those 
that either resulted in harm (to population health or to economy) 
or gathered high publicity.  
* On the contrary all the weather phenomena that happened 
in the period from January 2001 to November 2011 at United States 
and neither caused any harm (to population health or to economy) 
nor gathered high public interest,
were ignored, even if they were of a type 
that was recorded at the time they occurred.  

Consequently any conclusion made for a weather event type in *general* 
will inevitably be biased, as it will overestimate the 
consequences with respect to the harm they caused 
(either to population health or to economy) 
due to the fact that the available sample is not representative of the 
the overall population of weather phenomena (of the types that were recorded)
by default.  


For this reason **it was decided to use for the analysis:**  

* __Only the subset of observations that resulted in non-zero harm 
with respect to each of the perspectives of interest
(fatalities, injuries and casualties)
in order to determine the most harmful weather event types 
for the population health.__  
* __Only the subset of observations that resulted in non-zero harm 
with respect to each of the perspectives of interest
(property damage, crop damage and economic damage) 
in order to determine the most harmful weather event types 
for the economy.__  

<br>  

<font size="1">[back to start of this subsection](#ind-4-2-2--Eligibility-criteria-for-inclusion-of-weather-events-in-the-dataset)</font>  
<font size="1">[back to start of this section](#ind-4-2--Points-Of-Interest)</font>  
<font size="1">[back to start of this chapter](#ind-4--STORM-EVENTS-DATASET)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 5 PRELIMINARY ACTIVITIES {#ind-5--PRELIMINARY-ACTIVITIES}  
***  

Executes four preliminary tasks 
in order to ensure (and set when it is needed and possible) 
that the working directory and the R session 
are ready to proceed with the analysis:  

* [5.1 Set The Random Seed](#ind-5-1--Set-The-Random-Seed)  
  * Sets a random seed to make the random events reproducible.  
* [5.2 Load All Required Libraries](#ind-5-2--Load-All-Required-Libraries)  
  * Loads all libraries required to conduct the analysis and produce the report.  
* [5.3 Create All Required Directories](#ind-5-3--Create-All-Required-Directories)  
  * Creates (if it doesn't exist) a directory tree (at the working directory) 
  in which the output files will be exported.  
* [5.4 Access The File With The Raw Data](#ind-5-4--Access-The-File-With-The-Raw-Data)  
  * Downloads the file with the raw data, [repdata_data_StormData.csv.bz2
  ](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2) 
  in the working directory, if it doesn't already exist.  
 

<br>  

<font size="1">[back to start of this chapter](#ind-5--PRELIMINARY-ACTIVITIES)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

## 5.1 Set The Random Seed {#ind-5-1--Set-The-Random-Seed}  

In an attempt to fortify the reproducibility of the random events, 
the number *1234567890* was explicitly chosen and set as the random seed.  

```{r set_a_random_seed_for_the_execution_of_the_script}

# Select a random seed.
selected_random_seed <- 1234567890

# Set the selected random seed.
set.seed(selected_random_seed)

```

*Note that the only random events that took place in this analysis 
were the assignment of random positions for the labels at the plots:  * 

* _[Plot 1.1.4](#ind-8-1-4-1-4--Create-The-Plot-1-1-4)_  
* _[Plot 1.2.4](#ind-8-2-4-1-4--Create-The-Plot-1-2-4)_  
* _[Plot 1.3.4](#ind-8-3-4-1-4--Create-The-Plot-1-3-4)_  
* _[Plot 2.1.4](#ind-9-1-4-1-4--Create-The-Plot-2-1-4)_  
* _[Plot 2.2.4](#ind-9-2-4-1-4--Create-The-Plot-2-2-4)_  
* _[Plot 2.3.4](#ind-9-3-4-1-4--Create-The-Plot-2-3-4)_  

*by the function geom_repel_label() from the ggrepel library.*  


<br>  

<font size="1">[back to start of this section](#ind-5-1--Set-The-Random-Seed)</font>  
<font size="1">[back to start of this chapter](#ind-5--PRELIMINARY-ACTIVITIES)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 5.2 Load All Required Libraries {#ind-5-2--Load-All-Required-Libraries}  

Loads all libraries required to conduct the analysis and produce the report.  

```{r load_all_required_libraries}

# Load all required libraries.
library(tools)
library(rmarkdown)
library(knitr)
library(kableExtra)
library(magrittr)
library(DT)
library(rmdformats)
library(data.table)
library(validate)
library(stringr)
library(moments)
library(ggplot2)
library(ggrepel)
library(grid)
library(gridExtra)

```

*Note that the library:*  

- *rmdformats*  
  - *which was only used to produce the [Report
](https://jzstats.github.io/Reproducible-Research--2nd-Assignment/Report.html)*  

*is not essential to conduct the analysis.* 

<br>  

<font size="1">[back to start of this section](#ind-5-2--Load-All-Required-Libraries)</font>  
<font size="1">[back to start of this chapter](#ind-5--PRELIMINARY-ACTIVITIES)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 5.3 Create All Required Directories {#ind-5-3--Create-All-Required-Directories}  

During the execution of the main script, [RepRes_analysis.Rmd
   ](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/RepRes_analysis.Rmd) 
several outputs are produced, 
(that are also included in the report), 
mostly to enhance further the reproducibility of the analysis. 

All those files are exported in appropriate sub-directories 
inside the directory with name *outputs* 
which is created at the working directory.  

```{r create_the_directory_tree_for_the_outputs_of_the_script}

# Create a list with the paths to all sub-directories 
# of the directory tree for the outputs of this analysis
directory_tree_____outputs <- list(
    "filepath_____outputs_____processed_data" = 
        file.path("outputs", "processed_data"),
    "filepath_____outputs_____harm_on_population_health_____figures" = 
        file.path("outputs", "harm_on_population_health", "figures"),
    "filepath_____outputs_____harm_on_population_health_____results" = 
        file.path("outputs", "harm_on_population_health", "results"),
    "filepath_____outputs_____harm_on_economy_____figures" = 
        file.path("outputs", "harm_on_economy", "figures"),
    "filepath_____outputs_____harm_on_economy_____results" = 
        file.path("outputs", "harm_on_economy", "results"),
    "filepath_____outputs_____reproducibility_support_____r_session" = 
        file.path("outputs", "reproducibility_support", "r_session"),
    "filepath_____outputs_____reproducibility_support_____MD5_checksums" =
        file.path("outputs", "reproducibility_support", "MD5_checksums")
    
)

# Create the directory tree for the outputs of the analysis.  
invisible(lapply(
    X = directory_tree_____outputs,
    FUN = function(filepath_of_subdirectory) {
        if ( ! dir.exists(filepath_of_subdirectory) ) {
            dir.create(filepath_of_subdirectory, recursive = TRUE)
        }
    }
))


# Check if all subdirectories of the directory for the outputs of the analysis 
# were successfully created.
do_the_directories_exists <- vapply(
    X = directory_tree_____outputs,
    FUN = dir.exists,
    FUN.VALUE = logical(1)
)

# If failed to created any of the sub-directories 
# required for the outputs of the analysis 
# the process terminates
if (any(!do_the_directories_exists)) {
    stop(
        "\n",
        "Failed to create the directories: ", "\n",
        paste0("\t", directory_tree_____outputs[!do_the_directories_exists], "\n"),
        "The process is aborted for now.", "\n",
        "Please rerun the script or create the required sub-directories manually.", 
        "\n"
    )
}
    
```

*If failed to created any of the sub-directories in the directory tree 
for the outputs of the analysis, the process terminates.*

<br>  

<font size="1">[back to start of this section](#ind-5-3--Create-All-Required-Directories)</font>  
<font size="1">[back to start of this chapter](#ind-5--PRELIMINARY-ACTIVITIES)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 5.4 Access The File With The Raw Data {#ind-5-4--Access-The-File-With-The-Raw-Data}  

The file with name [repdata_data_StormData.csv.bz2
](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2), 
which contains data from the [Storm Events Dataset](#ind-4--STORM-EVENTS-DATASET)
was supplied for this assignment and used to conduct the analysis.  

If the file doesn't already exists at the working directory,
an attempt will be made to download it automatically.  

```{r access_the_file_with_the_compressed_raw_data}

# Path to the file with the compressed raw data.
filepath_____unprocessed_data <- "repdata_data_StormData.csv.bz2"

# The link supplied by the instuctions of the assignment 
# to download the file with the compressed raw data.
url_to_download_the_data_file <- 
  "https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2"

# Check if the file 'repdata_data_StormData.csv.bz2', 
# with the compressed raw data is available at the working directory. 
## if it doesn't exist...
if ( !file.exists(filepath_____unprocessed_data) ) {

  message(
    "\n", 
    "The file, '", filepath_____unprocessed_data, "'", "\n", 
    "doesn't exists at the working directory.",
    "\n"
  )
  message(
    "\n", "Trying to download the file, ", "\n",
    "'", filepath_____unprocessed_data, "' ", "\n",
    "with the raw data from the url: ", "\n",
    "\t", "'",  url_to_download_the_data_file, "'"
  )
  
  ### ...an attempt is made to download it from the link supplied by assignment
  try(
    download.file(
      url = url_to_download_the_data_file,
      destfile = filepath_____unprocessed_data)
  )
  
  ## Checks if the file 'repdata_data_StormData.csv.bz2' 
  ## was successfully downloaded.  
  ### in case the file is not found at the working directory 
  ### after the attempt to download 
  ### the process terminates with an informative message 
  ### that explains the situation to the user
  if ( !file.exists(filepath_____unprocessed_data)  ) {
    stop(
      "\n", 
      "Failed to download the required file,", "\n",
      "'", filepath_____unprocessed_data, "'", "\n",
      "with the raw data.", "\n",
      "The process is aborted for now."
    )
  } 
} 

```

*If the download fails, the process terminates.*

<br>  

<font size="1">[back to start of this section](#ind-5-4--Access-The-File-With-The-Raw-Data)</font>  
<font size="1">[back to start of this chapter](#ind-5--PRELIMINARY-ACTIVITIES)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 6 DATA PROCESSING {#ind-6--DATA-PROCESSING}  
***  

The data processing pipeline, started with a supplied file,
[*repdata_data_StormData.csv.bz2*
](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2) 
that contained raw data from the 
[*Storm Events Dataset*](#ind-4--STORM-EVENTS-DATASET)
and produced the [table with the processed data](#ind-7--PROCESSED-DATA).  

The pipeline consists of seven distinct stages:  

  1. [**Load The Raw Data In R**](#ind-6-1--Load-The-Raw-Data-In_R)  
     * The table with the raw data was created 
     by loading in R the raw data from the supplied file 
     with the compressed raw data with all variables coerced to character type. 
     Post validation was conducted and 
     an overview of the table with the raw data was presented.  
  2. [**Preprocess The Raw Data**](#ind-6-2--Preprocess-The-Raw-Data)  
     * From the data at the table with the raw data, 
     in order to create the table with the preprocessed data 
     prerequisites were verified about the variables required for the analysis 
     before they were selected, coerced to their appropriate types 
     and a key was set for the table. Post validation was conducted and 
     an overview of the table with the preprocessed data was presented.  
  3. [**6.3 Extract The Target Data Subset**](#ind-6-3--Extract-The-Target-Data-Subset)  
     * From the table with the preprocessed data only the subset of data 
     that includes the observations for the weather events 
     that happened in the period from 2001 to 2011 
     and caused non-zero fatalities, injuries, property damage or crop damage 
     were extracted. Post validation was conducted and 
     an overview of the table with the target data subset was presented.  
  4. [**Conduct In-Record Data Validation**](#ind-6-4--Conduct-In-Record-Data-Validation)  
     * The values of each variable at the table with the target data subset 
     were validated against appropriate constrains for each column separately 
     (independently of the other variables) 
     and those entries that were found invalid got substituted with NAs 
     to create the table with the in-record validated data. 
     Post validation was conducted and 
     an overview of the table with the in-record validated data was presented.  
  5. [**Impute Missing Values**](#ind-6-5--Impute-Missing-Values)  
     * The missing values at each variable 
     from the table with the in-record validated data were examined 
     and the those that could be retrieved 
     (via a deterministic and conservative way) were imputed,
     to produce the table with the imputed data. 
     Post validation was conducted and 
     an overview of the table with the imputed data was presented.  
  6. [**Conduct Cross-Record Data Validation**](#ind-6-6--Conduct-Cross-Record-Data-Validation)  
     * Each observations from the table with the imputed data 
     was validated against appropriate constrains 
     that spanned across all available variables 
     and only those that were found valid
     were used to create the table with the cross-record validated data. 
     Post validation was conducted and 
     an overview of the table with the cross-record validated data was presented.  
  7. [**6.7 Produce The Processed Data**](#ind-6-7--Produce-The-Processed-Data)  
     * From the table with the cross-record validated data, 
     by transforming appropriately the available information,
     the table with the processed data was created 
     that contained the variables required 
     to identify the most harmful weather event types 
     with respect to the population health and for the economy. 
     Post validation was conducted.  

At each stage of the data processing procedure 
any fact that played a major role 
was highlighted and examined when it was needed, 
in compliance with the spirit of the assignment, 
aiming to supply all the facts necessary to understand how and why 
the decision making behind this analysis happened 
in order to create a well justified and documented, reproducible report.

<br>  

<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

## 6.1 Load The Raw Data In R {#ind-6-1--Load-The-Raw-Data-In_R}  

<font size="3"><u><strong>Summary</strong></u></font>  

The raw data was loaded in R 
from the supplied file [*repdata_data_StormData.csv.bz2*
](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2) 
(which contains data from the 
[Storm Events Dataset](#ind-4--STORM-EVENTS-DATASET)), 
to create the table with the raw data which was 
then post validated and some basics fact about it were highlighted.  

<font size="3"><u><strong>Steps</strong></u></font>  

* [6.1.1 Create the table with the raw data
](#ind-6-1-1--Create-the-table-with-the-raw-data)  
  * Reads the file [*repdata_data_StormData.csv.bz2*
  ](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2) 
  in R, to create the table with the raw data.   
* [6.1.2 Conduct post validation for the table with the raw data
](#ind-6-1-2--Conduct-post-validation-for-the-table-with-the-raw-data)  
  * Ensures that the raw data was loaded correctly.    
* [6.1.3 Overview of the table with the raw data
](#ind-6-1-3--Overview-of-the-table-with-the-raw-data)  
  * Presents some basic facts about the table with the raw data.  

<br>  

<font size="1">[back to start of this section](#ind-6-1--Load-The-Raw-Data-In_R)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 6.1.1 Create the table with the raw data {#ind-6-1-1--Create-the-table-with-the-raw-data}  

The raw data was loaded in R directly from the supplied file 
[repdata_data_StormData.csv.bz2
](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2) 
(which was a CSV file, compressed via a bzip2 algorithm),
with all variables deliberately coerced to character type 
in order to ensure that no information was lost or altered 
as a side effect of coercion. 
The first row of the file includes headers that were used 
to automatically assign the names of all the variables 
at the table with the raw data that was created.  

```{r create_the_table_with_the_raw_data}

# Load the raw data in R from the supplied file:
#     "repdata_data_StormData.csv.bz2"
# and create the table with the raw data.
raw_data <- fread(
  ## the file is expected to exist at the working directory
  file = filepath_____unprocessed_data,
  ## the variables in the file are separated via a comma
  sep = ",",
  ## the first row of the file contains the names of the variables
  header = TRUE,
  ## all variables were deliberately loaded as character type
  ## to avoid any loss or alteration of information as a side effect of coercion
  colClasses = "character"
)

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-1-1--Create-the-table-with-the-raw-data)</font>  
<font size="1">[back to start of this section](#ind-6-1--Load-The-Raw-Data-In_R)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.1.2 Conduct post validation for the table with the raw data {#ind-6-1-2--Conduct-post-validation-for-the-table-with-the-raw-data}  

The table with the raw data was post validated to ensure 
that the data from the file was loaded in R correctly.  
Three simple constrains were applied:  

   1. It should contain 37 variables.  
   2. It should contain 902297 observations.  
   3. The type of all variables should be 'character'.  

*(The expected number of variables and the expected number of observations, 
were acquired interactively before the execution of the main script 
[RepRes_analysis.Rmd
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/RepRes_analysis.Rmd) 
and were then used to form the constrains for the post validation.)*

```{r conduct_post_validation_for_the_table_with_the_raw_data}

# Create a validator with constrains for the validity of loaded raw data. 
V_____loaded_raw_data <- validator(
  ## create a character vector that captures the class of each variable
  classes_of_varirables := vapply(
    X = ., 
    ### although it is not expected to get an output 
    ### with more than one element for the class of each variable, 
    ### in general it is possible to happen, 
    ### so proper care is taken to collapse the elements of such vector 
    ### in a single element so that the vapply() function 
    ### won't fail with an error in such case
    FUN = function(x) paste(class(x), collapse = ","), 
    FUN.VALUE = character(1)
  ),
  "expected_number_of_variables" = ( length(.) == 37 ),
  "expected_number_of_observations" = ( nrow(.) == 902297 ),
  "expected_variable_types" = ( classes_of_varirables == "character" )
)

# Confront the table with the raw data with the validator
# which constrains the constrains for the validity of raw data.
CF_____loaded_raw_data <- confront(dat = raw_data, V_____loaded_raw_data)

```

The table with the raw data was valid.  

```{r create_a_kable_with_the_results_from_post_validation_of_the_table_with_the_raw_data}

# Create a kable with the results of post validation 
# for the table with the raw data. 
kable(
  x = summary(CF_____loaded_raw_data)[
    , 
    c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ], 
  caption = paste0(
    "TABLE 6.1.3-1: ", 
    "The results of post validation for the table with the raw data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c(
      "striped", "hover", "condensed", "responsive", "bordered"
    ), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-1-2--Conduct-post-validation-for-the-table-with-the-raw-data)</font>  
<font size="1">[back to start of this section](#ind-6-1--Load-The-Raw-Data-In_R)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.1.3 Overview of the table with the raw data {#ind-6-1-3--Overview-of-the-table-with-the-raw-data}  

The table with the raw data 
contained 37 variables that were all of type 'character' 
and 902297 observations.

```{r print_the_structure_of_the_table_with_the_raw_data}

# Print the structure of the table with the raw data.
str(raw_data)

```

There were no missing values (coded as NAs) 
at any of the variables it contained, 
but there were a lot of empty values 
which probably represent missing values. 
For some of the variables, 
a suspiciously large or small number of distinct values was observed.  

```{r create_a_kable_to_present_facts_for_the_table_with_the_raw_data}

# Create a kable to highlight some facts 
# about the variables at the table with the raw data.
kable(
  data.table(
    "Variable" = names(raw_data),
    "Number of Distinct Values" = vapply(
      X = raw_data, 
      FUN = function(x) length(unique(x)), 
      FUN.VALUE = integer(1)
      ),
    "Number of NAs" = vapply(
      X = raw_data, 
      FUN = function(x) sum(is.na(x)),
      FUN.VALUE = integer(1)
      ),
    # from the output with the structure of the table with the raw data 
    # it was found that some empty values exist at some variables 
    # and the exact number that each of them contains was reported
    "Number of Empty Values" = vapply(
      X = raw_data, 
      FUN = function(x) sum(x == ""), 
      FUN.VALUE = integer(1))
    
  ),
  caption = paste0(
    "TABLE 6.1.3-2: ", 
    "Facts about the variables at the table with the raw data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c(
      "striped", "hover", "condensed", "responsive", "bordered"
    ), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The table with the raw data contains 37 variables ", 
      "that are all of type 'character'", "\n",
      "and 902297 observations."
    )
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-1-3--Overview-of-the-table-with-the-raw-data)</font>  
<font size="1">[back to start of this section](#ind-6-1--Load-The-Raw-Data-In_R)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 6.2 Preprocess The Raw Data {#ind-6-2--Preprocess-The-Raw-Data}  

<font size="3"><u><strong>Summary</strong></u></font>  

From the table with the raw data which contains 37 variables, 
only 9 were selected to create the table with preprocessed data 
and proceed with this analysis:  

  1. **REFNUM** : an id that uniquely identifies each observation  
  2. **BGN_DATE** : the date when each weather event begun  
  3. **EVTYPE** : the type of each weather event  
  4. **FATALITIES** : the number of fatalities  
  5. **INJURIES** : the number of injuries  
  6. **PROPDMG** : the magnitude value of the damage caused in properties 
  that could have been expressed in thousands, millions or billions of dollars, 
  depending on the corresponding indicator value at the variable *PROPDMGEXP*  
  7. **PROPDMGEXP** : an indicator value that denotes 
  whether the corresponding magnitude value at the variable *PROPDMG*
  refers to thousands, millions or billions of dollars  
  8. **CROPDMG** : the magnitude value of the damage caused in crops 
  that could have been expressed in thousands, millions or billions of dollars, 
  depending on the corresponding indicator value at the variable *CROPDMGEXP*  
  9. **CROPDMGEXP** : an indicator value that denotes 
  whether the corresponding magnitude value at the variable *CROPDMG*
  refers to thousands, millions or billions of dollars  

Due to the fact that all variables at the table with the raw data 
were (deliberately) loaded as type 'character' 
some prerequisites were needed to get verified 
for the format of the character string values that they contained
before they were coerced to their appropriate type.   

The variable *REFNUM* after having verified 
that the values it contained uniquely identify each observation, 
was set as the key for the table with the preprocessed data. 

Finally post validation was conducted 
and some facts about the table with the preprocessed data were highlighted.  

<font size="3"><u><strong>Steps</strong></u></font>  

* [6.2.1 Verify the prerequisites for the selected variables
](#ind-6-2-1--Verify-the-prerequisites-for-the-selected-variables)  
  * Checks two key points for the values of selected variables 
  from the table with the raw data:  
    * [6.2.1.1 Verify the coercibility of the values for the selected variables
    ](#ind-6-2-1-1--Verify-the-coercibility-for-the-values-at-the-selected-variables)  
      * The character values at the selected variables were checked to verify 
      if their format was compatible with the variable type 
      that each of the them should be coerced to. 
    * [6.2.1.2 Verify the uniqueness of the key values
    ](#ind-6-2-1-2--Verify-the-uniqueness-of-the-key-values)  
      * The values of the variable that was intended to be used as the key 
      of the table with the preprocessed data were checked to verify 
      if they uniquely identify each observation.  
* [6.2.2 Create the table with the preprocessed data
](#ind-6-2-2--Create-the-table-with-the-preprocessed-data)  
  * Creates the table with the preprocessed data, 
  by selecting the required variahles, 
  coercing them to their appropriate type 
  and setting a key was set for the table.  
* [6.2.3 Conduct post validation for the table with the preprocessed data
](#ind-6-2-3--Conduct-post-validation-for-the-table-with-the-preprocessed-data)
  * Ensures that the raw data was preprocessed data correctly.  
* [6.2.4 Overview of the table with the preprocessed data
](#ind-6-2-4--Overview-of-the-table-with-the-preprocessed-data)
  * Presents some basic fact about the table with the preprocessed data.  

<br>  

<font size="1">[back to start of this section](#ind-6-2--Preprocess-The-Raw-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 6.2.1 Verify the prerequisites for the selected variables {#ind-6-2-1--Verify-the-prerequisites-for-the-selected-variables}  

Two key points were checked for the values of the selected variables 
from the table with raw data before proceeding 
to create the table with the preprocessed data:  

* [6.2.1.1 Verify the coercibility of the values for the selected variables
](#ind-6-2-1-1--Verify-the-coercibility-for-the-values-at-the-selected-variables)  
  * Checks if the format of the character string values 
  of the selected variables from the table with the raw data 
  are compatible with the (variable) type 
  that each of them should be coerced to.  
* [6.2.1.2 Verify the uniqueness of the key values
](#ind-6-2-1-2--Verify-the-uniqueness-of-the-key-values)  
  * Checked if the values of the variable *REFNUM* 
  (when coerced to type 'integer')
  that was intended to be used as the key 
  of the table preprocessed data 
  uniquely identifies each observation.  

<br>  

<font size="1">[back to start of this subsection](#ind-6-2-1--Verify-the-prerequisites-for-the-selected-variables)</font>  
<font size="1">[back to start of this section](#ind-6-2--Preprocess-The-Raw-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.2.1.1 Verify the coercibility of the values for the selected variables {#ind-6-2-1-1--Verify-the-coercibility-for-the-values-at-the-selected-variables}  

The format of the character string values of the selected variables, 
*REFNUM*, *BGN_DATE*, *EVTYPE*, *FATALITIES*, *INJURIES*, 
*PROPDMG*, *PROPDMGEXP*, *CROPDMG* and *CROPDMGEXP*, 
from the table with the raw data were checked in order to verify that 
they were compatible with the new variable type 
that each them should be coerced to, 
so as not to lose any information without knowing it 
(or in other words to avoid the side effect of automatic substitution by NAs, 
of the values that were incompatible 
with the new variable type that each of them should be coerced to).  

The variables *EVTYPE*, *BGN_DATE*, *PROPDMGEXP* and *CROPDMGEXP* 
were already in their appropriate type (which is 'character'),
so no further adjustments were needed. 
On the other hand the variables *REFNUM*, *FATALITIES* and *INJURIES* 
had to be coerced from 'character' type to 'integer',
while the type of the remaining two variables, 
*PROPDMG* and *CROPDMG* had to change from 'character' to 'double'.  

A validation was conducted to verify that:  
  
  1. the values of the variable *REFNUM* can be coerced to 'integer' type  
  2. the values of the variable *FATALITIES* can be coerced to 'integer' type  
  3. the values of the variable *INJURIES* can be coerced to 'integer' type  
  4. the values of the variable *PROPDMG* can be coerced to 'double' type  
  5. the values of the variable *CROPDMG* can be coerced to 'double' type  
  
```{r verify_the_coercibility_of_the_format_of_the_character_string_values_for_the_selected_variables}

# Create a validator with the constrains needed to verify 
# that the formats of the character string values 
# at the selected variables from the table with the raw data 
# are compatible with the variable types that they should be coerced to.
V_____coercibible_format_of_the_character_string_values <- 
  validator(
    "REFNUM_value_is_coercible_to_integer" = 
      ( grepl("^\\d{1,}\\.00$", REFNUM) ),
    "FATALITIES_value_is_coercible_to_integer" = 
      ( grepl("^\\d{1,}\\.00$", FATALITIES) ),
    "INJURIES_value_is_coercible_to_integer" = 
      ( grepl("^\\d{1,}\\.00$", INJURIES) ),
    "PROPDMG_value_is_coercible_to_double" = 
      ( grepl("^\\d{1,}\\.\\d{2}$", PROPDMG) ),
    "CROPDMG_value_is_coercible_to_double" = 
      ( grepl("^\\d{1,}\\.\\d{2}$", CROPDMG) )
  )

# Confront the table with the raw data with the validator 
# which contains the constrains for the formats of the character string values 
# at the selected variables from the table with the raw data.
CF_____coercibible_format_of_the_character_string_values <- 
  confront(
    dat = raw_data,
    V_____coercibible_format_of_the_character_string_values
  )

```

The values of all selected variables 
were found to be compatible with the new type 
that each of them should be coerced to. 

```{r create_a_kable_to_present_the_results_for_the_coercibility_of_the_format_of_the_character_string_values_for_the_selected_variables}

# Create a kable to present the results validation 
# for the format of the character string values 
# at the selected variables from the table with the raw data.
kable(
  x = summary(
    CF_____coercibible_format_of_the_character_string_values
  )[, c("name", "items", "passes", "fails", "nNA", "error", "warning")],
  caption = paste0(
    "Table 6.2.1.1-1: ",
    "The results of the validation ", 
    "for the compatibility of the format of the character string values ", 
    "at the selected variables from the table with raw data ",
    "with the appropriate type that each of them should be coerced to, ",
    "at the table of preprocessed data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )   


```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-2-1-1--Verify-the-coercibility-for-the-values-at-the-selected-variables)</font>  
<font size="1">[back to start of this subsection](#ind-6-2-1--Verify-the-prerequisites-for-the-selected-variables)</font>  
<font size="1">[back to start of this section](#ind-6-2--Preprocess-The-Raw-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.2.1.2 Verify the uniqueness of the key values {#ind-6-2-1-2--Verify-the-uniqueness-of-the-key-values}  

The variable *REFNUM*, coerced to its proper type (that is 'integer'),
should and was expected to uniquely identify each observation, 
making it an excellent choice 
for the key of the table with the preprocessed data, 
(as well as for the rest of the tables that were generated 
at the following stages of the data processing pipeline).  

Before proceeding to set the *REFNUM* as the key, 
the claim that *it uniquely identifies each observations* 
was checked to avoid unexpected surprises 
that may jeopardize the reproducibility of the analysis.  

```{r verify_the_uniqueness_of_values_for_the_key_variable}

# Create a validator for the uniqueness of values at the variable REFNUM.
V_____uniqueness_of_values_for_the_key_of_the_table <- validator(
  "value_uniquely_identifies_the_observation" = (
    # the values of the variable REFNUM will be first coerced 
    # to their appropriate variable type, which is 'integer' 
    # and then checked for uniqueness
    as.integer(REFNUM) %in% 
      names(table(as.integer(REFNUM)))[table(as.integer(REFNUM)) == 1]
  )
)

# Confront the table with raw data with the validator 
# for the uniqueness of values at REFNUM variable 
CF_____uniqueness_of_values_for_the_key_of_the_table <- confront(
  dat = raw_data,
  V_____uniqueness_of_values_for_the_key_of_the_table
)

```

All values of the variable *REFNUM* were found to be distinct,
and consequently they uniquely identify each observation.  

```{r create_a_kable_to_present_the_results_for_the_uniqueness_of_values_for_the_key_variable}

# Create a kable to present the results from the validation 
# for the uniqueness of each value at the variable REFNUM 
# at the table with the raw data. 
kable(
  x = summary(CF_____uniqueness_of_values_for_the_key_of_the_table)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ], 
  caption = paste0(
    "Table 6.2.1.2-1: ",
    "The results from the validation ",
    "for the uniqueness of values from REFNUM variable ", 
    "at the table with the raw data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c(
      "striped", "hover", "condensed", "responsive", "bordered"
    ), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The values at REFNUM variable were coerced to 'integer' type ", "\n",
      "before checking if they uniquely identify each observation."
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-2-1-2--Verify-the-uniqueness-of-the-key-values)</font>  
<font size="1">[back to start of this subsection](#ind-6-2-1--Verify-the-prerequisites-for-the-selected-variables)</font>  
<font size="1">[back to start of this section](#ind-6-2--Preprocess-The-Raw-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  


### 6.2.2 Create the table with the preprocessed data {#ind-6-2-2--Create-the-table-with-the-preprocessed-data}  

Having identify the variables from the table with the raw data 
(*REFNUM*, *BGN_DATE*, *EVTYPE*, *FATALITIES*, *INJURIES*, 
*PROPDMG*, *PROPDMGEXP*, *CROPDMG* and *CROPDMGEXP*) 
that were required to proceed with the analysis, 
and [verified that they satisfied the necessary prerequisites
](#ind-6-2-1--Verify-the-prerequisites-for-the-selected-variables), 
the table with preprocessed data was created,
by selecting those 9 variables, 
coercing them to their appropriate type:  

1. *REFNUM* was selected and coerced from 'character' type to 'integer'  
2. *BGN_DATE* was selected 
(no coercion happened as it was already of the proper type, 'character')  
3. *EVTYPE* was selected 
(no coercion happened as it was already of the proper type, 'character')  
4. *FATALITIES* was selected and coerced from 'character' type to 'integer'  
5. *INJURIES* was selected and coerced from 'character' type to 'integer'  
6. *PROPDMG* was selected and coerced from 'character' type to 'double'  
7. *PROPDMGEXP*  was selected 
(no coercion happened as it was already of the proper type, 'character')  
8. *CROPDMG* was selected and coerced from 'character' type to 'double'  
9. *CROPDMGEXP*  was selected 
(no coercion happened as it was already of the proper type, 'character')  

and finally setting the variable *REFNUM* as the key of the table.  

```{r create_the_table_with_the_preprocessed_data}

# Create the table with the preprocessed data 
# with the selected variables from the table with the raw data, 
# coerced to their appropriate type.
preprocessed_data <- raw_data[
  ,
  list(
    "REFNUM" = as.integer(REFNUM),
    "BGN_DATE" = BGN_DATE,
    "EVTYPE" = EVTYPE,
    "FATALITIES" = as.integer(FATALITIES),
    "INJURIES" = as.integer(INJURIES),
    "PROPDMG" = as.double(PROPDMG),
    "PROPDMGEXP" = PROPDMGEXP,
    "CROPDMG" = as.double(CROPDMG),
    "CROPDMGEXP" = CROPDMGEXP
  )
  ]

# Set REFNUM as the key of the table with the preprocessed data
setkey(preprocessed_data, REFNUM)

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-2-2--Create-the-table-with-the-preprocessed-data)</font>  
<font size="1">[back to start of this section](#ind-6-2--Preprocess-The-Raw-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.2.3 Conduct post validation for the table with the preprocessed data {#ind-6-2-3--Conduct-post-validation-for-the-table-with-the-preprocessed-data}  

The table with the preprocessed data was post validated to ensure that:

  1. all and only, the variables required for the analysis were included  
  2. all the observations from table with raw data were transfered  
  3. each of the selected variables was coerced to its appropriate type  
  4. no missing values were introduced as a result of the coercion  
  5. *REFNUM* was set as the key of the table  
  
```{r conduct_post_validation_for_the_table_with_the_preprocessed_data}

# Create a vector with the names of the expected variables 
# at the table with the preprocessed data.
expected_variables_at_the_table_with_preprocessed_data <- c(
  "REFNUM", "BGN_DATE", "EVTYPE", "FATALITIES", "INJURIES", 
  "PROPDMG","PROPDMGEXP","CROPDMG","CROPDMGEXP"
)

# Create a validator for the post validation of the preprocessed data.
V_____post_validation_of_table_with_preprocessed_data <- validator(
  # check if the table contains all and only the required variables 
  "all_and_only_the_required_variables_are_included" = 
    ( names(.) == expected_variables_at_the_table_with_preprocessed_data ),
  # check if all the observations were included.
  "all_observations_were_transfered" = nrow(.) == nrow(raw_data),
  # checks if each variable is coerced to its appropriate type
  "REFNUM_is_integer" = 
    ( paste(class(.[["REFNUM"]]), collapse = ",") == "integer" ),
  "BGN_DATE_is_character" = 
    ( paste(class(.[["BGN_DATE"]]), collapse = ",") == "character" ),
  "EVTYPE_is_character" = 
    ( paste(class(.[["EVTYPE"]]), collapse = ",") == "character" ),
  "FATALITIES_is_integer" = 
    ( paste(class(.[["FATALITIES"]]), collapse = ",") == "integer" ),
  "INJURIES_is_integer" = 
    ( paste(class(.[["INJURIES"]]), collapse = ",") == "integer" ),
  "PROPDMG_is_numeric" = 
    ( paste(class(.[["PROPDMG"]]), collapse = ",") == "numeric" ),
  "PROPDMGEXP_is_character" = 
    ( paste(class(.[["PROPDMGEXP"]]), collapse = ",") == "character" ),
  "CROPDMG_is_numeric" = 
    ( paste(class(.[["CROPDMG"]]), collapse = ",") == "numeric" ),
  "CROPDMGEXP_is_character" = 
    ( paste(class(.[["CROPDMGEXP"]]), collapse = ",") == "character" ),
  # check that no missing values were introduced as a result of coercion
  "no_missing_values_introduced" = ( mean(complete.cases(.)) == 1 ),
  # checks if the REFNUM is set as the key of the table
  "REFNUM_is_the_key_of_the_table" = ( attributes(.)[["sorted"]] == "REFNUM" )
)

# Confront the table with the preprocessed data with the validator 
# which contains the constrains for the validity of preprocessed data. 
CF_____post_validation_of_table_with_preprocessed_data <- confront(
  dat = preprocessed_data,
  V_____post_validation_of_table_with_preprocessed_data
)

```

The table with the preprocessed data was valid.

```{r create_a_kable_with_the_results_from_post_validation_of_the_table_with_the_preprocessed_data}

# Create a kable was to present the results of post validation 
# for table with the preprocessed data. 
kable(
  x = summary(CF_____post_validation_of_table_with_preprocessed_data)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ], 
  caption = paste0(
    "Table 6.2.3-1: ",
    "The results of post validation for the table with the preprocessed data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```


<br>  

<font size="1">[back to start of this subsection](#ind-6-2-3--Conduct-post-validation-for-the-table-with-the-preprocessed-data)</font>  
<font size="1">[back to start of this section](#ind-6-2--Preprocess-The-Raw-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.2.4 Overview of the table with the preprocessed data {#ind-6-2-4--Overview-of-the-table-with-the-preprocessed-data}  

The table with the preprocessed data, 
contained 9 variables and 902297 observations.  

The variable *REFNUM* was set as the key of the table.  

```{r print_the_structure_of_the_table_with_the_preprocessed_data}

# Print the structure of the table with the preprocessed data.
str(preprocessed_data)

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-2-4--Overview-of-the-table-with-the-preprocessed-data)</font>  
<font size="1">[back to start of this section](#ind-6-2--Preprocess-The-Raw-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 6.3 Extract The Target Data Subset {#ind-6-3--Extract-The-Target-Data-Subset}  

<font size="3"><u><strong>Summary</strong></u></font>  

From all available observations 
that the table with the preprocessed data contains, 
only the subset of the weather phenomena 
that begun at 2001 or later 
and resulted in non-zero harm either to population health 
(caused fatalities or injuries) 
or to economy (caused property damage or crop damage) 
will be used for this analysis (for the reasons that were discussed in detail 
at the section [4.2 Points Of Interest](#ind-4-2--Points-Of-Interest) 
about the *Storm Events Dataset*).  

The consistency of the format of dates at the *BGN_DATE* variable 
(that indicates when each weather phenomenon begun)
was checked, as it was intended to be used for the identification,
the eligible observations for the target data subset were identified, 
and got extracted to create the table with the target data subset.  

Finally post validation was conducted 
and some facts about the table with the target data subset were highlighted.  

<font size="3"><u><strong>Steps</strong></u></font>  

* [6.3.1 Identify the target subset of observations
](#ind-6-3-1--Identify-the-target-subset-of-observations)  
  * Verifies prerequisites and identifies the eligible observations 
  for the table with the target data subset:  
    * [6.3.1.1 Verify the consistency of date format
    ](#ind-6-3-1-1--Verify-the-consistency-of-date-format)  
      * Verifies that the character string format of the values 
      at *BGN_DATE* variable are consistent.  
    * [6.3.1.2 Identify the eligible observations
    ](#ind-6-3-1-2--Identify-the-eligible-observations)  
      * Identifies the eligible observations 
      for the table with the target data subset by their key value.  
* [6.3.2 Create the table with the target data subset
](#ind-6-3-2--Create-the-table-with-the-target-data-subset)  
  * Creates the table with the target data subset 
  by identifying and extracting the eligible observations by their key values.  
* [6.3.3 Conduct post validation for the table with the target data subset
](#ind-6-3-3--Conduct-post-validation-for-the-table-with-the-target-data-subset)  
  * Ensures that the target data was extracted correctly.  
* [6.3.4 Overview of the table with the target data subset
](#ind-6-3-4--Overview-of-the-table-with-the-target-data-subset)  
  * Presents some basic facts about the table with the target data subset.  

<br>  

<font size="1">[back to start of this section](#ind-6-3--Extract-The-Target-Data-Subset)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 6.3.1 Identify the target subset of observations {#ind-6-3-1--Identify-the-target-subset-of-observations}  

Out of all available observations it was decided to use for the analysis 
the subset that includes only the weather phenomena 
that happened from 2001 and later (due to the implications of 
[changes in the composition of weather event types
](#ind-4-2-1--Changes-in-the-composition-of-weather-event-types)) 
and resulted in non-zero harm either to population health 
(caused fatalities or injuries) or to economy 
(caused property damage or crop damage) (due to the implications of the 
[eligibility criteria for inclusion of weather events in the dataset
](#ind-4-2-2--Eligibility-criteria-for-inclusion-of-weather-events-in-the-dataset)).  

The format of the date values at *BGN_DATE* variable 
from the table with preprocessed data 
had to be checked to see if it is consistent across all observations, 
before it was used to form the first of the two constrains. 

The eligible observations were finally identified by their key value 
(denoted by the variable *REFNUM*).  

* [6.3.1.1 Verify the consistency of date format
](#ind-6-3-1-1--Verify-the-consistency-of-date-format`)  
  * Verifies that the character string format of the values 
    at *BGN_DATE* variable are consistent. 
* [6.3.1.2 Identify the eligible observations
](#ind-6-3-1-2--Identify-the-eligible-observations)  
  * Identifies by their key value 
  the observations at the table with preprocessed data 
  that begun from 2001 or later and resulted in non-zero harm 
  either to population health (caused fatalities or injuries) 
  or to economy (caused property damage or crop damage)

<br>  

<font size="1">[back to start of this subsection](#ind-6-3-1--Identify-the-target-subset-of-observations)</font>  
<font size="1">[back to start of this section](#ind-6-3--Extract-The-Target-Data-Subset)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.3.1.1 Verify the consistency of date format {#ind-6-3-1-1--Verify-the-consistency-of-date-format}  

The year in the value of date at the variable *BGN_DATE* 
was intended to be used as one of the two criteria to 
identify the eligible observations for the target data subset at the 
[next subsubsection](#ind-6-3-1-2--Identify-the-eligible-observations).  

That's why it is crucial at this point, 
to verify that the values of date are in the expected format, 
which as indicated by the [overview of the table with preprocessed data
](#ind-6-2-4--Overview-of-the-table-with-the-preprocessed-data) 
(as well as some interactive examination) seems to be:  

* **MM/DD/YYYY 0:00:00**
  * *MM* stands for 2 characters for the month  
  * *DD* stands for 2 characters for the day  
  * *YYYY* stands for 4 characters for the year  
  * the value of year is followed by a space  
  * *0:00:00* is a dummy part that stands for the time  

```{r verify_the_consistency_of_format_for_the_values_of_begin_date}

# Create a validator for the format 
# of the character string values of the dates.
V____expected_character_string_format_for_begin_date <- validator(
  "expected_character_string_format_of_date" = 
    grepl("^\\d{1,2}/\\d{1,2}/\\d{4} 0:00:00$", BGN_DATE)
)

# Confront the table with the preprocessed data with the validator 
# for the format of the character string values of dates.
CF____expected_character_string_format_for_begin_date <- confront(
  dat = preprocessed_data,
  V____expected_character_string_format_for_begin_date
)

```

Indeed all values for dates were found to be in the expected format.  

```{r create_a_kable_to_present_the_results_for_the_consistency_of_format_for_the_values_of_begin_date}

# Create a kable to present the results of the confrontation 
# for the format of the character string values of dates.
kable(
  x = summary(CF____expected_character_string_format_for_begin_date)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.3.1.1-1: ",
    "The results of the validation ",
    "for the format of the character sting values of dates ", 
    "from the variable BGN_DATE at the table with preprocessed data." 
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-3-1-1--Verify-the-consistency-of-date-format)</font>  
<font size="1">[back to start of this subsection](#ind-6-3-1--Identify-the-target-subset-of-observations)</font>  
<font size="1">[back to start of this section](#ind-6-3--Extract-The-Target-Data-Subset)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.3.1.2 Identify the eligible observations {#ind-6-3-1-2--Identify-the-eligible-observations}

According to the discussion for the two 
[points of interest for the Storm Events Dataset](#ind-4-2--Points-Of-Interest) 
only a subset of observations will be used for this analysis. 
This target data subset includes only the observations which refer to 
weather phenomena that simultaneously satisfy the following two criteria:  

* **begun at Jan 2011 and later** due to the implications of 
  [changes in the composition of weather event types
  ](#ind-4-2-1--Changes-in-the-composition-of-weather-event-types)  
  * the year (that was extracted from the date value of the *BGN_DATE* variable  
  coerced to integer) must be found equal or larger than 2001  
* **resulted in non-zero harm either to population health (caused fatalities or injuries) 
or to economy (caused property damage or crop damage)** due to the implications of the 
[eligibility criteria for inclusion of weather events in the dataset
](#ind-4-2-2--Eligibility-criteria-for-inclusion-of-weather-events-in-the-dataset)
  * the value of at least one of the variables, 
  *FATALITIES*, *INJURIES*, *PROPDMG* and *CROPDMG* must be positive  

```{r identify_the_target_data_subset_of_observations}

# Create a validator with the eligibility criteria 
# for the inclusion of observations at the target data subset. 
V____criteria_for_target_data_subset_of_observations <- validator(
  "begin_date_from_2001_and_later" = (
    as.integer(
      str_extract(
        string = BGN_DATE,
        pattern = "(?<=^\\d{1,2}/\\d{1,2}/)\\d{4}"
      )
    ) %in%
      c(2001:2011)
  ),
  "non_zero_damage_to_population_health_or_economy" = (
    (as.integer(FATALITIES) > 0) |
      (as.integer(INJURIES) > 0) |
      (as.double(PROPDMG) > 0) |
      (as.double(CROPDMG) > 0)
  )
)

# Confront the table with the preprocessed data with the validator 
# with the eligibility criteria for the inclusion of observations 
# at the target data subset.
CF____criteria_for_target_data_subset_of_observations <- confront(
  dat = preprocessed_data,
  V____criteria_for_target_data_subset_of_observations
)

```

Out of 902297 observation from the table with preprocessed data, 
there were found:  

* 488692 observations which refer to weather phenomena 
that begun at 2001 or later  
* 254633 observations which refer to weather phenomena that resulted in 
non-zero harm either to population health (caused fatalities or injuries) 
or to economy (caused property damage or crop damage)  

```{r create_a_kable_to_present_the_results_for_the_identification_of_observations_for_the_target_data_subset}

# Create a kable to present the results of the test 
# for the inclusion of observations at the target data subset.
kable( 
  x = summary(CF____criteria_for_target_data_subset_of_observations)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.3.1.2-1: ",
    "The results for the eligibility criteria for inclusion of observations ",
    "from the table with the preprocessed data in the target data subset."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

The observations that satisfied simultaneously the two criteria
which determine which observation would be included in the target data subset 
were identified by their key value (denoted by the variable *REFNUM*).

```{r identify_the_target_data_subset_of_observations_by_their_key_value}

# Identify the observations eligible to be included in the target data subset 
# by their key value denoted by the variable REFNUM.
criterion_by_REFNUM_____eligible_observations_for_the_target_data_subset <- with(
  data = CF____criteria_for_target_data_subset_of_observations[["._value"]],
  expr = preprocessed_data[
    begin_date_from_2001_and_later &
      non_zero_damage_to_population_health_or_economy,
    REFNUM
    ]
)

```

Exactly 144826 observations 
were found eligible to be included in the table with the target data subset.

```{r create_a_kable_to_present_the_number_of_eligible_observations_for_the_target_data_subset}

# Create a table that presents the number of observations 
# that were found eligible to be included in the target data subset.
kable(
  x = data.table(
    "Number of Eligible Observations for the Target Data Subset" = 
      length(
        criterion_by_REFNUM_____eligible_observations_for_the_target_data_subset
      )
  ),
  caption = paste0(
    "Table 6.3.1.2-2: ",
    "The number of observations that were found eligible ", "\n",
    "to get included in the table with the target data subset."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-3-1-2--Identify-the-eligible-observations)</font>  
<font size="1">[back to start of this subsection](#ind-6-3-1--Identify-the-target-subset-of-observations)</font>  
<font size="1">[back to start of this section](#ind-6-3--Extract-The-Target-Data-Subset)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.3.2 Create the table with the target data subset {#ind-6-3-2--Create-the-table-with-the-target-data-subset}  

From the table with the preprocessed data, 
the table with the target data subset was created 
by including only those observation that simultaneous satisfied two criteria:   

* begun at Jan 2011 and later (due to the implications of 
  [changes in the composition of weather event types
  ](#ind-4-2-1--Changes-in-the-composition-of-weather-event-types))  
* resulted in non-zero harm either to population health (caused fatalities or injuries) 
or to economy (caused property damage or crop damage) (due to the implications of the 
[eligibility criteria for inclusion of weather events in the dataset
](#ind-4-2-2--Eligibility-criteria-for-inclusion-of-weather-events-in-the-dataset))  

The observations were identified and extracted by their key value 
(denoted by the variable *REFNUM*).  

```{r create_the_table_with_the_target_data_subset}

# Create the table with the target data subset 
# by including only the observations that were found eligible 
# from those included at the table with the preprocessed data.
target_data_subset <- preprocessed_data[
  criterion_by_REFNUM_____eligible_observations_for_the_target_data_subset
  ]

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-3-2--Create-the-table-with-the-target-data-subset)</font>  
<font size="1">[back to start of this section](#ind-6-3--Extract-The-Target-Data-Subset)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.3.3 Conduct post validation for the table with the target data subset {#ind-6-3-3--Conduct-post-validation-for-the-table-with-the-target-data-subset}  

Post validation was conducted to verify that all observations 
contained at the table with the target data subset were eligible.  

The same constrains that were used to 
[identify the eligible observations from the table with preprocessed data
](#ind-6-3-1-2--Identify-the-eligible-observations) 
were used to verify the eligibility of observations 
at the table with the target data subset.  

```{r conduct_post_validation_for_the_table_with_the_target_data_subset}

# The table with the target data subset was post validated 
# to verify that it contained only eligible observations 
# from the table with the preprocessed data.
CF____post_validation_of_target_data_subset_table <- confront(
  dat = target_data_subset,
  # The validator that was created and used to identify 
  # the eligible observations for the target data subset 
  # was used to ensure the validity of the table with the target data subset.
  V____criteria_for_target_data_subset_of_observations
)

```

All observations contained at the table with the target data subset 
were eligible.  

```{r create_a_kable_to_present_the_results_from_post_validation_of_the_table_with_the_target_data_subset}

# Create a kable to present the results of post validation 
# for the table with the target data subset.
kable(
  x = summary(CF____post_validation_of_target_data_subset_table)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.3.3-1: ",
    "The results of the post validation ", 
    "from the table with the target data subset."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The same constrains that were used to identify the eligible observations ", 
      "from the table with the preprocessed data, ", "\n",
      "were used for the post validation of the observations ", 
      "at the table with the target data subset."
    )
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-3-3--Conduct-post-validation-for-the-table-with-the-target-data-subset)</font>  
<font size="1">[back to start of this section](#ind-6-3--Extract-The-Target-Data-Subset)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.3.4 Overview of the table with the target data subset {#ind-6-3-4--Overview-of-the-table-with-the-target-data-subset}  

The table with the target data subset contained 9 variables
and 144826 observations.  

The variable *REFNUM* was set as the key of the table.  

```{r print_the_structure_of_the_table_with_the_target_data_subset}

# Print the structure of the table with target data subset.
str(target_data_subset) 

```

The variables *EVTYPE*, *PROPDMGEXP* and *CROPDMGEXP* contained 
a suspiciously large number of distinct values.

```{r create_a_kable_to_present_facts_for_the_table_with_the_target_data_subset} 

# Create a kable to highlight some facts about the target data subset table.
kable(
  x = data.table(
    "Variable Name" = names(target_data_subset),
    "Number of Distinct Values" = vapply(
      X = target_data_subset, 
      FUN = function(x) length(unique(x[!is.na(x)])), 
      FUN.VALUE = integer(1))
  ),
  caption = paste0(
    "Table 6.3.4: ",
    "Facts about the variables at the table with the target data subset."
  )
) %>% 
  kable_styling(
    bootstrap_options = c(
      "striped", "hover", "condensed", "responsive", "bordered"
    ), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The table with the target data subset contains 9 variables ", "\n",
      "and 144826 observations without any missing value (coded as NA)."
    )
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-3-4--Overview-of-the-table-with-the-target-data-subset)</font>  
<font size="1">[back to start of this section](#ind-6-3--Extract-The-Target-Data-Subset)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 6.4 Conduct In-Record Data Validation {#ind-6-4--Conduct-In-Record-Data-Validation}  

<font size="3"><u><strong>Summary</strong></u></font>  

Through the in-record data validation stage
the values of each variable from the table with the target data subset 
were examined independently of the corresponding values at other variables, 
in order to identify invalid entries 
which were then substituted by missing values (coded properly as NA)
to create the table with the in-record validated data.  

Finally post validation was conducted 
and some facts about the table with the in-record validated data 
were highlighted.  

<font size="3"><u><strong>Steps</strong></u></font>  

* [6.4.1 Introduce information from the Strom Data Documentation
](#ind-6-4-1--Introduce-information-from-the-Strom-Data-Documentation)  
  * Creates constants with information about the permitted values 
  of some variables that will be used to form validity contains.  
    * [6.4.1.1 Valid values for the EVTYPE variable
    ](#ind-6-4-1-1--Valid-values-for-the-EVTYPE-variable)  
      * The valid values for EVTYPE variable were introduced.  
    * [6.4.1.2 Valid values for the PROPDMGEXP variable
    ](#ind-6-4-1-2--Valid-values-for-the-PROPDMGEX-variable)  
      * The valid values for PROPDMGEXP variable were introduced.  
    * [6.4.1.3 Valid values for the CROPDMGEXP variable
    ](#ind-6-4-1-3--Valid-values-for-the-CROPDMGEXP-variable)  
      * The valid values for PROPDMGEXP variable were introduced.  
* [6.4.2 Conduct in-record data validation for each variable
](#ind-6-4-2--Conduct-in-record-data-validation-for-each-variable)  
  * Identifies the invalid values for each variable.  
* [6.4.3 Create the table with the in-record validated data
](#ind-6-4-3--Create-the-table-with-the-in-record-validated-data)  
  * Creates the table with the in-record validated data 
  by substituting all invalid values that were identified as invalid, 
  with NAs.  
* [6.4.4 Conduct post validation for the table with the in-record validated data
](#ind-6-4-4--Conduct-post-validation-for-the-table-with-the-in-record-validated-data)  
  * Ensures that all values of each variable 
  at the table with the in-record validated data are valid.  
* [6.4.5 Overview of the table with the in-record validated data
](#ind-6-4-5--Overview-of-the-table-with-the-in-record-validated-data)  
  * Presents some basic facts about the table with the in-record validated data.  

<br>  

<font size="1">[back to start of this section](#ind-6-4--Conduct-In-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 6.4.1 Introduce information from the Strom Data Documentation {#ind-6-4-1--Introduce-information-from-the-Strom-Data-Documentation}  

Some constants with the valid values 
for the variables *EVTYPE*, *PROPDMGEXP* and *CROPDMGEXP* 
(as stated at the [Storm Data Documentation
](https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2Fpd01016005curr.pdf))
were created and used in order to form their respective constrains.

* [6.4.1.1 Valid values for the EVTYPE variable](#ind-6-4-1-1--Valid-values-for-the-EVTYPE-variable)  
  * The 48 valid values for EVTYPE variable were introduced.  
* [6.4.1.2 Valid values for the PROPDMGEXP variable](#ind-6-4-1-2--Valid-values-for-the-PROPDMGEXP-variable)  
  * The 3 valid values for PROPDMGEXP variable were introduced.  
* [6.4.1.3 Valid values for the CROPDMGEXP variable](#ind-6-4-1-3--Valid-values-for-the-CROPDMGEXP)-variable)  
  * The 3 valid values for CROPDMGEXP variable were introduced.  
 
<br>  

<font size="1">[back to start of this subsection](#ind-6-4-1--Introduce-information-from-the-Strom-Data-Documentation)</font>  
<font size="1">[back to start of this section](#ind-6-4--Conduct-In-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.4.1.1 Valid values for the EVTYPE variable {#ind-6-4-1-1--Valid-values-for-the-EVTYPE-variable}  

The entries of the variable *EVTYPE* according to the 
[NATIONAL WEATHER SERVICE INSTRUCTION 10-1605, AUGUST 17, 2007
](https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2Fpd01016005curr.pdf)
(at chapter 7), must take one of the 48 character values 
that correspond to the defined weather event types:  

<div class = "row">
  
 <div class = "col-md-4">
  1. ASTRONOMICAL LOW TIDE  
  2. AVALANCHE  
  3. BLIZZARD  
  4. COASTAL FLOOD  
  5. COLD/WIND CHILL  
  6. DEBRIS FLOW  
  7. DENSE FOG  
  8. DENSE SMOKE  
  9. DROUGHT  
  10. DUST DEVIL  
  11. DUST STORM  
  12. EXCESSIVE HEAT  
  13. EXTREME COLD/WIND CHILL  
  14. FLASH FLOOD  
  15. FLOOD  
  16. FROST/FREEZE  
 </div>
  
 <div class = "col-md-4">
  17. FUNNEL CLOUD  
  18. FREEZING FOG  
  19. HAIL  
  20. HEAT  
  21. HEAVY RAIN  
  22. HEAVY SNOW  
  23. HIGH SURF  
  24. HIGH WIND  
  25. HURRICANE/TYPHOON  
  26. ICE STORM  
  27. LAKE-EFFECT SNOW  
  28. LAKESHORE FLOOD  
  29. LIGHTNING  
  30. MARINE HAIL  
  31. MARINE HIGH WIND  
  32. MARINE STRONG WIND  
 </div>

 <div class = "col-md-4">
  33. MARINE THUNDERSTORM WIND  
  34. RIP CURRENT  
  35. SEICHE  
  36. SLEET  
  37. STORM SURGE/TIDE  
  38. STRONG WIND  
  39. THUNDERSTORM WIND  
  40. TORNADO  
  41. TROPICAL DEPRESSION  
  42. TROPICAL STORM  
  43. TSUNAMI  
  44. VOLCANIC ASH  
  45. WATERSPOUT  
  46. WILDFIRE  
  47. WINTER STORM  
  48. WINTER WEATHER  
 </div>

</div>

```{r supply_information_for_the_defined_weather_event_type}

# Create a vector that includes the 48 values of the defined weather event types.
defined_event_types <- c(
  "ASTRONOMICAL LOW TIDE", 
  "AVALANCHE", 
  "BLIZZARD", 
  "COASTAL FLOOD", 
  "COLD/WIND CHILL", 
  "DEBRIS FLOW", 
  "DENSE FOG", 
  "DENSE SMOKE", 
  "DROUGHT", 
  "DUST DEVIL", 
  "DUST STORM",
  "EXCESSIVE HEAT",
  "EXTREME COLD/WIND CHILL", 
  "FLASH FLOOD", 
  "FLOOD", 
  "FROST/FREEZE", 
  "FUNNEL CLOUD", 
  "FREEZING FOG", 
  "HAIL", 
  "HEAT",
  "HEAVY RAIN", 
  "HEAVY SNOW", 
  "HIGH SURF", 
  "HIGH WIND", 
  "HURRICANE/TYPHOON", 
  "ICE STORM", 
  "LAKE-EFFECT SNOW", 
  "LAKESHORE FLOOD", 
  "LIGHTNING",
  "MARINE HAIL", 
  "MARINE HIGH WIND",
  "MARINE STRONG WIND", 
  "MARINE THUNDERSTORM WIND", 
  "RIP CURRENT", 
  "SEICHE", 
  "SLEET", 
  "STORM SURGE/TIDE",
  "STRONG WIND", 
  "THUNDERSTORM WIND",
  "TORNADO", 
  "TROPICAL DEPRESSION", 
  "TROPICAL STORM", 
  "TSUNAMI", 
  "VOLCANIC ASH", 
  "WATERSPOUT", 
  "WILDFIRE",
  "WINTER STORM", 
  "WINTER WEATHER"
)

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-4-1-1--Valid-values-for-the-EVTYPE-variable)</font>  
<font size="1">[back to start of this subsection](#ind-6-4-1--Introduce-information-from-the-Strom-Data-Documentation)</font>  
<font size="1">[back to start of this section](#ind-6-4--Conduct-In-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.4.1.2 Valid values for the PROPDMGEXP variable {#ind-6-4-1-2--Valid-values-for-the-PROPDMGEX-variable} 

The entries of the variable *PROPDMGEXP* 
that indicates whether the magnitude for the economic damage,
(denoted by the *PROPDMG* variable),
refers to thousands, millions or billions of dollars, 
according to the information provided by 
[NATIONAL WEATHER SERVICE INSTRUCTION 10-1605, AUGUST 17, 2007
](https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2Fpd01016005curr.pdf)
(at chapter 2.7), must take one of the following 3 character values :  

  1. **K** which corresponds to thousands of dollars  
  2. **M** which corresponds to millions of dollars  
  3. **B** which corresponds to billions of dollars  

```{r supply_information_for_the_defined_property_damage_exponent}

# Create a vector that includes the defined values for the variable PROPDGMEXP.
defined_property_damage_exponents <- c("K", "M", "B")

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-4-1-2--Valid-values-for-the-EVTYPE-variable)</font>  
<font size="1">[back to start of this subsection](#ind-6-4-1--Introduce-information-from-the-Strom-Data-Documentation)</font>  
<font size="1">[back to start of this section](#ind-6-4--Conduct-In-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.4.1.3 Valid values for the CROPDMGEXP variable {#ind-6-4-1-3--Valid-values-for-the-PROPDMGEXP-variable} 

The entries of the variable *CROPDMGEXP* 
that indicates whether the magnitude for the economic damage,
(denoted by the *CROPDMG* variable),
refers to thousands, millions or billions of dollars, 
according to the information provided by 
[NATIONAL WEATHER SERVICE INSTRUCTION 10-1605, AUGUST 17, 2007
](https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2Fpd01016005curr.pdf)
(at chapter 2.7), must take one of the following 3 character values :  

  1. **K** which corresponds to thousands of dollars  
  2. **M** which corresponds to millions of dollars  
  3. **B** which corresponds to billions of dollars  

```{r supply_information_for_the_defined_crop_damage_exponent} 

# Create a vector that includes the defined values for the variable CROPDGMEXP.
defined_crop_damage_exponents <- c("K", "M", "B")

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-4-1-3--Valid-values-for-the-CROPDMGEXP-variable)</font>  
<font size="1">[back to start of this subsection](#ind-6-4-1--Introduce-information-from-the-Strom-Data-Documentation)</font>  
<font size="1">[back to start of this section](#ind-6-4--Conduct-In-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.4.2 Conduct in-record data validation for each variable {#ind-6-4-2--Conduct-in-record-data-validation-for-each-variable}  

To create the constrains for the in-record validation for each variable 
from the table with the target data subset, some 'common world knowledge' 
combined with information provided by the *Storm Data Documentation* 
about the [valid values of the available variables
](#ind-6-4-1--Introduce-information-from-the-Strom-Data-Documentation) 
were used.  

Specifically:  

1. The *REFNUM* variable's values must be unique for each observations.  
2. the *BGN_DATE* variable's value must contain a year part that is from 2001 up to 2011
3. The *EVTYPE* variable's values must be one of the 
[48 defined events types](#ind-6-4-1-1--Valid-values-for-the-EVTYPE-variable).  
4. The *FATALITIES* variable's values must be non-negative.  
5. The *INJURIES* variable's values must be non-negative. 
6. The *PROPDMG* variable's values must be non-negative.  
7. The *PROPDMGEXP* variable's values must be *K*, *M* or *B*.  
8. The *CROPDMG* variable's values must be non negative.  
9. The *CROPDMGEXP* variable's values must be *K*, *M* or *B*.

Although unnecessary to test the constrains for all variables,
that were included in the table with the target data subset 
(the uniqueness of the values in key variable *REFNUM*,
the fact the year indicated in the *BGN_DATE* variable was from 2001 to 2011 
as well as the fact that the values of the variables 
*FATALITIES*, *INJURIES*, *CROPDMG*, *PROPDMG* were non-negative), 
because some of them had been verified 
in previous stages of the data processing procedure,
such tests were included in order to provided a detailed and complete 
overview of all the in-record constrains for the entries  
of each variable at the validated data table.  

Actually only the variables *EVTYPE*, *PROPDMGEXP* and *CROPDMGEXP* 
needed to be validated in this stage, 
as these were the ones that haven't been checked properly yet.  

```{r conduct_in_record_validation_for_the_variables_at_the_table_with_the_target_data_subset}

# Create a validator with constrains for the in-record validation 
# for the values of each variable.
V____constrains_for_the_in_record_data_validation <- validator(
  "REFNUM" = ( REFNUM %in% names(table(REFNUM))[table(REFNUM) == 1] ),
  "BGN_DATE" = ( 
    as.integer(
      str_extract(BGN_DATE, "(?<=^\\d{1,2}/\\d{1,2}/)\\d{4}(?= 0:00:00$)")
    ) %in%
      c(2001:2011)
  ),
  "EVTYPE" = ( EVTYPE %in% defined_event_types ),
  "FATALITIES" = ( FATALITIES >= 0 ),
  "INJURIES" = ( INJURIES >= 0 ),
  "PROPDMG" = ( PROPDMG >= 0 ),
  "PROPDMGEXP" = ( PROPDMGEXP %in% defined_property_damage_exponents ),
  "CROPDMG" = ( CROPDMG >= 0 ),
  "CROPDMGEXP" = ( CROPDMGEXP %in% defined_crop_damage_exponents )
)

# Confront the table with target data subset with the validator 
# which contains the constrains for the in-record data validation. 
CF____constrains_for_the_in_record_data_validation <- confront(
  dat = target_data_subset,
  V____constrains_for_the_in_record_data_validation
)

```

According to the results of the in-record data validation, 
there is a significant proportion of invalid values found 
at the variables *EVTYPE*, *PROPDMGEXP* and *CROPDMGEXP*.  

```{r create_a_kable_to_present_the_results_from_the_in_record_validation_for_the_variables_at_the_table_with_the_target_data_subset}

# Create a kable to present the results of the in-record data validation 
# with the table with target data subset.
kable(
  x = summary(CF____constrains_for_the_in_record_data_validation)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.4.2-1: ",
    "The results of the in-record data validation ",
    "for the table with the target data subset."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

The invalid values for each variable were identified by their key value 
(denoted by the variable *REFNUM*). 

```{r identify_the_invalid_observations_at_each_variable_of_table_with_the_target_data_subset_by_their_key_value}

# Identify the values that were found invalid for each variable 
# by the key value. 
criterion_by_REFNUM_____invalid_values_of_each_variable <- 
  lapply(
    X = CF____constrains_for_the_in_record_data_validation[["._value"]],
    FUN = function(x) {
      target_data_subset[!x, REFNUM]
    }
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-4-2--Conduct-in-record-data-validation-for-each-variable)</font>  
<font size="1">[back to start of this section](#ind-6-4--Conduct-In-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.4.3 Create the table with the in-record validated data {#ind-6-4-3--Create-the-table-with-the-in-record-validated-data}  

The table with the in-record validated data was obtained, 
by substituting with NAs all values 
that were identified as invalid at the table with the target data subset.  

The invalid values for each variable were identified and substituted 
by their key value (denoted by the variable *REFNUM*).  

```{r create_the_table_with_the_in_record_validated_data}

# Create a dummy table as a copy of the table with the target data subset. 
in_record_validated_data <- copy(target_data_subset)

# Create the table with the in-record validated data 
# by substituted with NAs the invalid values of each variable.
for ( var_name in names(criterion_by_REFNUM_____invalid_values_of_each_variable) ) {
  set(x = in_record_validated_data,
      i = which(
        in_record_validated_data$REFNUM %in%
          criterion_by_REFNUM_____invalid_values_of_each_variable[[var_name]]
      ),
      j = var_name,
      value = NA
  )
}

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-4-3--Create-the-table-with-the-in-record-validated-data)</font>  
<font size="1">[back to start of this section](#ind-6-4--Conduct-In-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.4.4 Conduct post validation for the table with the in-record validated data {#ind-6-4-4--Conduct-post-validation-for-the-table-with-the-in-record-validated-data}  

Post validation was conducted to verify that the values of variables 
at the table with the in-record validated data were valid 
according to the same constrains that were used to 
[identify the invalid values for each variable
](#ind-6-4-2--Conduct-in-record-data-validation-for-each-variable) 
at the table with the target data subset.  

```{r conduct_post_validation_for_the_table_with_the_in_record_validated_data}

# The table with the in-record validated data was post validated to verify 
# that all values for each of variable it contained were valid.
CF____post_validation_of_the_table_with_the_in_record_validated_data <- 
  confront(
    dat = in_record_validated_data,
    V____constrains_for_the_in_record_data_validation
)

```

All the values for each variable at the table with the in-record validated data 
were valid.  

```{r create_a_kable_to_present_the_results_from_post_validation_of_the_table_with_the_in_record_validated_data}

# Create a kable to present the results of the post validation 
# for the table with the in-record validated data.  
kable(
  x = summary(CF____post_validation_of_the_table_with_the_in_record_validated_data)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.4.4-1: ",
    "The results of post validation ", 
    "for the table with the in-record validated data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The same constrains that were used to identify the invalid values ", 
      "of each variable at the table with the target data subset, ", "\n",
      "were used for the post validation of the observations ", 
      "at the table with the in-record validated data."
    )
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-4-4--Conduct-post-validation-for-the-table-with-the-in-record-validated-data)</font>  
<font size="1">[back to start of this section](#ind-6-4--Conduct-In-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.4.5 Overview of the table with the in-record validated data {#ind-6-4-5--Overview-of-the-table-with-the-in-record-validated-data}  

The table with the in-record validated data contained 9 variables 
and 144826 observations.  

The variable *REFNUM* was set as the key of table.

```{r print_the_structure_of_the_table_with_the_in_record_validated_data}

# Print the structure of the table with the in-record validated data table .
str(in_record_validated_data)

```

There were plenty of missing values, 
that were introduced as a result of the in-record validation procedure
for the variables *EVTYPE*, *PROPDMGEXP* and *CROPDMGEXP*, 
but the number of distinct values didn't indicate any more 
the presence of obvious abnormalities.  

```{r create_a_kable_to_present_facts_for_the_table_with_the_in_record_validated_data}

# Create a kable to highlight some facts 
# about the table with the in-record validated data.
kable(
  x = data.table(
    "Variable" = names(in_record_validated_data),
    "Number of Distinct Values" = vapply(
      X = in_record_validated_data, 
      FUN = function(x) length(unique(x[!is.na(x)])), 
      FUN.VALUE = integer(1)
    ),
    "Number of NAs" = vapply(
      X = in_record_validated_data, 
      FUN = function(x) sum(is.na(x)), 
      FUN.VALUE = integer(1)),
    "Percentage of NAs" = 
      vapply(
        X = in_record_validated_data, 
        FUN = function(x) mean(is.na(x)), 
        FUN.VALUE =double(1))
  ),
  caption = "Table 6.4.5-1: Facts about the table with in-record validated data."
) %>% 
  kable_styling(
    bootstrap_options = c(
      "striped", "hover", "condensed", "responsive", "bordered"
      ), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The table with the in-record validated data contained 9 variables ", 
      "and 144826 observations."
    )
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-4-5--Overview-of-the-table-with-the-in-record-validated-data)</font>  
<font size="1">[back to start of this section](#ind-6-4--Conduct-In-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 6.5 Impute Missing Values {#ind-6-5--Impute-Missing-Values}  

<font size="3"><u><strong>Summary</strong></u></font>  

In this stage of data processing procedure,
an attempt was made to maximize 
the amount of available information for the analysis,
by imputing some of the missing values 
that exist at the table with the in-record validated data 
with plausible values.

There were 3 variables (*EVTYPE*, *PROPDMGEXP* and *CROPDMGEXP*) 
that contained NAs, all of which were introduced through the 
[in-record data validation stage](#ind-6-4--Conduct-In-Record-Data-Validation). 

Via a conservative deterministic approach 
which aimed to retrieve the missing values 
only for the cases that there were almost no doubt 
about the values that were imputed,
the majority of those entries got successfully restored.

However it is highlighted that for the variable *EVTYPE*, 
there is no guarantee that the values imputed are error-free, 
due to the fact that the associations were made based on the invalid values 
found at the table with the target data subset, 
that were substituted by NAs and the information available in 
[NATIONAL WEATHER SERVICE INSTRUCTION 10-1605, AUGUST 17, 2007
](https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2Fpd01016005curr.pdf)
(at chapter 7)*  
by the analyst who has **no expertise neither on weather nor in meteorology**. 

On the other hand, the missing values that were imputed 
for the variables *PROPDMGEXP* and *CROPDMGEXP* 
are almost certainly correct 
(and even if they are not,
it didn't affect in any significant way the results of the analysis 
as they all correspond to observations 
that resulted in 0 property and crop damage respectively 
while the analysis focused on the observations for the weather events 
that caused non-zero harm).  

```{r create_a_dummy_table_for_imputed_data_as_a_copy_of_the_table_with_in_record_validated_data} 

# Create a dummy table by coping the table with the in-record validated data 
# at which the missing values for the variable EVTYPE, PROPDMGEXP and CROPDMGEXP 
# will be imputed to get the table with the imputed data.
imputed_data <- copy(in_record_validated_data)

```

<font size="3"><u><strong>Steps</strong></u></font>  

* [6.5.1 Impute missing values at the variable EVTYPE](#ind-6-5-1--Impute-missing-values-at-the-variable-EVTYPE)  
  * Imputes the missing values at the variable EVTYPE 
  with plausible substitutions based on the invalid values they corresponded:  
    * [6.5.1.1 Examine the invalid values from the variable EVTYPE
    ](#ind-6-5-1-1--Examine-the-invalid-values-from-the-variable-EVTYPE)  
      * Examine the invalid values that have been substituted by NAs.  
    * [6.5.1.2 Associate plausible substitutions to the invalid values from the variable EVTYPE
    ](#ind-6-5-1-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-EVTYPE)  
      * Associated the invalid values with plausible substitutions.  
    * [6.5.1.3 Identify the imputable missing values at the variable EVTYPE
    ](#ind-6-5-1-3--Identify-the-imputable-missing-values-at-the-variable-EVTYPE)  
      * Identified the imputable missing values according to associations by their key value.   
    * [6.5.1.4 Substitute the imputable missing values at the variable EVTYPE
    ](#ind-6-5-1-4--Substitute-the-imputable-missing-values-at-the-variable-EVTYPE)  
      * Substituted the imputable missing values with valid ones.  
* [6.5.2 Impute missing values at the variable PROPDMGEXP](#ind-6-5-2--Impute-missing-values-at-the-variable-PROPDMGEXP)  
  * Imputes the missing values at the variable PROPDMGEXP 
  with plausible substitutions based on the invalid values they corresponded:  
    * [6.5.2.1 Examine the invalid values from the variable PROPDMGEXP
    ](#ind-6-5-2-1--Examine-the-invalid-values-from-the-variable-PROPDMGEXP)  
      * Examine the invalid values that have been substituted by NAs.  
    * [6.5.2.2 Associate plausible substitutions to the invalid values from the variable PROPDMGEXP
    ](#ind-6-5-2-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-PROPDMGEXP)  
      * Associated the invalid values with plausible substitutions.  
    * [6.5.2.3 Identify the imputable missing values at the variable PROPDMGEXP
    ](#ind-6-5-2-3--Identify-the-imputable-missing-values-at-the-variable-PROPDMGEXP)  
      * Identified the imputable missing values according to associations by their key value.   
    * [6.5.2.4 Substitute the imputable missing values at the variable PROPDMGEXP
    ](#ind-6-5-2-4--Substitute-the-imputable-missing-values-at-the-variable-PROPDMGEXP)  
      * Substituted the imputable missing values with valid ones.  
* [6.5.3 Impute missing values at the variable CROPDMGEXP](#ind-6-5-3--Impute-missing-values-at-the-variable-CROPDMGEXP)  
  * Imputes the missing values at the variable CROPDMGEXP 
  with plausible substitutions based on the invalid values they corresponded:  
    * [6.5.3.1 Examine the invalid values from the variable CROPDMGEXP
    ](#ind-6-5-3-1--Examine-the-invalid-values-from-the-variable-CROPDMGEXP)  
      * Examine the invalid values that have been substituted by NAs.  
    * [6.5.3.2 Associate plausible substitutions to the invalid values from the variable CROPDMGEXP
    ](#ind-6-5-3-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-CROPDMGEXP)  
      * Associated the invalid values with plausible substitutions.  
    * [6.5.3.3 Identify the imputable missing values at the variable CROPDMGEXP
    ](#ind-6-5-3-3--Identify-the-imputable-missing-values-at-the-variable-CROPDMGEXP)  
      * Identified the imputable missing values according to associations by their key value.   
    * [6.5.3.4 Substitute the imputable missing values at the variable CROPDMGEXP
    ](#ind-6-5-3-4--Substitute-the-imputable-missing-values-at-the-variable-CROPDMGEXP)  
      * Substituted the imputable missing values with valid ones.  
* [6.5.4 Conduct post validation for the table with the imputed data](#ind-6-5-4--Conduct-post-validation-for-the-table-with-the-imputed-data)
  * Ensures that all values of each variable 
  at the table with the imputed data are valid.  
* [6.5.5 Overview of the table with the imputed data](#ind-6-5-5--Overview-of-the-table-with-the-imputed-data)  
  * Presents some basic facts about the table with the imputed data.  

<br>  

<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 6.5.1 Impute missing values at the variable EVTYPE {#ind-6-5-1--Impute-missing-values-at-the-variable-EVTYPE}  

The invalid values for the variable EVTYPE 
at the table with the target data subset 
(before they got substituted by NAs at the 
[in-record data validation stage](#ind-6-4--Conduct-In-Record-Data-Validation))
were examined and associations were made to plausible valid substitutions. 
Those observations with missing values 
that corresponded to successfully associated plausible substitutions, 
were identified by their key values and were imputed.


* [6.5.1.1 Examine the invalid values from the variable EVTYPE
](#ind-6-5-1-1--Examine-the-invalid-values-from-the-variable-EVTYPE)  
  * Examine the invalid values that have been substituted by NAs.  
* [6.5.1.2 Associate plausible substitutions to the invalid values from the variable EVTYPE
](#ind-6-5-1-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-EVTYPE)  
  * Associated the invalid values with plausible substitutions.  
* [6.5.1.3 Identify the imputable missing values at the variable EVTYPE ](#ind-6-5-1-3--Identify-the-imputable-missing-values-at-the-variable-EVTYPE)  
  * Identified the imputable missing values according to associations by their key value.   
* [6.5.1.4 Substitute the imputable missing values at the variable EVTYPE ](#ind-6-5-1-4--Substitute-the-imputable-missing-values-at-the-variable-EVTYPE)  
  * Substituted the imputable missing values with valid ones.  

<br>  

<font size="1">[back to start of this subsection](#ind-6-5-1--Impute-missing-values-at-the-variable-EVTYPE)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.1.1 Examine the invalid values from the variable EVTYPE {#ind-6-5-1-1--Examine-the-invalid-values-from-the-variable-EVTYPE}  

For the variable *EVTYPE* at the table with the in-record validated data, 
out of the total 144826 observations 32775 (22.63%) were NAs.  

```{r create_a_kable_to_present_the_facts_about_the_variable_EVTYPE_at_the_table_with_the_in_record_validated_data} 

# Create a kable to present information on the missing values 
# for the variable EVTYPE at the table with the imputed data.
kable(
  x = data.table(
    "Variable" = "EVTYPE",
    "Total Number of Values" = length(in_record_validated_data$EVTYPE),
    "Number of Missing Values" = sum(is.na(in_record_validated_data$EVTYPE)),
    "Percentage of Missing Values" = mean(is.na(in_record_validated_data$EVTYPE))
  ),
  caption = paste0(
    "Table 6.5.1.1-1: ",
    "Information on the missing values ", 
    "for the variable EVTYPE at the table with the target data subset."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

These 32775 missing values at the table with the in-record validated data, 
corresponded to 51 distinct invalid entries 
at the table with the target data subset 
before they got substituted by NAs at the 
[in-record data validation stage](#ind-6-4--Conduct-In-Record-Data-Validation).

```{r create_a_kable_to_present_the_distinct_invalid_values_for_the_the_variable_EVTYPE_at_the_table_with_the_target_data_subset}

# Create a kable to presents information on the distinct invalid values 
# for the variable EVTYPE at the table with the target data subset 
# that were substituted by NAs at the in-record validation stage.
kable(
  x = target_data_subset[
    is.na(in_record_validated_data$EVTYPE), .N, by = EVTYPE][
      order(N,decreasing = TRUE)],
  col.names = c("Invalid Values", "Number of Occurrences"),
  caption = paste0(
    "Table 6.5.1.1-2: ",
    "Information on the distinct invalid values ", 
    "for the variable EVTYPE at the table with the target data subset ",
    "which got substituted by NAs at the in-record validation stage."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-1-1--Examine-the-invalid-values-from-the-variable-EVTYPE)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-1--Impute-missing-values-at-the-variable-EVTYPE)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.1.2 Associate plausible substitutions to the invalid values from the variable EVTYPE {#ind-6-5-1-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-EVTYPE}

To impute the corresponding NAs associations were made 
from the invalid entries to defined weather event types.  

* Some of the associations were based solely on the invalid values,
which directly corresponded to defined event types 
as they seem to be either typos 
(e.g. "RIP CURRENTS" instead of "RIP CURRENT") 
or acronyms of the expected values 
(e.g. "TSTM WIND" instead of "THUNDERSTORM WIND").  
* While for others the description for each one of the 48 event types 
that was available in 
[NATIONAL WEATHER SERVICE INSTRUCTION 10-1605, AUGUST 17, 2007
](https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2Fpd01016005curr.pdf)
*(at chapter 7)* was taken into account 
for cases where a variation of the defined value had been supplied 
(e.g. "URBAN/SML STREAM FLD" instead of "HEAVY RAIN").  

**Nevertheless it is stressed 
that the associations mainly depend on 'common sense' judgment 
(instead of solid professional expertise)
and in no way they are guaranteed to be error-free,
despite the best efforts made to impute only the most obvious cases.**  

In total, 28 distinct invalid values were associated 
to some of the 48 defined weather event types:

<div class = "row">
  
 <div class = "col-md-6">
  1. 'COASTAL FLOODING' --> **COASTAL FLOOD**  
  2. 'COLD WEATHER' --> **COLD/WIND CHILL**  
  3. 'LANDSLIDE' --> **DEBRIS FLOW**  
  4. 'MUDSLIDE' --> **DEBRIS FLOW**  
  5. 'MUD SLIDE' --> **DEBRIS FLOW**  
  6. 'DROWNING' --> **DROUGHT**  
  7. 'EXTREME COLD' --> **EXTREME COLD/WIND CHILL**  
  8. 'EXTREME WINDCHILL' --> **EXTREME COLD/WIND CHILL**  
  9. 'FREEZE' --> **FROST/FREEZE**  
  10. 'SMALL HAIL' --> **HAIL**  
  11. 'URBAN/SML STREAM FLD' --> **HEAVY RAIN**  
  12. 'HEAVY SURF/HIGH SURF' --> **HIGH SURF**  
  13. 'HEAVY SURF' --> **HIGH SURF**  
  14. 'HAZARDOUS SURF' --> **HIGH SURF**  
 </div>
  
 <div class = "col-md-6">
  15. '   HIGH SURF ADVISORY' --> **HIGH SURF**  
  16. 'HURRICANE' --> **HURRICANE/TYPHOON**  
  17. 'LAKE EFFECT SNOW' --> **LAKE-EFFECT SNOW**  
  18. 'MARINE TSTM WIND' --> **MARINE THUNDERSTORM WIND**  
  19. 'RIP CURRENTS' --> **RIP CURRENT**  
  20. 'STORM SURGE' --> **STORM SURGE/TIDE**  
  21. 'STRONG WINDS' --> **STRONG WIND**  
  22. 'TSTM WIND' --> **THUNDERSTORM WIND**  
  23. 'DRY MICROBURST' --> **THUNDERSTORM WIND**  
  24. 'THUNDERSTORM' --> **THUNDERSTORM WIND**  
  25. 'WILD/FOREST FIRE' --> **WILDFIRE**  
  26. 'BRUSH FIRE' --> **WILDFIRE**  
  27. 'WINTER WEATHER/MIX' --> **WINTER WEATHER**  
  28. 'WINTER WEATHER MIX' --> **WINTER WEATHER**  
 </div>

</div>

*( The 15th invalid value contained __3 spaces__ before the 'HIGH SURF ADVISORY', 
but for some unknown reason after rendering it seems to be only 1 space.)*  

```{r create_the_associations_of_distinct_invalid_values_from_variable_EVTYPE_at_the_target_data_subset_to_defined_weather_event_types}

# Create a list the associations made from the invalid entries 
# for the variable EVTYPE at the table with the target data subset 
# to defined weather event types.
associations_on_defined_event_types <- list(
  "COASTAL FLOOD" = c("COASTAL FLOODING"),
  "COLD/WIND CHILL" = c("COLD WEATHER"),
  "DEBRIS FLOW" = c("LANDSLIDE", "MUDSLIDE", "MUD SLIDE"),
  "DROUGHT" = c("DROWNING"),
  "EXTREME COLD/WIND CHILL" = c("EXTREME COLD", "EXTREME WINDCHILL"),
  "FROST/FREEZE" = c("FREEZE"),
  "HAIL" = c("SMALL HAIL"),
  "HEAVY RAIN" = c("URBAN/SML STREAM FLD"),
  "HIGH SURF" = c(
    "HEAVY SURF/HIGH SURF", "HEAVY SURF", "HAZARDOUS SURF",
    "   HIGH SURF ADVISORY"),
  "HURRICANE/TYPHOON" = c("HURRICANE"),
  "LAKE-EFFECT SNOW" = c("LAKE EFFECT SNOW"),
  "MARINE THUNDERSTORM WIND" = c("MARINE TSTM WIND"),
  "RIP CURRENT" = c("RIP CURRENTS"),
  "STORM SURGE/TIDE" = c("STORM SURGE"),
  "STRONG WIND" = c("STRONG WINDS"),
  "THUNDERSTORM WIND" = c("TSTM WIND", "DRY MICROBURST", "THUNDERSTORM"),
  "WILDFIRE" = c("WILD/FOREST FIRE", "BRUSH FIRE"),
  "WINTER WEATHER" = c("WINTER WEATHER/MIX", "WINTER WEATHER MIX")
)

```

On the other hand there were 23 distinct invalid values
were not possible to get associated (with relatively high confidence)
with any of the 48 defined event types: 

<div class = "row">
  
 <div class = "col-md-6">
  1. 'FOG'  
  2. 'LIGHT SNOW'  
  3. 'WIND'  
  4. 'LIGHT FREEZING RAIN'  
  5. 'MIXED PRECIPITATION'  
  6. 'ASTRONOMICAL HIGH TIDE'  
  7. 'GUSTY WINDS'  
  8. 'SNOW'  
  9. 'HIGH SEAS'  
  10. 'ROUGH SEAS'  
  11. 'SNOW SQUALLS'  
  12. 'FALLING SNOW/ICE'  
 </div>
  
 <div class = "col-md-6">
  13. 'GUSTY WIND'  
  14. 'HIGH WATER'  
  15. 'OTHER'  
  16. 'BLOWING DUST'  
  17. 'ICE ON ROAD'  
  18. 'LATE SEASON SNOW'  
  19. 'NON TSTM WIND'  
  20. 'NON-TSTM WIND'  
  21. 'ROGUE WAVE'  
  22. 'WHIRLWIND'  
  23. 'TSTM WIND/HAIL'  
 </div>

</div>

```{r create_a_vector_with_the_ambiguous_distinct_invalid_values_from_the_variable_EVTYPE}

# Create a list with the distinct invalid values of the variable EVTYPE 
# at the table with target data subset that couldn't be safely associated 
# with any of defined weather event types.
ambiguous_entries_on_EVTYPE <- list(
  "FOG", 
  "LIGHT SNOW", 
  "WIND", 
  "LIGHT FREEZING RAIN",
  "MIXED PRECIPITATION", 
  "ASTRONOMICAL HIGH TIDE", 
  "GUSTY WINDS", 
  "SNOW",
  "HIGH SEAS", 
  "ROUGH SEAS", 
  "SNOW SQUALLS",
  "FALLING SNOW/ICE", 
  "GUSTY WIND", 
  "HIGH WATER", 
  "OTHER", 
  "BLOWING DUST",
  "ICE ON ROAD", 
  "LATE SEASON SNOW",
  "NON TSTM WIND", 
  "NON-TSTM WIND", 
  "ROGUE WAVE",
  "WHIRLWIND", 
  "TSTM WIND/HAIL"
)

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-1-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-EVTYPE)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-1--Impute-missing-values-at-the-variable-EVTYPE)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.1.3 Identify the imputable missing values at the variable EVTYPE {#ind-6-5-1-3--Identify-the-imputable-missing-values-at-the-variable-EVTYPE}

After having established the 
[associations for the invalid entries of the variable *EVTYPE*
](#ind-6-5-1-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-EVTYPE) 
the observations that contained values that could be retrieved were identified.

```{r identify_the_observations_which_contain_imputable_missing_values_at_the_variable_EVTYPE}

# Create a validator to identify which observations for the variable EVTYPE 
# contain a missing value that correspond to one of the invalid values 
# at the table with target data subset that can be retrieved 
# according to the list with the association. 
V_________identification_test_of_imputable_missing_values_for_EVTYPE <- validator(
  "COASTAL FLOOD" = EVTYPE %in% associations_on_defined_event_types[["COASTAL FLOOD"]],
  "COLD WIND CHILL" = EVTYPE %in% associations_on_defined_event_types[["COLD/WIND CHILL"]],
  "DEBRIS FLOW" = EVTYPE %in% associations_on_defined_event_types[["DEBRIS FLOW"]],
  "DROUGHT" = EVTYPE %in% associations_on_defined_event_types[["DROUGHT"]],
  "EXTREME COLD/WIND CHILL" = EVTYPE %in% associations_on_defined_event_types[["EXTREME COLD/WIND CHILL"]],
  "FROST/FREEZE" = EVTYPE %in% associations_on_defined_event_types[["FROST/FREEZE"]],
  "HAIL" = EVTYPE %in% associations_on_defined_event_types[["HAIL"]],
  "HEAVY RAIN" = EVTYPE %in% associations_on_defined_event_types[["HEAVY RAIN"]],
  "HIGH SURF" = EVTYPE %in% associations_on_defined_event_types[["HIGH SURF"]],
  "HURRICANE/TYPHOON" = EVTYPE %in% associations_on_defined_event_types[["HURRICANE/TYPHOON"]],
  "LAKE-EFFECT SNOW" = EVTYPE %in% associations_on_defined_event_types[["LAKE-EFFECT SNOW"]],
  "MARINE THUNDERSTORM WIND" = EVTYPE %in% associations_on_defined_event_types[["MARINE THUNDERSTORM WIND"]],
  "RIP CURRENT" = EVTYPE %in% associations_on_defined_event_types[["RIP CURRENT"]],
  "STORM SURGE/TIDE" = EVTYPE %in% associations_on_defined_event_types[["STORM SURGE/TIDE"]],
  "STRONG WIND" = EVTYPE %in% associations_on_defined_event_types[["STRONG WIND"]],
  "THUNDERSTORM WIND" = EVTYPE %in% associations_on_defined_event_types[["THUNDERSTORM WIND"]],
  "WILDFIRE" = EVTYPE %in% associations_on_defined_event_types[["WILDFIRE"]],
  "WINTER WEATHER" = EVTYPE %in% associations_on_defined_event_types[["WINTER WEATHER"]]
)

# Confront the table with the target data subset with the validator with 
# the criteria for the association of invalid entries for the variable EVTYPE.
CF_________identification_test_of_imputable_missing_values_for_EVTYPE <- confront(
  dat = target_data_subset[is.na(in_record_validated_data[["EVTYPE"]])],
  V_________identification_test_of_imputable_missing_values_for_EVTYPE
)

```

Out of the total 32775 missing values 
for the variable *EVTYPE* at the in-record validation data table, 
32520 (99.22%) could be imputed 
while for only 255 (0.78%) values it wasn't possible 
to safely associate them with some of the 48 defined event types.

```{r create_a_kable_to_present_the_results_for_the_imputable_and_not_imputable_missing_values_at_the_variable_EVTYPE}

# Create a kable to presents information 
# on the imputable and not imputable missing values at the variable EVTYPE.
kable(
  x = data.table(
    "variable" = "EVTYPE",
    "n_missing" = sum(is.na(in_record_validated_data$EVTYPE)),
    "n_imputable" = sum(
      vapply(
        X = CF_________identification_test_of_imputable_missing_values_for_EVTYPE[["._value"]],
        FUN = sum,
        FUN.VALUE = integer(1)
      )
    )
  )[,"n_not_imputable" := n_missing - n_imputable][
      , "perc_imputable" := n_imputable/n_missing][
        ,"perc_not_imputable" := n_not_imputable/n_missing], 
  col.names = c(
    "Variable",
    "Number of Missing Values",
    "Number of Imputable Missing Values",
    "Number of Not Imputable Missing Values",
    "Percentage of Imputable Missing Values",
    "Percentage of Not Imputable Missing Values"
  ),
  caption = paste0(
    "Table 6.5.1.3-1: ",
    "Information on the imputable and not imputable missing values ", 
    "at the variable EVTYPE."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

The imputed missing values were distributed according to the associations 
at 18 defined event types.  

```{r create_a_kable_to_present_the_results_of_identification_of_observations_which_contain_imputable_missing_values_at_the_variable_EVTYPE}

# Create a kable to presents the results from the identification 
# of the imputable missing values 
# by each of the associated defined weather event types. 
kable(
  x = summary(CF_________identification_test_of_imputable_missing_values_for_EVTYPE)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.5.1.3-2: ",
    "Information on the number of invalid values ",
    "that can be imputed by one the 48 defined weather event types ",
    "for the variable EVTYPE at the table with the imputed data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The subset of the 32775 observations with missing values ", "\n",
      "was used for the identification of imputable invalid values."
    )
  )

```

The key value (denoted by the *REFNUM* variable) 
for the observations that successfully 
got associated with a defined weather event type was identified.  

```{r identify_the_observations_which_contain_imputable_missing_values_at_the_variable_EVTYPE_by_their_key_value}

# Identify the missing values that can be imputed 
# with one of the defined event type values 
# by their key value (denoted by the variable REFNUM)
criterion_by_REFNUM_____imputable_entries_for_EVTYPE <- lapply(
  X = CF_________identification_test_of_imputable_missing_values_for_EVTYPE[["._value"]],
  FUN = function(x) in_record_validated_data[is.na(EVTYPE), REFNUM][x]
) 

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-1-3--Identify-the-imputable-missing-values-at-the-variable-EVTYPE)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-1--Impute-missing-values-at-the-variable-EVTYPE)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.1.4 Substitute the imputable missing values at the variable EVTYPE {#ind-6-5-1-4--Substitute-the-imputable-missing-values-at-the-variable-EVTYPE}  

The associated value for each of the 28 distinct invalid values 
at the variable *EVTYPE* was imputed at the corresponding observations 
which were identified by their key value.  

```{r impute_the_retrievable_missing_values_at_the_variable_EVTYPE}

# Impute the retrievable missing values at the EVTYPE variable 
# with the defined values
for (i in seq_along(criterion_by_REFNUM_____imputable_entries_for_EVTYPE)) {
  set(
    x = imputed_data,
    i = which(
      imputed_data$REFNUM %in%
        criterion_by_REFNUM_____imputable_entries_for_EVTYPE[[i]],
    ),
    j = "EVTYPE",
    value = names(associations_on_defined_event_types)[i]
  )
}

``` 


<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-1-4--Substitute-the-imputable-missing-values-at-the-variable-EVTYPE)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-1--Impute-missing-values-at-the-variable-EVTYPE)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.5.2 Impute missing values at the variable PROPDMGEXP {#ind-6-5-2--Impute-missing-values-at-the-variable-PROPDMGEXP}  

The invalid values for the variable PROPDMGEXP 
at the table with the target data subset 
(before they got substituted by NAs at the 
[in-record data validation stage](#ind-6-4--Conduct-In-Record-Data-Validation))
were examined and associations were made to plausible valid substitutions. 
Those observations with missing values 
that corresponded to successfully associated plausible substitutions, 
were identified by their key values and were imputed.

* [6.5.2.1 Examine the invalid values from the variable PROPDMGEXP
](#ind-6-5-2-1--Examine-the-invalid-values-from-the-variable-PROPDMGEXP)  
  * Examine the invalid values that have been substituted by NAs.  
* [6.5.2.2 Associate plausible substitutions to the invalid values from the variable PROPDMGEXP
](#ind-6-5-2-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-PROPDMGEXP)  
  * Associated the invalid values with plausible substitutions.  
* [6.5.2.3 Identify the imputable missing values at the variable PROPDMGEXP ](#ind-6-5-2-3--Identify-the-imputable-missing-values-at-the-variable-PROPDMGEXP)  
  * Identified the imputable missing values according to associations by their key value.   
* [6.5.2.4 Substitute the imputable missing values at the variable PROPDMGEXP ](#ind-6-5-2-4--Substitute-the-imputable-missing-values-at-the-variable-PROPDMGEXP)  
  * Substituted the imputable missing values with valid ones.  

<br>  

<font size="1">[back to start of this subsection](#ind-6-5-2--Impute-missing-values-at-the-variable-PROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.2.1 Examine the invalid values from the variable PROPDMGEXP {#ind-6-5-2-1--Examine-the-invalid-values-from-the-variable-PROPDMGEXP}  

For the variable *PROPDMGEXP*, at the table with the in-record validated data, 
out of the total 144826 observations, 4158 (2.87%) were NAs.

```{r create_a_kable_to_present_facts_about_the_variable_PROPDMGEXP} 

# Create a kable to present information on the missing values 
# for the variable PROPDMGEXP at the table with the in-record validated data.
kable(
  x = data.table(
    "Variable" = "PROPDMGEXP",
    "Total Number of Values" = length(in_record_validated_data$PROPDMGEXP),
    "Number of Missing Values" = sum(is.na(in_record_validated_data$PROPDMGEXP)),
    "Percentage of Missing Values" = mean(is.na(in_record_validated_data$PROPDMGEXP))
  ),
  caption = paste0(
    "Table 6.5.2.1-1: ",
    "Information on missing values for the variable PROPDMGEXP ", 
    "at the table with the in-record validated data."
    )
  
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

Those 4158 missing values at the table with the in-record validated data,
corresponded to empty values at the table with the target data subset 
before they got substituted by NAs at the 
[in-record data validation stage](#ind-6-4--Conduct-In-Record-Data-Validation).

```{r create_a_kable_to_present_the_distinct_invalid_values_for_the_the_variable_PROPDMGEXP}

# Create a kable to presents the distinct invalid values 
# of the variable PROPDMGEXP at the table with the target data subset 
# that were substituted by NAs at the in-record data validation stage.
kable(
  x = target_data_subset[
    REFNUM %in% in_record_validated_data[
      is.na(PROPDMGEXP), REFNUM
      ],
    list(
      "distinct_values" = PROPDMGEXP
    )
    ][
      ,
      .N,
      distinct_values
      ],
  col.names = c(
    "Distinct Values", 
    "Number of Observations"
  ),
  caption = paste0(
    "Table 6.5.2.1-2: ",
    "The distinct invalid values for the variable 'PROPDMGEXP' ", 
    "that were substituted by NAs at the in-record data validation stage."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-2-1--Examine-the-invalid-values-from-the-variable-PROPDMGEXP)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-2--Impute-missing-values-at-the-variable-PROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.2.2 Associate plausible substitutions to the invalid values from the variable PROPDMGEXP {#ind-6-5-2-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-PROPDMGEXP}

A single association (which works perfectly as shown in the [next subsubsection
](#ind-6-5-2-3--Identify-the-imputable-missing-values-at-the-variable-PROPDMGEXP) 
was made for the missing values that corresponded to empty values: 

  * The entries that correspond to property damage with zero magnitude, 
  (denoted by the value 0 at the variable *PROPDMG*) 
  could be associated with any of the valid values ("K", "M", "B").  

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-2-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-PROPDMGEXP)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-2--Impute-missing-values-at-the-variable-PROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.2.3 Identify the imputable missing values at the variable PROPDMGEXP {#ind-6-5-2-3--Identify-the-imputable-missing-values-at-the-variable-PROPDMGEXP}

The observations that satisfied the criterion imposed by the 
[association made for the invalid values from the variable *PROPDMGEXP*
](#ind-6-5-2-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-PROPDMGEXP) 
were identified.  

```{r identify_the_observations_which_contain_imputable_missing_values_at_the_variable_PROPDMGEXP} 

# Create a validator with the criterion to identify 
# the imputable missing values for the variable PROPDMGEXP.
V_____imputable_missing_values_at_the_variable_PROPDMGEXP <- validator(
  "imputable_missing_values_at_PROPDMGEXP" = ( 
    (PROPDMG == 0) & is.na(PROPDMGEXP) 
  )
)

# Confront the subset of observations with missing values 
# in the variable PROPDMGEXP at the in-record validated data 
# with the validator with the criterion to identify 
# the imputable missing values at the variable PROPDMGEXP. 
CF_____imputable_missing_values_at_the_variable_PROPDMGEXP <- 
  confront(
    dat = in_record_validated_data[is.na(PROPDMGEXP)],
    V_____imputable_missing_values_at_the_variable_PROPDMGEXP
  )

```

All missing values at the variable *PROPDMGEXP* (4158 in total), 
corresponded to observations for which the magnitude of property damage 
(denoted by the variable *PROPDMG*) was zero. 

```{r create_a_kable_to_present_the_results_for_the_observations_which_contain_imputable_missing_values_at_the_variable_PROPDMGEXP}

# Create a kable to present the number of imputable missing values for the 
# variable PROPDMGEXP at the table with the in-record validated data subset.
kable(
  x = summary(CF_____imputable_missing_values_at_the_variable_PROPDMGEXP)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.5.2.3-1: ",
    "Results from identification of imputable missing values ", 
    "at the variable PROPDMGEXP."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The subset of the 4158 observations with missing values ", 
      "was used for the identification of imputable invalid values"
    )
  )


```

The key values (denoted by the variable *REFNUM*) of the observations 
for which the missing values at the variable *PROPDMGEXP* could be retrieved 
were identified.  

```{r identify_the_observations_which_contain_imputable_missing_values_at_the_variable_PROPDMGEXP_by_their_key_value}

# Identify the observations for which the missing value 
# at the variable PROPDMGEXP can be safely imputed, 
# by their key value denoted by the variable REFNUM.
criterion_by_REFNUM_____imputable_missing_values_at_the_variable_PROPDMGEXP <- 
  with(
    data = CF_____imputable_missing_values_at_the_variable_PROPDMGEXP[["._value"]],
    expr = in_record_validated_data[is.na(PROPDMGEXP), REFNUM]
  )

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-2-3--Identify-the-imputable-missing-values-at-the-variable-PROPDMGEXP)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-2--Impute-missing-values-at-the-variable-PROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.2.4 Substitute the imputable missing values at the variable PROPDMGEXP {#ind-6-5-2-4--Substitute-the-imputable-missing-values-at-the-variable-PROPDMGEXP}  

The value *"K"* was imputed to all observations with imputable missing values 
at the variable *PROPDMGEXP* (which were identified by their key value).

```{r impute_the_retrievable_missing_values_for_the_variable_PROPDMGEXP}

# Set the imputable missing values at the variable PROPDMGEXP 
# with the value "K".
set(
  x = imputed_data,
  i = which(
    imputed_data$REFNUM %in% 
      criterion_by_REFNUM_____imputable_missing_values_at_the_variable_PROPDMGEXP
  ),
  j = "PROPDMGEXP",
  value = "K"
)

```

*(They could have been substituted by any of the valid values ("K", "M" or "B") 
for the variable PROPDMGEXP without changing the fact 
that they refer to 0$ property damage.)*  

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-2-4--Substitute-the-imputable-missing-values-at-the-variable-PROPDMGEXP)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-2--Impute-missing-values-at-the-variable-PROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.5.3 Impute missing values at the variable CROPDMGEXP {#ind-6-5-3--Impute-missing-values-at-the-variable-CROPDMGEXP}  

The invalid values for the variable PROPDMGEXP 
at the table with the target data subset 
(before they got substituted by NAs at the 
[in-record data validation stage](#ind-6-4--Conduct-In-Record-Data-Validation))
were examined and associations were made to plausible valid substitutions. 
Those observations with missing values 
that corresponded to successfully associated plausible substitutions, 
were identified by their key values and were imputed.

* [6.5.3.1 Examine the invalid values from the variable CROPDMGEXP
](#ind-6-5-3-1--Examine-the-invalid-values-from-the-variable-CROPDMGEXP)  
  * Examine the invalid values that have been substituted by NAs.  
* [6.5.3.2 Associate plausible substitutions to the invalid values from the variable CROPDMGEXP
](#ind-6-5-3-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-CROPDMGEXP)  
  * Associated the invalid values with plausible substitutions.  
* [6.5.3.3 Identify the imputable missing values at the variable CROPDMGEXP ](#ind-6-5-3-3--Identify-the-imputable-missing-values-at-the-variable-CROPDMGEXP)  
  * Identified the imputable missing values according to associations by their key value.   
* [6.5.3.4 Substitute the imputable missing values at the variable CROPDMGEXP ](#ind-6-5-3-4--Substitute-the-imputable-missing-values-at-the-variable-CROPDMGEXP)  
  * Substituted the imputable missing values with valid ones.  

<br>  

<font size="1">[back to start of this subsection](#ind-6-5-3--Impute-missing-values-at-the-variable-CROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.3.1 Examine the invalid values from the variable CROPDMGEXP {#ind-6-5-3-1--Examine-the-invalid-values-from-the-variable-CROPDMGEXP}  

For the variable *CROPDMGEXP* at the table with the in-record validated data, 
out of the total 144826 observations 55041 (38.00%) were NAs.

```{r create_a_kable_to_present_the_facts_about_the_variable_CROPDMGEXP} 

# Create a kable to present information on the missing values 
# for the variable CROPDMGEXP at the table with the in-record validated data.
kable(
  x = data.table(
    "Variable" = "CROPDMGEXP",
    "Total Number of Values" = length(in_record_validated_data$CROPDMGEXP),
    "Number of Missing Values" = sum(is.na(in_record_validated_data$CROPDMGEXP)),
    "Percentage of Missing Values" = mean(is.na(in_record_validated_data$CROPDMGEXP))
  ),
  caption = paste0(
    "Table 6.5.3.1-1: ",
    "Information on missing values for the variable CROPDMGEXP ", 
    "at the table with the in-record validated data."
    )
  
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

Those 55041 missing values at the table with the in-record validated data,
corresponded to empty values at the table with the target data subset 
before they got substituted by NAs at the 
[in-record data validation stage](#ind-6-4--Conduct-In-Record-Data-Validation).

```{r create_a_kable_to_present_the_distinct_invalid_values_for_the_the_variable_CROPDMGEXP}

# Create a kable to presents the distinct invalid values 
# of the variable CROPDMGEXP at the table with the target data subset 
# that were substituted by NAs at the in-record data validation stage.
kable(
  x = target_data_subset[
    REFNUM %in% in_record_validated_data[
      is.na(CROPDMGEXP), REFNUM
      ],
    list(
      "distinct_values" = CROPDMGEXP
    )
    ][
      ,
      .N,
      distinct_values
      ],
  col.names = c(
    "Distinct Values", 
    "Number of Observations"
  ),
  caption = paste0(
    "Table 6.5.3.1-2: ",
    "The distinct invalid values for the variable 'CROPDMGEXP' ", 
    "that were substituted by NAs at the in-record data validation stage."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-3-1--Examine-the-invalid-values-from-the-variable-CROPDMGEXP)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-3--Impute-missing-values-at-the-variable-CROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.3.2 Associate plausible substitutions to the invalid values from the variable CROPDMGEXP {#ind-6-5-3-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-CROPDMGEXP}

A single association (which works perfectly as shown in the [next subsubsection
](#ind-6-5-3-3--Identify-the-imputable-missing-values-at-the-variable-CROPDMGEXP) 
was made for the missing values that corresponded to empty values: 

  * The entries that correspond to crop damage with zero magnitude, 
  (denoted by the value 0 at the variable *CROPDMG*) 
  could be associated with any of the valid values ("K", "M", "B").  

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-3-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-CROPDMGEXP)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-3--Impute-missing-values-at-the-variable-CROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.3.3 Identify the imputable missing values at the variable CROPDMGEXP {#ind-6-5-3-3--Identify-the-imputable-missing-values-at-the-variable-CROPDMGEXP}

The observations that satisfied the criterion imposed by the 
[association made for the invalid values from the variable *CROPDMGEXP*
](#ind-6-5-3-2--Associate-plausible-substitutions-to-the-invalid-values-from-the-variable-CROPDMGEXP) 
were identified.  

```{r identify_the_observations_which_contain_imputable_missing_values_at_the_variable_CROPDMGEXP} 

# Create a validator with the criterion to identify 
# the imputable missing values for the variable CROPDMGEXP.
V_____imputable_missing_values_at_the_variable_CROPDMGEXP <- validator(
  "imputable_missing_values_at_CROPDMGEXP" = ( 
    (CROPDMG == 0) & is.na(CROPDMGEXP) 
  )
)

# Confront the subset of observations with missing values 
# in the variable PROPDMGEXP at the in-record validated data 
# with the validator with the criterion to identify 
# the imputable missing values at the variable CROPDMGEXP. 
CF_____imputable_missing_values_at_the_variable_CROPDMGEXP <- 
  confront(
    dat = in_record_validated_data[is.na(CROPDMGEXP)],
    V_____imputable_missing_values_at_the_variable_CROPDMGEXP
  )

```

The key values (denoted by the variable *REFNUM*) of the observations 
for which the missing values at the variable *CROPDMGEXP* could be retrieved 
were identified.  

```{r create_a_kable_to_present_the_results_for_the_observations_which_contain_imputable_missing_values_at_the_variable_CROPDMGEXP}

# Create a kable to present the number of imputable missing values for the 
# variable CROPDMGEXP at the table with the in-record validated data subset.
kable(
  x = summary(CF_____imputable_missing_values_at_the_variable_CROPDMGEXP)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.5.3.3-1: ",
    "Results from identification of imputable missing values ", 
    "at the variable CROPDMGEXP."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The subset of the 55041 observations with missing values ",
      "was used for the identification of imputable invalid values."
    )
  )


```

The key values (denoted by the variable *REFNUM*) of the observations 
for which the missing values at the variable *CROPDMGEXP* could be retrieved 
were identified. 

```{r identify_the_observations_which_contain_imputable_missing_values_at_the_variable_CROPDMGEXP_by_their_key_value}

# Identify the observations for which the missing value 
# at the variable CROPDMGEXP can be safely imputed, 
# by their key value denoted by the variable REFNUM.
criterion_by_REFNUM_____imputable_missing_values_at_the_variable_CROPDMGEXP <- 
  with(
    data = CF_____imputable_missing_values_at_the_variable_CROPDMGEXP[["._value"]],
    expr = in_record_validated_data[is.na(CROPDMGEXP), REFNUM]
  )

```

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-3-3--Identify-the-imputable-missing-values-at-the-variable-CROPDMGEXP)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-3--Impute-missing-values-at-the-variable-CROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 6.5.3.4 Substitute the imputable missing values at the variable CROPDMGEXP {#ind-6-5-3-4--Substitute-the-imputable-missing-values-at-the-variable-CROPDMGEXP}  

The value *"K"* was imputed to all observations with imputable missing values 
at the variable *CROPDMGEXP* (which were identified by their key value).

```{r impute_the_retrievable_missing_values_for_the_variable_CROPDMGEXP}

# Set the imputable missing values at the variable CROPDMGEXP 
# with the value "K".
set(
  x = imputed_data,
  i = which(
    imputed_data$REFNUM %in% 
      criterion_by_REFNUM_____imputable_missing_values_at_the_variable_CROPDMGEXP
  ),
  j = "CROPDMGEXP",
  value = "K"
)


```

*(They could have been substituted by any of the valid values ("K", "M" or "B") 
for the variable PROPDMGEXP without changing the fact 
that they refer to 0$ property damage.)*  

<br>  

<br>  

<font size="1">[back to start of this subsubsection](#ind-6-5-3-4--Substitute-the-imputable-missing-values-at-the-variable-CROPDMGEXP)</font>  
<font size="1">[back to start of this subsection](#ind-6-5-3--Impute-missing-values-at-the-variable-CROPDMGEXP)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.5.4 Conduct post validation for the table with the imputed data {#ind-6-5-4--Conduct-post-validation-for-the-table-with-the-imputed-data}  

Post validation was conducted to verify that the values of variables 
at the table with imputed data were valid 
according to the same constrains that were used to 
[identify the invalid values for each variable
](#ind-6-4-2--Conduct-in-record-data-validation-for-each-variable) 
at the table with the target data subset.  

```{r conduct_post_validation_for_the_table_with_the_imputed_data}

# The table with the imputed data was post validated to verify 
# that all values for each of the variables it contained were valid.
CF____post_validation_of_the_table_with_the_imputed_data <- confront(
  dat = imputed_data,
  V____constrains_for_the_in_record_data_validation
)

```

All values for each variable at the table with the imputed data were valid.

```{r create_a_kable_with_the_results_from_post_validation_of_the_table_with_the_imputed_data}

# Present the results of the post validation for the table with imputed data
kable(
  x = summary(CF____post_validation_of_the_table_with_the_imputed_data)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.5.4-1: ", 
    "The results of post validation for the table with the imputed data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
     general = paste0(
      "The same constrains that were used to identify the invalid values ", 
      "of each variable at the table with the target data subset, ", "\n",
      "were used for the post validation of the observations ", 
      "at the table with the imputed data."
    )
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-5-4--Conduct-post-validation-for-the-table-with-the-imputed-data)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.5.5 Overview of the table with the imputed data {#ind-6-5-5--Overview-of-the-table-with-the-imputed-data}  

The table with the imputed data contained 9 variables and 144826 observations.  

The variable *REFNUM* was set as the key of the this table.  

```{r print_the_structure_of_the_table_with_the_imputed_data}

# Print the structure of the table with the imputed data.
str(imputed_data)

```

There were 255 missing values left only at the variable *EVTYTE* 
(which were those that couldn't be safely imputed). 
The number of distinct values at any of the variables didn't indicate 
the presence of obvious abnormalities.  

```{r create_a_kable_with_facts_for_the_table_with_the_imputed_data}

# Create a kable to highlight some facts about the table with the imputed data.
kable(
  x = data.table(
    "Variable" = names(imputed_data),
    "Number of Distinct Values" = vapply(imputed_data, function(x) length(unique(x[!is.na(x)])), integer(1)),
    "Number of Missing Values" = vapply(
      X = imputed_data, 
      FUN = function(x) sum(is.na(x)), 
      FUN.VALUE = integer(1)),
    "Percentage of Missing Values" = vapply(
      X = imputed_data, 
      FUN = function(x) mean(is.na(x)),
      FUN.VALUE = double(1))
  ),
  caption = paste0(
    "Table 6.5.5-1: Facts about the table with the imputed data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = paste0(
      "The table with the imputed data contained 9 variables ", 
      "and 144826 observations."
    )
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-5-5--Overview-of-the-table-with-the-imputed-data)</font>  
<font size="1">[back to start of this section](#ind-6-5--Impute-Missing-Values)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 6.6 Conduct Cross-Record Data Validation {#ind-6-6--Conduct-Cross-Record-Data-Validation}  

<font size="3"><u><strong>Summary</strong></u></font>  

Each observation at the table with imputed data was checked to verify 
if it contains entries which were valid across all variables simultaneous. 
Those observations that were valid 
were used to create the table with the cross-record validated data.  

<font size="3"><u><strong>Steps</strong></u></font>  

* [6.6.1 Identify all valid observations
](#ind-6-6-1--Identify-all-valid-observations)  
  * Identifies the valid observations according to a criterion 
  that spans across all variables.  
* [6.6.2 Create the table with the cross-record validated data
](#ind-6-6-2--Create-the-table-with-the-cross-record-validated-data)  
  * Creates the table with the cross-record validated data 
  extracting only the valid observations.  
* [6.6.3 Conduct post validation for table with the cross-record validated data
](#ind-6-6-3--Conduct-post-validation-for-table-with-the-cross-record-validated-data)  
  * Ensures that all observations 
  at the table with the cross-record validated data are valid.  
* [6.6.4 Overview of the table with the cross-record validated data
](#ind-6-6-4--Overview-of-the-table-with-the-cross-record-validated-data)  
  * Presents some basic facts about the table with the cross-validated data.  

<br>  

<font size="1">[back to start of this section](#ind-6-6--Conduct-Cross-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 6.6.1 Identify all valid observations {#ind-6-6-1--Identify-all-valid-observations}  

A single constrain that spanned across all available variables 
at the table with the imputed data was created and used 
to identify the valid observations.  

Specifically, each observation must simultaneous satisfy the 4 criteria below 
in order to be considered valid:  
  
  1. The id must be unique (and non-missing).  
  2. The weather event type value must be 
  one of the defined weather events (and non-missing).  
  3. The year must be in the period from 2001 to 2011 (and non-missing).  
  4. There must be non-zero harm either to population health or to economy, so:
     * either fatalities must be positive (and non-missing), 
     * or injuries must be positive (and non-missing), 
     * or property damage (in dollars) must be retrievable and positive (and non-missing), 
     * or crop damage (in dollars) must be retrievable and positive (and non-missing).  

```{r conduct_cross_record_validation_for_the_observations_at_table_with_the_imputed_data}

# A validator was created that contains a constrain 
# for the validity of each observation 
# that spans across all variables .  
V_____cross_record_constrains <- validator(
  "valid_observations" = (
    ( REFNUM %in% names(table(REFNUM)[table(REFNUM) == 1]) ) &
      ( !is.na(EVTYPE) ) & 
      ( as.integer(str_extract(BGN_DATE, "(?<=^\\d{1,2}/\\d{1,2}/)\\d{4}(?= 0:00:00$)")) %in%
          c(2001:2011) ) &
      (
        ( FATALITIES > 0 ) |
          ( INJURIES > 0 ) |
          ( PROPDMG > 0 & !is.na(PROPDMGEXP) ) |
          ( CROPDMG > 0 & !is.na(CROPDMGEXP) )
      )
  )
)

# The imputed data table was confronted 
# with the validator that identifies 
# the observations that contain valid values across all variables. 
CF_____cross_record_constrains <- confront(
  dat = imputed_data,
  V_____cross_record_constrains
)

```

Out of the total of 144826 observation at the table with the imputed data 
144571 were valid across all variables while only 255 were found to be invalid.

```{r create_a_kable_with_the_results_of_cross_record_validation_for_the_observations_at_the_table_with_the_imputed_data}

# Present the result of cross-record validation 
# for the observations contained at the table with imputed data.  
kable(
  x = summary(CF_____cross_record_constrains)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.6.1-1: ",
    "The table contains the results of the cross-record data validation ",
    "for the observation contained at the imputed data table."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```

The value of the key (denoted by the variable *REFNUM*) 
was used to identify the observations that were valid. 

```{r identify_the_cross_record_valid_observation_at_the_table_with_the_imputed_data_by_their_key_value}

# Identify the valid observations found through the cross-record validation 
# by the their key value.  
criterion_by_REFNUM_____cross_validated_observations <- imputed_data[
  CF_____cross_record_constrains[["._value"]][["valid_observations"]],
  REFNUM
  ]

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-6-1--Identify-all-valid-observations)</font>  
<font size="1">[back to start of this section](#ind-6-6--Conduct-Cross-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.6.2 Create the table with the cross-record validated data {#ind-6-6-2--Create-the-table-with-the-cross-record-validated-data}  

From the table with the imputed data, 
the table with the cross-record validated data was created, 
by including only the observations 
that contained valid (and non-missing) values across all variables. 

```{r create_the_table_with_the_cross_record_validated_data}

# Create the table with cross-record data validation 
# by using only the valid observations.
cross_validated_data <- imputed_data[
  REFNUM %in% criterion_by_REFNUM_____cross_validated_observations
  ]

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-6-2--Create-the-table-with-the-cross-record-validated-data)</font>  
<font size="1">[back to start of this section](#ind-6-6--Conduct-Cross-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.6.3 Conduct post validation for table with the cross-record validated data {#ind-6-6-3--Conduct-post-validation-for-table-with-the-cross-record-validated-data}  

Post validation was conducted to verify that all observations 
at the table with the cross-validated data were valid 
according to the same constrains that were used to 
[identify the valid observation](#ind-6-6-1--Identify-all-valid-observations) 
at the table with the imputed data.  

```{r conduct_post_validation_for_the_table_with_the_cross_record_validated_data}

# The table with the cross-record validated data was post validated to verify 
# that all observations were valid.
CF_________post_validation_of_cross_validated_data <- confront(
  dat = cross_validated_data,
  V_____cross_record_constrains
)

```

All the observations at the table with the cross-record validated data 
were valid.  

```{r create_a_kable_with_the_results_from_post_validation_of_the_table_with_the_cross_record_validated_data}

# Create a kable to present the results of the post validation 
# for the table with the cross-record validated data.
kable(
  x = summary(CF_________post_validation_of_cross_validated_data)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning")
    ],
  caption = paste0(
    "Table 6.6.3-1: ",
    "Presents the result of the post validation ", 
    "for the table with cross validated data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```


<br>  

<font size="1">[back to start of this subsection](#ind-6-6-3--Conduct-post-validation-for-table-with-the-cross-record-validated-data)</font>  
<font size="1">[back to start of this section](#ind-6-6--Conduct-Cross-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.6.4 Overview of the table with the cross-record validated data {#ind-6-6-4--Overview-of-the-table-with-the-cross-record-validated-data}

The table with the cross-validated data contained 9 variables and 144571 observations.  

The variable *REFNUM* was set as the key of this table.  

```{r print_the_structure_of_the_table_with_the_cross_record_validated_data}

# Print the structure of the table with the cross-record validated data.
str(cross_validated_data)

```

All the observation at the table with the cross-validated data are complete 
as indicated by the results of 
[post validation for the table with cross-validated data
](#ind-6-6-3--Conduct-post-validation-for-table-with-the-cross-record-validated-data).  

<br>  

<font size="1">[back to start of this subsection](#ind-6-6-4--Overview-of-the-table-with-the-cross-record-validated-data)</font>  
<font size="1">[back to start of this section](#ind-6-6--Conduct-Cross-Record-Data-Validation)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 6.7 Produce The Processed Data {#ind-6-7--Produce-The-Processed-Data}  

<font size="3"><u><strong>Summary</strong></u></font>  

Having identified, validated and imputed 
the target data for the period of interest,
by transforming the variables from the table with cross-record validated data, 
the processed data table was constructed 
that contained all information that was necessary 
in order to proceed with this analysis 
and address the two questions of interest.  

<font size="3"><u><strong>Steps</strong></u></font>  

* [6.7.1 Create the table with the processed data
](#ind-6-7-1--Create-the-table-with-the-processed-data)  
  * Transforms the variables from the table with cross-validated data 
  to created the table with the processed data.
* [6.7.2 Conduct post validation for the table with the processed data
](#ind-6-7-2--Conduct-post-validation-for-the-table-with-the-processed-data)  
  * Ensures that all observations at the table with the processed data 
  are valid.

<br>  

<font size="1">[back to start of this section](#ind-6-7--Produce-The-Processed-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 6.7.1 Create the table with the processed data {#ind-6-7-1--Create-the-table-with-the-processed-data}  

The following transformations were applied 
at the variables from the table with the cross-record validated data, 
in order to construct the table with the processed data: 
  
  1. the variable **REFNUM** was transfered unchanged  
  2. the variable *BGN_DATE* was omitted  
  3. the variable *EVTYPE* was transfered and renamed to **EVENT_TYPE**  
  4. the variable **FATALITIES** was transfered unchanged  
  5. the variable **INJURIES** was transfered unchanged  
  6. the variables *FATALITIES* and *INJURIES* were added  
  in order to create the variable **CASUALTIES**  
  7. the variables *PROPDMG* (that denoted the magnitude of property damage) 
  and *PROPDMGEXP* (that indicated if the value of *PROPDMG* referred to 
  thousands, millions or billions)
  were combined appropriately to retrieve the property damage in dollars 
  in order to create the variable **PROPERTY_DAMAGE**  
  8. the variables *CROPDMG* (that denoted the magnitude of crop damage) 
  and *CROPDMGEXP* (that indicated if the value of *CROPDMG* referred to 
  thousands, millions or billions)
  were combined appropriately to retrieve the crop damage in dollars 
  in order to create the variable **CROP_DAMAGE**  
  9. the variables *PROPERTY_DAMAGE* and *CROP_DAMAGE* were added 
  in order to create the variable **ECONOMIC_DAMAGE**  

```{r create_the_table_with_the_processed_data}

# Create the table with the processed data 
# from the information contained 
# at the table with cross-record validated data.
processed_data <- cross_validated_data[
  ,
  list(
    # REFNUM variable doesn't need to change
    "REFNUM" = REFNUM,
    # EVTYPE variable should be renamed to EVENT_TYPE
    "EVENT_TYPE" = EVTYPE,
    # FATALITIES variable doesn't need to change
    "FATALITIES" = FATALITIES,
    # INJURIES variable doesn't need to change
    "INJURIES" = INJURIES,
    # PROPERTY_DAMAGE is created by combining the information
    # from the PROPDMG variable which denotes the magnitude of property damage
    # and the PROPDMGEXP variable that indicates if the magnitude
    # refers to thousands (K), millions (M) or billions (B) of dollars
    "PROPERTY_DAMAGE" = (function(magnitude, coded_exponent, code_dictionary) {
      recoded_exponent <- str_replace_all(
        string = coded_exponent,
        code_dictionary
      ) %>%
        as.integer()
      ## the magnitude is multiplied by a coefficient
      ## with base 10 raised to the appropriate power
      ## (3 for thousands, 6 for millions or 9 for billions)
      ## to retrieve the value of property damage 
      reconstructed_number <- magnitude * 10^recoded_exponent
    })(PROPDMG, PROPDMGEXP, c("K" = "3", "M" = "6", "B" = "9")),
    # CROP_DAMAGE is created by combining the information
    # from the CROPDMG variable which denotes the magnitude of crop damage
    # and the CROPDMGEXP variable that indicates if the magnitude
    # refers to thousands (K), millions (M) or billions (B) of dollars
    "CROP_DAMAGE" = (function(magnitude, coded_exponent, code_dictionary) {
      recoded_exponent <- str_replace_all(
        string = coded_exponent,
        code_dictionary
      ) %>%
        as.integer()
      ## the magnitude is multiplied by a coefficient
      ## with base 10 raised to the appropriate power
      ## (3 for thousands, 6 for millions or 9 for billions)
      ## to retrieve the value of crop damage 
      reconstructed_number <- magnitude * 10^recoded_exponent
    })(CROPDMG, CROPDMGEXP, c("K" = "3", "M" = "6", "B" = "9"))
  )
  ][
    ,
    # Create a variable with the number of casualties
    # caused by each weather event type 
    # by adding the fatalities and injuries
    CASUALTIES := FATALITIES + INJURIES][
      ,
      # Create a variable with the economic damage
      # caused by each weather event type 
      # by adding the property damage and crop damage
      ECONOMIC_DAMAGE := PROPERTY_DAMAGE + CROP_DAMAGE
      ][
        ,
        # Re-arrange the order of the variables 
        list(
          REFNUM, EVENT_TYPE, 
          FATALITIES, INJURIES, CASUALTIES,
          PROPERTY_DAMAGE, CROP_DAMAGE, ECONOMIC_DAMAGE
        )
        ]

```

<br>  

<font size="1">[back to start of this subsection](#ind-6-7-1--Create-the-table-with-the-processed-data)</font>  
<font size="1">[back to start of this section](#ind-6-7--Produce-The-Processed-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 6.7.2 Conduct post validation for the table with the processed data {#ind-6-7-2--Conduct-post-validation-for-the-table-with-the-processed-data}  

Post validation was conducted to verify that all observations 
contained at the table with the processed data were valid 
across all variables it contained.  

One constrain was created and used, which consists of three parts 
that must hold simultaneous for each observation:  
  
  * The key for each observation denoted by the variable *REFNUM* must be unique.  
  * The event type for each observation denoted by the variable *EVENT_TYPE* 
  must be one of 48 defined weather event types according to the 
  *NATIONAL WEATHER SERVICE INSTRUCTION 10-1605, AUGUST 17, 2007 (at chapter 7)*  
  * At least one of the six variables that indicate the harm 
  (either to population health or to economy), 
  denoted by the variables *FATALITIES*, *INJURIES*, *CASUALTIES*, 
  *PROPERTY_DAMAGE*, *CROP_DAMAGE* or *EC0NOMIC_DAMAGE* must be positive.  

```{r conduct_post_validation_for_the_table_with_the_processed_data}

# Create a validator that contains a constrain 
# that spans across all variables contained 
# at the table with the processed data 
# for each observation it includes.
V_____post_validation_of_table_with_the_processed_data <- validator(
  "valid_observation" = (
    ( REFNUM %in% table(REFNUM)[names(table(REFNUM)[table(REFNUM) == 1])] ) &
      ( EVENT_TYPE %in% defined_event_types ) &
      ( FATALITIES > 0 ) |
      ( INJURIES > 0 ) |
      ( CASUALTIES > 0) |
      ( PROPERTY_DAMAGE > 0 ) |
      ( CROP_DAMAGE > 0) |
      ( ECONOMIC_DAMAGE > 0 )
  )
)

# Confront the table with the processed data with 
# validator that verifies the validity of each observation it contains 
# across all variables.
CF_____post_validation_of_table_with_the_processed_data <- confront(
  dat = processed_data,
  V_____post_validation_of_table_with_the_processed_data
)


```

All the 144571 observations included in the processed data table 
were found to satisfy the condition.

```{r create_a_kable_with_the_results_from_post_validation_of_the_table_with_the_processed_data}

# Create a kable to resents the results of post validation 
# for the table with the processed data.
kable(
  x = summary(CF_____post_validation_of_table_with_the_processed_data)[
    , c("name", "items", "passes", "fails", "nNA", "error", "warning", "error", "warning")
    ],
  caption = paste0(
    "Table 6.7.2-1: ",
    "The results of post validation for the table with the processed data."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  )

```


<br>  

<font size="1">[back to start of this subsection](#ind-6-7-2--Conduct-post-validation-for-the-table-with-the-processed-data)</font>  
<font size="1">[back to start of this section](#ind-6-7--Produce-The-Processed-Data)</font>  
<font size="1">[back to start of this chapter](#ind-6--DATA-PROCESSING)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 7 PROCESSED DATA {#ind-7--PROCESSED-DATA}  
***  

The table with the processed data (which was the result 
of the [data processing pipeline](#ind-6--DATA-PROCESSING)) 
contains all the information that was used in the chapters:  

* [8 HARM ON POPULATION HEALTH](#ind-8--HARM-ON-POPULATION-HEALTH)  
* [9 HARM ON ECONOMY](#ind-9--HARM-ON-ECONOMY)  

in order to address the two questions of interest for this analysis.  

[Details about the variables
](#ind-7-1--Information-For-The-Table-With-The-Processed-Data)
it contains and 
[a short overview](#ind-7-2--Overview-Of-The-Table-With-The-Processed-Data) 
are presented in this chapter. 

Finally in order to assist any attempt to reproduce the analysis 
[a file with the processed data was exported
](#ind-7-3--Export-The-Table-With-The-Processed-Data) 
to serve as *checkpoint*.  

<br>  

<font size="1">[back to start of this chapter](#ind-7--PROCESSED-DATA)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

## 7.1 Information For The Table With The Processed Data {#ind-7-1--Information-For-The-Table-With-The-Processed-Data}  

There are 8 variable at the table with the processed data:  
    
1. **REFNUM** (int) : a value that uniquely identifies each observation 
and was used as the key of the table  
2. **EVENT_TYPE** (chr) : the type of each weather event type  
3. **FATALITIES** (int) : the number of fatalities  
4. **INJURIES** (int) : the number of injuries  
5. **CASUALTIES** (int) : the number of casualties (injuries and fatalities)  
6. **PROPERTY_DAMAGE** (num) : the property damage in dollars  
7. **CROP_DAMAGE** (num) : the crop damage in dollars  
8. **ECONOMIC_DAMAGE** (num): the economic damage in dollars 
(property damage and crop damage)  

<br>  

<font size="1">[back to start of this section](#ind-7-1--Information-For-The-Table-With-The-Processed-Data)</font>  
<font size="1">[back to start of this chapter](#ind-7--PROCESSED-DATA)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 7.2 Overview Of The Table With The Processed Data {#ind-7-2--Overview-Of-The-Table-With-The-Processed-Data}  

The processed data consists of 8 variables and 144571 observations.  

The variable REFNUM was set as the key of this table.  

```{r print_the_structure_of_the_table_with_the_processed_data}

# Print the structure of the table with the processed data.
str(processed_data)

```

All the observations included in the processed data table are complete. 

```{r create_a_kable_with_the_number_of_complete_cases_at_the_table_with_the_processed_data}

# Create a kable to present the number of complete cases 
# at the table with the processed data.
kable(
    x = data.table(
        "Percentage Of Complete Observations" = 
            paste0(mean(complete.cases(processed_data))*100, "%")
    ),
    caption = paste0(
        "Table 7.2-1: ",
        "The percentage of complete observations ",
        "at the table with the processed data."
    )
) %>% 
    kable_styling(
        bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
        full_width = FALSE,
        fixed_thead = TRUE
    )


```

The number of distinct values comply with what was expected from each variable.

```{r create_a_kable_with_the_number_of_distinct_values_for_the_variables_at_the_table_with_the_processed_data}

# Create a kable to present the number of distinct values 
# for each variable at the table with the processed data.
kable(
    x = data.table(
        "Variable" = names(processed_data),
        "Number of Distinct Values" = 
            vapply(
                X = processed_data, 
                FUN = function(x) length(unique(x[!is.na(x)])), 
                FUN.VALUE = integer(1)
            )
    ),
    caption = paste0(
        "Table 7.2-2: ",
        "The number of distinct values ",
        "for each variable at the table with the processed data."
    )
) %>% 
    kable_styling(
        bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
        full_width = FALSE,
        fixed_thead = TRUE
    ) %>% 
  footnote(
    general = paste0(
      "The table with the processed data consists of 8 variables ", "\n",
      "and 144571 observations."
    )
  )

```

<br>  

<font size="1">[back to start of this section](#ind-7-2--Overview-Of-The-Table-With-The-Processed-Data)</font>  
<font size="1">[back to start of this chapter](#ind-7--PROCESSED-DATA)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 7.3 Export The Table With The Processed Data {#ind-7-3--Export-The-Table-With-The-Processed-Data}  

The table with the processed data was exported (as an R file), 
in the sub-directory of the working directory: 
    
* *outputs --> processed_data* 
    
with filename:  
    
* *table_with_the_precessed_data.R*
    
```{r exprot_the_table_with_processed_data}

# Supply the filepath at which the table with the summary
# for the harm on population health will be exported.
filepath_____processed_data <-
    file.path(
        directory_tree_____outputs[[
            "filepath_____outputs_____processed_data"
            ]],
        "table_with_the_processed_data.R"
    )

# Export the table with the summary for the harm on population health
# with respect to fatalities.
saveRDS(
    object = processed_data,
    file = filepath_____processed_data
)

```

*The main reason for exporting the a file with the processed data 
was to supply a checkpoint for any attempts to reproduce the analysis.*

<br>  

<font size="1">[back to start of this section](#ind-7-3--Export-The-Table-With-The-Processed-Data)</font>  
<font size="1">[back to start of this chapter](#ind-7--PROCESSED-DATA)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 8 HARM ON POPULATION HEALTH {#ind-8--HARM-ON-POPULATION-HEALTH}  
***  

In this chapter an attempt was made to quantify the harm on population health 
based on the information from the 
[table with the processed data](#ind-7--PROCESSED-DATA).  

The harm on population health was examined over three perspectives:  
  
  1. [The harm on population health with respect to fatalities 
  caused by each weather event type 
  based on the observations for weather events 
  that resulted in non-zero fatalities 
  at United States in the period from 2001 to 2011.
  ](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)  
  2. [The harm on population health with respect to injuries 
  caused by each weather event type 
  based on the observations for weather events 
  that resulted in non-zero injuries 
  at United States in the period from 2001 to 2011.
  ](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)  
  3. [The harm on population health with respect to casualties 
  (sum of fatalities and injuries) caused by each weather event type
  based on the observations for weather events 
  that resulted in non-zero casualties 
  at United States in the period from 2001 to 2011.
  ](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)  

The weather event types for which less 
than 10 observations that resulted in non-zero harm were available 
with respect to a perspective of interest were ommitted 
(from the analysis of that particular perspective),
to avoid highly misleading statistics. 
Consequently the subset of weather event types 
that were included for each of the three perspectives is different. 

Due to the fact that for all perspectives 
the values of interest for the observations 
of most weather event types were highly positively skewed, 
it was consider important in order to obtain an insightful picture 
of their consequences to examine them over three different aspects: 

  1. The **overall** harm on population health 
  caused by each weather event type.  
  2. The harm on population health caused by 
  **the 90% of cases with the lowest impact** 
  of each weather event type.  
  3. The harm on population health caused by 
  **the 10% of cases with the highest impact** 
  of each weather event type.  

For every aspect the sample size, the skewness and the mean 
of the values that encapsulated the harm with respect to each perspective 
were summarized by each weather event type and reported.

The results obtained for the harm on population health 
by each weather event type were presented at the section 
[10.1 Question 1: Across the United States, 
which types of events (as indicated in the EVTYPE variable) 
are most harmful with respect to population health?
](#ind-10-1--results-harm-on-population-health) 
of the chapter [10 RESULTS](#ind-10--RESULTS)).  

For each of the three perspectives that were examined 
for the harm on population health by each weather event type 
a multiplot was created to visualize the respective results. 
Those multiplots constitute the three parts of the *Figure 1*, 
which was composed and presented at the subsection 
[10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health) 
of the chapter [10 RESULTS](#ind-10--RESULTS)).

(*In compliance with the restrictions of the assignment, 
according to which at least 1 but no more than 3 figures 
should be included in the report, 
the Multiplot as well as the elementary plots that contain 
were NOT displayed separately and can ONLY be examined 
as PARTs of the Figure 1 at the subsection 
[10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health) 
of the chapter [10 RESULTS](#ind-10--RESULTS).)*

<br>  
  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

## 8.1 Harm On Population Health With Respect To Fatalities By Each Weather Event Type {#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type}  

<font size="3"><u><strong>Summary</strong></u></font>  

The required variables and the target data subset of observations 
for the harm on population health with respect to fatalities were extracted 
from the table with the processed data, and processed 
to create a new variable that divided the observations 
for each of the included weather event types to two supplementary groups:  

* the 90% of observations with the lowest impact  
* the 10% of observations with the highest impact  
  
before the information for the harm on population health 
with respect to fatalities was summarized by each weather event type.  

Three aspects were examined: 
  
  1. The overall average number of fatalities by each weather event type.  
  2. The average number of fatalities by each weather event type 
  for the 90% of cases with the lowest impact.  
  3. The average number of fatalities by each weather event type 
  for the 10% of cases with the highest impact.  

For each aspect, the average number of fatalities 
by each weather event type, the number of its
available observations (based on which the average was computed) 
and their skewness were examined.  

The overall average number of fatalities was used as the main criterion 
to determine which weather events caused the most harm on population health
with respect to fatalities but it is important to take into account 
the other two aspect that were presented in order to obtain a more insightful 
and complete 'picture' of their consequences, 
(especially given the fact that for most of the weather event types, 
the fatalities were highly positively skewed).  

The table with results for the harm on population health 
with respect to fatalities by each weather event type 
were presented at the subsection 
[10.1.2 Most harmful event types with respect to fatalities
](#ind-10-1-2--Most-harmful-weather-event-types-with-respect-to-fatalities) 
of the chapter [10 RESULTS](#ind-10--RESULTS).

Finally the *Multiplot 1.1* was created to visualize 
the results for the harm on population health 
with respect to fatalities by each weather event type.  

*(Note that neither the Multiplot 1.1 nor the elementary plots 
that it contains were presented in this section 
due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures.
It can be examined at the subsection 
[10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health)
at the chapter [10 RESULTS](#ind-10--RESULTS), 
where the Figure 1 was presented, 
of which the Multiplot 1.1 constitutes the PART 1.)*

<font size="3"><u><strong>Steps</strong></u></font>  

* [8.1.1 Extract the target data for harm on population health with respect to fatalities
](#ind-8-1-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-fatalities)  
  * The target data subset of observations needed to evaluate 
  the harm on population health with respect to fatalities 
  by each weather event type was extracted 
  from the table with the processed data.
* [8.1.2 Process the target data for harm on population health with respect to fatalities
](#ind-8-1-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-fatalities)  
  * The table with target data subset for the harm on population health 
  with respect to fatalities was processed to create 
  the table with processed data for the harm on population health 
  with respect to fatalities.  
* [8.1.3 Summarize the processed data for harm on population health with respect to fatalities by each weather event type
](#ind-8-1-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)  
  * The harm on population health with respect to fatalities 
  by each weather event type was evaluated over various aspects.  
* [8.1.4 Visualize the results of the summary for the harm on population health with respect to fatalities by each weather event type
](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)  
  * The Multiplot 1.1 that presents the results of the summary 
  for the harm on population health with respect to fatalities 
  by each weather event type was created.  
    * [8.1.4.1 Create the components of Multiplot 1.1
    ](#ind-8-1-4-1--Create-the-components-of-Multiplot-1-1)  
      * Creates the four elementary plot that constitute the Multiplot 1.1:  
        * [8.1.4.1.1 Create The Plot 1.1.1](#ind-8-1-4-1-1--Create-The-Plot-1-1-1)  
          * Displays the overall average number of fatalities 
          caused by each weather event type 
          based on all the cases of weather events 
          that resulted in non-zero fatalities.  
        * [8.1.4.1.2 Create The Plot 1.1.2](#ind-8-1-4-1-2--Create-The-Plot-1-1-2)  
          * Displays the average number of fatalities 
          caused by each weather event type 
          based on 90% of weather events with the lowest impact 
          (for each weather event type) 
          that resulted in non-zero fatalities.  
        * [8.1.4.1.3 Create The Plot 1.1.3](#ind-8-1-4-1-3--Create-The-Plot-1-1-3)  
          * Displays the average number of fatalities 
          caused by each weather event type 
          based on 10% of weather events with the highest impact 
          (for each weather event type) 
          Displays the average number of fatalities 
          that resulted in non-zero fatalities.  
        * [8.1.4.1.4 Create The Plot 1.1.4](#ind-8-1-4-1-4--Create-The-Plot-1-1-4)  
          * Displays a comparison for each weather event type, 
          of the average number of fatalities 
          for the 90% of its observations with the lowest impact 
          versus the average number of fatalities 
          for the 10% of its observations with the highest impact 
          based only on the weather events 
          that resulted in non-zero fatalities.  
    * [8.1.4.2 Compose the Multiplot 1.1
    ](#ind-8-1-4-2--Compose-the-Multiplot-1-1)  
      * Combines the four elementary plots to create the Multiplot 1.1.  

<br>  

<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 8.1.1 Extract the target data for harm on population health with respect to fatalities {#ind-8-1-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-fatalities}  

In order to examine the harm on population health with respect to fatalities 
caused by each weather event type, 
the variables *REFNUM*, *EVENT_TYPE* and *FATALITIES* 
were selected from the table with the processed data and 
**only the observations that refer to weather events 
that resulted in non-zero fatalities** were extracted. 

Furthermore, in an attempt to avoid highly misleading statistics 
due to the small number of observations for some of the weather event types, 
a lowest bound of 10 weather events that caused non zero fatalities 
(for each of the included weather event types)
was selected (subjectively by the analyst) and applied. 

This lowest bound, although it may seem (and generally it is) not enough 
to get trustworthy statistics, it was considered to be *"good enough"* 
taking into account that : 
  
  1. the analysis focuses in describing historical data 
  without trying to make inferences 
  that would demand substantially bigger samples, 
  although any statistic based on less than 10 observations 
  could not be taken seriously 
  especially in cases (such as in this analysis) where the distribution 
  of fatalities for each weather event type was skewed.
  2. a period of 10 years (from 2001 to 2011) 
  in which the observations that were used in the analysis occurred, 
  is relatively small time to produce big samples of weather events 
  that caused non zero fatalities for some the weather event types. 
  Thus, if a highest bound was selected to get more robust statistics 
  such as samples of 100 or 300, the majority of weather event types 
  would have been excluded, making the results of the analysis trivial.  

```{r create_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_population_health_with_respect_to_fatalities}

# Extract the required variables and the target data subset of observations 
# for the harm on population health with respect to fatalities.
target_data_____harm_on_population_health_____fatalities <- processed_data[
  ## Extract only the observations that have resulted in non-zero fatalities.
  FATALITIES > 0,
  ## Select only the relevant variables. 
  list(REFNUM, EVENT_TYPE, FATALITIES)
  ][
    ### Keep only the observations that correspond to the weather event types 
    ### for which there are at least 10 weather events available.
    EVENT_TYPE %in% 
      names(table(EVENT_TYPE)[table(EVENT_TYPE) >= 10])
    ]

```

The table with the target data for the harm on population health 
with respect to fatalities consist of 3175 observations. 

```{r print_the_structure_of_the_table_with_the_target_data_subset_for_the_harm_on_population_health_with_respect_to_fatalities} 

# Print the structure of the table with the target data subset 
# for the harm on population health with respect to fatalities.
str(target_data_____harm_on_population_health_____fatalities)

```

The variable *EVENT_TYPE* includes 26 distinct weather event types, 
for most of which the variable *FATALITIES* was highly positively skewed. 

```{r create_a_kable_to_present_some_facts_for_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_population_health_with_respect_to_fatalities}

# Create a kable to present some facts about the table with the target data 
# for the harm on population health with respect to fatalities.
kable(
  x = target_data_____harm_on_population_health_____fatalities[
    order(EVENT_TYPE), 
    list(
      "N" = .N, 
      "SKEWNESS" = round(skewness(FATALITIES), 4)
    ), 
    by = EVENT_TYPE
    ],
  caption = paste0(
    "Table 8.1.1-1: ",
    "Facts about the table with the target data subset of observations ", 
    "for the harm on population health with respect to fatalities."
  )
) %>% 
  kable_styling(
    bootstrap_options = c(
      "striped", "hover", "condensed", "responsive", "bordered"
    ), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = "The skewness was rounded to 4 decimal places."
  )

```

It was worth noting that for the weather event types 
with highest number of observations 
there was highest skewness for the values of fatalities, 
indicating that the corresponding distribution of fatalities
has a heavy tail that wasn't possible to be observed 
when few observation were available.  

<br>  

<font size="1">[back to start of this subsection](#ind-8-1-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-fatalities)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 8.1.2 Process the target data for harm on population health with respect to fatalities {#ind-8-1-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-fatalities}  

To create the table with the processed data 
for the harm on population health with respect to fatalities 
from the corresponding target data subset for this perspective,
a new variable was created that divides the observations 
for each of the included weather event types in two complementary levels: 

* one that contains the 90% of cases with lowest impact  
* the other that contains the 10% of cases with highest impact  

This decision was made due to the high skewness that was observed 
for the values of the variable *FATALITIES* for most weather event types, 
which indicates that the underlining distributions of such phenomena 
has a heavy tail that causes this heterogeneity on the observations. 
As a result a small number of fatalities were observed 
for the majority of cases that resulted in non-zero fatalities 
while in the few cases with the highest impact 
they caused lots of fatalities. 

Having in mind that the average number of fatalities 
will be used to determine which weather event types 
were the most harmful to population health (with respect to fatalities) 
combined with the fact that the average doesn't represent well 
the distribution of variables with high skewness, 
as it is highly affected by the most extreme values, 
it was considered necessary to examine the subsets 
created by those two levels in order to obtain an insightful picture. 


```{r create_the_table_with_the_processed_data_for_harm_on_population_health_with_respect_to_fatalities}

# Create the table with the processed data 
# for the harm on population health with respect to fatalities.
processed_data_____harm_on_population_health_____fatalities <- 
  target_data_____harm_on_population_health_____fatalities[
    ,
    ## Create a new variable divides the observations
    ## for each weather event into two supplementary groups:  
    ##   - the 90% of weather events that resulted in lowest fatalities
    ##   - the 10% of weather events that resulted in highest fatalities
    BIN_GROUP_PER_EVENT_TYPE := (function(x, p_bins) {
      
      # adds 0 and 1 in the vector supplied at the argument 'p_bins' 
      # to the start and the end respectively  
      # the supplied percentiles if they are missing 
      # and sort them ascending
      p_bins_increasing <- sort(c(0, p_bins, 1))
      
      # creates the character strings that labels of the bins by the values supplied at 
      # the argument 'p_bins' that will be the values of the new variable
      bin_labels <- paste0("(", p_bins_increasing[-length(p_bins_increasing)]*100,
                           "% - ", p_bins_increasing[-1]*100, "%]")
      
      # identify the number of occurrences that correspond to each label
      n_times <- vapply(2:length(p_bins_increasing),
                        function(i) {
                          as.integer(floor(length(x) * p_bins_increasing[i]) -
                                       floor(length(x) * p_bins_increasing[i - 1]))
                        }, integer(1))
      
      # multiply each label with the number of its occurrences
      x_bins_expanded <- rep(x = bin_labels, times = n_times)
      
      # order the label to much the values of the corresponding vector
      x_bins_expanded_reordered <- x_bins_expanded[order(seq_along(x)[order(x)])]
      
      ## Coerce the character vector with the labels of bins to a factor
      x_bins_factor <- factor(x_bins_expanded_reordered, labels = bin_labels, ordered = TRUE)
      
    })(FATALITIES, 0.9)
    , by = EVENT_TYPE
  ][
    ## Coerce the EVENT_VARIABLE to factor
    , EVENT_TYPE := as.factor(EVENT_TYPE) 
  ]

```

The table with the processed data for the harm on population health 
with respect to fatalities contains 4 variables:  

  1. **REFNUM** (int) : an id that uniquely identifies each observation  
  2. **EVENT_TYPE** (Factor w/ 26 levels) : the type of each weather event
  3. **FATALITIES** (int) : the number of fatalities  
  4. **BIN_GROUP_PER_EVENT_TYPE** (Ord.factor w/ 2 levels) : 
  a factor that divides the observations for each 
  weather event type to two complementary levels, 
  one with the 90% of observations with the lowest impact and 
  another with the 10% of observations with the highest impact.

and 3175 observations. 

```{r print_structure_for_the_table_with_the_processed_data_for_the_harm_on_population_health_with_respect_to_fatalities}

# Print the structure of the table with the processed data 
# for the harm on population health with respect to fatalities.
str(processed_data_____harm_on_population_health_____fatalities)

```

<br>  

<font size="1">[back to start of this subsection](#ind-8-1-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-fatalities)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 8.1.3 Summarize the processed data for harm on population health with respect to fatalities by each weather event type {#ind-8-1-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type}  

To evaluate the harm on population health by each weather event type 
with respect to fatalities a simplistic approach was adopted :  

  * the weather event types were ranked 
  from the most harmful to the least 
  based on the overall average number of fatalities 
  of the weather events that resulted in non-zero fatalities

The overall average number of fatalities caused by each weather event type 
was initially examined along with the skewness of the number of fatalities 
for each weather event type. In most cases the skewness was high 
(or even extremely high), so it was possible that the overall mean 
misrepresented the consequences of each weather event type.  

That is the reason why the average number of fatalities for 90% of weather events 
with the lowest impact versus the average number of fatalities for the 10% of 
weather events with the highest impact were also computed and examined.  

**It is highlighted that for the average number of fatalities 
that refers to the 10% of the cases that had the highest impact, 
there were few observations available for a lot of weather event types 
and the corresponding mean values should be interpreted with caution.**

```{r create_the_table_with_the_summary_for_the_harm_on_population_health_with_respect_to_fatalities_by_each_weather_event_type}

# Create the table with the summary for the harm on population health 
# with respect to fatalities for each weather event type.
summary_____harm_on_population_health______fatalities <- 
  processed_data_____harm_on_population_health_____fatalities[
  ,
  list(
    ## The total number of observation by each weather event type.
    "N" = .N,
    ## The average number of fatalities caused by each weather event type.
    "AVRG" = round(mean(FATALITIES), 2),
    ## The skewness of fatalities for the observations by each weather event type.
    "SKEWNESS" = round(skewness(FATALITIES), 4),
    ## The number of observations for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "N_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , .N],
    ## The average number of fatalities caused by each weather event type 
    ## for the 90% of cases with the lowest impact.
    "AVRG_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(mean(FATALITIES), 2)],
    ## The skewness of fatalities for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "SKEWNESS_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(skewness(FATALITIES), 4)],
    ## The number of observations for the 10% of cases with the lowest impact 
    ## by each weather event type.
    "N_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , .N],
    ## The average number of fatalities caused by each weather event type 
    ## for the 10% of cases with the highest impact.
    "AVRG_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(mean(FATALITIES), 2)],
    ## The skewness of fatalities for the 10% of cases with the highest impact 
    ## by each weather event type.
    "SKEWNESS_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(skewness(FATALITIES), 4)]
  ),
  by = "EVENT_TYPE"
  ][
    ## The average number of fatalities is used to order the rows of the table
    ## from the most harmful weather event type to the least.
    order(-AVRG),
    ## Create a variable with the rank of the harmness of each weather event type.
    RANK := 1:length(EVENT_TYPE)
    ][
      ,
      ## Reorder the variables at the table.
      list(
        RANK, EVENT_TYPE, N, AVRG, SKEWNESS, N_LOW, AVRG_LOW, SKEWNESS_LOW, N_HIGH, AVRG_HIGH, SKEWNESS_HIGH
      )
      ]

```

The results of the table with the summary 
for the harm on population health with respect to fatalities
by each weather event type that was created in this section 
were presented at the subsection 
[10.1.2 Most harmful event types with respect to fatalities
]({#ind-10-1-2--Most-harmful-weather-event-types-with-respect-to-fatalities}) 
of the chapter [10 RESULTS](#ind-10--RESULTS). 

The table with the summary for the harm on population health 
with respect to fatalities by each weather event type 
was exported (as an R file), in the folder of the working directory: 

* *outputs --> harm_on_population_health --> results* 

with filename:  

* *summary______harm_on_population_health______fatalities.R*

```{r exprot_the_summary_for_the_harm_on_population_health_with_respect_to_fatalities}

# Supply the filepath at which the table with the summary
# for the harm on population health will be exported.
filepath_____summary_____harm_on_population_health______fatalities <-
  file.path(
    directory_tree_____outputs[[
      "filepath_____outputs_____harm_on_population_health_____results"
    ]],
    "summary_____harm_on_population_health______fatalities.R"
  )

# Export the table with the summary for the harm on population health
# with respect to fatalities.
saveRDS(
  object = summary_____harm_on_population_health______fatalities,
  file = filepath_____summary_____harm_on_population_health______fatalities
)

```

*The main reason for exporting the file 
with the summary for the harm on population health 
with respect to fatalities by each weather event type 
was to supply a checkpoint for any attempts to reproduce the analysis.*

<br>  

<font size="1">[back to start of this subsection](#ind-8-1-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 8.1.4 Visualize the results of the summary for the harm on population health with respect to fatalities by each weather event type {#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type}  

From the table with the summary for the harm on population health 
by each weather event type with respect to fatalities 
the **Multiplot 1.1** was created to present an overview of the results 
for the three different aspects that were examined for this perspective.  

The elementary plots were 
[created](#ind-8-1-4-1--Create-the-components-of-Multiplot-1-1):  

* [8.1.4.1.1 Create The Plot 1.1.1](#ind-8-1-4-1-1--Create-The-Plot-1-1-1)  
  * Displays the overall average number of fatalities 
  caused by each weather event type 
  based on all the cases of weather events 
  that resulted in non-zero fatalities.  
* [8.1.4.1.2 Create The Plot 1.1.2](#ind-8-1-4-1-2--Create-The-Plot-1-1-2)  
  * Displays the average number of fatalities 
  caused by each weather event type 
  based on 90% of weather events with the lowest impact 
  (for each weather event type)
  that resulted in non-zero fatalities.  
* [8.1.4.1.3 Create The Plot 1.1.3](#ind-8-1-4-1-3--Create-The-Plot-1-1-3)  
  * Displays the average number of fatalities 
  caused by each weather event type 
  based on 10% of weather events with the highest impact 
  (for each weather event type)
  that resulted in non-zero fatalities.  
* [8.1.4.1.4 Create The Plot 1.1.4](#ind-8-1-4-1-4--Create-The-Plot-1-1-4)  
  * Displays a comparison for each weather event type, 
  of the average number of fatalities 
  for the 90% of its observations with the lowest impact 
  versus the average number of fatalities 
  for the 10% of its observations with the highest impact 
  based only on the weather events 
  that resulted in non-zero fatalities.  

which were then [combined](#Compose-the-Multiplot-1-1) 
in order to obtain the **Multiplot 1.1**.

It constitutes the *PART 1* of the *Figure 1*
that displays the overview of the harm on population health 
by each weather event type.  

*(Note that neither the Multiplot 1.1 nor the elementary plots 
that it contains were presented in this section 
due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures.
It can be examined at the subsection 
[10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health)
at the chapter [10 RESULTS](#ind-10--RESULTS), 
were the Figure 1 was presented, 
of which the Multiplot 1.1 constitutes the PART 1.)*


<br>  

<font size="1">[back to start of this subsection](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 8.1.4.1 Create the components of Multiplot 1.1 {#ind-8-1-4-1--Create-the-components-of-Multiplot-1-1}  

Creates four elementary plots to visualize the results for the aspects 
that were examined for the harm on population health 
with respect to fatalities by each weather event type.

* [8.1.4.1.1 Create The Plot 1.1.1](#ind-8-1-4-1-1--Create-The-Plot-1-1-1)  
  * Displays the overall average number of fatalities 
  caused by each weather event type 
  based on all the cases of weather events 
  that resulted in non-zero fatalities.  
* [8.1.4.1.2 Create The Plot 1.1.2](#ind-8-1-4-1-2--Create-The-Plot-1-1-2)  
  * Displays the average number of fatalities 
  caused by each weather event type 
  based on 90% of weather events with the lowest impact 
  (for each weather event type) 
  that resulted in non-zero fatalities.  
* [8.1.4.1.3 Create The Plot 1.1.3](#ind-8-1-4-1-3--Create-The-Plot-1-1-3)  
  * Displays the average number of fatalities 
  caused by each weather event type 
  based on 10% of weather events with the highest impact 
  (for each weather event type) 
  that resulted in non-zero fatalities.  
* [8.1.4.1.4 Create The Plot 1.1.4](#ind-8-1-4-1-4--Create-The-Plot-1-1-4)  
  * Displays a comparison for each weather event type, 
  of the average number of fatalities 
  for the 90% of its observations with the lowest impact 
  versus the average number of fatalities 
  for the 10% of its observations with the highest impact 
  based only on the weather events 
  that resulted in non-zero fatalities.  

The elementary plots were used to 
[compose the Multiplot 1.1](#ind-8-1-4-2--Compose-the-Multiplot-1-1).  

<br>  

<font size="1">[back to start of this subsubsection](#ind-8-1-4-1--Create-the-components-of-Multiplot-1-1)</font>  
<font size="1">[back to start of this subsection](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.1.4.1.1 Create The Plot 1.1.1** {#ind-8-1-4-1-1--Create-The-Plot-1-1-1}

The *Plot 1.1.1* displays 
**the overall average number of fatalities** 
caused by each weather event type taking into account 
all and only the observation that resulted in non-zero fatalities. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of fatalities** they caused.  

The skewness of the number of fatalities 
for the observations of each weather event type
(based on which the overall number of fatalities was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_1_1}

# Create the Elementary Plot 1.1.1 that displays 
# the overall average number of fatalities 
# by each weather event type for all cases. 
elementary_plot_1_1_1 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______fatalities,
    mapping = aes(
      x = AVRG,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to make them displayed alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a square shaped point to the position that corresponds to 
  ## the average number of fatalities caused by each weather event type, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(color = SKEWNESS),
    shape = 15, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average number of fatalities.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG, 
      group = EVENT_TYPE, 
      color = SKEWNESS
    )
    ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## number of fatalities it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2.5
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of fatalities for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.1 will be composed from the four elementary plots. 
    limits = c(-2, 14), 
    midpoint = 7, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels.  
  labs(
    title = "Plot 1.1.1", 
    subtitle = "Aspect: Overall",
    x = "Average Number of Fatalities\n",
    y = "Weather Event Types \n"
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )
```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-1-4-1-1--Create-The-Plot-1-1-1)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-1-4-1--Create-the-components-of-Multiplot-1-1)</font>  
<font size="1">[back to start of this subsection](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.1.4.1.2 Create The Plot 1.1.2** {#ind-8-1-4-1-2--Create-The-Plot-1-1-2}

The *Elementary Plot 1.1.2* displays 
**the average number of fatalities for the 90% of cases with the lowest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero fatalities. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of fatalities** they caused.  
(so it is NOT based on the average number of fatalities 
caused by the 90% of cases with the lowest impact of each weather event type).  

The skewness of the number of fatalities 
for the observations of each weather event type
(based on which the average number of fatalities for the 90% of cases 
with the lowest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_1_2}

# Create the Elementary Plot 1.1.2 that displays 
# the average number of fatalities by each weather event type 
# for the 90% of its cases with the lowest impact.
elementary_plot_1_1_2 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______fatalities,
    mapping = aes(
      x = AVRG_LOW,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a circle shaped point to the position that corresponds to 
  ## the average number of fatalities caused by each weather event type
  ## for the 90% of its cases with the lowest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_LOW
    ), 
    size = 3.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average number of fatalities 
  ## for the 90% of its cases with the lowest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_LOW, 
      group = EVENT_TYPE, 
      color = SKEWNESS_LOW
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## number of fatalities it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2
    ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of fatalities for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.1 will be composed from the four elementary plots.
    limits = c(-2, 14), 
    midpoint = 7, 
    low = "lightgreen",
    mid = "orange",
    high = "purple"
    ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 1.1.2",
    subtitle = "Aspect: 90% of cases with the lowest impact",
    x = paste0(
      "Average Number of Fatalities for the 90% ", "\n",
      "of Observations with the Lowest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```


<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-1-4-1-2--Create-The-Plot-1-1-2)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-1-4-1--Create-the-components-of-Multiplot-1-1)</font>  
<font size="1">[back to start of this subsection](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.1.4.1.3 Create The Plot 1.1.3** {#ind-8-1-4-1-3--Create-The-Plot-1-1-3}

The *Plot 1.1.3* displays 
**the average number of fatalities for the 10% of cases with the highest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero fatalities. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of fatalities** they caused.  
(so it is NOT based on the average number of fatalities 
caused by the 10% of cases with the highest impact of each weather event type).  

The skewness of the number of fatalities 
for the observations of each weather event type
(based on which the average number of fatalities for the 10% of cases 
with the highest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_1_3}

# Create the Elementary Plot 1.1.3 that displays 
# the average number of fatalities by each weather event type 
# for the 10% of its cases with the highest impact.
elementary_plot_1_1_3 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______fatalities,
    mapping = aes(
      x = AVRG_HIGH,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a diamond shaped point to the position that corresponds to 
  ## the average number of fatalities caused by each weather event type
  ## for the 10% of its cases with the highest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_HIGH
    ), 
    shape = 18, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average number of fatalities 
  ## for the 10% of its cases with the highest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_HIGH, 
      group = EVENT_TYPE, 
      color = SKEWNESS_HIGH
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## number of fatalities it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ),
    size = 2
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of fatalities for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.1 will be composed from the four elementary plots.
    limits = c(-2, 14), 
    midpoint = 7, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 1.1.3",
    subtitle ="Aspect: 10% of cases with the highest impact",
    x = paste0(
      "Average Number of Fatalities for the 10% ", "\n", 
      "of Observations with the Highest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    ### Remove the text, ticks and title of the y axis 
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-1-4-1-3--Create-The-Plot-1-1-3)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-1-4-1--Create-the-components-of-Multiplot-1-1)</font>  
<font size="1">[back to start of this subsection](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.1.4.1.4 Create The Plot 1.1.4** {#ind-8-1-4-1-4--Create-The-Plot-1-1-4}

The *Plot 1.1.4* displays 
a compact overview of all three aspect that were examined 
for the harm on population health with respect to fatalities.  

For each weather event type, the comparison was visualized for 
**the average number of fatalities for the 90% of cases with the lowest impact** 
versus
**the average number of fatalities for the 10% of cases with the highest impact**.

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of fatalities** they caused.  

The skewness of the number of fatalities 
for the observations of each weather event type
(based on which the overall number of fatalities was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_1_4}

# Create the Elementary Plot 1.1.4 that displays 
# by each weather event type the comparison of 
# the average number of fatalities 
# for the 90% of cases with the lowest impact
# versus the average number of fatalities 
# for the 10% of cases with the highest impact.
elementary_plot_1_1_4 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______fatalities,
    mapping = aes(
      x = AVRG_HIGH, 
      y = AVRG_LOW
    )
  ) +
  geom_point(
    mapping = aes(
      fill = SKEWNESS
    ), 
    shape = 21
  ) +
  ## Draw a label with a number that indicates the rank assigned 
  ## to each weather event type (from the most harmful to the least) 
  ## based on the overall average number of fatalities it caused.
  geom_label_repel(
    mapping = aes(
      label = RANK, 
      fill = SKEWNESS
    ),
    size = 2.5
  ) +
  ## Adjust the scale for the fill of each label.
  scale_fill_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of fatalities for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.1 will be composed from the four elementary plots.
    limits = c(-2, 14),
    midpoint = 7, 
    low = "lightgreen",
    mid = "orange", 
    high = "purple"
    ) +
  ## Set proper limits to the plot.
    xlim(c(1, 18)) +
    ylim(c(0.75, 2)) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 1.1.4",
    subtitle = paste0(
      "Comparison of the average number of fatalities ", 
      "for the 90% of observations with the lowest impact ", 
      "versus the average number of fatalities ", 
      "for the 10% of observations with highest impact. "
    ),
    x = paste0(
      "Average Number of Fatalities by each Weather Event Type ", 
      "for the 10% of its Observations with the Highest Impact"
    ),
    y = paste0(
      "Average Number of Fatalities by each Weather Event Type ", "\n", 
      "for the 90% of its Observations with the Lowest Impact."
    ),
    ### Add a descriptive label for the legend.
    fill = paste0(
      "The color indicates the skewness ",
      "of fatalities for the each weather event type. ",
      "(the color scale is unique for all four plots of PART 1) ", "\n",
      "When the color of a bar is gray, the skewness was indeterminable ",
      "due to the fact that all observations for that weather event type ",
      "took the same value."
    )
  ) +
  ## Select a theme.
  theme_linedraw() +
  ## Customize the selected theme.
  theme(
    ### Adjust the legend.
    legend.position = "bottom",
    legend.direction = "horizontal",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-1-4-1-4--Create-The-Plot-1-1-4)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-1-4-1--Create-the-components-of-Multiplot-1-1)</font>  
<font size="1">[back to start of this subsection](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  

#### 8.1.4.2 Compose the Multiplot 1.1 {#ind-8-1-4-2--Compose-the-Multiplot-1-1}  

The four elementary plots that were created from 
the results of the summary for the harm on population health 
with respect to fatalities by each weather event type, 
were combined to construct a single multiplot 
that displays the complete picture for this perspective. 

```{r compose_the_multiplot_1_1}

# Create a multiplot that displays the overview of the summary 
# for the harm on population health with respect to fatalities
# by each weather event type.
multiplot_1_1 <- arrangeGrob(
  grobs = list(
      
    # Title
    textGrob(
      label = paste0(
        "\n",
        "PART 1: Harm on population health by each weather event type ", 
        "with the respect to fatalities ", "\n", 
        "based on the cases of weather events ", 
        "that resulted in non-zero fatalities.", "\n", 
        "\n"
      ),
       gp=gpar(
         fontsize = 16, 
         fontface = "bold"
       )
    ),
    
    # Subtitle
    textGrob(
      label = paste0(
          "\n", 
          "The results include only the weather event types, ", 
          "for which at least 10 observations ", 
          "that resulted in non-zero fatalities were available. ", "\n",
          "The number associated with each weather event type ", 
          "represents the rank (from the most harmful to the least) ", 
          "which was assigned based on the overall average number of fatalities.", "\n",
          "Because for most of the weather event types ", 
          "high positive skewness was observed for the number of fatalities, ",
          "the average of the 90% of cases with lowest impact ", "\n",
          "and the 10% of cases with highest impact were reported ", 
          "to provide a more representative picture of their consequences.","\n",
          "\n"
      ),
       gp=gpar(
         fontsize = 14, 
         fontface = "bold"
       )
    ),
    
    # Plot 1.1.1
    # Elementary plot for the average number of fatalities 
    # by each weather event type for all cases.
    elementary_plot_1_1_1,
    
    # ELEMENTARY PLOT 1.1.2
    # Elementary plot for the average number of fatalities 
    # by each weather event type for 90% of cases with the lowest impact.
    elementary_plot_1_1_2,
    
    # ELEMENTARY PLOT 1.1.3
    # Elementary plot for the average number of fatalities 
    # by each weather event type for 10% of cases with the highest impact.
    elementary_plot_1_1_3,
    
    # ELEMENTARY PLOT 1.1.4
    # Elementary Plot 1.1.4 for the comparison of 
    # the average number of fatalities 
    # for the 90% of cases with the lowest impact versus 
    # the 10% of cases with the highest impact.
    elementary_plot_1_1_4
  ),
  # Set the layout for this elementary plots
  layout_matrix = 
    matrix(
      c(1,1,1,1,1,1,1,1,1,
        2,2,2,2,2,2,2,2,2,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6
      ),
      byrow = TRUE, 
      nrow = 13
    )
)

```

*(Note that the Multiplot 1.1 was NOT presented in this section 
due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures.
It can be examined at the subsection 
[10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health)
of the chapter [10 RESULTS](#ind-10--RESULTS), 
were the Figure 1 was presented, 
of which the Multiplot 1.1 constitutes the PART 1.)*

<br>  

<font size="1">[back to start of this subsubsection](#ind-8-1-4-2--Compose-the-Multiplot-1-1)</font>  
<font size="1">[back to start of this subsection](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  



## 8.2 Harm On Population Health With Respect To Injuries By Each Weather Event Type {#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type}  

<font size="3"><u><strong>Summary</strong></u></font>  

The required variables and the target data subset of observations 
for the harm on population health with respect to injuries 
were extracted from the table with the processed data, 
and processed to create a new variable that divided the observations 
for each of the included weather event types to two supplementary groups:  

* the 90% of observations with the lowest impact  
* the 10% of observations with the highest impact  
  
before the information for the harm on population health 
with respect to injuries was summarized by each weather event type.  

Three aspects were examined: 
  
  1. The overall average number of injuries by each weather event type.  
  2. The average number of injuries by each weather event type 
  for the 90% of cases with the lowest impact.  
  3. The average number of injuries by each weather event type 
  for the 10% of cases with the highest impact.  

For each aspect, the average number of injuries 
by each weather event type, the number of its
available observations (based on which the average was computed) 
and their skewness were examined. 

The overall average number of injuries was used as the main criterion 
to determine which weather events caused the most harm on population health
with respect to injuries but it is important to take into account 
the other two aspect that were presented in order to obtain a more insightful 
and complete 'picture' of their consequences, 
(especially given the fact that for most of the weather event types, 
the injuries were highly positively skewed).

The table with results for the harm on population health 
with respect to injuries by each weather event type 
were presented at the subsection 
[10.1.3 Most harmful event types with respect to injuries
](#ind-10-1-3--Most-harmful-weather-event-types-with-respect-to-injuries) 
of the chapter [10 RESULTS](#ind-10--RESULTS).

Finally the *Multiplot 1.2* was created to visualize 
the results of the harm on population health with respect to injuries 
by each weather event type.  

*(Note that neither the Multiplot 1.1 nor the elementary plots that it contains 
were presented in this section due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection [10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health) 
at the chapter [10 RESULTS](#ind-10--RESULTS), 
where the Figure 1 was presented, 
of which the Multiplot 1.2 constitutes the PART 2.)

<font size="3"><u><strong>Steps</strong></u></font>  

* [8.2.1 Extract the target data for harm on population health with respect to injuries
](#ind-8-2-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-injuries)  
  * The target data subset of observations needed to evaluate 
  the harm on population health with respect to injuries 
  by each weather event type was extracted 
  from the table with the processed data.  
* [8.2.2 Process the target data for harm on population health with respect to injuries
](#ind-8-2-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-injuries)  
  * The table with target data subset for the harm on population health 
  with respect to injuries was processed to create 
  the table with processed data for the harm on population health 
  with respect to injuries.  
* [8.2.3 Summarize the processed data for harm on population health with respect to injuries by each weather event type
](#ind-8-2-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)  
  * The harm on population health with respect to injuries 
  by each weather event type was evaluated over various aspects.  
* [8.2.4 Visualize the results of the summary for the harm on population health with respect to injuries by each weather event type
](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)  
  * The Multiplot 1.2 that presents the results of the summary 
  for the harm on population health with respect to injuries 
  by each weather event type was created.  
    * [8.2.4.1 Create the components of Multiplot 1.2
    ](#ind-8-2-4-1--Create-the-components-of-Multiplot-1-2)  
      * Creates the four elementary plot that constitute the Multiplot 1.2:  
        * [8.2.4.1.1 Create The Plot 1.2.1](#ind-8-2-4-1-1--Create-The-Plot-1-2-1)  
          * Displays the overall average number of injuries 
          caused by each weather event type based 
          on all the cases of weather events 
          that resulted in non-zero injuries.  
        * [8.2.4.1.2 Create The Plot 1.2.2](#ind-8-2-4-1-2--Create-The-Plot-1-2-2)  
          * Displays the average number of injuries 
          caused by each weather event type based on 90% of weather events 
          with the lowest impact (for each weather event type) 
          that resulted in non-zero injuries.  
        * [8.2.4.1.3 Create The Plot 1.2.3](#ind-8-2-4-1-3--Create-The-Plot-1-2-3)  
          * Displays the average number of injuries 
          caused by each weather event type based on 10% of weather events 
          with the highest impact (for each weather event type) 
          that resulted in non-zero injuries.  
        * [8.2.4.1.4 Create The Plot 1.2.4](#ind-8-2-4-1-4--Create-The-Plot-1-2-4)
          * Displays a comparison for each weather event type, 
          of the average number of injuries for the 90% of its observations 
          with the lowest impact versus the average number of injuries 
          for the 10% of its observations with the highest impact 
          based only on the weather events that resulted in non-zero injuries.  
    * [8.2.4.2 Compose the Multiplot 1.2](#ind-8-2-4-2--Compose-the-Multiplot-1-2)  
      * Combines the four elementary plots to create the Multiplot 1.1.  

<br>  

<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 8.2.1 Extract the target data for harm on population health with respect to injuries {#ind-8-2-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-injuries}  

In order to examine the harm on population health with respect to injuries 
caused by each weather event type, 
the variables *REFNUM*, *EVENT_TYPE* and *INJURIES* 
were selected from the table with the processed data and 
**only the observations that refer to weather events 
that resulted in non-zero injuries** were extracted. 

Furthermore, in an attempt to avoid highly misleading statistics 
due to the small number of observations for some of the weather event types, 
a lowest bound of 10 weather events that caused non zero injuries 
(for each of the included weather event types)
was selected (subjectively by the analyst) and applied. 

This lowest bound, although it may seem (and generally it is) not enough 
to get trustworthy statistics, it was considered to be *"good enough"* 
taking into account that : 
  
  1. the analysis focuses in describing historical data 
  without trying to make inferences 
  that would demand substantially bigger samples, 
  although any statistic based on less than 10 observations 
  could not be taken seriously 
  especially in cases (such as in this analysis) where the distribution 
  of injuries for each weather event type was skewed.
  2. a period of 10 years (from 2001 to 2011) 
  in which the observations that were used in the analysis occurred, 
  is relatively small time to produce big samples of weather events 
  that caused non zero injuries for some the weather event types. 
  Thus, if a highest bound was selected to get more robust statistics 
  such as samples of 100 or 300, the majority of weather event types 
  would have been excluded, making the results of the analysis trivial.  

```{r create_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_population_health_with_respect_to_injuries}

# Extract the required variables and the target data subset of observations 
# for the harm on population health with respect to injuries.
target_data_____harm_on_population_health_____injuries <- processed_data[
  ## Extract only the observations that have resulted in non-zero injuries.
  INJURIES > 0,
  ## Select only the relevant variables. 
  list(REFNUM, EVENT_TYPE, INJURIES)
  ][
    ### Keep only the observations that correspond to the weather event types 
    ### for which there are at least 10 weather events available.
    EVENT_TYPE %in% 
      names(table(EVENT_TYPE)[table(EVENT_TYPE) >= 10])
    ]

```

The table with the target data for the harm on population health 
with respect to injuries consist of 5581 observations. 

```{r print_the_structure_of_the_table_with_the_target_data_subset_for_the_harm_on_population_health_with_respect_to_injuries} 

# Print the structure of the table with the target data subset 
# for the harm on population health with respect to injuries.
str(target_data_____harm_on_population_health_____injuries)

```

The variable *EVENT_TYPE* includes 27 distinct weather event types, 
for most of which the variable *INJURIES* was highly positively skewed. 

```{r create_a_kable_to_present_some_facts_for_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_population_health_with_respect_to_injuries}

# Create a kable to present some facts about the table with the target data 
# for the harm on population health with respect to injuries.
kable(
  x = target_data_____harm_on_population_health_____injuries[
    order(EVENT_TYPE), 
    list(
      "N" = .N, 
      "SKEWNESS" = round(skewness(INJURIES), 4)
    ), 
    by = EVENT_TYPE
    ],
  caption = paste0(
    "Table 8.2.1-1: ",
    "Facts about the table with the target data subset of observations ", 
    "for the harm on population health with respect to injuries."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = "The skewness was rounded to 4 decimal places."
  )

```

It was worth noting that for the weather event types 
with highest number of observations 
there was highest skewness for the values of injuries, 
indicating that the corresponding distribution of injuries
has a heavy tail that wasn't possible to be observed 
when few observation were available.  

<br>  

<font size="1">[back to start of this subsection](#ind-8-2-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-injuries)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 8.2.2 Process the target data for harm on population health with respect to injuries {#ind-8-2-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-injuries}  

To create the table with the processed data 
for the harm on population health with respect to injuries 
from the corresponding target data subset for this perspective,
a new variable was created that divides the observations 
for each of the included weather event types in two complementary levels: 

* one that contains the 90% of cases with lowest impact  
* the other that contains the 10% of cases with highest impact  

This decision was made due to the high skewness that was observed 
for the values of the variable *INJURIES* for most weather event types, 
which indicates that the underlining distributions of such phenomena 
has a heavy tail that causes this heterogeneity on the observations. 
As a result a small number of injuries were observed 
for the majority of cases that resulted in non-zero injuries 
while in the few cases with the highest impact 
they caused lots of injuries. 

Having in mind that the average number of injuries 
will be used to determine which weather event types 
were the most harmful to population health (with respect to injuries) 
combined with the fact that the average doesn't represent well 
the distribution of variables with high skewness, 
as it is highly affected by the most extreme values, 
it was considered necessary to examine the subsets 
created by those two levels in order to obtain an insightful picture. 

```{r create_the_table_with_the_processed_data_for_harm_on_population_health_with_respect_to_injuries}

# Create the table with the processed data 
# for the harm on population health with respect to injuries.
processed_data_____harm_on_population_health_____injuries <- 
  target_data_____harm_on_population_health_____injuries[
    ,
    ## Create a new variable divides the observations
    ## for each weather event into two supplementary groups:  
    ##   - the 90% of weather events that resulted in lowest injuries
    ##   - the 10% of weather events that resulted in highest injuries
    BIN_GROUP_PER_EVENT_TYPE := (function(x, p_bins) {
      
      # adds 0 and 1 in the vector supplied at the argument 'p_bins' 
      # to the start and the end respectively  
      # the supplied percentiles if they are missing 
      # and sort them ascending
      p_bins_increasing <- sort(c(0, p_bins, 1))
      
      # creates the character strings that labels of the bins by the values supplied at 
      # the argument 'p_bins' that will be the values of the new variable
      bin_labels <- paste0("(", p_bins_increasing[-length(p_bins_increasing)]*100,
                           "% - ", p_bins_increasing[-1]*100, "%]")
      
      # identify the number of occurrences that correspond to each label
      n_times <- vapply(2:length(p_bins_increasing),
                        function(i) {
                          as.integer(floor(length(x) * p_bins_increasing[i]) -
                                       floor(length(x) * p_bins_increasing[i - 1]))
                        }, integer(1))
      
      # multiply each label with the number of its occurrences
      x_bins_expanded <- rep(x = bin_labels, times = n_times)
      
      # order the label to much the values of the corresponding vector
      x_bins_expanded_reordered <- x_bins_expanded[order(seq_along(x)[order(x)])]
      
      ## Coerce the character vector with the labels of bins to a factor
      x_bins_factor <- factor(x_bins_expanded_reordered, labels = bin_labels, ordered = TRUE)
      
    })(INJURIES, 0.9)
    , by = EVENT_TYPE
  ][
    ## Coerce the EVENT_VARIABLE to factor
    , EVENT_TYPE := as.factor(EVENT_TYPE) 
  ]

```

The table with the processed data for the harm on population health 
with respect to injuries contains 4 variables:  

  1. **REFNUM** (int) : an id that uniquely identifies each observation  
  2. **EVENT_TYPE** (Factor w/ 27 levels) : the type of each weather event
  3. **INJURIES** (int) : the number of injuries  
  4. **BIN_GROUP_PER_EVENT_TYPE** (Ord.factor w/ 2 levels) : 
  a factor that divides the observations for each 
  weather event type to two complementary levels, 
  one with the 90% of observations with the lowest impact and 
  another with the 10% of observations with the highest impact.

and 5581 observations. 

```{r print_structure_for_the_table_with_the_processed_data_for_the_harm_on_population_health_with_respect_to_injuries}

# Print the structure of the table with the processed data 
# for the harm on population health with respect to injuries.
str(processed_data_____harm_on_population_health_____injuries)

```


<br>  

<font size="1">[back to start of this subsection](#ind-8-2-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-injuries)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 8.2.3 Summarize the processed data for harm on population health with respect to injuries by each weather event type {#ind-8-2-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type}  

To evaluate the harm on population health by each weather event type 
with respect to injuries a simplistic approach was adopted :  

  * the weather event types were ranked 
  from the most harmful to the least 
  based on the overall average number of injuries 
  of the weather events that resulted in non-zero injuries

The overall average number of injuries caused by each weather event type 
was initially examined along with the skewness of the number of injuries 
for each weather event type. In most cases the skewness was high 
(or even extremely high), so it was possible that the overall mean 
misrepresented the consequences of each weather event type.  

That is the reason why the average number of injuries for 90% of weather events 
with the lowest impact versus the average number of injuries for the 10% of 
weather events with the highest impact were also computed and examined.  

**It is highlighted that for the average number of injuries 
that refers to the 10% of the cases that had the highest impact, 
there were few observations available for a lot of weather event types 
and the corresponding mean values should be interpreted with caution.**

```{r create_the_table_with_the_summary_for_the_harm_on_population_health_with_respect_to_injuries_by_each_weather_event_type}

# Create the table with the summary for the harm on population health 
# with respect to injuries for each weather event type.
summary_____harm_on_population_health______injuries <- 
  processed_data_____harm_on_population_health_____injuries[
  ,
  list(
    ## The total number of observation by each weather event type.
    "N" = .N,
    ## The average number of injuries caused by each weather event type.
    "AVRG" = round(mean(INJURIES), 2),
    ## The skewness of injuries for the observations by each weather event type.
    "SKEWNESS" = round(skewness(INJURIES), 4),
    ## The number of observations for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "N_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , .N],
    ## The average number of injuries caused by each weather event type 
    ## for the 90% of cases with the lowest impact.
    "AVRG_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(mean(INJURIES), 2)],
    ## The skewness of injuries for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "SKEWNESS_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(skewness(INJURIES), 4)],
    ## The number of observations for the 10% of cases with the lowest impact 
    ## by each weather event type.
    "N_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , .N],
    ## The average number of injuries caused by each weather event type 
    ## for the 10% of cases with the highest impact.
    "AVRG_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(mean(INJURIES), 2)],
    ## The skewness of injuries for the 10% of cases with the highest impact 
    ## by each weather event type.
    "SKEWNESS_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(skewness(INJURIES), 4)]
  ),
  by = "EVENT_TYPE"
  ][
    ## The average number of injuries is used to order the rows of the table
    ## from the most harmful weather event type to the least.
    order(-AVRG),
    ## Create a variable with the rank of the harmness of each weather event type.
    RANK := 1:length(EVENT_TYPE)
    ][
      ,
      ## Reorder the variables at the table.
      list(
        RANK, EVENT_TYPE, N, AVRG, SKEWNESS, N_LOW, AVRG_LOW, SKEWNESS_LOW, N_HIGH, AVRG_HIGH, SKEWNESS_HIGH
      )
      ]

```

The results of the table with the summary 
for the harm on population health with respect to injuries
by each weather event type that was created in this section 
were presented at the subsection 
[10.1.3 Most harmful event types with respect to injuries
](#ind-10-1-3--Most-harmful-weather-event-types-with-respect-to-injuries)
of the chapter [10 RESULTS](#ind-10--RESULTS).  

The table with the summary for the harm on population health 
with respect to injuries by each weather event type 
was exported (as an R file), in the folder of the working directory: 

* *outputs --> harm_on_population_health --> results* 
  
with filename:  

* *summary______harm_on_population_health______injuries.R*
  
```{r exprot_the_summary_for_the_harm_on_population_health_with_respect_to_injuries}

# Supply the filepath at which the table with the summary
# for the harm on population health will be exported.
filepath_____summary_____harm_on_population_health______injuries <-
  file.path(
    directory_tree_____outputs[[
      "filepath_____outputs_____harm_on_population_health_____results"
    ]],
    "summary_____harm_on_population_health______injuries.R"
  )

# Export the table with the summary for the harm on population health
# with respect to injuries.
saveRDS(
  object = summary_____harm_on_population_health______injuries,
  file = filepath_____summary_____harm_on_population_health______injuries
)

```

*The main reason for exporting the file 
with the summary for the harm on population health with respect to injuries 
by each weather event type was to supply a checkpoint 
for any attempts to reproduce the analysis.*  

<br>  

<font size="1">[back to start of this subsection](#ind-8-2-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 8.2.4 Visualize the results of the summary for the harm on population health with respect to injuries by each weather event type {#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type}  

From the table with the summary for the harm on population health 
by each weather event type with respect to injuries 
the **Multiplot 1.2** was created to present an overview of the results 
for the three different aspects that were examined for this perspective.  

Four elementary plots were 
[created](#ind-8-2-4-1--Create-the-components-of-Multiplot-1-2):  

* [8.2.4.1.1 Create The Plot 1.2.1](#ind-8-2-4-1-1--Create-The-Plot-1-2-1)  
  * Displays the overall average number of injuries 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero injuries.  
* [8.2.4.1.2 Create The Plot 1.2.2](#ind-8-2-4-1-2--Create-The-Plot-1-2-2)  
  * Displays the average number of injuries 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero injuries.  
* [8.2.4.1.3 Create The Plot 1.2.3](#ind-8-2-4-1-3--Create-The-Plot-1-2-3)  
  * Displays the average number of injuries 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero injuries.  
* [8.2.4.1.4 Create The Plot 1.2.4](#ind-8-2-4-1-4--Create-The-Plot-1-2-4)
  * Displays a comparison for each weather event type, 
  of the average number of injuries for the 90% of its observations 
  with the lowest impact versus the average number of injuries 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted in non-zero injuries.  
     
which were then [combined](#ind-8-2-4-2--Compose-the-Multiplot-1-2) 
in order to obtain the **Multiplot 1.2**.

It constitutes the *PART 2* of the *Figure 1* 
that displays the overview of the harm on population health 
by each weather event type.  

*(Note that neither the Multiplot 1.1 
nor the elementary plots that it contains were presented in this section 
due to the restrictions imposed by the assignment to include in the report 
at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health) 
at the chapter [10 RESULTS](#ind-10--RESULTS), 
were the Figure 1 was presented, 
of which the Multiplot 1.2 constitutes the PART 2.)*

<br>  

<font size="1">[back to start of this subsection](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 8.2.4.1 Create the components of Multiplot 1.2 {#ind-8-2-4-1--Create-the-components-of-Multiplot-1-2}  

Creates four elementary plots to visualize the results for the aspects 
that were examined for the harm on population health 
with respect to injuries by each weather event type.  

* [8.2.4.1.1 Create The Plot 1.2.1](#ind-8-2-4-1-1--Create-The-Plot-1-2-1)  
  * Displays the overall average number of injuries 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero injuries.  
* [8.2.4.1.2 Create The Plot 1.2.2](#ind-8-2-4-1-2--Create-The-Plot-1-2-2)  
  * Displays the average number of injuries 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero injuries.  
* [8.2.4.1.3 Create The Plot 1.2.3](#ind-8-2-4-1-3--Create-The-Plot-1-2-3)  
  * Displays the average number of injuries 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero injuries.  
* [8.2.4.1.4 Create The Plot 1.2.4](#ind-8-2-4-1-4--Create-The-Plot-1-2-4)
  * Displays a comparison for each weather event type, 
  of the average number of injuries for the 90% of its observations 
  with the lowest impact versus the average number of injuries 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted in non-zero injuries.  

<br>  

<font size="1">[back to start of this subsubsection](#ind-8-2-4-1--Create-the-components-of-Multiplot-1-2)</font>  
<font size="1">[back to start of this subsection](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.2.4.1.1 Create The Plot 1.2.1** {#ind-8-2-4-1-1--Create-The-Plot-1-2-1}

The *Plot 1.2.1* displays 
**the overall average number of injuries** 
caused by each weather event type taking into account 
all and only the observation that resulted in non-zero injuries. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of injuries** they caused.  

The skewness of the number of injuries 
for the observations of each weather event type
(based on which the overall number of injuries was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_2_1}

# Create the Elementary Plot 1.2.1 that displays 
# the overall average number of injuries 
# by each weather event type for all cases. 
elementary_plot_1_2_1 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______injuries,
    mapping = aes(
      x = AVRG,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to make them displayed alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a square shaped point to the position that corresponds to 
  ## the average number of injuries caused by each weather event type, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(color = SKEWNESS),
    shape = 15, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average number of injuries.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG, 
      group = EVENT_TYPE, 
      color = SKEWNESS
    )
    ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## number of injuries it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2.5
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of injuries for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.2 will be composed from the four elementary plots. 
    limits = c(-2, 17), 
    midpoint = 7, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels.  
  labs(
    title = "Plot 1.2.1", 
    subtitle = "Aspect: Overall",
    x = "Average Number of Injuries\n",
    y = "Weather Event Types \n"
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )
```


<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-2-4-1-1--Create-The-Plot-1-2-1)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-2-4-1--Create-the-components-of-Multiplot-1-2)</font>  
<font size="1">[back to start of this subsection](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.2.4.1.2 Create The Plot 1.2.2** {#ind-8-2-4-1-2--Create-The-Plot-1-2-2}

The *Elementary Plot 1.2.2* displays 
**the average number of injuries for the 90% of cases with the lowest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero injuries. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of injuries** they caused.  
(so it is NOT based on the average number of injuries 
caused by the 90% of cases with the lowest impact of each weather event type).  

The skewness of the number of injuries 
for the observations of each weather event type
(based on which the average number of injuries for the 90% of cases 
with the lowest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_2_2}

# Create the Elementary Plot 1.2.2 that displays 
# the average number of injuries by each weather event type 
# for the 90% of its cases with the lowest impact.
elementary_plot_1_2_2 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______injuries,
    mapping = aes(
      x = AVRG_LOW,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a circle shaped point to the position that corresponds to 
  ## the average number of injuries caused by each weather event type
  ## for the 90% of its cases with the lowest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_LOW
    ), 
    size = 3.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average number of injuries 
  ## for the 90% of its cases with the lowest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_LOW, 
      group = EVENT_TYPE, 
      color = SKEWNESS_LOW
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## number of injuries it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2
    ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of injuries for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.2 will be composed from the four elementary plots.
    limits = c(-2, 17), 
    midpoint = 7, 
    low = "lightgreen",
    mid = "orange",
    high = "purple"
    ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 1.2.2",
    subtitle = "Aspect: 90% of cases with the lowest impact",
    x = paste0(
      "Average Number of Injuries for the 90% ", "\n",
      "of Observations with the Lowest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-2-4-1-2--Create-The-Plot-1-2-2)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-2-4-1--Create-the-components-of-Multiplot-1-2)</font>  
<font size="1">[back to start of this subsection](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.2.4.1.3 Create The Plot 1.2.3** {#ind-8-2-4-1-3--Create-The-Plot-1-2-3}

The *Plot 1.2.3* displays 
**the average number of injuries for the 10% of cases with the highest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero injuries. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of injuries** they caused.  
(so it is NOT based on the average number of injuries 
caused by the 10% of cases with the highest impact of each weather event type).  

The skewness of the number of injuries 
for the observations of each weather event type
(based on which the average number of injuries for the 10% of cases 
with the highest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_2_3}

# Create the Elementary Plot 1.2.3 that displays 
# the average number of injuries by each weather event type 
# for the 10% of its cases with the highest impact.
elementary_plot_1_2_3 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______injuries,
    mapping = aes(
      x = AVRG_HIGH,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a diamond shaped point to the position that corresponds to 
  ## the average number of injuries caused by each weather event type
  ## for the 10% of its cases with the highest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_HIGH
    ), 
    shape = 18, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average number of injuries 
  ## for the 10% of its cases with the highest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_HIGH, 
      group = EVENT_TYPE, 
      color = SKEWNESS_HIGH
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## number of injuries it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ),
    size = 2
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of injuries for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.2 will be composed from the four elementary plots.
    limits = c(-2, 17), 
    midpoint = 7, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 1.2.3",
    subtitle ="Aspect: 10% of cases with the highest impact",
    x = paste0(
      "Average Number of Injuries for the 10% ", "\n", 
      "of Observations with the Highest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    ### Remove the text, ticks and title of the y axis 
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```


<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-2-4-1-3--Create-The-Plot-1-2-3)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-2-4-1--Create-the-components-of-Multiplot-1-2)</font>  
<font size="1">[back to start of this subsection](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.2.4.1.4 Create The Plot 1.2.4** {#ind-8-2-4-1-4--Create-The-Plot-1-2-4}

The *Plot 1.2.4* displays 
a compact overview of all three aspect that were examined 
for the harm on population health with respect to injuries.  

For each weather event type, the comparison was visualized for 
**the average number of injuries for the 90% of cases with the lowest impact** 
versus
**the average number of injuries for the 10% of cases with the highest impact**.

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of injuries** they caused.  

The skewness of the number of injuries 
for the observations of each weather event type
(based on which the overall number of injuries was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_2_4}

# Create the Elementary Plot 1.2.4 that displays 
# by each weather event type the comparison of 
# the average number of injuries 
# for the 90% of cases with the lowest impact
# versus the average number of injuries 
# for the 10% of cases with the highest impact.
elementary_plot_1_2_4 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______injuries,
    mapping = aes(
      x = AVRG_HIGH, 
      y = AVRG_LOW
    )
  ) +
  geom_point(
    mapping = aes(
      fill = SKEWNESS
    ), 
    shape = 21
  ) +
  ## Draw a label with a number that indicates the rank assigned 
  ## to each weather event type (from the most harmful to the least) 
  ## based on the overall average number of injuries it caused.
  geom_label_repel(
    mapping = aes(
      label = RANK, 
      fill = SKEWNESS
    ),
    size = 2.5
  ) +
  ## Adjust the scale for the fill of each label.
  scale_fill_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of injuries for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.2 will be composed from the four elementary plots.
    limits = c(-2, 17),
    midpoint = 7, 
    low = "lightgreen",
    mid = "orange", 
    high = "purple"
    ) +
  ## Set proper limits to the plot.
    xlim(c(-20, 550)) +
    ylim(c(-1, 17)) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 1.2.4",
    subtitle = paste0(
      "Comparison of the average number of injuries ", 
      "for the 90% of observations with the lowest impact ", 
      "versus the average number of injuries ", 
      "for the 10% of observations with highest impact. "
    ),
    x = paste0(
      "Average Number of Injuries by each Weather Event Type ", 
      "for the 10% of its Observations with the Highest Impact"
    ),
    y = paste0(
      "Average Number of Injuries by each Weather Event Type ", "\n", 
      "for the 90% of its Observations with the Lowest Impact."
    ),
    ### Add a descriptive label for the legend.
    fill = paste0(
      "The color indicates the skewness ",
      "of injuries for the each weather event type. ",
      "(the color scale is unique for all four plots of PART 2) ", "\n",
      "When the color of a bar is gray, the skewness was indeterminable ",
      "due to the fact that all observations for that weather event type ",
      "took the same value."
    )
  ) +
  ## Select a theme.
  theme_linedraw() +
  ## Customize the selected theme.
  theme(
    ### Adjust the legend.
    legend.position = "bottom",
    legend.direction = "horizontal",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-2-4-1-4--Create-The-Plot-1-2-4)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-2-4-1--Create-the-components-of-Multiplot-1-2)</font>  
<font size="1">[back to start of this subsection](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  

#### 8.2.4.2 Compose the Multiplot 1.2 {#ind-8-2-4-2--Compose-the-Multiplot-1-2}  

The four elementary plots that were created from 
the results of the summary for the harm on population health 
with respect to injuries by each weather event type, 
were combined to construct a single multiplot 
that displays the complete picture for this perspective. 

```{r compose_the_multiplot_1_2}

# Create a multiplot that displays the overview of the summary 
# for the harm on population health with respect to injuries
# by each weather event type.
multiplot_1_2 <- arrangeGrob(
  grobs = list(
      
    # Title
    textGrob(
      label = paste0(
        "\n",
        "PART 2: Harm on population health by each weather event type ", 
        "with the respect to injuries ", "\n", 
        "based on the cases of weather events ", 
        "that resulted in non-zero injuries.", "\n", 
        "\n"
      ),
       gp=gpar(
         fontsize = 16, 
         fontface = "bold"
       )
    ),
    
    # Subtitle
    textGrob(
      label = paste0(
          "\n", 
          "The results include only the weather event types, ", 
          "for which at least 10 observations ", 
          "that resulted in non-zero injuries were available. ", "\n",
          "The number associated with each weather event type ", 
          "represents the rank (from the most harmful to the least) ", 
          "which was assigned based on the overall average number of injuries.", "\n",
          "Because for most of the weather event types ", 
          "high positive skewness was observed for the number of injuries, ",
          "the average of the 90% of cases with lowest impact ", "\n",
          "and the 10% of cases with highest impact were reported ", 
          "to provide a more representative picture of their consequences.","\n",
          "\n"
      ),
       gp=gpar(
         fontsize = 14, 
         fontface = "bold"
       )
    ),
    
    # Plot 1.2.1
    # Elementary plot for the average number of injuries 
    # by each weather event type for all cases.
    elementary_plot_1_2_1,
    
    # ELEMENTARY PLOT 1.2.2
    # Elementary plot for the average number of injuries 
    # by each weather event type for 90% of cases with the lowest impact.
    elementary_plot_1_2_2,
    
    # ELEMENTARY PLOT 1.2.3
    # Elementary plot for the average number of injuries 
    # by each weather event type for 10% of cases with the highest impact.
    elementary_plot_1_2_3,
    
    # ELEMENTARY PLOT 1.2.4
    # Elementary Plot 1.2.4 for the comparison of 
    # the average number of injuries 
    # for the 90% of cases with the lowest impact versus 
    # the 10% of cases with the highest impact.
    elementary_plot_1_2_4
  ),
  # Set the layout for this elementary plots
  layout_matrix = 
    matrix(
      c(1,1,1,1,1,1,1,1,1,
        2,2,2,2,2,2,2,2,2,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6
      ),
      byrow = TRUE, 
      nrow = 13
    )
)

```

*(Note that the Multiplot 1.2 was NOT presented in this section 
due to the restrictions imposed by the assignment to include in the report 
at least 1 but no more than 3 figures. 
It can be examined at the subsection [10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health) 
of the chapter [10 RESULTS](#ind-10--RESULTS), 
were the Figure 1 was presented, of which the Multiplot 1.2 constitutes the PART 2.)  

<br>  

<font size="1">[back to start of this subsubsection](#ind-8-2-4-2--Compose-the-Multiplot-1-2)</font>  
<font size="1">[back to start of this subsection](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  


<br>  
<br>  
<br>  



## 8.3 Harm On Population Health With Respect To Casualties By Each Weather Event Type {#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type}  

<font size="3"><u><strong>Summary</strong></u></font>  

The required variables and the target data subset of observations 
for the harm on population health with respect to casualties 
were extracted from the table with the processed data, 
and processed to create a new variable that divided the observations 
for each of the included weather event types to two supplementary groups:  

* the 90% of observations with the lowest impact  
* the 10% of observations with the highest impact  
  
before the information for the harm on population health 
with respect to casualties was summarized by each weather event type.  

Three aspects were examined: 
  
  1. The overall average number of casualties by each weather event type.  
  2. The average number of casualties by each weather event type 
  for the 90% of cases with the lowest impact.  
  3. The average number of casualties by each weather event type 
  for the 10% of cases with the highest impact.  

For each aspect, the average number of casualties 
by each weather event type, the number of its
available observations (based on which the average was computed) 
and their skewness were examined. 

The overall average number of casualties was used as the main criterion 
to determine which weather events caused the most harm on population health 
with respect to casualties but it is important to take into account 
the other two aspect that were presented in order to obtain a more insightful 
and complete 'picture' of their consequences, 
(especially given the fact that for most of the weather event types, 
the casualties were highly positively skewed).

The table with results for the harm on population health 
with respect to casualties by each weather event type 
were presented at the subsection 
[10.1.4 Most harmful event types with respect to casualties
](#ind-10-1-4--Most-harmful-weather-event-types-with-respect-to-casualties) 
of the chapter [10 RESULTS](#ind-10--RESULTS).

Finally the *Multiplot 1.3* was created to visualize 
the results of the harm on population health with respect to casualties 
by each weather event type.  

*(Note that neither the Multiplot 1.3 nor the elementary plots that it contains 
were presented in this section due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health) 
at the chapter [10 RESULTS](#ind-10--RESULTS), 
where the Figure 1 was presented, 
of which the Multiplot 1.3 constitutes the PART 3.)

<font size="3"><u><strong>Steps</strong></u></font>  

* [8.3.1 Extract the target data for harm on population health with respect to casualties
](#ind-8-3-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-casualties)  
  * The target data subset of observations needed to evaluate 
  the harm on population health with respect to casualties 
  by each weather event type was extracted 
  from the table with the processed data.  
* [8.3.2 Process the target data for harm on population health with respect to casualties
](#ind-8-3-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-casualties)  
  * The table with target data subset for the harm on population 
  with respect to casualties was processed to create 
  the table with processed data for the harm on population health 
  with respect to casualties.  
* [8.3.3 Summarize the processed data for harm on population health with respect to casualties by each weather event type
](#ind-8-3-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)  
  * The harm on population health with respect to casualties 
  by each weather event type was evaluated over various aspects.  
* [8.3.4 Visualize the results of the summary for the harm on population health with respect to casualties by each weather event type
](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)  
  * The Multiplot 1.3 that presents the results of the summary 
  for the harm on population health with respect to casualties 
  by each weather event type was created.  
    * [8.3.4.1 Create the components of Multiplot 1.3
    ](#ind-8-3-4-1--Create-the-components-of-Multiplot-1-3)  
      * Creates the four elementary plot that constitute the Multiplot 1.3:  
        * [8.3.4.1.1 Create The Plot 1.3.1](#ind-8-3-4-1-1--Create-The-Plot-1-3-1)  
          * Displays the overall average number of casualties 
          caused by each weather event type based 
          on all the cases of weather events 
          that resulted in non-zero casualties.  
        * [8.3.4.1.2 Create The Plot 1.3.2](#ind-8-3-4-1-2--Create-The-Plot-1-3-2)  
          * Displays the average number of casualties 
          caused by each weather event type based on 90% of weather events 
          with the lowest impact (for each weather event type) 
          that resulted in non-zero casualties.  
        * [8.3.4.1.3 Create The Plot 1.3.3](#ind-8-3-4-1-3--Create-The-Plot-1-3-3)  
          * Displays the average number of casualties 
          caused by each weather event type based on 10% of weather events 
          with the highest impact (for each weather event type) 
          that resulted in non-zero casualties.  
        * [8.3.4.1.4 Create The Plot 1.3.4](#ind-8-3-4-1-4--Create-The-Plot-1-3-4)
          * Displays a comparison for each weather event type, 
          of the average number of casualties for the 90% of its observations 
          with the lowest impact versus the average number of casualties 
          for the 10% of its observations with the highest impact 
          based only on the weather events that resulted in non-zero casualties.  
    * [8.3.4.2 Compose the Multiplot 1.3](#ind-8-3-4-2--Compose-the-Multiplot-1-3)  
      * Combines the four elementary plots to create the Multiplot 1.3.  

<br>  

<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 8.3.1 Extract the target data for harm on population health with respect to casualties {#ind-8-3-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-casualties}  

In order to examine the harm on population health with respect to casualties 
caused by each weather event type, 
the variables *REFNUM*, *EVENT_TYPE* and *CASUALTIES* 
were selected from the table with the processed data and 
**only the observations that refer to weather events 
that resulted in non-zero casualties** were extracted. 

Furthermore, in an attempt to avoid highly misleading statistics 
due to the small number of observations for some of the weather event types, 
a lowest bound of 10 weather events that caused non zero casualties 
(for each of the included weather event types)
was selected (subjectively by the analyst) and applied. 

This lowest bound, although it may seem (and generally it is) not enough 
to get trustworthy statistics, it was considered to be *"good enough"* 
taking into account that : 
  
  1. the analysis focuses in describing historical data 
  without trying to make inferences 
  that would demand substantially bigger samples, 
  although any statistic based on less than 10 observations 
  could not be taken seriously 
  especially in cases (such as in this analysis) where the distribution 
  of casualties for each weather event type was skewed.
  2. a period of 10 years (from 2001 to 2011) 
  in which the observations that were used in the analysis occurred, 
  is relatively small time to produce big samples of weather events 
  that caused non zero casualties for some the weather event types. 
  Thus, if a highest bound was selected to get more robust statistics 
  such as samples of 100 or 300, the majority of weather event types 
  would have been excluded, making the results of the analysis trivial.  

```{r create_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_population_health_with_respect_to_casualties}

# Extract the required variables and the target data subset of observations 
# for the harm on population health with respect to casualties.
target_data_____harm_on_population_health_____casualties <- processed_data[
  ## Extract only the observations that have resulted in non-zero casualties.
  CASUALTIES > 0,
  ## Select only the relevant variables. 
  list(REFNUM, EVENT_TYPE, CASUALTIES)
  ][
    ### Keep only the observations that correspond to the weather event types 
    ### for which there are at least 10 weather events available.
    EVENT_TYPE %in% 
      names(table(EVENT_TYPE)[table(EVENT_TYPE) >= 10])
    ]

```

The table with the target data for the harm on population health 
with respect to casualties consist of 7936 observations. 

```{r print_the_structure_of_the_table_with_the_target_data_subset_for_the_harm_on_population_health_with_respect_to_casualties} 

# Print the structure of the table with the target data subset 
# for the harm on population health with respect to casualties.
str(target_data_____harm_on_population_health_____casualties)

```

The variable *EVENT_TYPE* includes 30 distinct weather event types, 
for most of which the variable *CASUALTIES* was highly positively skewed. 

It was worth noting that for the weather event types 
with highest number of observations 
there was highest skewness for the values of casualties, 
indicating that the corresponding distribution of casualties
has a heavy tail that wasn't possible to be observed 
when few observation were available.  

```{r create_a_kable_to_present_some_facts_for_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_population_health_with_respect_to_casualties}

# Create a kable to present some facts about the table with the target data 
# for the harm on population health with respect to casualties.
kable(
  x = target_data_____harm_on_population_health_____casualties[
    order(EVENT_TYPE), 
    list(
      "N" = .N, 
      "SKEWNESS" = round(skewness(CASUALTIES), 4)
    ), 
    by = EVENT_TYPE
    ],
  caption = paste0(
    "Table 8.3.1-1: ",
    "Facts about the table with the target data subset of observations ", 
    "for the harm on population health with respect to casualties."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = "The skewness was rounded to 4 decimal places."
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-8-3-1--Extract-the-target-data-for-harm-on-population-health-with-respect-to-casualties)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 8.3.2 Process the target data for harm on population health with respect to casualties {#ind-8-3-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-casualties}  

To create the table with the processed data 
for the harm on population health with respect to casualties 
from the corresponding target data subset for this perspective,
a new variable was created that divides the observations 
for each of the included weather event types in two complementary levels: 

* one that contains the 90% of cases with lowest impact  
* the other that contains the 10% of cases with highest impact  

This decision was made due to the high skewness that was observed 
for the values of the variable *CASUALTIES* for most weather event types, 
which indicates that the underlining distributions of such phenomena 
has a heavy tail that causes this heterogeneity on the observations. 
As a result a small number of casualties were observed 
for the majority of cases that resulted in non-zero casualties 
while in the few cases with the highest impact 
they caused lots of casualties. 

Having in mind that the average number of casualties 
will be used to determine which weather event types 
were the most harmful to population health (with respect to casualties) 
combined with the fact that the average doesn't represent well 
the distribution of variables with high skewness, 
as it is highly affected by the most extreme values, 
it was considered necessary to examine the subsets 
created by those two levels in order to obtain an insightful picture. 


```{r create_the_table_with_the_processed_data_for_harm_on_population_health_with_respect_to_casualties}

# Create the table with the processed data 
# for the harm on population health with respect to casualties.
processed_data_____harm_on_population_health_____casualties <- 
  target_data_____harm_on_population_health_____casualties[
    ,
    ## Create a new variable divides the observations
    ## for each weather event into two supplementary groups:  
    ##   - the 90% of weather events that resulted in lowest casualties
    ##   - the 10% of weather events that resulted in highest casualties
    BIN_GROUP_PER_EVENT_TYPE := (function(x, p_bins) {
      
      # adds 0 and 1 in the vector supplied at the argument 'p_bins' 
      # to the start and the end respectively  
      # the supplied percentiles if they are missing 
      # and sort them ascending
      p_bins_increasing <- sort(c(0, p_bins, 1))
      
      # creates the character strings that labels of the bins by the values supplied at 
      # the argument 'p_bins' that will be the values of the new variable
      bin_labels <- paste0("(", p_bins_increasing[-length(p_bins_increasing)]*100,
                           "% - ", p_bins_increasing[-1]*100, "%]")
      
      # identify the number of occurrences that correspond to each label
      n_times <- vapply(2:length(p_bins_increasing),
                        function(i) {
                          as.integer(floor(length(x) * p_bins_increasing[i]) -
                                       floor(length(x) * p_bins_increasing[i - 1]))
                        }, integer(1))
      
      # multiply each label with the number of its occurrences
      x_bins_expanded <- rep(x = bin_labels, times = n_times)
      
      # order the label to much the values of the corresponding vector
      x_bins_expanded_reordered <- x_bins_expanded[order(seq_along(x)[order(x)])]
      
      ## Coerce the character vector with the labels of bins to a factor
      x_bins_factor <- factor(x_bins_expanded_reordered, labels = bin_labels, ordered = TRUE)
      
    })(CASUALTIES, 0.9), 
    by = EVENT_TYPE
  ][
    ## Coerce the EVENT_VARIABLE to factor
    , EVENT_TYPE := as.factor(EVENT_TYPE) 
  ]

```

The table with the processed data for the harm on population health 
with respect to casualties contains 4 variables:  

  1. **REFNUM** (int) : an id that uniquely identifies each observation  
  2. **EVENT_TYPE** (Factor w/ 30 levels) : the type of each weather event
  3. **CASUALTIES** (int ): the number of casualties  
  4. **BIN_GROUP_PER_EVENT_TYPE** (Ord.factor w/ 2 levels) : 
  a factor that divides the observations for each 
  weather event type to two complementary levels, 
  one with the 90% of observations with the lowest impact and 
  another with the 10% of observations with the highest impact.

and 7936 observations. 

```{r print_structure_for_the_table_with_the_processed_data_for_the_harm_on_population_health_with_respect_to_casualties}

# Print the structure of the table with the processed data 
# for the harm on population health with respect to casualties.
str(processed_data_____harm_on_population_health_____casualties)

```

<br>  

<font size="1">[back to start of this subsection](#ind-8-3-2--Process-the-target-data-for-harm-on-population-health-with-respect-to-casualties)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 8.3.3 Summarize the processed data for harm on population health with respect to casualties by each weather event type {#ind-8-3-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type}  

To evaluate the harm on population health by each weather event type 
with respect to casualties a simplistic approach was adopted :  

  * the weather event types were ranked 
  from the most harmful to the least 
  based on the overall average number of casualties 
  of the weather events that resulted in non-zero casualties

The overall average number of casualties caused by each weather event type 
was initially examined along with the skewness of the number of casualties 
for each weather event type. In most cases the skewness was high 
(or even extremely high), so it was possible that the overall mean 
misrepresented the consequences of each weather event type.  

That is the reason why the average number of casualties for 90% of weather events 
with the lowest impact versus the average number of casualties for the 10% of 
weather events with the highest impact were also computed and examined.  

**It is highlighted that for the average number of casualties 
that refers to the 10% of the cases that had the highest impact, 
there were few observations available for a lot of weather event types 
and the corresponding mean values should be interpreted with caution.**

```{r create_the_table_with_the_summary_for_the_harm_on_population_health_with_respect_to_casualties_by_each_weather_event_type}

# Create the table with the summary for the harm on population health 
# with respect to casualties for each weather event type.
summary_____harm_on_population_health______casualties <- 
  processed_data_____harm_on_population_health_____casualties[
  ,
  list(
    ## The total number of observation by each weather event type.
    "N" = .N,
    ## The average number of casualties caused by each weather event type.
    "AVRG" = round(mean(CASUALTIES), 2),
    ## The skewness of casualties for the observations by each weather event type.
    "SKEWNESS" = round(skewness(CASUALTIES), 4),
    ## The number of observations for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "N_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , .N],
    ## The average number of casualties caused by each weather event type 
    ## for the 90% of cases with the lowest impact.
    "AVRG_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(mean(CASUALTIES), 2)],
    ## The skewness of casualties for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "SKEWNESS_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(skewness(CASUALTIES), 4)],
    ## The number of observations for the 10% of cases with the lowest impact 
    ## by each weather event type.
    "N_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , .N],
    ## The average number of casualties caused by each weather event type 
    ## for the 10% of cases with the highest impact.
    "AVRG_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(mean(CASUALTIES), 2)],
    ## The skewness of casualties for the 10% of cases with the highest impact 
    ## by each weather event type.
    "SKEWNESS_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(skewness(CASUALTIES), 4)]
  ),
  by = "EVENT_TYPE"
  ][
    ## The average number of casualties is used to order the rows of the table
    ## from the most harmful weather event type to the least.
    order(-AVRG),
    ## Create a variable with the rank of the harmness of each weather event type.
    RANK := 1:length(EVENT_TYPE)
    ][
      ,
      ## Reorder the variables at the table.
      list(
        RANK, EVENT_TYPE, N, AVRG, SKEWNESS, N_LOW, AVRG_LOW, SKEWNESS_LOW, N_HIGH, AVRG_HIGH, SKEWNESS_HIGH
      )
      ]

```

The results of the table with the summary 
for the harm on population health with respect to casualties
by each weather event type that was created in this section 
were presented at the subsection 
[10.1.4 Most harmful event types with respect to casualties
](#ind-10-1-4--Most-harmful-weather-event-types-with-respect-to-casualties) 
of the chapter [10 RESULTS](#ind-10--RESULTS). 

The table with the summary for the harm on population health 
with respect to casualties by each weather event type 
was exported (as an R file), in the folder of the working directory: 

* *outputs --> harm_on_population_health --> results* 
  
with filename:  

* *summary______harm_on_population_health______casualties.R*
  
```{r exprot_the_summary_for_the_harm_on_population_health_with_respect_to_casualties}

# Supply the filepath at which the table with the summary
# for the harm on population health will be exported.
filepath_____summary_____harm_on_population_health______casualties <-
  file.path(
    directory_tree_____outputs[[
      "filepath_____outputs_____harm_on_population_health_____results"
      ]],
    "summary_____harm_on_population_health______casualties.R"
  )

# Export the table with the summary for the harm on population health
# with respect to casualties.
saveRDS(
  object = summary_____harm_on_population_health______casualties,
  file = filepath_____summary_____harm_on_population_health______casualties
)

```

*The main reason for exporting the file 
with the summary for the harm on population health with respect to casualties 
by each weather event type was to supply a checkpoint 
for any attempts to reproduce the analysis.*

<br>  

<font size="1">[back to start of this subsection](#ind-8-3-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 8.3.4 Visualize the results of the summary for the harm on population health with respect to casualties by each weather event type {#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type}  

From the table with the summary for the harm on population health 
by each weather event type with respect to casualties 
the **Multiplot 1.3** was created to present an overview of the results 
for the three different aspects that were examined for this perspective.  

Four elementary plots were 
[created](#ind-8-3-4-1--Create-the-components-of-Multiplot-1-3):  

* [8.3.4.1.1 Create The Plot 1.3.1](#ind-8-3-4-1-1--Create-The-Plot-1-3-1)  
  * Displays the overall average number of casualties 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero casualties.  
* [8.3.4.1.2 Create The Plot 1.3.2](#ind-8-3-4-1-2--Create-The-Plot-1-3-2)  
  * Displays the average number of casualties 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero casualties.  
* [8.3.4.1.3 Create The Plot 1.3.3](#ind-8-3-4-1-3--Create-The-Plot-1-3-3)  
  * Displays the average number of casualties 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero casualties.  
* [8.3.4.1.4 Create The Plot 1.3.4](#ind-8-3-4-1-4--Create-The-Plot-1-3-4)
  * Displays a comparison for each weather event type, 
  of the average number of casualties for the 90% of its observations 
  with the lowest impact versus the average number of casualties 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted in non-zero casualties.  

which were then [combined](#ind-8-3-4-2--Compose-the-Multiplot-1-3) 
in order to obtain the **Multiplot 1.3**.

It constitutes the *PART 3* of the *Figure 1* 
that displays the overview of the harm on population health 
by each weather event type.  

*(Note that neither the Multiplot 1.3 
nor the elementary plots that it contains were presented in this section 
due to the restrictions imposed by the assignment to include in the report 
at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health) 
at the chapter [10 RESULTS](#ind-10--RESULTS), 
were the Figure 1 was presented, 
of which the Multiplot 1.2 constitutes the PART 2.)*

<br>  

<font size="1">[back to start of this subsection](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 8.3.4.1 Create the components of Multiplot 1.3 {#ind-8-3-4-1--Create-the-components-of-Multiplot-1-3}  

Creates four elementary plots to visualize the results for the aspects 
that were examined for the harm on population health 
with respect to casualties by each weather event type.  

* [8.3.4.1.1 Create The Plot 1.3.1](#ind-8-3-4-1-1--Create-The-Plot-1-3-1)  
  * Displays the overall average number of casualties 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero casualties.  
* [8.3.4.1.2 Create The Plot 1.3.2](#ind-8-3-4-1-2--Create-The-Plot-1-3-2)  
  * Displays the average number of casualties 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero casualties.  
* [8.3.4.1.3 Create The Plot 1.3.3](#ind-8-3-4-1-3--Create-The-Plot-1-3-3)  
  * Displays the average number of casualties 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero casualties.  
* [8.3.4.1.4 Create The Plot 1.3.4](#ind-8-3-4-1-4--Create-The-Plot-1-3-4)
  * Displays a comparison for each weather event type, 
  of the average number of casualties for the 90% of its observations 
  with the lowest impact versus the average number of casualties 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted in non-zero casualties.  

<br>  

<font size="1">[back to start of this subsubsection](#ind-8-3-4-1--Create-the-components-of-Multiplot-1-3)</font>  
<font size="1">[back to start of this subsection](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.3.4.1.1 Create The Plot 1.3.1** {#ind-8-3-4-1-1--Create-The-Plot-1-3-1}

The *Plot 1.3.1* displays 
**the overall average number of casualties** 
caused by each weather event type taking into account 
all and only the observation that resulted in non-zero casualties. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of casualties** they caused.  

The skewness of the number of casualties 
for the observations of each weather event type
(based on which the overall number of casualties was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_3_1}

# Create the Elementary Plot 1.3.1 that displays 
# the overall average number of casualties 
# by each weather event type for all cases. 
elementary_plot_1_3_1 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______casualties,
    mapping = aes(
      x = AVRG,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to make them displayed alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a square shaped point to the position that corresponds to 
  ## the average number of casualties caused by each weather event type, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(color = SKEWNESS),
    shape = 15, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average number of casualties.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG, 
      group = EVENT_TYPE, 
      color = SKEWNESS
    )
    ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## number of casualties it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2.5
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of casualties for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.3 will be composed from the four elementary plots. 
    limits = c(-2, 18), 
    midpoint = 8, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels.  
  labs(
    title = "Plot 1.3.1", 
    subtitle = "Aspect: Overall",
    x = "Average Number of Casualties\n",
    y = "Weather Event Types \n"
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-3-4-1-1--Create-The-Plot-1-3-1)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-3-4-1--Create-the-components-of-Multiplot-1-3)</font>  
<font size="1">[back to start of this subsection](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.3.4.1.2 Create The Plot 1.3.2** {#ind-8-3-4-1-2--Create-The-Plot-1-3-2}

The *Elementary Plot 1.3.2* displays 
**the average number of casualties for the 90% of cases with the lowest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero casualties. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of casualties** they caused.  
(so it is NOT based on the average number of casualties 
caused by the 90% of cases with the lowest impact of each weather event type).  

The skewness of the number of casualties 
for the observations of each weather event type
(based on which the average number of casualties for the 90% of cases 
with the lowest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_3_2}

# Create the Elementary Plot 1.3.2 that displays 
# the average number of casualties by each weather event type 
# for the 90% of its cases with the lowest impact.
elementary_plot_1_3_2 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______casualties,
    mapping = aes(
      x = AVRG_LOW,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a circle shaped point to the position that corresponds to 
  ## the average number of casualties caused by each weather event type
  ## for the 90% of its cases with the lowest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_LOW
    ), 
    size = 3.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average number of casualties 
  ## for the 90% of its cases with the lowest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_LOW, 
      group = EVENT_TYPE, 
      color = SKEWNESS_LOW
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## number of casualties it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2
    ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of casualties for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.3 will be composed from the four elementary plots.
    limits = c(-2, 18), 
    midpoint = 8, 
    low = "lightgreen",
    mid = "orange",
    high = "purple"
    ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 1.3.2",
    subtitle = "Aspect: 90% of cases with the lowest impact",
    x = paste0(
      "Average Number of Casualties for the 90% ", "\n",
      "of Observations with the Lowest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-3-4-1-2--Create-The-Plot-1-3-2)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-3-4-1--Create-the-components-of-Multiplot-1-3)</font>  
<font size="1">[back to start of this subsection](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.3.4.1.3 Create The Plot 1.3.3** {#ind-8-3-4-1-3--Create-The-Plot-1-3-3}

The *Plot 1.3.3* displays 
**the average number of casualties for the 10% of cases with the highest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero casualties. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of casualties** they caused.  
(so it is NOT based on the average number of casualties 
caused by the 10% of cases with the highest impact of each weather event type).  

The skewness of the number of casualties 
for the observations of each weather event type
(based on which the average number of casualties for the 10% of cases 
with the highest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_3_3}

# Create the Elementary Plot 1.3.3 that displays 
# the average number of casualties by each weather event type 
# for the 10% of its cases with the highest impact.
elementary_plot_1_3_3 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______casualties,
    mapping = aes(
      x = AVRG_HIGH,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a diamond shaped point to the position that corresponds to 
  ## the average number of casualties caused by each weather event type
  ## for the 10% of its cases with the highest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_HIGH
    ), 
    shape = 18, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average number of casualties 
  ## for the 10% of its cases with the highest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_HIGH, 
      group = EVENT_TYPE, 
      color = SKEWNESS_HIGH
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## number of casualties it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ),
    size = 2
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of casualties for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.3 will be composed from the four elementary plots.
    limits = c(-2, 18), 
    midpoint = 8, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 1.3.3",
    subtitle ="Aspect: 10% of cases with the highest impact",
    x = paste0(
      "Average Number of Casualties for the 10% ", "\n", 
      "of Observations with the Highest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    ### Remove the text, ticks and title of the y axis 
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-3-4-1-3--Create-The-Plot-1-3-3)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-3-4-1--Create-the-components-of-Multiplot-1-3)</font>  
<font size="1">[back to start of this subsection](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **8.3.4.1.4 Create The Plot 1.3.4** {#ind-8-3-4-1-4--Create-The-Plot-1-3-4}

The *Plot 1.3.4* displays 
a compact overview of all three aspect that were examined 
for the harm on population health with respect to casualties.  

For each weather event type, the comparison was visualized for 
**the average number of casualties for the 90% of cases with the lowest impact** 
versus
**the average number of casualties for the 10% of cases with the highest impact**.

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to population health, 
based on the **overall average number of casualties** they caused.  

The skewness of the number of casualties 
for the observations of each weather event type
(based on which the overall number of casualties was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_1_3_4}

# Create the Elementary Plot 1.3.4 that displays 
# by each weather event type the comparison of 
# the average number of casualties 
# for the 90% of cases with the lowest impact
# versus the average number of casualties 
# for the 10% of cases with the highest impact.
elementary_plot_1_3_4 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_population_health______casualties,
    mapping = aes(
      x = AVRG_HIGH, 
      y = AVRG_LOW
    )
  ) +
  geom_point(
    mapping = aes(
      fill = SKEWNESS
    ), 
    shape = 21
  ) +
  ## Draw a label with a number that indicates the rank assigned 
  ## to each weather event type (from the most harmful to the least) 
  ## based on the overall average number of casualties it caused.
  geom_label_repel(
    mapping = aes(
      label = RANK, 
      fill = SKEWNESS
    ),
    size = 2.5
  ) +
  ## Adjust the scale for the fill of each label.
  scale_fill_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average number of casualties for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 1.3 will be composed from the four elementary plots.
    limits = c(-2, 18),
    midpoint = 8, 
    low = "lightgreen",
    mid = "orange", 
    high = "purple"
    ) +
  ## Set proper limits to the plot.
    xlim(c(0, 320)) +
    ylim(c(0.5, 7)) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 1.3.4",
    subtitle = paste0(
      "Comparison of the average number of casualties ", 
      "for the 90% of observations with the lowest impact ", 
      "versus the average number of casualties ", 
      "for the 10% of observations with highest impact. "
    ),
    x = paste0(
      "Average Number of Casualties by each Weather Event Type ", 
      "for the 10% of its Observations with the Highest Impact"
    ),
    y = paste0(
      "Average Number of Casualties by each Weather Event Type ", "\n", 
      "for the 90% of its Observations with the Lowest Impact."
    ),
    ### Add a descriptive label for the legend.
    fill = paste0(
      "The color indicates the skewness ",
      "of casualties for the each weather event type. ",
      "(the color scale is unique for all four plots of PART 3) "
    )
  ) +
  ## Select a theme.
  theme_linedraw() +
  ## Customize the selected theme.
  theme(
    ### Adjust the legend.
    legend.position = "bottom",
    legend.direction = "horizontal",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-8-3-4-1-4--Create-The-Plot-1-3-4)</font>  
<font size="1">[back to start of this subsubsection](#ind-8-3-4-1--Create-the-components-of-Multiplot-1-3)</font>  
<font size="1">[back to start of this subsection](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  

#### 8.3.4.2 Compose the Multiplot 1.3 {#ind-8-3-4-2--Compose-the-Multiplot-1-3}  

The four elementary plots that were created from 
the results of the summary for the harm on population health 
with respect to casualties by each weather event type, 
were combined to construct a single multiplot 
that displays the complete picture for this perspective. 

```{r compose_the_multiplot_1_3}

# Create a multiplot that displays the overview of the summary 
# for the harm on population health with respect to casualties
# by each weather event type.
multiplot_1_3 <- arrangeGrob(
  grobs = list(
      
    # Title
    textGrob(
      label = paste0(
        "\n",
        "PART 3: Harm on population health by each weather event type ", 
        "with the respect to casualties ", "\n", 
        "based on the cases of weather events ", 
        "that resulted in non-zero casualties.", "\n", 
        "\n"
      ),
       gp=gpar(
         fontsize = 16, 
         fontface = "bold"
       )
    ),
    
    # Subtitle
    textGrob(
      label = paste0(
          "\n", 
          "The results include only the weather event types, ", 
          "for which at least 10 observations ", 
          "that resulted in non-zero casualties were available. ", "\n",
          "The number associated with each weather event type ", 
          "represents the rank (from the most harmful to the least) ", 
          "which was assigned based on the overall average number of casualties.", "\n",
          "Because for most of the weather event types ", 
          "high positive skewness was observed for the number of casualties, ",
          "the average of the 90% of cases with lowest impact ", "\n",
          "and the 10% of cases with highest impact were reported ", 
          "to provide a more representative picture of their consequences.","\n",
          "\n"
      ),
       gp=gpar(
         fontsize = 14, 
         fontface = "bold"
       )
    ),
    
    # Plot 1.3.1
    # Elementary plot for the average number of casualties 
    # by each weather event type for all cases.
    elementary_plot_1_3_1,
    
    # ELEMENTARY PLOT 1.3.2
    # Elementary plot for the average number of casualties 
    # by each weather event type for 90% of cases with the lowest impact.
    elementary_plot_1_3_2,
    
    # ELEMENTARY PLOT 1.3.3
    # Elementary plot for the average number of casualties 
    # by each weather event type for 10% of cases with the highest impact.
    elementary_plot_1_3_3,
    
    # ELEMENTARY PLOT 1.3.4
    # Elementary Plot 1.3.4 for the comparison of 
    # the average number of casualties 
    # for the 90% of cases with the lowest impact versus 
    # the 10% of cases with the highest impact.
    elementary_plot_1_3_4
  ),
  # Set the layout for this elementary plots
  layout_matrix = 
    matrix(
      c(1,1,1,1,1,1,1,1,1,
        2,2,2,2,2,2,2,2,2,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6
      ),
      byrow = TRUE, 
      nrow = 13
    )
)

```

*(Note that the Multiplot 1.3 was NOT presented in this section 
due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures.
It can be examined at the subsection 
[10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health)
of the chapter [10 RESULTS](#ind-10--RESULTS), 
were the Figure 1 was presented, 
of which the Multiplot 1.3 constitutes the PART 3.)*

<br>  

<font size="1">[back to start of this subsubsection](#ind-8-3-4-2--Compose-the-Multiplot-1-3)</font>  
<font size="1">[back to start of this subsection](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-8--HARM-ON-POPULATION-HEALTH)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 9 HARM ON ECONOMY {#ind-9--HARM-ON-ECONOMY}  
***  

In this chapter an attempt was made to quantify the harm on economy 
based on the information from the 
[table with the processed data](#ind-7--PROCESSED-DATA).
    
The harm on economy was examined over three perspectives:  
        
1. [The harm on economy with respect to property damage 
caused by each weather event type 
based on the observations for weather events 
that resulted in non-zero property damage 
at United States in the period from 2001 to 2011.
](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)  
2. [The harm on economy with respect to crop damage 
caused by each weather event type 
based on the observations for weather events 
that resulted in non-zero crop damage 
at United States in the period from 2001 to 2011.
](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)  
3. [The harm on economy with respect to economic damage  
(sum of property damage and crop damage) 
caused by each weather event type
based on the observations for weather events 
that resulted in non-zero economic damage 
at United States in the period from 2001 to 2011.
](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)  

The weather event types for which less 
than 10 observations that resulted in non-zero harm were available 
with respect to a perspective of interest were ommited 
(from the analysis of that particular perspective),
to avoid highly misleading statistics. 
Consequently the subset of weather event types 
that were included for each of the three perspectives is different.  

Due to the fact that for all perspectives 
the values of interest for the observations 
of most weather event types were highly positively skewed, 
it was consider important in order to obtain an insightful picture 
of their consequences to examine them over three different apsects:  

  1. The **overall** harm on economy 
  caused by each weather event type.  
  2. The harm on economy cauced by 
  **the 90% of cases with the lowest impact** 
  of each weather event type.  
  3. The harm on economy cauced by 
  **the 10% of cases with the highest impact** 
  of each weather event type.  
  
For every apsect the sample size, the skewness and the mean 
of the values that encapsulated the harm with respect to each perspective 
were summarized by each weather event type and reported.  

The results obtained for the harm on economy by each weather event type 
were presented at the section 
[10.2 Question 2 : Across the United States, 
which types of events have the greatest economic consequences?
](#ind-10-2--results-harm-on-economy)
of the chapter [10 RESULTS](#ind-10--RESULTS).  

(In compliance with the restrictions of the assignment, 
according to which at least 1 but no more than 3 figures 
should be included in the report, the multiplots as well as the elementary plots 
that they contain were NOT displayed separately 
and can ONLY be examined as PARTs of the Figure 2 at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS).)

<br>  

<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

## 9.1 Harm On Economy With Respect To Property Damage By Each Weather Event Type {#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type}  

<font size="3"><u><strong>Summary</strong></u></font>  

The required variables and the target data subset of observations 
for the harm on economy with respect to property damage 
were extracted from the table with the processed data, 
and processed to create a new variable that divided the observations 
for each of the included weather event types to two supplementary groups:  

* the 90% of observations with the lowest impact  
* the 10% of observations with the highest impact  
  
before the information for the harm on economy 
with respect to property damage was summarized 
by each weather event type.  

Three aspects were examined: 
  
  1. The overall average property damage by each weather event type.  
  2. The average property damage by each weather event type 
  for the 90% of cases with the lowest impact.  
  3. The average property damage by each weather event type 
  for the 10% of cases with the highest impact.  

For each aspect, the average property damage 
by each weather event type, the number of its
available observations (based on which the average was computed) 
and their skewness were examined. 

The overall average property damage was used as the main criterion 
to determine which weather events caused the most harm on economy
with respect to property damage but it is important to take into account 
the other two aspect that were presented in order to obtain a more insightful 
and complete 'picture' of their consequences, 
(especially given the fact that for most of the weather event types, 
the property damage were highly positively skewed).

The table with results for the harm on economy 
with respect to property damage by each weather event type 
were presented at the subsection 
[10.2.2 Most harmful event types with respect to property damage
](#ind-10-2-2--Most-harmful-weather-event-types-with-respect-to-property-damage) 
of the chapter [10 RESULTS](#ind-10--RESULTS).

Finally the *Multiplot 2.1* was created to visualize 
the results of the harm on economy with respect to property damage 
by each weather event type.  

*(Note that neither the Multiplot 2.1 nor the elementary plots that it contains 
were presented in this section due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS), 
where the Figure 2 was presented, 
of which the Multiplot 2.1 constitutes the PART 1.)

of the chapter . 

<font size="3"><u><strong>Steps</strong></u></font>  

* [9.1.1 Extract the target data for harm on economy with respect to property damage
](#ind-9-1-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-property-damage)  
  * The target data subset of observations needed to evaluate 
  the harm on economy with respect to property damage 
  by each weather event type was extracted 
  from the table with the processed data.  
* [9.1.2 Process the target data for harm on economy with respect to property damage
](#ind-9-1-2--Process-the-target-data-for-harm-on-economy-with-respect-to-property-damage)  
  * The table with target data subset for the harm on economy 
  with respect to property damage was processed to create 
  the table with processed data for the harm on economy 
  with respect to property damage.  
* [9.1.3 Summarize the processed data for harm on economy with respect to property damage by each weather event type
](#ind-9-1-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)  
  * The harm on economy with respect to property damage 
  by each weather event type was evaluated over various aspects.  
* [9.1.4 Visualize the results of the summary for the harm on economy with respect to property damage by each weather event type
](#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)  
  * The Multiplot 2.1 that presents the results of the summary 
  for the harm on economy with respect to property damage 
  by each weather event type was created.  
    * [9.1.4.1 Create the components of Multiplot 2.1
    ](#ind-9-1-4-1--Create-the-components-of-Multiplot-2-1)  
      * Creates the four elementary plot that constitute the Multiplot 2.1:  
        * [9.1.4.1.1 Create The Plot 2.1.1](#ind-9-1-4-1-1--Create-The-Plot-2-1-1)  
          * Displays the overall average property damage 
          caused by each weather event type based 
          on all the cases of weather events 
          that resulted in non-zero property damage.  
        * [9.1.4.1.2 Create The Plot 2.1.2](#ind-9-1-4-1-2--Create-The-Plot-2-1-2)  
          * Displays the average property damage 
          caused by each weather event type based on 90% of weather events 
          with the lowest impact (for each weather event type) 
          that resulted in non-zero property damage.  
        * [9.1.4.1.3 Create The Plot 2.1.3](#ind-9-1-4-1-3--Create-The-Plot-2-1-3)  
          * Displays the average property damage 
          caused by each weather event type based on 10% of weather events 
          with the highest impact (for each weather event type) 
          that resulted in non-zero property damage.  
        * [9.1.4.1.4 Create The Plot 2.1.4](#ind-9-1-4-1-4--Create-The-Plot-2-1-4)  
          * Displays a comparison for each weather event type, 
          of the average property damage for the 90% of its observations 
          with the lowest impact versus the average property damage 
          for the 10% of its observations with the highest impact 
          based only on the weather events that resulted 
          in non-zero property damage.  
    * [9.1.4.2 Compose the Multiplot 2.1](#ind-9-1-4-2--Compose-the-Multiplot-2-1)  
      * Combines the four elementary plots to create the Multiplot 2.1.  

<br>  

<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 9.1.1 Extract the target data for harm on economy with respect to property damage {#ind-9-1-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-property-damage}  

In order to examine the harm on economy with respect to property damage 
caused by each weather event type, 
the variables *REFNUM*, *EVENT_TYPE* and *PROPERTY_DAMAGE* 
were selected from the table with the processed data and 
**only the observations that refer to weather events 
that resulted in non-zero property damage** were extracted. 

Furthermore, in an attempt to avoid highly misleading statistics 
due to the small number of observations for some of the weather event types, 
a lowest bound of 10 weather events that caused non zero property damage 
(for each of the included weather event types)
was selected (subjectively by the analyst) and applied. 

This lowest bound, although it may seem (and generally it is) not enough 
to get trustworthy statistics, it was considered to be *"good enough"* 
taking into account that : 
  
  1. the analysis focuses in describing historical data 
  without trying to make inferences 
  that would demand substantially bigger samples, 
  although any statistic based on less than 10 observations 
  could not be taken seriously 
  especially in cases (such as in this analysis) where the distribution 
  of property damage for each weather event type was skewed.
  2. a period of 11 years (from 2001 to 2011) 
  in which the observations that were used in the analysis occurred, 
  is relatively small time to produce big samples of weather events 
  that caused non zero property damage for some the weather event types. 
  Thus, if a highest bound was selected to get more robust statistics 
  such as samples of 100 or 300, the majority of weather event types 
  would have been excluded, making the results of the analysis trivial.  

```{r create_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_economy_with_respect_to_property_damage}

# Extract the required variables and the target data subset of observations 
# for the harm on economy with respect to property damage.
target_data_____harm_on_economy_____property_damage <- processed_data[
  ## Extract only the observations that have resulted in non-zero property damage.
  PROPERTY_DAMAGE > 0,
  ## Select only the relevant variables. 
  list(REFNUM, EVENT_TYPE, PROPERTY_DAMAGE)
  ][
    ### Keep only the observations that correspond to the weather event types 
    ### for which there are at least 10 weather events available.
    EVENT_TYPE %in% 
      names(table(EVENT_TYPE)[table(EVENT_TYPE) >= 10])
    ]

```

The table with the target data for the harm on economy 
with respect to property damage consist of 136928 observations. 

```{r print_the_structure_of_the_table_with_the_target_data_subset_for_the_harm_on_economy_with_respect_to_property_damage} 

# Print the structure of the table with the target data subset 
# for the harm on economy with respect to property damage.
str(target_data_____harm_on_economy_____property_damage)

```

The variable *EVENT_TYPE* includes 37 distinct weather event types, 
for most of which the variable *PROPERTY_DAMAGE* was highly positively skewed. 

```{r create_a_kable_to_present_some_facts_for_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_economy_with_respect_to_property_damage}

# Create a kable to present some facts about the table with the target data 
# for the harm on economy with respect to property damage.
kable(
  x = target_data_____harm_on_economy_____property_damage[
    order(EVENT_TYPE), 
    list(
      "N" = .N, 
      "SKEWNESS" = round(skewness(PROPERTY_DAMAGE), 4)
    ), 
    by = EVENT_TYPE
    ],
  caption = paste0(
    "Table 9.1.1-1: ",
    "Facts about the table with the target data subset of observations ", 
    "for the harm on economy with respect to property damage."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = "The skewness was rounded to 4 decimal places."
  )

```

It was worth noting that for the weather event types 
with highest number of observations 
there was highest skewness for the values of property damage, 
indicating that the corresponding distribution of property damage
has a heavy tail that wasn't possible to be observed 
when few observation were available.  

<br>  

<font size="1">[back to start of this subsection](#ind-9-1-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-property-damage)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 9.1.2 Process the target data for harm on economy with respect to property damage {#ind-9-1-2--Process-the-target-data-for-harm-on-economy-with-respect-to-property-damage}  

To create the table with the processed data 
for the harm on economy with respect to property damage 
from the corresponding target data subset for this perspective,
a new variable was created that divides the observations 
for each of the included weather event types in two complementary levels: 

* one that contains the 90% of cases with lowest impact  
* the other that contains the 10% of cases with highest impact  

This decision was made due to the high skewness that was observed 
for the values of the variable *PROPERTY_DAMAGE* for most weather event types, 
which indicates that the underlining distributions of such phenomena 
has a heavy tail that causes this heterogeneity on the observations. 
As a result a small property damage were observed 
for the majority of cases that resulted in non-zero fatalities 
while in the few cases with the highest impact 
they caused lots of property damage. 

Having in mind that the average property damage 
will be used to determine which weather event types 
were the most harmful to economy (with respect to property damage) 
combined with the fact that the average doesn't represent well 
the distribution of variables with high skewness, 
as it is highly affected by the most extreme values, 
it was considered necessary to examine the subsets 
created by those two levels in order to obtain an insightful picture. 


```{r create_the_table_with_the_processed_data_for_harm_on_economy_with_respect_to_property_damage}

# Create the table with the processed data 
# for the harm on economy with respect to property damage.
processed_data_____harm_on_economy_____property_damage <- 
  target_data_____harm_on_economy_____property_damage[
    ,
    ## Create a new variable divides the observations
    ## for each weather event into two supplementary groups:  
    ##   - the 90% of weather events that resulted in lowest fatalities
    ##   - the 10% of weather events that resulted in highest fatalities
    BIN_GROUP_PER_EVENT_TYPE := (function(x, p_bins) {
      
      # adds 0 and 1 in the vector supplied at the argument 'p_bins' 
      # to the start and the end respectively  
      # the supplied percentiles if they are missing 
      # and sort them ascending
      p_bins_increasing <- sort(c(0, p_bins, 1))
      
      # creates the character strings that labels of the bins by the values supplied at 
      # the argument 'p_bins' that will be the values of the new variable
      bin_labels <- paste0("(", p_bins_increasing[-length(p_bins_increasing)]*100,
                           "% - ", p_bins_increasing[-1]*100, "%]")
      
      # identify the number of occurrences that correspond to each label
      n_times <- vapply(2:length(p_bins_increasing),
                        function(i) {
                          as.integer(floor(length(x) * p_bins_increasing[i]) -
                                       floor(length(x) * p_bins_increasing[i - 1]))
                        }, integer(1))
      
      # multiply each label with the number of its occurrences
      x_bins_expanded <- rep(x = bin_labels, times = n_times)
      
      # order the label to much the values of the corresponding vector
      x_bins_expanded_reordered <- x_bins_expanded[order(seq_along(x)[order(x)])]
      
      ## Coerce the character vector with the labels of bins to a factor
      x_bins_factor <- factor(x_bins_expanded_reordered, labels = bin_labels, ordered = TRUE)
      
    })(PROPERTY_DAMAGE, 0.9), 
    by = EVENT_TYPE
  ][
    ## Coerce the EVENT_VARIABLE to factor
    , EVENT_TYPE := as.factor(EVENT_TYPE) 
  ]

```

The table with the processed data for the harm on economy 
with respect to property damage contains 4 variables:  

  1. **REFNUM** (int) : an id that uniquely identifies each observation  
  2. **EVENT_TYPE** (Factor w/ 37 levels) : the type of each weather event
  3. **PROPERTY_DAMAGE** (int) : the property damage in dollars  
  4. **BIN_GROUP_PER_EVENT_TYPE** (Ord.factor w/ 2 levels) : 
  a factor that divides the observations for each 
  weather event type to two complementary levels, 
  one with the 90% of observations with the lowest impact and 
  another with the 10% of observations with the highest impact.

and 136928 observations. 

```{r print_structure_for_the_table_with_the_processed_data_for_the_harm_on_economy_with_respect_to_property_damage}

# Print the structure of the table with the processed data 
# for the harm on economy with respect to property damage.
str(processed_data_____harm_on_economy_____property_damage)

```

<br>  

<font size="1">[back to start of this subsection](#ind-9-1-2--Process-the-target-data-for-harm-on-economy-with-respect-to-property-damage)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 9.1.3 Summarize the processed data for harm on economy with respect to property damage by each weather event type {#ind-9-1-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type}  

To evaluate the harm on economy by each weather event type 
with respect to property damage a simplistic approach was adopted :  

  * the weather event types were ranked 
  from the most harmful to the least 
  based on the overall average property damage 
  of the weather events that resulted in non-zero property damage

The overall average property damage caused by each weather event type 
was initially examined along with the skewness of the property damage 
for each weather event type. In most cases the skewness was high 
(or even extremely high), so it was possible that the overall mean 
misrepresented the consequences of each weather event type.  

That is the reason why the average property damage for 90% of weather events 
with the lowest impact versus the average property damage for the 10% of 
weather events with the highest impact were also computed and examined.  

**It is highlighted that for the average property damage 
that refers to the 10% of the cases that had the highest impact, 
there were few observations available for a lot of weather event types 
and the corresponding mean values should be interpreted with caution.**

```{r create_the_table_with_the_summary_for_the_harm_on_economy_with_respect_to_property_damage_by_each_weather_event_type}

# Create the table with the summary for the harm on economy 
# with respect to property damage for each weather event type.
summary_____harm_on_economy______property_damage <- 
  processed_data_____harm_on_economy_____property_damage[
  ,
  list(
    ## The total number of observation by each weather event type.
    "N" = .N,
    ## The average property damage caused by each weather event type.
    "AVRG" = round(mean(PROPERTY_DAMAGE), 0),
    ## The skewness of property damage for the observations by each weather event type.
    "SKEWNESS" = round(skewness(PROPERTY_DAMAGE), 4),
    ## The number of observations for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "N_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , .N],
    ## The average property damage caused by each weather event type 
    ## for the 90% of cases with the lowest impact.
    "AVRG_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(mean(PROPERTY_DAMAGE), 0)],
    ## The skewness of property damage for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "SKEWNESS_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(skewness(PROPERTY_DAMAGE), 4)],
    ## The number of observations for the 10% of cases with the lowest impact 
    ## by each weather event type.
    "N_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , .N],
    ## The average property damage caused by each weather event type 
    ## for the 10% of cases with the highest impact.
    "AVRG_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(mean(PROPERTY_DAMAGE), 0)],
    ## The skewness of property damage for the 10% of cases with the highest impact 
    ## by each weather event type.
    "SKEWNESS_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(skewness(PROPERTY_DAMAGE), 4)]
  ),
  by = "EVENT_TYPE"
  ][
    ## The average property damage is used to order the rows of the table
    ## from the most harmful weather event type to the least.
    order(-AVRG),
    ## Create a variable with the rank of the harmness of each weather event type.
    RANK := 1:length(EVENT_TYPE)
    ][
      ,
      ## Reorder the variables at the table.
      list(
        RANK, EVENT_TYPE, N, AVRG, SKEWNESS, N_LOW, AVRG_LOW, SKEWNESS_LOW, N_HIGH, AVRG_HIGH, SKEWNESS_HIGH
      )
      ]

```

The results of the table with the summary 
for the harm on economy with respect to property damage
by each weather event type that was created in this section 
were presented at the subsection 
[10.2.2 Most harmful event types with respect to property damage
](#ind-10-2-2--Most-harmful-weather-event-types-with-respect-to-property-damage) 
of the chapter [10 RESULTS](#ind-10--RESULTS).

The table with the summary for the harm on economy 
with respect to property damage by each weather event type 
was exported (as an R file), in the folder of the working directory: 

* *outputs --> harm_on_economy --> results* 
  
with filename:  

* *summary______harm_on_economy______property_damage.R*
  
In addition a txt file that contains the MD5 hash of the file 
was created and saved at the same directory with filename:  

* *summary_____harm_on_economy______property_damage.R-----(MD5 HASH).txt*

```{r exprot_the_summary_for_the_harm_on_economy_with_respect_to_property_damage}

# Supply the filepath at which the table with the summary
# for the harm on economy will be exported.
filepath_____summary_____harm_on_economy______property_damage <-
  file.path(
    directory_tree_____outputs[[
      "filepath_____outputs_____harm_on_economy_____results"
    ]],
    "summary_____harm_on_economy______property_damage.R"
  )

# Export the table with the summary for the harm on economy
# with respect to property damage.
saveRDS(
  object = summary_____harm_on_economy______property_damage,
  file = filepath_____summary_____harm_on_economy______property_damage
)

```

The main reason for exporting the file with the summary 
for the harm on economy with respect to property damage 
by each weather event type was to supply a checkpoint 
for any attempts to reproduce the analysis.  

<br>  

<font size="1">[back to start of this subsection](#ind-9-1-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 9.1.4 Visualize the results of the summary for the harm on economy with respect to property damage by each weather event type {#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type}  

From the table with the summary for the harm on economy 
by each weather event type with respect to property damage 
the **Multiplot 2.1** was created to present an overview of the results 
for the three different aspects that were examined for this perspective.  

Four elementary plots were 
[created](#ind-9-1-4-2--Compose-the-Multiplot-2-1):  

* [9.1.4.1.1 Create The Plot 2.1.1](#ind-9-1-4-1-1--Create-The-Plot-2-1-1)  
  * Displays the overall average property damage 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero property damage.  
* [9.1.4.1.2 Create The Plot 2.1.2](#ind-9-1-4-1-2--Create-The-Plot-2-1-2)  
  * Displays the average property damage 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero property damage.  
* [9.1.4.1.3 Create The Plot 2.1.3](#ind-9-1-4-1-3--Create-The-Plot-2-1-3)  
  * Displays the average property damage 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero property damage.  
* [9.1.4.1.4 Create The Plot 2.1.4](#ind-9-1-4-1-4--Create-The-Plot-2-1-4)  
  * Displays a comparison for each weather event type, 
  of the average property damage for the 90% of its observations 
  with the lowest impact versus the average property damage 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted 
  in non-zero property damage.  

which were then [combined](#Compose-the-Multiplot-2-1) 
in order to obtain the **Multiplot 2.1**.

It constitutes the *PART 1* of the *Figure 2* 
that displays the overview of the harm on economy 
by each weather event type.  

*(Note that neither the Multiplot 2.1 
nor the elementary plots that it contains 
were presented in this section 
due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS).)*  

<br>  

<font size="1">[back to start of this subsection](#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 9.1.4.1 Create the components of Multiplot 2.1 {#ind-9-1-4-1--Create-the-components-of-Multiplot-2-1}  

Creates four elementary plots to visualize the results for the aspects 
that were examined for the harm on economy with respect to property damage 
by each weather event type.

* [9.1.4.1.1 Create The Plot 2.1.1](#ind-9-1-4-1-1--Create-The-Plot-2-1-1)  
  * Displays the overall average property damage 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero property damage.  
* [9.1.4.1.2 Create The Plot 2.1.2](#ind-9-1-4-1-2--Create-The-Plot-2-1-2)  
  * Displays the average property damage 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero property damage.  
* [9.1.4.1.3 Create The Plot 2.1.3](#ind-9-1-4-1-3--Create-The-Plot-2-1-3)  
  * Displays the average property damage 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero property damage.  
* [9.1.4.1.4 Create The Plot 2.1.4](#ind-9-1-4-1-4--Create-The-Plot-2-1-4)  
  * Displays a comparison for each weather event type, 
  of the average property damage for the 90% of its observations 
  with the lowest impact versus the average property damage 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted 
  in non-zero property damage.  

<br>  

<font size="1">[back to start of this subsubsection](#ind-9-1-4-1--Create-the-components-of-Multiplot-2-1)</font>  
<font size="1">[back to start of this subsection](#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.1.4.1.1 Create The Plot 2.1.1** {#ind-9-1-4-1-1--Create-The-Plot-2-1-1}

The *Plot 2.1.1* displays 
**the overall average property damage** 
caused by each weather event type taking into account 
all and only the observation that resulted in non-zero property damage. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average property damage** they caused.  

The skewness of the property damage 
for the observations of each weather event type
(based on which the overall property damage was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_1_1}

# Create the Elementary Plot 2.1.1 that displays 
# the overall average property damage 
# by each weather event type for all cases. 
elementary_plot_2_1_1 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______property_damage,
    mapping = aes(
      x = AVRG,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to make them displayed alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a square shaped point to the position that corresponds to 
  ## the average property damage caused by each weather event type, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(color = SKEWNESS),
    shape = 15, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average property damage.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG, 
      group = EVENT_TYPE, 
      color = SKEWNESS
    )
    ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## property damage it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2.5
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average property damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.1 will be composed from the four elementary plots. 
    limits = c(-5, 170), 
    midpoint = 70, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels.  
  labs(
    title = "Plot 2.1.1", 
    subtitle = "Aspect: Overall",
    x = "Average Number of Property Damage\n",
    y = "Weather Event Types \n"
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )
```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-1-4-1-1--Create-The-Plot-2-1-1)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-1-4-1--Create-the-components-of-Multiplot-2-1)</font>  
<font size="1">[back to start of this subsection](#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.1.4.1.2 Create The Plot 2.1.2** {#ind-9-1-4-1-2--Create-The-Plot-2-1-2}

The *Elementary Plot 2.1.2* displays 
**the average property damage for the 90% of cases with the lowest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero property damage. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average property damage** they caused.  
(so it is NOT based on the average property damage 
caused by the 90% of cases with the lowest impact of each weather event type).  

The skewness of the property damage 
for the observations of each weather event type
(based on which the average property damage for the 90% of cases 
with the lowest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_1_2}

# Create the Elementary Plot 2.1.2 that displays 
# the average property damage by each weather event type 
# for the 90% of its cases with the lowest impact.
elementary_plot_2_1_2 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______property_damage,
    mapping = aes(
      x = AVRG_LOW,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a circle shaped point to the position that corresponds to 
  ## the average property damage caused by each weather event type
  ## for the 90% of its cases with the lowest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_LOW
    ), 
    size = 3.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average property damage 
  ## for the 90% of its cases with the lowest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_LOW, 
      group = EVENT_TYPE, 
      color = SKEWNESS_LOW
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## property damage it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2
    ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average property damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.1 will be composed from the four elementary plots.
    limits = c(-5, 170), 
    midpoint = 70, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
    ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 2.1.2",
    subtitle = "Aspect: 90% of cases with the lowest impact",
    x = paste0(
      "Average Number of Property Damage for the 90% ", "\n",
      "of Observations with the Lowest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-1-4-1-2--Create-The-Plot-2-1-2)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-1-4-1--Create-the-components-of-Multiplot-2-1)</font>  
<font size="1">[back to start of this subsection](#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.1.4.1.3 Create The Plot 2.1.3** {#ind-9-1-4-1-3--Create-The-Plot-2-1-3}

The *Plot 2.1.3* displays 
**the average property damage for the 10% of cases with the highest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero property damage. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average property damage** they caused.  
(so it is NOT based on the average property damage 
caused by the 10% of cases with the highest impact of each weather event type).  

The skewness of the property damage 
for the observations of each weather event type
(based on which the average property damage for the 10% of cases 
with the highest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_1_3}

# Create the Elementary Plot 2.1.3 that displays 
# the average property damage by each weather event type 
# for the 10% of its cases with the highest impact.
elementary_plot_2_1_3 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______property_damage,
    mapping = aes(
      x = AVRG_HIGH,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a diamond shaped point to the position that corresponds to 
  ## the average property damage caused by each weather event type
  ## for the 10% of its cases with the highest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_HIGH
    ), 
    shape = 18, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average property damage 
  ## for the 10% of its cases with the highest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_HIGH, 
      group = EVENT_TYPE, 
      color = SKEWNESS_HIGH
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## property damage it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ),
    size = 2
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average property damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.1 will be composed from the four elementary plots.
    limits = c(-5, 170), 
    midpoint = 70, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 2.1.3",
    subtitle ="Aspect: 10% of cases with the highest impact",
    x = paste0(
      "Average Number of Property Damage for the 10% ", "\n", 
      "of Observations with the Highest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    ### Remove the text, ticks and title of the y axis 
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-1-4-1-3--Create-The-Plot-2-1-3)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-1-4-1--Create-the-components-of-Multiplot-2-1)</font>  
<font size="1">[back to start of this subsection](#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.1.4.1.4 Create The Plot 2.1.4** {#ind-9-1-4-1-4--Create-The-Plot-2-1-4}

The *Plot 2.1.4* displays 
a compact overview of all three aspect that were examined 
for the harm on economy with respect to property damage.  

For each weather event type, the comparison was visualized for 
**the average property damage for the 90% of cases with the lowest impact** 
versus
**the average property damage for the 10% of cases with the highest impact**.

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average property damage** they caused.  

The skewness of the property damage 
for the observations of each weather event type
(based on which the overall property damage was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_1_4}

# Create the Elementary Plot 2.1.4 that displays 
# by each weather event type the comparison of 
# the average property damage 
# for the 90% of cases with the lowest impact
# versus the average property damage 
# for the 10% of cases with the highest impact.
elementary_plot_2_1_4 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______property_damage,
    mapping = aes(
      x = AVRG_HIGH, 
      y = AVRG_LOW
    )
  ) +
  geom_point(
    mapping = aes(
      fill = SKEWNESS
    ), 
    shape = 21
  ) +
  ## Draw a label with a number that indicates the rank assigned 
  ## to each weather event type (from the most harmful to the least) 
  ## based on the overall average property damage it caused.
  geom_label_repel(
    mapping = aes(
      label = RANK, 
      fill = SKEWNESS
    ),
    size = 2.5
  ) +
  ## Adjust the scale for the fill of each label.
  scale_fill_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average property damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.1 will be composed from the four elementary plots.
    limits = c(-5, 170), 
    midpoint = 70, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
    ) +
  ## Set proper limits to the plot.
    xlim(c(-0.5e9, 6e9)) +
    ylim(c(-1e7, 8.5e7)) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 2.1.4",
    subtitle = paste0(
      "Comparison of the average property damage ", 
      "for the 90% of observations with the lowest impact ", 
      "versus the average property damage ", 
      "for the 10% of observations with highest impact. "
    ),
    x = paste0(
      "Average Number of Property Damage by each Weather Event Type ", 
      "for the 10% of its Observations with the Highest Impact"
    ),
    y = paste0(
      "Average Number of Property Damage by each Weather Event Type ", "\n", 
      "for the 90% of its Observations with the Lowest Impact."
    ),
    ### Add a descriptive label for the legend.
    fill = paste0(
      "The color indicates the skewness ",
      "of property damage for the each weather event type. ",
      "(the color scale is unique for all four plots of PART 1) "
    )
  ) +
  ## Select a theme.
  theme_linedraw() +
  ## Customize the selected theme.
  theme(
    ### Adjust the legend.
    legend.position = "bottom",
    legend.direction = "horizontal",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-1-4-1-4--Create-The-Plot-2-1-4)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-1-4-1--Create-the-components-of-Multiplot-2-1)</font>  
<font size="1">[back to start of this subsection](#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  

#### 9.1.4.2 Compose the Multiplot 2.1 {#ind-9-1-4-2--Compose-the-Multiplot-2-1}  

The four elementary plots that were created from 
the results of the summary for the harm on economy 
with respect to property damage by each weather event type, 
were combined to construct a single multiplot 
that displays the complete picture for this perspective. 

```{r compose_the_multiplot_2_1}

# Create a multiplot that displays the overview of the summary 
# for the harm on economy with respect to property damage
# by each weather event type.
multiplot_2_1 <- arrangeGrob(
  grobs = list(
      
    # Title
    textGrob(
      label = paste0(
        "\n",
        "PART 1: Harm on economy by each weather event type ", 
        "with the respect to property damage ", "\n", 
        "based on the cases of weather events ", 
        "that resulted in non-zero property damage.", "\n", 
        "\n"
      ),
       gp=gpar(
         fontsize = 16, 
         fontface = "bold"
       )
    ),
    
    # Subtitle
    textGrob(
      label = paste0(
          "\n", 
          "The results include only the weather event types, ", 
          "for which at least 10 observations ", 
          "that resulted in non-zero property damage were available. ", "\n",
          "The number associated with each weather event type ", 
          "represents the rank (from the most harmful to the least) ", 
          "which was assigned based on the overall average property damage.", "\n",
          "Because for most of the weather event types ", 
          "high positive skewness was observed for the property damage, ",
          "the average of the 90% of cases with lowest impact ", "\n",
          "and the 10% of cases with highest impact were reported ", 
          "to provide a more representative picture of their consequences.","\n",
          "\n"
      ),
       gp=gpar(
         fontsize = 14, 
         fontface = "bold"
       )
    ),
    
    # Plot 2.1.1
    # Elementary plot for the average property damage 
    # by each weather event type for all cases.
    elementary_plot_2_1_1,
    
    # ELEMENTARY PLOT 1.1.2
    # Elementary plot for the average property damage 
    # by each weather event type for 90% of cases with the lowest impact.
    elementary_plot_2_1_2,
    
    # ELEMENTARY PLOT 1.1.3
    # Elementary plot for the average property damage 
    # by each weather event type for 10% of cases with the highest impact.
    elementary_plot_2_1_3,
    
    # ELEMENTARY PLOT 1.1.4
    # Elementary Plot 2.1.4 for the comparison of 
    # the average property damage 
    # for the 90% of cases with the lowest impact versus 
    # the 10% of cases with the highest impact.
    elementary_plot_2_1_4
  ),
  # Set the layout for this elementary plots
  layout_matrix = 
    matrix(
      c(1,1,1,1,1,1,1,1,1,
        2,2,2,2,2,2,2,2,2,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6
      ),
      byrow = TRUE, 
      nrow = 13
    )
)

```

*(Note that the Multiplot 2.1 was NOT presented in this section 
due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS).)*, 
were the Figure 2 was presented, 
of which the Multiplot 2.1 constitutes the PART 1.)*  

<br>  

<font size="1">[back to start of this subsubsection](#ind-9-1-4-2--Compose-the-Multiplot-2-1)</font>  
<font size="1">[back to start of this subsection](#ind-9-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 9.2 Harm On Economy With Respect To Crop Damage By Each Weather Event Type {#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type}  

<font size="3"><u><strong>Summary</strong></u></font>  

The required variables and the target data subset of observations 
for the harm on economy with respect to crop damage 
were extracted from the table with the processed data, 
and processed to create a new variable that divided the observations 
for each of the included weather event types to two supplementary groups:  

* the 90% of observations with the lowest impact  
* the 10% of observations with the highest impact  
  
before the information for the harm on economy 
with respect to crop damage was summarized 
by each weather event type.  

Three aspects were examined: 
  
  1. The overall average crop damage by each weather event type.  
  2. The average crop damage by each weather event type 
  for the 90% of cases with the lowest impact.  
  3. The average crop damage by each weather event type 
  for the 10% of cases with the highest impact.  

For each aspect, the average crop damage 
by each weather event type, the number of its
available observations (based on which the average was computed) 
and their skewness were examined. 

The overall average crop damage was used as the main criterion 
to determine which weather events caused the most harm on economy
with respect to crop damage but it is important to take into account 
the other two aspect that were presented in order to obtain a more insightful 
and complete 'picture' of their consequences, 
(especially given the fact that for most of the weather event types, 
the crop damage were highly positively skewed).

The table with results for the harm on economy 
with respect to crop damage by each weather event type 
were presented at the subsection 
[10.2.3 Most harmful event types with respect to crop damage
](#ind-10-2-3--Most-harmful-weather-event-types-with-respect-to-crop-damage) 
of the chapter [10 RESULTS](#ind-10--RESULTS).  

Finally the *Multiplot 2.2* was created to visualize 
the results of the harm on economy with respect to crop damage 
by each weather event type.  

*(Note that neither the Multiplot 2.2 nor the elementary plots that it contains 
were presented in this section due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS), 
where the Figure 2 was presented, 
of which the Multiplot 2.2 constitutes the PART 2.)

<font size="3"><u><strong>Steps</strong></u></font>  

* [9.2.1 Extract the target data for harm on economy with respect to crop damage
](#ind-9-2-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-crop-damage)  
  * The target data subset of observations needed to evaluate 
  the harm on economy with respect to crop damage 
  by each weather event type was extracted 
  from the table with the processed data.  
* [9.2.2 Process the target data for harm on economy with respect to crop damage
](#ind-9-2-2--Process-the-target-data-for-harm-on-economy-with-respect-to-crop-damage)  
  * The table with target data subset for the harm on economy 
  with respect to crop damage was processed to create 
  the table with processed data for the harm on economy 
  with respect to crop damage.  
* [9.2.3 Summarize the processed data for harm on economy with respect to crop damage by each weather event type
](#ind-9-2-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)  
  * The harm on economy with respect to crop damage 
  by each weather event type was evaluated over various aspects.  
* [9.2.4 Visualize the results of the summary for the harm on economy with respect to crop damage by each weather event type](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)  
  * The Multiplot 2.2 that presents the results of the summary 
  for the harm on economy with respect to crop damage 
  by each weather event type was created.  
    * [9.2.4.1 Create the components of Multiplot 2.2](#ind-9-2-4-1--Create-the-components-of-Multiplot-2-2)   
      * Creates the four elementary plot that constitute the Multiplot 2.2:  
        * [9.2.4.1.1 Create The Plot 2.2.1](#ind-9-2-4-1-1--Create-The-Plot-2-2-1)  
          * Displays the overall average crop damage 
          caused by each weather event type based 
          on all the cases of weather events 
          that resulted in non-zero crop damage.  
        * [9.2.4.1.2 Create The Plot 2.2.2](#ind-9-2-4-1-2--Create-The-Plot-2-2-2)  
          * Displays the average crop damage 
          caused by each weather event type based on 90% of weather events 
          with the lowest impact (for each weather event type) 
          that resulted in non-zero crop damage.  
        * [9.2.4.1.3 Create The Plot 2.2.3](#ind-9-2-4-1-3--Create-The-Plot-2-2-3)  
          * Displays the average crop damage 
          caused by each weather event type based on 10% of weather events 
          with the highest impact (for each weather event type) 
          that resulted in non-zero crop damage.  
        * [9.2.4.1.4 Create The Plot 2.2.4](#ind-9-2-4-1-4--Create-The-Plot-2-2-4)  
          * Displays a comparison for each weather event type, 
          of the average crop damage for the 90% of its observations 
          with the lowest impact versus the average crop damage 
          for the 10% of its observations with the highest impact 
          based only on the weather events that resulted 
          in non-zero crop damage.  
    * [9.2.4.2 Compose the Multiplot 2.2](#ind-9-2-4-2--Compose-the-Multiplot-2-2)  
      * Combines the four elementary plots to create the Multiplot 2.2.  

<br>  

<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 9.2.1 Extract the target data for harm on economy with respect to crop damage {#ind-9-2-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-crop-damage}  

In order to examine the harm on economy with respect to crop damage 
caused by each weather event type, 
the variables *REFNUM*, *EVENT_TYPE* and *CROP_DAMAGE* 
were selected from the table with the processed data and 
**only the observations that refer to weather events 
that resulted in non-zero crop damage** were extracted. 

Furthermore, in an attempt to avoid highly misleading statistics 
due to the small number of observations for some of the weather event types, 
a lowest bound of 10 weather events that caused non zero crop damage 
(for each of the included weather event types)
was selected (subjectively by the analyst) and applied. 

This lowest bound, although it may seem (and generally it is) not enough 
to get trustworthy statistics, it was considered to be *"good enough"* 
taking into account that : 
  
  1. the analysis focuses in describing historical data 
  without trying to make inferences 
  that would demand substantially bigger samples, 
  although any statistic based on less than 10 observations 
  could not be taken seriously 
  especially in cases (such as in this analysis) where the distribution 
  of crop damage for each weather event type was skewed.
  2. a period of 10 years (from 2001 to 2011) 
  in which the observations that were used in the analysis occurred, 
  is relatively small time to produce big samples of weather events 
  that caused non zero crop damage for some the weather event types. 
  Thus, if a highest bound was selected to get more robust statistics 
  such as samples of 100 or 300, the majority of weather event types 
  would have been excluded, making the results of the analysis trivial.  

```{r create_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_economy_with_respect_to_crop_damage}

# Extract the required variables and the target data subset of observations 
# for the harm on economy with respect to crop damage.
target_data_____harm_on_economy_____crop_damage <- processed_data[
  ## Extract only the observations that have resulted in non-zero crop damage.
  CROP_DAMAGE > 0,
  ## Select only the relevant variables. 
  list(REFNUM, EVENT_TYPE, CROP_DAMAGE)
  ][
    ### Keep only the observations that correspond to the weather event types 
    ### for which there are at least 10 weather events available.
    EVENT_TYPE %in% 
      names(table(EVENT_TYPE)[table(EVENT_TYPE) >= 10])
    ]

```

The table with the target data for the harm on economy 
with respect to crop damage consist of 12177 observations. 

```{r print_the_structure_of_the_table_with_the_target_data_subset_for_the_harm_on_economy_with_respect_to_crop_damage} 

# Print the structure of the table with the target data subset 
# for the harm on economy with respect to crop damage.
str(target_data_____harm_on_economy_____crop_damage)

```

The variable *EVENT_TYPE* includes 16 distinct weather event types, 
for most of which the variable *CROP_DAMAGE* was highly positively skewed. 

It was worth noting that for the weather event types 
with highest number of observations 
there was highest skewness for the values of crop damage, 
indicating that the corresponding distribution of crop damage
has a heavy tail that wasn't possible to be observed 
when few observation were available.  

```{r create_a_kable_to_present_some_facts_for_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_economy_with_respect_to_crop_damage}

# Create a kable to present some facts about the table with the target data 
# for the harm on economy with respect to crop damage.
kable(
  x = target_data_____harm_on_economy_____crop_damage[
    order(EVENT_TYPE), 
    list(
      "N" = .N, 
      "SKEWNESS" = round(skewness(CROP_DAMAGE), 4)
    ), 
    by = EVENT_TYPE
    ],
  caption = paste0(
    "Table 9.2.1-1: ",
    "Facts about the table with the target data subset of observations ", 
    "for the harm on economy with respect to crop damage."
  )
) %>% kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = "The skewness was rounded to 4 decimal places."
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-9-2-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-crop-damage)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 9.2.2 Process the target data for harm on economy with respect to crop damage {#ind-9-2-2--Process-the-target-data-for-harm-on-economy-with-respect-to-crop-damage}  

To create the table with the processed data 
for the harm on economy with respect to crop damage 
from the corresponding target data subset for this perspective,
a new variable was created that divides the observations 
for each of the included weather event types in two complementary levels: 

* one that contains the 90% of cases with lowest impact  
* the other that contains the 10% of cases with highest impact  

This decision was made due to the high skewness that was observed 
for the values of the variable *CROP_DAMAGE* for most weather event types, 
which indicates that the underlining distributions of such phenomena 
has a heavy tail that causes this heterogeneity on the observations. 
As a result a small crop damage were observed 
for the majority of cases that resulted in non-zero fatalities 
while in the few cases with the highest impact 
they caused lots of crop damage. 

Having in mind that the average crop damage 
will be used to determine which weather event types 
were the most harmful to economy (with respect to crop damage) 
combined with the fact that the average doesn't represent well 
the distribution of variables with high skewness, 
as it is highly affected by the most extreme values, 
it was considered necessary to examine the subsets 
created by those two levels in order to obtain an insightful picture. 

```{r create_the_table_with_the_processed_data_for_harm_on_economy_with_respect_to_crop_damage}

# Create the table with the processed data 
# for the harm on economy with respect to crop damage.
processed_data_____harm_on_economy_____crop_damage <- 
  target_data_____harm_on_economy_____crop_damage[
    ,
    ## Create a new variable divides the observations
    ## for each weather event into two supplementary groups:  
    ##   - the 90% of weather events that resulted in lowest fatalities
    ##   - the 10% of weather events that resulted in highest fatalities
    BIN_GROUP_PER_EVENT_TYPE := (function(x, p_bins) {
      
      # adds 0 and 1 in the vector supplied at the argument 'p_bins' 
      # to the start and the end respectively  
      # the supplied percentiles if they are missing 
      # and sort them ascending
      p_bins_increasing <- sort(c(0, p_bins, 1))
      
      # creates the character strings that labels of the bins by the values supplied at 
      # the argument 'p_bins' that will be the values of the new variable
      bin_labels <- paste0("(", p_bins_increasing[-length(p_bins_increasing)]*100,
                           "% - ", p_bins_increasing[-1]*100, "%]")
      
      # identify the number of occurrences that correspond to each label
      n_times <- vapply(2:length(p_bins_increasing),
                        function(i) {
                          as.integer(floor(length(x) * p_bins_increasing[i]) -
                                       floor(length(x) * p_bins_increasing[i - 1]))
                        }, integer(1))
      
      # multiply each label with the number of its occurrences
      x_bins_expanded <- rep(x = bin_labels, times = n_times)
      
      # order the label to much the values of the corresponding vector
      x_bins_expanded_reordered <- x_bins_expanded[order(seq_along(x)[order(x)])]
      
      ## Coerce the character vector with the labels of bins to a factor
      x_bins_factor <- factor(x_bins_expanded_reordered, labels = bin_labels, ordered = TRUE)
      
    })(CROP_DAMAGE, 0.9), 
    by = EVENT_TYPE
  ][
    ## Coerce the EVENT_VARIABLE to factor
    , EVENT_TYPE := as.factor(EVENT_TYPE) 
  ]

```

The table with the processed data for the harm on economy 
with respect to crop damage contains 4 variables:  

  1. **REFNUM** (int) : an id that uniquely identifies each observation  
  2. **EVENT_TYPE** (Factor w/ 16 levels) : the type of each weather event
  3. **CROP_DAMAGE** (int) : the crop damage in dollars  
  4. **BIN_GROUP_PER_EVENT_TYPE** (Ord.factor w/ 2 levels) : 
  a factor that divides the observations for each 
  weather event type to two complementary levels, 
  one with the 90% of observations with the lowest impact and 
  another with the 10% of observations with the highest impact.

and 12177 observations. 

```{r print_structure_for_the_table_with_the_processed_data_for_the_harm_on_economy_with_respect_to_crop_damage}

# Print the structure of the table with the processed data 
# for the harm on economy with respect to crop damage.
str(processed_data_____harm_on_economy_____crop_damage)

```


<br>  

<font size="1">[back to start of this subsection](#ind-9-2-2--Process-the-target-data-for-harm-on-economy-with-respect-to-crop-damage)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 9.2.3 Summarize the processed data for harm on economy with respect to crop damage by each weather event type {#ind-9-2-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type}  

To evaluate the harm on economy by each weather event type 
with respect to crop damage a simplistic approach was adopted :  

  * the weather event types were ranked 
  from the most harmful to the least 
  based on the overall average crop damage 
  of the weather events that resulted in non-zero crop damage

The overall average crop damage caused by each weather event type 
was initially examined along with the skewness of the crop damage 
for each weather event type. In most cases the skewness was high 
(or even extremely high), so it was possible that the overall mean 
misrepresented the consequences of each weather event type.  

That is the reason why the average crop damage for 90% of weather events 
with the lowest impact versus the average crop damage for the 10% of 
weather events with the highest impact were also computed and examined.  

**It is highlighted that for the average crop damage 
that refers to the 10% of the cases that had the highest impact, 
there were few observations available for a lot of weather event types 
and the corresponding mean values should be interpreted with caution.**

```{r create_the_table_with_the_summary_for_the_harm_on_economy_with_respect_to_crop_damage_by_each_weather_event_type}

# Create the table with the summary for the harm on economy 
# with respect to crop damage for each weather event type.
summary_____harm_on_economy______crop_damage <- 
  processed_data_____harm_on_economy_____crop_damage[
  ,
  list(
    ## The total number of observation by each weather event type.
    "N" = .N,
    ## The average crop damage caused by each weather event type.
    "AVRG" = round(mean(CROP_DAMAGE), 0),
    ## The skewness of crop damage for the observations by each weather event type.
    "SKEWNESS" = round(skewness(CROP_DAMAGE), 4),
    ## The number of observations for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "N_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , .N],
    ## The average crop damage caused by each weather event type 
    ## for the 90% of cases with the lowest impact.
    "AVRG_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(mean(CROP_DAMAGE), 0)],
    ## The skewness of crop damage for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "SKEWNESS_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(skewness(CROP_DAMAGE), 4)],
    ## The number of observations for the 10% of cases with the lowest impact 
    ## by each weather event type.
    "N_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , .N],
    ## The average crop damage caused by each weather event type 
    ## for the 10% of cases with the highest impact.
    "AVRG_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(mean(CROP_DAMAGE), 0)],
    ## The skewness of crop damage for the 10% of cases with the highest impact 
    ## by each weather event type.
    "SKEWNESS_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(skewness(CROP_DAMAGE), 4)]
  ),
  by = "EVENT_TYPE"
  ][
    ## The average crop damage is used to order the rows of the table
    ## from the most harmful weather event type to the least.
    order(-AVRG),
    ## Create a variable with the rank of the harmness of each weather event type.
    RANK := 1:length(EVENT_TYPE)
    ][
      ,
      ## Reorder the variables at the table.
      list(
        RANK, EVENT_TYPE, N, AVRG, SKEWNESS, N_LOW, AVRG_LOW, SKEWNESS_LOW, N_HIGH, AVRG_HIGH, SKEWNESS_HIGH
      )
      ]

```

The results of the table with the summary 
for the harm on economy with respect to crop damage
by each weather event type that was created in this section 
were presented at the subsection 
[10.2.3 Most harmful event types with respect to crop damage
](#ind-10-2-3--Most-harmful-weather-event-types-with-respect-to-crop-damage) 
of the chapter [10 RESULTS](#ind-10--RESULTS).  

The table with the summary for the harm on economy 
with respect to crop damage by each weather event type 
was exported (as an R file), in the folder of the working directory: 

* *outputs --> harm_on_economy --> results* 
  
with filename:  

* *summary______harm_on_economy______crop_damage.R*

```{r exprot_the_summary_for_the_harm_on_economy_with_respect_to_crop_damage}

# Supply the filepath at which the table with the summary
# for the harm on economy will be exported.
filepath_____summary_____harm_on_economy______crop_damage <-
  file.path(
    directory_tree_____outputs[[
      "filepath_____outputs_____harm_on_economy_____results"
    ]],
    "summary_____harm_on_economy______crop_damage.R"
  )

# Export the table with the summary for the harm on economy
# with respect to crop damage.
saveRDS(
  object = summary_____harm_on_economy______crop_damage,
  file = filepath_____summary_____harm_on_economy______crop_damage
)

```

The main reason for exporting the file with the summary 
for the harm on economy with respect to crop damage by each weather event type 
was to supply a checkpoint for any attempts to reproduce the analysis.  

<br>  

<font size="1">[back to start of this subsection](#ind-9-2-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 9.2.4 Visualize the results of the summary for the harm on economy with respect to crop damage by each weather event type {#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type}  

From the table with the summary for the harm on economy 
by each weather event type with respect to crop damage 
the **Multiplot 2.2** was created to present an overview of the results 
for the three different aspects that were examined for this perspective.  

Four elementary plots were 
[created](#ind-9-2-4-1--Create-the-components-of-Multiplot-2-2):  

* [9.2.4.1.1 Create The Plot 2.2.1](#ind-9-2-4-1-1--Create-The-Plot-2-2-1)  
  * Displays the overall average crop damage 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero crop damage.  
* [9.2.4.1.2 Create The Plot 2.2.2](#ind-9-2-4-1-2--Create-The-Plot-2-2-2)  
  * Displays the average crop damage 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero crop damage.  
* [9.2.4.1.3 Create The Plot 2.2.3](#ind-9-2-4-1-3--Create-The-Plot-2-2-3)  
  * Displays the average crop damage 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero crop damage.  
* [9.2.4.1.4 Create The Plot 2.2.4](#ind-9-2-4-1-4--Create-The-Plot-2-2-4)  
  * Displays a comparison for each weather event type, 
  of the average crop damage for the 90% of its observations 
  with the lowest impact versus the average crop damage 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted 
  in non-zero crop damage.  

which were then [combined](#ind-9-2-4-2--Compose-the-Multiplot-2-2) 
in order to obtain the **Multiplot 2.2**.

It constitutes the *PART 2* of the *Figure 2* 
that displays the overview of the harm on economy 
by each weather event type.  

*(Note that neither the Multiplot 2.2 
nor the elementary plots that it contains 
were presented in this section 
due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS).)*  

<br>  

<font size="1">[back to start of this subsection](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 9.2.4.1 Create the components of Multiplot 2.2 {#ind-9-2-4-1--Create-the-components-of-Multiplot-2-2}  

Creates four elementary plots to visualize the results for the aspects 
that were examined for the harm on economy with respect to crop damage 
by each weather event type.  

* [9.2.4.1.1 Create The Plot 2.2.1](#ind-9-2-4-1-1--Create-The-Plot-2-2-1)  
  * Displays the overall average crop damage 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero crop damage.  
* [9.2.4.1.2 Create The Plot 2.2.2](#ind-9-2-4-1-2--Create-The-Plot-2-2-2)  
  * Displays the average crop damage 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero crop damage.  
* [9.2.4.1.3 Create The Plot 2.2.3](#ind-9-2-4-1-3--Create-The-Plot-2-2-3)  
  * Displays the average crop damage 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero crop damage.  
* [9.2.4.1.4 Create The Plot 2.2.4](#ind-9-2-4-1-4--Create-The-Plot-2-2-4)  
  * Displays a comparison for each weather event type, 
  of the average crop damage for the 90% of its observations 
  with the lowest impact versus the average crop damage 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted 
  in non-zero crop damage.  

<br>  

<font size="1">[back to start of this subsubsection](#ind-9-2-4-1--Create-the-components-of-Multiplot-2-2)</font>
<font size="1">[back to start of this subsection](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.2.4.1.1 Create The Plot 2.2.1** {#ind-9-2-4-1-1--Create-The-Plot-2-2-1}

The *Plot 2.2.1* displays 
**the overall average crop damage** 
caused by each weather event type taking into account 
all and only the observation that resulted in non-zero crop damage. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average crop damage** they caused.  

The skewness of the crop damage 
for the observations of each weather event type
(based on which the overall crop damage was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_2_1}

# Create the Elementary Plot 2.2.1 that displays 
# the overall average crop damage 
# by each weather event type for all cases. 
elementary_plot_2_2_1 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______crop_damage,
    mapping = aes(
      x = AVRG,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to make them displayed alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a square shaped point to the position that corresponds to 
  ## the average crop damage caused by each weather event type, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(color = SKEWNESS),
    shape = 15, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average crop damage.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG, 
      group = EVENT_TYPE, 
      color = SKEWNESS
    )
    ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## crop damage it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2.5
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average crop damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.2 will be composed from the four elementary plots. 
    limits = c(0, 28), 
    midpoint = 14, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels.  
  labs(
    title = "Plot 2.2.1", 
    subtitle = "Aspect: Overall",
    x = "Average Number of Crop Damage\n",
    y = "Weather Event Types \n"
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-2-4-1-1--Create-The-Plot-2-2-1)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-2-4-1--Create-the-components-of-Multiplot-2-2)</font>
<font size="1">[back to start of this subsection](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.2.4.1.2 Create The Plot 2.2.2** {#ind-9-2-4-1-2--Create-The-Plot-2-2-2}

The *Elementary Plot 2.2.2* displays 
**the average crop damage for the 90% of cases with the lowest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero crop damage. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average crop damage** they caused.  
(so it is NOT based on the average crop damage 
caused by the 90% of cases with the lowest impact of each weather event type).  

The skewness of the crop damage 
for the observations of each weather event type
(based on which the average crop damage for the 90% of cases 
with the lowest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_2_2}

# Create the Elementary Plot 2.2.2 that displays 
# the average crop damage by each weather event type 
# for the 90% of its cases with the lowest impact.
elementary_plot_2_2_2 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______crop_damage,
    mapping = aes(
      x = AVRG_LOW,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a circle shaped point to the position that corresponds to 
  ## the average crop damage caused by each weather event type
  ## for the 90% of its cases with the lowest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_LOW
    ), 
    size = 3.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average crop damage 
  ## for the 90% of its cases with the lowest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_LOW, 
      group = EVENT_TYPE, 
      color = SKEWNESS_LOW
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## crop damage it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2
    ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average crop damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.2 will be composed from the four elementary plots.
    limits = c(0, 28), 
    midpoint = 14, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
    ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 2.2.2",
    subtitle = "Aspect: 90% of cases with the lowest impact",
    x = paste0(
      "Average Number of Crop Damage for the 90% ", "\n",
      "of Observations with the Lowest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```


<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-2-4-1-2--Create-The-Plot-2-2-2)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-2-4-1--Create-the-components-of-Multiplot-2-2)</font>
<font size="1">[back to start of this subsection](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.2.4.1.3 Create The Plot 2.2.3** {#ind-9-2-4-1-3--Create-The-Plot-2-2-3}

The *Plot 2.2.3* displays 
**the average crop damage for the 10% of cases with the highest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero crop damage. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average crop damage** they caused.  
(so it is NOT based on the average crop damage 
caused by the 10% of cases with the highest impact of each weather event type).  

The skewness of the crop damage 
for the observations of each weather event type
(based on which the average crop damage for the 10% of cases 
with the highest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_2_3}

# Create the Elementary Plot 2.2.3 that displays 
# the average crop damage by each weather event type 
# for the 10% of its cases with the highest impact.
elementary_plot_2_2_3 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______crop_damage,
    mapping = aes(
      x = AVRG_HIGH,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a diamond shaped point to the position that corresponds to 
  ## the average crop damage caused by each weather event type
  ## for the 10% of its cases with the highest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_HIGH
    ), 
    shape = 18, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average crop damage 
  ## for the 10% of its cases with the highest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_HIGH, 
      group = EVENT_TYPE, 
      color = SKEWNESS_HIGH
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## crop damage it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ),
    size = 2
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average crop damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.2 will be composed from the four elementary plots.
    limits = c(0, 28), 
    midpoint = 14, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 2.2.3",
    subtitle ="Aspect: 10% of cases with the highest impact",
    x = paste0(
      "Average Number of Crop Damage for the 10% ", "\n", 
      "of Observations with the Highest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    ### Remove the text, ticks and title of the y axis 
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-2-4-1-3--Create-The-Plot-2-2-3)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-2-4-1--Create-the-components-of-Multiplot-2-2)</font>
<font size="1">[back to start of this subsection](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.2.4.1.4 Create The Plot 2.2.4** {#ind-9-2-4-1-4--Create-The-Plot-2-2-4}

The *Plot 2.2.4* displays 
a compact overview of all three aspect that were examined 
for the harm on economy with respect to crop damage.  

For each weather event type, the comparison was visualized for 
**the average crop damage for the 90% of cases with the lowest impact** 
versus
**the average crop damage for the 10% of cases with the highest impact**.

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average crop damage** they caused.  

The skewness of the crop damage 
for the observations of each weather event type
(based on which the overall crop damage was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_2_4}

# Create the Elementary Plot 2.2.4 that displays 
# by each weather event type the comparison of 
# the average crop damage 
# for the 90% of cases with the lowest impact
# versus the average crop damage 
# for the 10% of cases with the highest impact.
elementary_plot_2_2_4 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______crop_damage,
    mapping = aes(
      x = AVRG_HIGH, 
      y = AVRG_LOW
    )
  ) +
  geom_point(
    mapping = aes(
      fill = SKEWNESS
    ), 
    shape = 21
  ) +
  ## Draw a label with a number that indicates the rank assigned 
  ## to each weather event type (from the most harmful to the least) 
  ## based on the overall average crop damage it caused.
  geom_label_repel(
    mapping = aes(
      label = RANK, 
      fill = SKEWNESS
    ),
    size = 2.5
  ) +
  ## Adjust the scale for the fill of each label.
  scale_fill_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average crop damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.2 will be composed from the four elementary plots.
    limits = c(0, 28), 
    midpoint = 14, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
    ) +
  ## Set proper limits to the plot.
    xlim(c(-0.25e8, 5.2e8)) +
    ylim(c(-0.2e7, 1.5e7)) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 2.2.4",
    subtitle = paste0(
      "Comparison of the average crop damage ", 
      "for the 90% of observations with the lowest impact ", 
      "versus the average crop damage ", 
      "for the 10% of observations with highest impact. "
    ),
    x = paste0(
      "Average Number of Crop Damage by each Weather Event Type ", 
      "for the 10% of its Observations with the Highest Impact"
    ),
    y = paste0(
      "Average Number of Crop Damage by each Weather Event Type ", "\n", 
      "for the 90% of its Observations with the Lowest Impact."
    ),
    ### Add a descriptive label for the legend.
    fill = paste0(
      "The color indicates the skewness ",
      "of crop damage for the each weather event type. ",
      "(the color scale is unique for all four plots of PART 2) ", "\n",
      "When the color of a bar is gray, the skewness was indeterminable ",
      "due to the fact that all observations for that weather event type ",
      "took the same value."
    )
  ) +
  ## Select a theme.
  theme_linedraw() +
  ## Customize the selected theme.
  theme(
    ### Adjust the legend.
    legend.position = "bottom",
    legend.direction = "horizontal",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-2-4-1-4--Create-The-Plot-2-2-4)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-2-4-1--Create-the-components-of-Multiplot-2-2)</font>
<font size="1">[back to start of this subsection](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  

#### 9.2.4.2 Compose the Multiplot 2.2 {#ind-9-2-4-2--Compose-the-Multiplot-2-2}  

The four elementary plots that were created from 
the results of the summary for the harm on economy 
with respect to crop damage by each weather event type, 
were combined to construct a single multiplot 
that displays the complete picture for this perspective. 

```{r compose_the_multiplot_2_2}

# Create a multiplot that displays the overview of the summary 
# for the harm on economy with respect to crop damage
# by each weather event type.
multiplot_2_2 <- arrangeGrob(
  grobs = list(
      
    # Title
    textGrob(
      label = paste0(
        "\n",
        "PART 2: Harm on economy by each weather event type ", 
        "with the respect to crop damage ", "\n", 
        "based on the cases of weather events ", 
        "that resulted in non-zero crop damage.", "\n", 
        "\n"
      ),
       gp=gpar(
         fontsize = 16, 
         fontface = "bold"
       )
    ),
    
    # Subtitle
    textGrob(
      label = paste0(
          "\n", 
          "The results include only the weather event types, ", 
          "for which at least 10 observations ", 
          "that resulted in non-zero crop damage were available. ", "\n",
          "The number associated with each weather event type ", 
          "represents the rank (from the most harmful to the least) ", 
          "which was assigned based on the overall average crop damage.", "\n",
          "Because for most of the weather event types ", 
          "high positive skewness was observed for the crop damage, ",
          "the average of the 90% of cases with lowest impact ", "\n",
          "and the 10% of cases with highest impact were reported ", 
          "to provide a more representative picture of their consequences.","\n",
          "\n"
      ),
       gp=gpar(
         fontsize = 14, 
         fontface = "bold"
       )
    ),
    
    # Plot 2.2.1
    # Elementary plot for the average crop damage 
    # by each weather event type for all cases.
    elementary_plot_2_2_1,
    
    # ELEMENTARY PLOT 1.2.2
    # Elementary plot for the average crop damage 
    # by each weather event type for 90% of cases with the lowest impact.
    elementary_plot_2_2_2,
    
    # ELEMENTARY PLOT 1.2.3
    # Elementary plot for the average crop damage 
    # by each weather event type for 10% of cases with the highest impact.
    elementary_plot_2_2_3,
    
    # ELEMENTARY PLOT 1.2.4
    # Elementary Plot 2.2.4 for the comparison of 
    # the average crop damage 
    # for the 90% of cases with the lowest impact versus 
    # the 10% of cases with the highest impact.
    elementary_plot_2_2_4
  ),
  # Set the layout for this elementary plots
  layout_matrix = 
    matrix(
      c(1,1,1,1,1,1,1,1,1,
        2,2,2,2,2,2,2,2,2,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6
      ),
      byrow = TRUE, 
      nrow = 12
    )
)

```

*(Note that the Multiplot 2.2 was NOT presented in this section 
due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS).)*, 
were the Figure 2 was presented, 
of which the Multiplot 2.2 constitutes the PART 2.)*  

<br>  

<font size="1">[back to start of this subsubsection](#ind-9-2-4-2--Compose-the-Multiplot-2-2)</font>
<font size="1">[back to start of this subsection](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 9.3 Harm On Economy With Respect To Economic Damage By Each Weather Event Type {#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type}  

<font size="3"><u><strong>Summary</strong></u></font>  

The required variables and the target data subset of observations 
for the harm on economy with respect to economic damage 
were extracted from the table with the processed data, 
and processed to create a new variable that divided the observations 
for each of the included weather event types to two supplementary groups:  

* the 90% of observations with the lowest impact  
* the 10% of observations with the highest impact  
  
before the information for the harm on economy 
with respect to economic damage was summarized 
by each weather event type.  

Three aspects were examined: 
  
  1. The overall average economic damage by each weather event type.  
  2. The average economic damage by each weather event type 
  for the 90% of cases with the lowest impact.  
  3. The average economic damage by each weather event type 
  for the 10% of cases with the highest impact.  

For each aspect, the average economic damage 
by each weather event type, the number of its
available observations (based on which the average was computed) 
and their skewness were examined. 

The overall average economic damage was used as the main criterion 
to determine which weather events caused the most harm on economy
with respect to economic damage but it is important to take into account 
the other two aspect that were presented in order to obtain a more insightful 
and complete 'picture' of their consequences, 
(especially given the fact that for most of the weather event types, 
the economic damage were highly positively skewed).

The table with results for the harm on economy 
with respect to economic damage by each weather event type 
were presented at the subsection 
[10.2.4 Most harmful event types with respect to economic damage
](#ind-10-2-4--Most-harmful-weather-event-types-with-respect-to-economic-damage)
of the chapter [10 RESULTS](#ind-10--RESULTS).  

Finally the *Multiplot 2.3* was created to visualize  
the results of the harm on economy with respect to economic damage 
by each weather event type.  

*(Note that neither the Multiplot 2.3 nor the elementary plots that it contains 
were presented in this section due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS), 
where the Figure 2 was presented, 
of which the Multiplot 2.3 constitutes the PART 3.)

<font size="3"><u><strong>Steps</strong></u></font>  

* [9.3.1 Extract the target data for harm on economy with respect to economic damage
](#ind-9-3-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-economic-damage)  
  * The target data subset of observations needed to evaluate 
  the harm on economy with respect to economic damage 
  by each weather event type was extracted 
  from the table with the processed data.  
* [9.3.2 Process the target data for harm on economy with respect to economic damage
](#ind-9-3-2--Process-the-target-data-for-harm-on-economy-with-respect-to-economic-damage)  
  * The table with target data subset for the harm on economy 
  with respect to economic damage was processed to create 
  the table with processed data for the harm on economy 
  with respect to economic damage.  
* [9.3.3 Summarize the processed data for harm on economy with respect to economic damage by each weather event type
](#ind-9-3-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)  
  * The harm on economy with respect to economic damage 
  by each weather event type was evaluated over various aspects.  
* [9.3.4 Visualize the results of the summary for the harm on economy with respect to economic damage by each weather event type
](#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)  
  * The Multiplot 2.3 that presents the results of the summary 
  for the harm on economy with respect to economic damage 
  by each weather event type was created.  
    * [9.3.4.1 Create the components of Multiplot 2.3
    ](#ind-9-3-4-1--Create-the-components-of-Multiplot-2-3)  
      * Creates the four elementary plot that constitute the Multiplot 2.3:  
        * [9.3.4.1.1 Create The Plot 2.3.1](#ind-9-3-4-1-1--Create-The-Plot-2-3-1)  
          * Displays the overall average economic damage 
          caused by each weather event type based 
          on all the cases of weather events 
          that resulted in non-zero economic damage.  
        * [9.3.4.1.2 Create The Plot 2.3.2](#ind-9-3-4-1-2--Create-The-Plot-2-3-2)  
          * Displays the average economic damage 
          caused by each weather event type based on 90% of weather events 
          with the lowest impact (for each weather event type) 
          that resulted in non-zero economic damage.  
        * [9.3.4.1.3 Create The Plot 2.3.3](#ind-9-3-4-1-3--Create-The-Plot-2-3-3)  
          * Displays the average economic damage 
          caused by each weather event type based on 10% of weather events 
          with the highest impact (for each weather event type) 
          that resulted in non-zero economic damage.  
        * [9.3.4.1.4 Create The Plot 2.3.4](#ind-9-3-4-1-4--Create-The-Plot-2-3-4)  
          * Displays a comparison for each weather event type, 
          of the average economic damage for the 90% of its observations 
          with the lowest impact versus the average economic damage 
          for the 10% of its observations with the highest impact 
          based only on the weather events that resulted 
          in non-zero economic damage.  
    * [9.3.4.2 Compose the Multiplot 2.3](#ind-9-3-4-2--Compose-the-Multiplot-2-3)  
      * Combines the four elementary plots to create the Multiplot 2.3.  

<br>  

<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 9.3.1 Extract the target data for harm on economy with respect to economic damage {#ind-9-3-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-economic-damage}  

In order to examine the harm on economy with respect to economic damage 
caused by each weather event type, 
the variables *REFNUM*, *EVENT_TYPE* and *ECONOMIC_DAMAGE* 
were selected from the table with the processed data and 
**only the observations that refer to weather events 
that resulted in non-zero economic damage** were extracted. 

Furthermore, in an attempt to avoid highly misleading statistics 
due to the small number of observations for some of the weather event types, 
a lowest bound of 10 weather events that caused non zero economic damage 
(for each of the included weather event types)
was selected (subjectively by the analyst) and applied. 

This lowest bound, although it may seem (and generally it is) not enough 
to get trustworthy statistics, it was considered to be *"good enough"* 
taking into account that : 
  
  1. the analysis focuses in describing historical data 
  without trying to make inferences 
  that would demand substantially bigger samples, 
  although any statistic based on less than 10 observations 
  could not be taken seriously 
  especially in cases (such as in this analysis) where the distribution 
  of economic damage for each weather event type was skewed.
  2. a period of 10 years (from 2001 to 2011) 
  in which the observations that were used in the analysis occurred, 
  is relatively small time to produce big samples of weather events 
  that caused non zero economic damage for some the weather event types. 
  Thus, if a highest bound was selected to get more robust statistics 
  such as samples of 100 or 300, the majority of weather event types 
  would have been excluded, making the results of the analysis trivial.  

```{r create_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_economy_with_respect_to_economic_damage}

# Extract the required variables and the target data subset of observations 
# for the harm on economy with respect to economic damage.
target_data_____harm_on_economy_____economic_damage <- processed_data[
  ## Extract only the observations that have resulted in non-zero economic damage.
  ECONOMIC_DAMAGE > 0,
  ## Select only the relevant variables. 
  list(REFNUM, EVENT_TYPE, ECONOMIC_DAMAGE)
  ][
    ### Keep only the observations that correspond to the weather event types 
    ### for which there are at least 10 weather events available.
    EVENT_TYPE %in% 
      names(table(EVENT_TYPE)[table(EVENT_TYPE) >= 10])
    ]

```

The table with the target data for the harm on economy 
with respect to economic damage consist of 140236 observations. 

```{r print_the_structure_of_the_table_with_the_target_data_subset_for_the_harm_on_economy_with_respect_to_economic_damage} 

# Print the structure of the table with the target data subset 
# for the harm on economy with respect to economic damage.
str(target_data_____harm_on_economy_____economic_damage)

```

The variable *EVENT_TYPE* includes 37 distinct weather event types, 
for most of which the variable *ECONOMIC_DAMAGE* was highly positively skewed. 

It was worth noting that for the weather event types 
with highest number of observations 
there was highest skewness for the values of economic damage, 
indicating that the corresponding distribution of economic damage
has a heavy tail that wasn't possible to be observed 
when few observation were available.  

```{r create_a_kable_to_present_some_facts_for_the_table_with_the_target_data_subset_of_observations_for_the_harm_on_economy_with_respect_to_economic_damage}

# Create a kable to present some facts about the table with the target data 
# for the harm on economy with respect to economic damage.
kable(
  x = target_data_____harm_on_economy_____economic_damage[
    order(EVENT_TYPE), 
    list(
      "N" = .N, 
      "SKEWNESS" = round(skewness(ECONOMIC_DAMAGE), 4)
    ), 
    by = EVENT_TYPE
    ],
  caption = paste0(
    "Table 9.3.1-1: ", 
    "Facts about the table with the target data subset of observations ", 
    "for the harm on economy with respect to economic damage."
  )
) %>% 
  kable_styling(
    bootstrap_options = c("striped", "hover", "condensed", "responsive", "bordered"), 
    full_width = FALSE,
    fixed_thead = TRUE
  ) %>% 
  footnote(
    general = "The skewness was rounded to 4 decimal places."
  )

```

<br>  

<font size="1">[back to start of this subsection](#ind-9-3-1--Extract-the-target-data-for-harm-on-economy-with-respect-to-economic-damage)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 9.3.2 Process the target data for harm on economy with respect to economic damage {#ind-9-3-2--Process-the-target-data-for-harm-on-economy-with-respect-to-economic-damage}  

To create the table with the processed data 
for the harm on economy with respect to economic damage 
from the corresponding target data subset for this perspective,
a new variable was created that divides the observations 
for each of the included weather event types in two complementary levels: 

* one that contains the 90% of cases with lowest impact  
* the other that contains the 10% of cases with highest impact  

This decision was made due to the high skewness that was observed 
for the values of the variable *ECONOMIC_DAMAGE* for most weather event types, 
which indicates that the underlining distributions of such phenomena 
has a heavy tail that causes this heterogeneity on the observations. 
As a result a small economic damage were observed 
for the majority of cases that resulted in non-zero fatalities 
while in the few cases with the highest impact 
they caused lots of economic damage. 

Having in mind that the average economic damage 
will be used to determine which weather event types 
were the most harmful to economy (with respect to economic damage) 
combined with the fact that the average doesn't represent well 
the distribution of variables with high skewness, 
as it is highly affected by the most extreme values, 
it was considered necessary to examine the subsets 
created by those two levels in order to obtain an insightful picture. 

```{r create_the_table_with_the_processed_data_for_harm_on_economy_with_respect_to_economic_damage}

# Create the table with the processed data 
# for the harm on economy with respect to economic damage.
processed_data_____harm_on_economy_____economic_damage <- 
  target_data_____harm_on_economy_____economic_damage[
    ,
    ## Create a new variable divides the observations
    ## for each weather event into two supplementary groups:  
    ##   - the 90% of weather events that resulted in lowest fatalities
    ##   - the 10% of weather events that resulted in highest fatalities
    BIN_GROUP_PER_EVENT_TYPE := (function(x, p_bins) {
      
      # adds 0 and 1 in the vector supplied at the argument 'p_bins' 
      # to the start and the end respectively  
      # the supplied percentiles if they are missing 
      # and sort them ascending
      p_bins_increasing <- sort(c(0, p_bins, 1))
      
      # creates the character strings that labels of the bins by the values supplied at 
      # the argument 'p_bins' that will be the values of the new variable
      bin_labels <- paste0("(", p_bins_increasing[-length(p_bins_increasing)]*100,
                           "% - ", p_bins_increasing[-1]*100, "%]")
      
      # identify the number of occurrences that correspond to each label
      n_times <- vapply(2:length(p_bins_increasing),
                        function(i) {
                          as.integer(floor(length(x) * p_bins_increasing[i]) -
                                       floor(length(x) * p_bins_increasing[i - 1]))
                        }, integer(1))
      
      # multiply each label with the number of its occurrences
      x_bins_expanded <- rep(x = bin_labels, times = n_times)
      
      # order the label to much the values of the corresponding vector
      x_bins_expanded_reordered <- x_bins_expanded[order(seq_along(x)[order(x)])]
      
      ## Coerce the character vector with the labels of bins to a factor
      x_bins_factor <- factor(x_bins_expanded_reordered, labels = bin_labels, ordered = TRUE)
      
    })(ECONOMIC_DAMAGE, 0.9), 
    by = EVENT_TYPE
  ][
    ## Coerce the EVENT_VARIABLE to factor
    , EVENT_TYPE := as.factor(EVENT_TYPE) 
  ]

```

The table with the processed data for the harm on economy 
with respect to economic damage contains 4 variables:  

  1. **REFNUM** (int) : an id that uniquely identifies each observation  
  2. **EVENT_TYPE** (Factor w/ 37 levels) : the type of each weather event
  3. **ECONOMIC_DAMAGE** (int) : the economic damage  
  4. **BIN_GROUP_PER_EVENT_TYPE** (Ord.factor w/ 2 levels) : 
  a factor that divides the observations for each 
  weather event type to two complementary levels, 
  one with the 90% of observations with the lowest impact and 
  another with the 10% of observations with the highest impact.

and 140236 observations. 

```{r print_structure_for_the_table_with_the_processed_data_for_the_harm_on_economy_with_respect_to_economic_damage}

# Print the structure of the table with the processed data 
# for the harm on economy with respect to economic damage.
str(processed_data_____harm_on_economy_____economic_damage)

```

<br>  

<font size="1">[back to start of this subsection](#ind-9-3-2--Process-the-target-data-for-harm-on-economy-with-respect-to-economic-damage)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 9.3.3 Summarize the processed data for harm on economy with respect to economic damage by each weather event type {#ind-9-3-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type}  

To evaluate the harm on economy by each weather event type 
with respect to economic damage a simplistic approach was adopted :  

  * the weather event types were ranked 
  from the most harmful to the least 
  based on the overall average economic damage 
  of the weather events that resulted in non-zero economic damage

The overall average economic damage caused by each weather event type 
was initially examined along with the skewness of the economic damage 
for each weather event type. In most cases the skewness was high 
(or even extremely high), so it was possible that the overall mean 
misrepresented the consequences of each weather event type.  

That is the reason why the average economic damage for 90% of weather events 
with the lowest impact versus the average economic damage for the 10% of 
weather events with the highest impact were also computed and examined.  

**It is highlighted that for the average economic damage 
that refers to the 10% of the cases that had the highest impact, 
there were few observations available for a lot of weather event types 
and the corresponding mean values should be interpreted with caution.**

```{r create_the_table_with_the_summary_for_the_harm_on_economy_with_respect_to_economic_damage_by_each_weather_event_type}

# Create the table with the summary for the harm on economy 
# with respect to economic damage for each weather event type.
summary_____harm_on_economy______economic_damage <- 
  processed_data_____harm_on_economy_____economic_damage[
  ,
  list(
    ## The total number of observation by each weather event type.
    "N" = .N,
    ## The average economic damage caused by each weather event type.
    "AVRG" = round(mean(ECONOMIC_DAMAGE), 0),
    ## The skewness of economic damage for the observations by each weather event type.
    "SKEWNESS" = round(skewness(ECONOMIC_DAMAGE), 4),
    ## The number of observations for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "N_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , .N],
    ## The average economic damage caused by each weather event type 
    ## for the 90% of cases with the lowest impact.
    "AVRG_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(mean(ECONOMIC_DAMAGE), 0)],
    ## The skewness of economic damage for the 90% of cases with the lowest impact 
    ## by each weather event type.
    "SKEWNESS_LOW" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(0% - 90%]" , round(skewness(ECONOMIC_DAMAGE), 4)],
    ## The number of observations for the 10% of cases with the lowest impact 
    ## by each weather event type.
    "N_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , .N],
    ## The average economic damage caused by each weather event type 
    ## for the 10% of cases with the highest impact.
    "AVRG_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(mean(ECONOMIC_DAMAGE), 0)],
    ## The skewness of economic damage for the 10% of cases with the highest impact 
    ## by each weather event type.
    "SKEWNESS_HIGH" = .SD[BIN_GROUP_PER_EVENT_TYPE == "(90% - 100%]" , round(skewness(ECONOMIC_DAMAGE), 4)]
  ),
  by = "EVENT_TYPE"
  ][
    ## The average economic damage is used to order the rows of the table
    ## from the most harmful weather event type to the least.
    order(-AVRG),
    ## Create a variable with the rank of the harmness of each weather event type.
    RANK := 1:length(EVENT_TYPE)
    ][
      ,
      ## Reorder the variables at the table.
      list(
        RANK, EVENT_TYPE, N, AVRG, SKEWNESS, N_LOW, AVRG_LOW, SKEWNESS_LOW, N_HIGH, AVRG_HIGH, SKEWNESS_HIGH
      )
      ]

```

The results of the table with the summary 
for the harm on economy with respect to economic damage
by each weather event type that was created in this section 
were presented at the subsection 
[10.2.4 Most harmful event types with respect to economic damage
](#ind-10-2-4--Most-harmful-weather-event-types-with-respect-to-economic-damage)
of the chapter [10 RESULTS](#ind-10--RESULTS).  

The table with the summary for the harm on economy 
with respect to economic damage by each weather event type 
was exported (as an R file), in the folder of the working directory: 

* *outputs --> harm_on_economy --> results* 
  
with filename:  

* *summary______harm_on_economy______economic_damage.R*
  
```{r exprot_the_summary_for_the_harm_on_economy_with_respect_to_economic_damage}

# Supply the filepath at which the table with the summary
# for the harm on economy will be exported.
filepath_____summary_____harm_on_economy______economic_damage <-
  file.path(
    directory_tree_____outputs[[
      "filepath_____outputs_____harm_on_economy_____results"
    ]],
    "summary_____harm_on_economy______economic_damage.R"
  )

# Export the table with the summary for the harm on economy
# with respect to economic damage.
saveRDS(
  object = summary_____harm_on_economy______economic_damage,
  file = filepath_____summary_____harm_on_economy______economic_damage
)

```

The main reason for exporting the file with the summary 
for the harm on economy with respect to crop damage by each weather event type 
was to supply a checkpoint for any attempts to reproduce the analysis.  

<br>  

<font size="1">[back to start of this subsection](#ind-9-3-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 9.3.4 Visualize the results of the summary for the harm on economy with respect to economic damage by each weather event type {#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type}  

From the table with the summary for the harm on economy 
by each weather event type with respect to economic damage 
the **Multiplot 2.3** was created to present an overview of the results 
for the three different aspects that were examined for this perspective.  

Four elementary plots were 
[created](#ind-9-3-4-1--Create-the-components-of-Multiplot-2-3):  

* [9.3.4.1.1 Create The Plot 2.3.1](#ind-9-3-4-1-1--Create-The-Plot-2-3-1)  
  * Displays the overall average economic damage 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero economic damage.  
* [9.3.4.1.2 Create The Plot 2.3.2](#ind-9-3-4-1-2--Create-The-Plot-2-3-2)  
  * Displays the average economic damage 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero economic damage.  
* [9.3.4.1.3 Create The Plot 2.3.3](#ind-9-3-4-1-3--Create-The-Plot-2-3-3)  
  * Displays the average economic damage 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero economic damage.  
* [9.3.4.1.4 Create The Plot 2.3.4](#ind-9-3-4-1-4--Create-The-Plot-2-3-4)  
  * Displays a comparison for each weather event type, 
  of the average economic damage for the 90% of its observations 
  with the lowest impact versus the average economic damage 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted 
  in non-zero economic damage.  

which were then [combined](#ind-9-3-4-2--Compose-the-Multiplot-2-3) 
in order to obtain the **Multiplot 2.3**.

It constitutes the *PART 2* of the *Figure 2* 
that displays the overview of the harm on economy 
by each weather event type.  

*(Note that neither the Multiplot 2.3 nor the elementary plots that it contains 
were presented in this section due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS), 
where the Figure 2 was presented, 
of which the Multiplot 2.3 constitutes the PART 3.)

<br>  

<font size="1">[back to start of this subsection](#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

#### 9.3.4.1 Create the components of Multiplot 2.3 {#ind-9-3-4-1--Create-the-components-of-Multiplot-2-3}  

Creates four elementary plots to visualize the results for the aspects 
that were examined for the harm on economy with respect to economic damage 
by each weather event type.  

* [9.3.4.1.1 Create The Plot 2.3.1](#ind-9-3-4-1-1--Create-The-Plot-2-3-1)  
  * Displays the overall average economic damage 
  caused by each weather event type based 
  on all the cases of weather events 
  that resulted in non-zero economic damage.  
* [9.3.4.1.2 Create The Plot 2.3.2](#ind-9-3-4-1-2--Create-The-Plot-2-3-2)  
  * Displays the average economic damage 
  caused by each weather event type based on 90% of weather events 
  with the lowest impact (for each weather event type) 
  that resulted in non-zero economic damage.  
* [9.3.4.1.3 Create The Plot 2.3.3](#ind-9-3-4-1-3--Create-The-Plot-2-3-3)  
  * Displays the average economic damage 
  caused by each weather event type based on 10% of weather events 
  with the highest impact (for each weather event type) 
  that resulted in non-zero economic damage.  
* [9.3.4.1.4 Create The Plot 2.3.4](#ind-9-3-4-1-4--Create-The-Plot-2-3-4)  
  * Displays a comparison for each weather event type, 
  of the average economic damage for the 90% of its observations 
  with the lowest impact versus the average economic damage 
  for the 10% of its observations with the highest impact 
  based only on the weather events that resulted 
  in non-zero economic damage.  

<br>  

<font size="1">[back to start of this subsubsection](#ind-9-3-4-1--Create-the-components-of-Multiplot-2-3)</font>
<font size="1">[back to start of this subsection](#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.3.4.1.1 Create The Plot 2.3.1** {#ind-9-3-4-1-1--Create-The-Plot-2-3-1}

The *Plot 2.3.1* displays 
**the overall average economic damage** 
caused by each weather event type taking into account 
all and only the observation that resulted in non-zero economic damage. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average economic damage** they caused.  

The skewness of the economic damage 
for the observations of each weather event type
(based on which the overall economic damage was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_3_1}

# Create the Elementary Plot 2.3.1 that displays 
# the overall average economic damage 
# by each weather event type for all cases. 
elementary_plot_2_3_1 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______economic_damage,
    mapping = aes(
      x = AVRG,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to make them displayed alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a square shaped point to the position that corresponds to 
  ## the average economic damage caused by each weather event type, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(color = SKEWNESS),
    shape = 15, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average economic damage.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG, 
      group = EVENT_TYPE, 
      color = SKEWNESS
    )
    ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## economic damage it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2.5
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average economic damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.3 will be composed from the four elementary plots. 
    limits = c(-5, 170), 
    midpoint = 70, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels.  
  labs(
    title = "Plot 2.3.1", 
    subtitle = "Aspect: Overall",
    x = "Average Number of Economic Damage\n",
    y = "Weather Event Types \n"
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-3-4-1-1--Create-The-Plot-2-3-1)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-3-4-1--Create-the-components-of-Multiplot-2-3)</font>
<font size="1">[back to start of this subsection](#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.3.4.1.2 Create The Plot 2.3.2** {#ind-9-3-4-1-2--Create-The-Plot-2-3-2}

The *Elementary Plot 2.3.2* displays 
**the average economic damage for the 90% of cases with the lowest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero economic damage. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average economic damage** they caused.  
(so it is NOT based on the average economic damage 
caused by the 90% of cases with the lowest impact of each weather event type).  

The skewness of the economic damage 
for the observations of each weather event type
(based on which the average economic damage for the 90% of cases 
with the lowest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_3_2}

# Create the Elementary Plot 2.3.2 that displays 
# the average economic damage by each weather event type 
# for the 90% of its cases with the lowest impact.
elementary_plot_2_3_2 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______economic_damage,
    mapping = aes(
      x = AVRG_LOW,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a circle shaped point to the position that corresponds to 
  ## the average economic damage caused by each weather event type
  ## for the 90% of its cases with the lowest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_LOW
    ), 
    size = 3.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average economic damage 
  ## for the 90% of its cases with the lowest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_LOW, 
      group = EVENT_TYPE, 
      color = SKEWNESS_LOW
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## economic damage it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ), 
    size = 2
    ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average economic damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.3 will be composed from the four elementary plots.
    limits = c(-5, 170), 
    midpoint = 70, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
    ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 2.3.2",
    subtitle = "Aspect: 90% of cases with the lowest impact",
    x = paste0(
      "Average Number of Economic Damage for the 90% ", "\n",
      "of Observations with the Lowest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-3-4-1-2--Create-The-Plot-2-3-2)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-3-4-1--Create-the-components-of-Multiplot-2-3)</font>
<font size="1">[back to start of this subsection](#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.3.4.1.3 Create The Plot 2.3.3** {#ind-9-3-4-1-3--Create-The-Plot-2-3-3}

The *Plot 2.3.3* displays 
**the average economic damage for the 10% of cases with the highest impact** 
caused by each weather event type 
from all the observation that resulted in non-zero economic damage. 

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average economic damage** they caused.  
(so it is NOT based on the average economic damage 
caused by the 10% of cases with the highest impact of each weather event type).  

The skewness of the economic damage 
for the observations of each weather event type
(based on which the average economic damage for the 10% of cases 
with the highest impact was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_3_3}

# Create the Elementary Plot 2.3.3 that displays 
# the average economic damage by each weather event type 
# for the 10% of its cases with the highest impact.
elementary_plot_2_3_3 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______economic_damage,
    mapping = aes(
      x = AVRG_HIGH,
      ### Reverse the order of the factors for the EVENT_TYPE variable 
      ### to display them alphabetically from top to bottom.
      y = factor(
        x = EVENT_TYPE, 
        levels = rev(x = levels(x = EVENT_TYPE)
        )
      ) 
    )
  ) +
  ## Draw a diamond shaped point to the position that corresponds to 
  ## the average economic damage caused by each weather event type
  ## for the 10% of its cases with the highest impact, 
  ## of which the color indicates the skewness of observations 
  ## based on which each average was computed.
  geom_point(
    mapping = aes(
      color = SKEWNESS_HIGH
    ), 
    shape = 18, 
    size = 4.5
  ) +
  ## Draw a line that visually associates each weather event type 
  ## with its respective average economic damage 
  ## for the 10% of its cases with the highest impact.
  geom_linerange(
    mapping = aes(
      xmin = 0, 
      xmax = AVRG_HIGH, 
      group = EVENT_TYPE, 
      color = SKEWNESS_HIGH
    )
  ) +
  ## Draw a number that indicates the rank assigned to each weather event type 
  ## (from the most harmful to the least) based on the overall average number
  ## economic damage it caused inside the square point 
  ## that displays the average.
  geom_text(
    mapping = aes(
      label = RANK
    ),
    size = 2
  ) +
  ## Adjust the scale for the color of each point.
  scale_color_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average economic damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.3 will be composed from the four elementary plots.
    limits = c(-5, 170), 
    midpoint = 70, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
  ) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 2.3.3",
    subtitle ="Aspect: 10% of cases with the highest impact",
    x = paste0(
      "Average Number of Economic Damage for the 10% ", "\n", 
      "of Observations with the Highest Impact" 
    )
  ) +
  ## Select a theme.
  theme_linedraw() + 
  ## Customize the selected theme.
  theme(
    ### Remove the legend.
    legend.position = "none",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    ),
    ### Remove the text, ticks and title of the y axis 
    axis.text.y = element_blank(),
    axis.ticks.y = element_blank(),
    axis.title.y = element_blank()
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-3-4-1-3--Create-The-Plot-2-3-3)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-3-4-1--Create-the-components-of-Multiplot-2-3)</font>
<font size="1">[back to start of this subsection](#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

##### **9.3.4.1.4 Create The Plot 2.3.4** {#ind-9-3-4-1-4--Create-The-Plot-2-3-4}

The *Plot 2.3.4* displays 
a compact overview of all three aspect that were examined 
for the harm on economy with respect to economic damage.  

For each weather event type, the comparison was visualized for 
**the average economic damage for the 90% of cases with the lowest impact** 
versus
**the average economic damage for the 10% of cases with the highest impact**.

The weather event types were matched with a number 
that represents the rank which was assigned to each of them 
from the most harmful to the least with respect to economy, 
based on the **overall average economic damage** they caused.  

The skewness of the economic damage 
for the observations of each weather event type
(based on which the overall economic damage was computed) 
had been encoded in the color of the bar associated with each of them.  

```{r create_the_plot_2_3_4}

# Create the Elementary Plot 2.3.4 that displays 
# by each weather event type the comparison of 
# the average economic damage 
# for the 90% of cases with the lowest impact
# versus the average economic damage 
# for the 10% of cases with the highest impact.
elementary_plot_2_3_4 <-
  ## Supply the constant arguments for the aesthetics of all included geoms.
  ggplot(
    data = summary_____harm_on_economy______economic_damage,
    mapping = aes(
      x = AVRG_HIGH, 
      y = AVRG_LOW
    )
  ) +
  geom_point(
    mapping = aes(
      fill = SKEWNESS
    ), 
    shape = 21
  ) +
  ## Draw a label with a number that indicates the rank assigned 
  ## to each weather event type (from the most harmful to the least) 
  ## based on the overall average economic damage it caused.
  geom_label_repel(
    mapping = aes(
      label = RANK, 
      fill = SKEWNESS
    ),
    size = 2.5
  ) +
  ## Adjust the scale for the fill of each label.
  scale_fill_gradient2(
    ### Choose such limits and midpoint for the colorbar of the legend
    ### that they can be used unchanged to correctly display 
    ### the skewness of the observations based on which 
    ### the average economic damage for all three aspects: 
    ###   1. overall
    ###   2. 90% of cases with the lowest impact 
    ###   3. 10% of cases with the highest impact
    ### was computed. 
    ### This will allow to include only one common legend when the 
    ### Multiplot 2.3 will be composed from the four elementary plots.
    limits = c(-5, 170), 
    midpoint = 70, 
    low = "lightgreen", 
    mid = "orange", 
    high = "purple"
    ) +
  ## Set proper limits to the plot.
    xlim(c(-0.5e9, 8.5e9)) +
    ylim(c(-1e7, 9.5e7)) +
  ## Supply descriptive labels. 
  labs(
    title = "Plot 2.3.4",
    subtitle = paste0(
      "Comparison of the average economic damage ", 
      "for the 90% of observations with the lowest impact ", 
      "versus the average economic damage ", 
      "for the 10% of observations with highest impact. "
    ),
    x = paste0(
      "Average Number of Economic Damage by each Weather Event Type ", 
      "for the 10% of its Observations with the Highest Impact"
    ),
    y = paste0(
      "Average Number of Economic Damage by each Weather Event Type ", "\n", 
      "for the 90% of its Observations with the Lowest Impact."
    ),
    ### Add a descriptive label for the legend.
    fill = paste0(
      "The color indicates the skewness ",
      "of economic damage for the each weather event type. ",
      "(the color scale is unique for all four plots of PART 3) "
    )
  ) +
  ## Select a theme.
  theme_linedraw() +
  ## Customize the selected theme.
  theme(
    ### Adjust the legend.
    legend.position = "bottom",
    legend.direction = "horizontal",
    ### Adjust the title.
    plot.title = element_text(
      size = 12,
      face = "bold"
    ),
    ### Adjust the subtitle.
    plot.subtitle = element_text(
      size = 10
    )
  )

```

<br>  

<font size="1">[back to start of this subsubsubsection](#ind-9-3-4-1-4--Create-The-Plot-2-3-4)</font>  
<font size="1">[back to start of this subsubsection](#ind-9-3-4-1--Create-the-components-of-Multiplot-2-3)</font>
<font size="1">[back to start of this subsection](#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  

#### 9.3.4.2 Compose the Multiplot 2.3 {#ind-9-3-4-2--Compose-the-Multiplot-2-3}  

The four elementary plots that were created from 
the results of the summary for the harm on economy 
with respect to economic damage by each weather event type, 
were combined to construct a single multiplot 
that displays the complete picture for this perspective. 

```{r compose_the_multiplot_2_3}

# Create a multiplot that displays the overview of the summary 
# for the harm on economy with respect to economic damage
# by each weather event type.
multiplot_2_3 <- arrangeGrob(
  grobs = list(
      
    # Title
    textGrob(
      label = paste0(
        "\n",
        "PART 3: Harm on economy by each weather event type ", 
        "with the respect to economic damage ", "\n", 
        "based on the cases of weather events ", 
        "that resulted in non-zero economic damage.", "\n", 
        "\n"
      ),
       gp=gpar(
         fontsize = 16, 
         fontface = "bold"
       )
    ),
    
    # Subtitle
    textGrob(
      label = paste0(
          "\n", 
          "The results include only the weather event types, ", 
          "for which at least 10 observations ", 
          "that resulted in non-zero economic damage were available. ", "\n",
          "The number associated with each weather event type ", 
          "represents the rank (from the most harmful to the least) ", 
          "which was assigned based on the overall average economic damage.", "\n",
          "Because for most of the weather event types ", 
          "high positive skewness was observed for the economic damage, ",
          "the average of the 90% of cases with lowest impact ", "\n",
          "and the 10% of cases with highest impact were reported ", 
          "to provide a more representative picture of their consequences.","\n",
          "\n"
      ),
       gp=gpar(
         fontsize = 14, 
         fontface = "bold"
       )
    ),
    
    # Plot 2.3.1
    # Elementary plot for the average economic damage 
    # by each weather event type for all cases.
    elementary_plot_2_3_1,
    
    # ELEMENTARY PLOT 1.3.2
    # Elementary plot for the average economic damage 
    # by each weather event type for 90% of cases with the lowest impact.
    elementary_plot_2_3_2,
    
    # ELEMENTARY PLOT 1.3.3
    # Elementary plot for the average economic damage 
    # by each weather event type for 10% of cases with the highest impact.
    elementary_plot_2_3_3,
    
    # ELEMENTARY PLOT 1.3.4
    # Elementary Plot 2.3.4 for the comparison of 
    # the average economic damage 
    # for the 90% of cases with the lowest impact versus 
    # the 10% of cases with the highest impact.
    elementary_plot_2_3_4
  ),
  # Set the layout for this elementary plots
  layout_matrix = 
    matrix(
      c(1,1,1,1,1,1,1,1,1,
        2,2,2,2,2,2,2,2,2,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        3,3,3,3,3,4,4,5,5,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6,
        NA,6,6,6,6,6,6,6,6
      ),
      byrow = TRUE, 
      nrow = 13
    )
)

```

*(Note that the Multiplot 2.3 was NOT presented in this section 
due to the restrictions imposed by the assignment 
to include in the report at least 1 but no more than 3 figures. 
It can be examined at the subsection 
[10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy) 
of the chapter [10 RESULTS](#ind-10--RESULTS).)*, 
were the Figure 2 was presented, 
of which the Multiplot 2.3 constitutes the PART 3.)*  

<br>  

<font size="1">[back to start of this subsubsection](#ind-9-3-4-2--Compose-the-Multiplot-2-3)</font>
<font size="1">[back to start of this subsection](#ind-9-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)</font>  
<font size="1">[back to start of this section](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)</font>  
<font size="1">[back to start of this chapter](#ind-9--HARM-ON-ECONOMY)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 10 RESULTS {#ind-10--RESULTS}  
***  

The unprocessed raw data from the file 
[repdata_data_StormData.csv.bz2
](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2)
that contains observations from 
[Storm Events Dataset](#ind-4--STORM-EVENTS-DATASET) 
that was created and made publicly available 
by the U.S. National Oceanic and Atmospheric Administration (NOAA), 
was processed to obtain 
[the table with processed data](#ind-7--PROCESSED-DATA) 
(through a processing pipeline which was described in detail at the chapter 
[6 DATA PROCESSING](#ind-6--DATA-PROCESSING)).

Based on the table with the processed data 
which contains valid observations for weather events 
that happened at United States in the period from 2001 to 2011 
and caused harm either to population health (resulted in fatalities or injuries) 
or to economy (resulted in property or crop damage) 
the results of this analysis were produced 
for the two questions of interest set by the assignment 
(for which the guidelines can be found at the section 
[2.1 About The Assignment](#ind-2-1--About-The-Assignment), 
that were presented in the following sections of this chapter:  

* [10.1 Question 1: Across the United States, 
which types of events (as indicated in the EVTYPE variable) 
are most harmful with respect to population health?
](#results-harm-on-population-health)  
* [10.2 Question 2 : Across the United States, 
which types of events have the greatest economic consequences?
](#ind-10-2--results-harm-on-economy)  

<br>  

<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

## 10.1 Question 1: Across the United States, which types of events (as indicated in the EVTYPE variable) are most harmful with respect to population health? {#ind-10-1--results-harm-on-population-health}  

In an attempt to identify the most harmful weather event types 
with respect to population health three different perspectives were examined 
(for which the analysis can be examined at the chapter 
[8 HARM ON POPULATION HEALTH](#ind-8--HARM-ON-POPULATION-HEALTH)).  

A short overview of the results was presented at the subsection:  

* [10.1.1 Overview of results for the harm on population health
](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health)  

Further details, at each of the three perspectives, 
are available at the following subsections:  

* [10.1.2 Most harmful event types with respect to fatalities
  ](#ind-10-1-2--Most-harmful-weather-event-types-with-respect-to-fatalities) 
* [10.1.3 Most harmful event types with respect to injuries
  ](#ind-10-1-3--Most-harmful-weather-event-types-with-respect-to-injuries) 
* [10.1.4 Most harmful event types with respect to casualties
  ](#ind-10-1-4--Most-harmful-weather-event-types-with-respect-to-casualties) 


It is highlighted that the results 
must be evaluated under the following context in order to be meaningful: 

* __The results for any perspective (fatalities, injuries or casualties) 
refer specifically to the harm that was caused 
when harm with respect to that particular perspective was observed.__

(*In other words the results do not refer 
to the harm caused for a perspective of interest 
when a weather phenomenon of an included weather event type occurred 
independently of whether or not it caused harm 
with respect to the perspective that was examined.*)  

In addition, due to the fact that it was decided 
to include only the weather event types 
for which there were available at least 10 observations 
that corresponded to weather events that resulted in non-zero harm 
with respect to each perspective examined, 
the composition of weather event types 
for the three perspectives is different.  

For each perspective, it was consider appropriate to present 
three aspects in order to supply an insightful picture of the 
consequences caused by each weather event type: 

* the overall average harm  
* the average harm of 90% of cases with lower impact  
* the average harm of 10% of cases with higher impact  

The number of observations as well as their skewness 
were summarized by each weather event types for every aspect 
and presented along with the corresponding average. 

Although the overall average harm was used as the primary criterion 
to determine the most harmful events, it should be examined along with the 
average harm for the two other subgroups, especially when the overall skewness 
for a weather event type of interest is high.  

<br>  

<font size="1">[back to start of this section](#ind-10-1--results-harm-on-population-health)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 10.1.1 Overview of results for the harm on population health {#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health}  

In order to display an overview of the results 
for the harm on population health by each weather event type 
the Figure 1 was created. 

```{r compose_figure_1}

# Compose the Figure 1, by combining
#   - Multiplot 1.1
#   - Multiplot 1.2
#   - Multiplot 1.3
figure_1 <- arrangeGrob(
  grobs = list(
      ## TITLE
      textGrob(
          label = paste0(
              "FIGURE 1: SUMMARY OF HARM ON POPULATION HEALTH BY EACH WEATHER EVENT TYPE."
          ),
          gp=gpar(
              fontsize = 20, 
              fontface = "bold"
          )
      ),
      ## PART 1.
      multiplot_1_1,
      ## PART 2
      multiplot_1_2,
      ## PART 3
      multiplot_1_3,
      ## CAPTION
      textGrob(
          label = paste0(
              "\n",
              "All details on the source data, the data processing procedure and other ",
              "aspects of the analysis from which these results were obtained ", "\n",
              "are available at the associated github repository: ",
              "https://github.com/jzstats/Reproducible-Research--2nd-Assignment",
            "\n"
        ),
        gp=gpar(
            fontsize = 14
        )
    )
  ),
  layout_matrix = matrix(
      data = c(1,
               2,
               2,
               2,
               2,
               2,
               2,
               NA,
               3,
               3,
               3,
               3,
               3,
               3,
               NA,
               4,
               4,
               4,
               4,
               4,
               4,
               5
      ),
      byrow = TRUE,
      ncol = 1
  )
)

```

The *Figure 2* consists of three parts, 
one for each of the three perspective examined:  

* **PART 1**  
  * Contains the *Multiplot 1.1* which was constructed at the subsection 
  [8.1.4 Visualize the results of the summary for the harm on population health with respect to fatalities by each weather event type
  ](#ind-8-1-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type) 
  and displays the results for the harm on population health 
  with respect to fatalities by each weather event type 
  for all the aspects that were examined. 
  It consists of four plots:  
    * Plot 1.1.1  
      * Displays the overall average number of fatalities 
      caused by each weather event type 
      based on all the cases of weather events 
      that resulted in non-zero fatalities.  
    * Plot 1.1.2  
      * Displays the average number of fatalities 
      caused by each weather event type 
      based on 90% of weather events with the lowest impact 
      (for each weather event type)
      that resulted in non-zero fatalities.  
    * Plot 1.1.3  
      * Displays the average number of fatalities 
      caused by each weather event type 
      based on 10% of weather events with the highest impact 
      (for each weather event type)
      that resulted in non-zero fatalities.  
    * Plot 1.1.4  
      * Displays a comparison for each weather event type, 
      of the average number of fatalities 
      for the 90% of its observations with the lowest impact 
      versus the average number of fatalities 
      for the 10% of its observations with the highest impact 
      based only on the weather events 
      that resulted in non-zero fatalities.  
* **PART 2**  
  * Contains the *Multiplot 1.2* which was constructed at the subsection 
  [8.2.4 Visualize the results of the summary for the harm on population health with respect to injuries by each weather event type
  ](#ind-8-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type) 
  and displays the results for the harm on population health 
  with respect to injuries by each weather event type 
  for all the aspects that were examined. 
  It consists of four plots:  
    * Plot 1.2.1  
      * Displays the overall average number of injuries 
      caused by each weather event type based 
      on all the cases of weather events 
      that resulted in non-zero injuries.  
    * Plot 1.2.2  
      * Displays the average number of injuries 
      caused by each weather event type based on 90% of weather events 
      with the lowest impact (for each weather event type) 
      that resulted in non-zero injuries.  
    * Plot 1.2.3  
      * Displays the average number of injuries 
      caused by each weather event type based on 10% of weather events 
      with the highest impact (for each weather event type) 
      that resulted in non-zero injuries.  
    * Create The Plot 1.2.4
      * Displays a comparison for each weather event type, 
      of the average number of injuries for the 90% of its observations 
      with the lowest impact versus the average number of injuries 
      for the 10% of its observations with the highest impact 
      based only on the weather events that resulted in non-zero injuries.  
* **PART 3**  
  * Contains the *Multiplot 1.3* which was constructed at the subsection 
  [8.3.4 Visualize the results of the summary for the harm on population health with respect to casualties by each weather event type
  ](#ind-8-3-4--Visualize-the-results-of-the-summary-for-the-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type) 
  and displays the results for the harm on population health 
  with respect to casualties by each weather event type 
  for all the aspects that were examined. 
  It consists of four plots:  
    * Plot 1.3.1  
      * Displays the overall average number of casualties 
      caused by each weather event type based 
      on all the cases of weather events 
      that resulted in non-zero casualties.  
    * Plot 1.3.2  
      * Displays the average number of casualties 
      caused by each weather event type based on 90% of weather events 
      with the lowest impact (for each weather event type) 
      that resulted in non-zero casualties.  
    * Plot 1.3.3  
      * Displays the average number of casualties 
      caused by each weather event type based on 10% of weather events 
      with the highest impact (for each weather event type) 
      that resulted in non-zero casualties.  
    * Plot 1.3.4
      * Displays a comparison for each weather event type, 
      of the average number of casualties for the 90% of its observations 
      with the lowest impact versus the average number of casualties 
      for the 10% of its observations with the highest impact 
      based only on the weather events that resulted in non-zero casualties.  
      
```{r display_figure_1, fig.width=17, fig.height=45}

# Display the Figure 1 
grid.draw(figure_1)

```

The *Figure 1* was exported (as a png file), 
in the folder of the working directory: 

* *outputs --> harm_on_population_health --> figures* 
  
with filename:  

* *figure_1.png*

```{r export_figure_1}

# Export Figure 1
ggsave(
  filename = "figure_1.png",
  plot = figure_1,
  device = "png",
  path = directory_tree_____outputs[[
    "filepath_____outputs_____harm_on_population_health_____figures"
    ]],
  width = 15,
  height = 50,
  limitsize = FALSE
)

```

<br>  

<font size="1">[back to start of this subsection](#ind-10-1-1--Overview-of-results-for-the-harm-on-population-health)</font>  
<font size="1">[back to start of this section](#ind-10-1--results-harm-on-population-health)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 10.1.2 Most harmful event types with respect to fatalities {#ind-10-1-2--Most-harmful-weather-event-types-with-respect-to-fatalities}  

According to the summary for the harm on population health 
with respect to fatalities by each weather event type 
(that were obtained at the section 
[8.1 Harm On Population Health With Respect To Fatalities By Each Weather Event Type
](#ind-8-1--Harm-On-Population-Health-With-Respect-To-Fatalities-By-Each-Weather-Event-Type)) 
out of the 26 included weather event types 
(for each of which at least 10 observations 
that resulted in non-zero fatalities 
at United States in the period from 2001 to 2011 were available) 
there were 7 of them that stand out:  

  1. When a weather event of type **TORNADO** resulted in fatalities, 
  it caused about 3.4 fatalities on average 
  (based on 339 observations 
  that had extreme positive skewness equal to 13.5732). 
  For 9 out of 10 times of such cases, 
  an average of 1.88 fatalities was observed 
  (based on the 90% of cases with the lower impact 
  for which 305 observations were available, 
  that had moderate positive skewness equal to 1.812), 
  while for the remaining 1 out of 10 times 
  it caused around 17 fatalities on average 
  (based on the 10% of cases with the higher impact 
  for which 34 observations were available, 
  that had high positive skewness equal to 4.9099).   
  2. When a weather event of type **DEBRIS FLOW** resulted in fatalities, 
  it caused about 3.36 fatalities on average 
  (based on 11 observations 
  that had moderate positive skewness equal to 1.6608). 
  For 9 out of 10 times of such cases, 
  an average of 1.44 fatalities was observed 
  (based on the 90% of cases with the lower impact 
  for which only 9 observations were available, 
  that had moderate positive skewness equal to 2.0673), 
  while for the remaining 1 out of 10 times 
  it caused around 12 fatalities on average 
  (based on the 10% of cases with the higher impact 
  for which only 2 observations were available, 
  that had low positive skewness equal to 0).  
  3. When a weather event of type **HURRICANE/TYPHOON** resulted in fatalities, 
  it caused about 2.96 fatalities on average 
  (based on 23 observations 
  that had moderate positive skewness equal to 2.1981). 
  For 9 out of 10 times of such cases, 
  an average of 1.95 fatalities was observed 
  (based on the 90% of cases with the lower impact 
  for which 20 observations were available, 
  that had moderate positive skewness equal to 1.6605), 
  while for the remaining 1 out of 10 times 
  it caused around 9.67 fatalities on average 
  (based on the 10% of cases with the higher impact 
  for which only 3 observations were available, 
  that had low positive skewness equal to 0.7071).  
  4. When a weather event of type **EXCESSIVE HEAT** resulted in fatalities, 
  it caused about 2.89 fatalities on average 
  (based on 296 observations 
  that had high positive skewness equal to 5.4405). 
  For 9 out of 10 times of such cases, 
  an average of 1.51 fatalities was observed 
  (based on the 90% of cases with the lower impact 
  for which 266 observations were available, 
  that had moderate positive skewness equal to 1.9625), 
  while for the remaining 1 out of 10 times 
  it caused around 15.17 fatalities on average 
  (based on the 10% of cases with the higher impact 
  for which 30 observations were available, 
  that had moderate positive skewness equal to 1.6149).  
  5. When a weather event of type **WILDFIRE** resulted in fatalities, 
  it caused about 2.61 fatalities on average 
  (based on 31 observations 
  that had moderate positive skewness equal to 2.629). 
  For 9 out of 10 times of such cases, 
  an average of 1.59 fatalities was observed 
  (based on the 90% of cases with the lower impact 
  for which 27 observations were available, 
  that had moderate positive skewness equal to 1.2688), 
  while for the remaining 1 out of 10 times 
  it caused around 9.5 fatalities on average 
  (based on the 10% of cases with the higher impact 
  for which only 4 observations were available, 
  that had low negative skewness equal to -0.278).  
  6. When a weather event of type **TROPICAL STORM** resulted in fatalities, 
  it caused about 2.5 fatalities on average 
  (based on 20 observations 
  that had high positive skewness equal to 3.8434). 
  For 9 out of 10 times of such cases, 
  an average of 1.33 fatalities was observed 
  (based on the 90% of cases with the lower impact 
  for which 18 observations were available, 
  that had moderate positive skewness equal to 2.3814), 
  while for the remaining 1 out of 10 times 
  it caused around 13 fatalities on average 
  (based on the 10% of cases with the higher impact 
  for which only 2 observations were available, 
  that had low positive skewness equal to 0).  
  7. When a weather event of type **HEAT** resulted in fatalities, 
  it caused about 1.81 fatalities on average 
  (based on 127 observations 
  that had high positive skewness equal to 4.1476). 
  For 9 out of 10 times of such cases, 
  an average of 1.26 fatalities was observed 
  (based on the 90% of cases with the lower impact 
  for which 114 observations were available, 
  that had moderate positive skewness equal to 1.912), 
  while for the remaining 1 out of 10 times 
  it caused around 6.62 fatalities on average 
  (based on the 10% of cases with the higher impact 
  for which 13 observations were available, 
  that had moderate positive skewness equal to 1.4602).  

```{r table_with_results_of_harm_on_population_health_with_respect_to_fatalities}

# Create an interactive table to present present the results 
# for the harm on population health with respect to fatalities.  
datatable(
  data = summary_____harm_on_population_health______fatalities[order(RANK)],
  caption = paste0(
    "Table 10.1.2-1: ",
    "Harm on Population Health with respect to Fatalities ", 
    "by Each Weather Event Type"
  ),
  colnames = c(
    "RANK", 
    "WEATHER EVENT TYPE", 
    "NUMBER OF ALL AVAILABLE OBSERVATIONS", 
    "AVERAGE NUMBER OF FATALITIES FOR ALL AVAILABLE CASES", 
    "SKEWNESS IN FATALITIES FOR ALL AVAILABLE CASES", 
    "NUMBER OF OBSERVATIONS FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "AVERAGE NUMBER OF FATALITIES FOR THE 90% OF CASES WITH LOWEST IMPACT",
    "SKEWNESS IN FATALITIES FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "NUMBER OF OBSERVATIONS FOR THE 10% OF CASES WITH HIGHEST IMPACT", 
    "AVERAGE NUMBER OF FATALITIES FOR THE 10% OF CASES WITH HIGHEST IMPACT",
    "SKEWNESS IN FATALITIES FOR THE 10% OF CASES WITH HIGHEST IMPACT"
  ),
  rownames = FALSE,
  escape = TRUE,
  options=list(
    pageLength = nrow(summary_____harm_on_population_health______fatalities),
    dom = "t",
    initComplete = JS(
      "function(settings, json) {",
      "$(this.api().table().header()).css({'font-size': '50%'});",
      "}"
    )
  )
) %>% 
  formatStyle(columns = c(1, 3:11), fontSize = '70%')%>% 
  formatStyle(columns = 2, fontSize = '35%')

```

<br>  

<font size="1">[back to start of this subsection](#ind-10-1-2--Most-harmful-weather-event-types-with-respect-to-fatalities)</font>  
<font size="1">[back to start of this section](#ind-10-1--results-harm-on-population-health)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 10.1.3 Most harmful event types with respect to injuries {#ind-10-1-3--Most-harmful-weather-event-types-with-respect-to-injuries}  

According to the summary for the harm on population health 
with respect to injuries by each weather event type 
(that were obtained at the section 
[8.2 Harm On Population Health With Respect To Injuries By Each Weather Event Type
](#ind-8-2--Harm-On-Population-Health-With-Respect-To-Injuries-By-Each-Weather-Event-Type)) 
out of the 27 included weather event types 
(for each of which at least 10 observations 
that resulted in non-zero injuries 
at United States in the period from 2001 to 2011 were available) 
there were 3 of them that stand out:  

Specifically : 

  1. When a weather event of type **HURRICANE/TYPHOON** resulted in injuries, 
  it caused about 86.07 injuries on average 
  (based on 15 observations 
  that had moderate positive skewness equal to 2.773). 
  For 9 out of 10 times of such cases, 
  an average of 15 injuries was observed 
  (based on the 90% of cases with the lower impact 
  for which 13 observations were available, 
  that had moderate positive skewness equal to 2.8806), 
  while for the remaining 1 out of 10 times 
  it caused around 548 injuries on average 
  (based on the 10% of cases with the higher impact 
  for which only 2 observations were available, 
  that had low positive skewness equal to 0).  
  2. When a weather event of type **EXCESSIVE HEAT** resulted in injuries, 
  it caused about 37.7 injuries on average 
  (based on 86 observations 
  that had high positive skewness equal to 4.1751). 
  For 9 out of 10 times of such cases, 
  an average of 16.48 injuries was observed 
  (based on the 90% of cases with the lower impact 
  for which 77 observations were available, 
  that had moderate positive skewness equal to 1.2674), 
  while for the remaining 1 out of 10 times 
  it caused around 219.22 injuries on average 
  (based on the 10% of cases with the higher impact 
  for which only 9 observations were available, 
  that had low positive skewness equal to 0.7763).  
  3. When a weather event of type **HEAT** resulted in injuries, 
  it caused about 33.94 injuries on average 
  (based on 36 observations 
  that had moderate positive skewness equal to 2.1619). 
  For 9 out of 10 times of such cases, 
  an average of 13.56 injuries was observed 
  (based on the 90% of cases with the lower impact 
  for which 32 observations were available, 
  that had moderate positive skewness equal to 2.4589), 
  while for the remaining 1 out of 10 times 
  it caused around 197 injuries on average 
  (based on the 10% of cases with the higher impact 
  for which only 4 observations were available, 
  that had moderate negative skewness equal to -1.0869).  


```{r table_with_results_of_harm_on_population_health_with_respect_to_injuries}

# Create an interactive table to present present the results 
# for the harm on population health with respect to injuries.  
datatable(
  data = summary_____harm_on_population_health______injuries[order(RANK)],
  caption = paste0(
    "Table 10.1.3-1: ",
    "Harm on Population Health with respect to Injuries ", 
    "by Each Weather Event Type"
  ),
  colnames = c(
    "RANK", 
    "WEATHER EVENT TYPE", 
    "NUMBER OF ALL AVAILABLE OBSERVATIONS", 
    "AVERAGE NUMBER OF INJURIES FOR ALL AVAILABLE CASES", 
    "SKEWNESS IN INJURIES FOR ALL AVAILABLE CASES", 
    "NUMBER OF OBSERVATIONS FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "AVERAGE NUMBER OF INJURIES FOR THE 90% OF CASES WITH LOWEST IMPACT",
    "SKEWNESS IN INJURIES FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "NUMBER OF OBSERVATIONS FOR THE 10% OF CASES WITH HIGHEST IMPACT", 
    "AVERAGE NUMBER OF INJURIES FOR THE 10% OF CASES WITH HIGHEST IMPACT",
    "SKEWNESS IN INJURIES FOR THE 10% OF CASES WITH HIGHEST IMPACT"
  ),
  rownames = FALSE,
  escape = TRUE,
  options=list(
    pageLength = nrow(summary_____harm_on_population_health______injuries),
    dom = "t",
    initComplete = JS(
      "function(settings, json) {",
      "$(this.api().table().header()).css({'font-size': '50%'});",
      "}"
    )
  )
) %>% 
  formatStyle(columns = c(1, 3:11), fontSize = '70%')%>% 
  formatStyle(columns = 2, fontSize = '35%')


```


<br>  

<font size="1">[back to start of this subsection](#ind-10-1-3--Most-harmful-weather-event-types-with-respect-to-injuries)</font>  
<font size="1">[back to start of this section](#ind-10-1--results-harm-on-population-health)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 10.1.4 Most harmful event types with respect to casualties {#ind-10-1-4--Most-harmful-weather-event-types-with-respect-to-casualties}  

According to the summary for the harm on population health 
with respect to casualties by each weather event type 
(that were obtained at the section 
[8.3 Harm On Population Health With Respect To Casualties By Each Weather Event Type
](#ind-8-3--Harm-On-Population-Health-With-Respect-To-Casualties-By-Each-Weather-Event-Type)) 
out of the 30 included weather event types 
(for each of which at least 10 observations 
that resulted in non-zero casualties 
at United States in the period from 2001 to 2011 were available) 
there were 7 of them that stand out:  

Specifically : 

  1. When a weather event of type **HURRICANE/TYPHOON** resulted in casualties, 
  it caused about 41.18 casualties on average 
  (based on 33 observations 
  that had high positive skewness equal to 4.4573). 
  For 9 out of 10 times of such cases, 
  an average of 3.93 casualties was observed 
  (based on the 90% of cases with the lower impact 
  for which 29 observations were available, 
  that had moderate positive skewness equal to 2.1573), 
  while for the remaining 1 out of 10 times
  it caused around 311.25 casualties on average 
  (based on the 10% of cases with the higher impact 
  for which only 4 observations were available, 
  that had low positive skewness equal to 0.7473).  
  2. When a weather event of type **EXCESSIVE HEAT** resulted in casualties, 
  it caused about 11.71 casualties on average 
  (based on 350 observations 
  that had extreme positive skewness equal to 8.3298). 
  For 9 out of 10 times of such cases, 
  an average of 2.85 casualties was observed 
  (based on the 90% of cases with the lower impact 
  for which 315 observations were available, 
  that had moderate positive skewness equal to 2.7042), 
  while for the remaining 1 out of 10 times 
  it caused around 91.43 casualties on average 
  (based on the 10% of cases with the higher impact 
  for which 35 observations were available, 
  that had moderate positive skewness equal to 2.7186).  
  3. When a weather event of type **TORNADO** resulted in casualties, 
  it caused about 11.67 casualties on average 
  (based on 1327 observations 
  that had extreme positive skewness equal to 17.6038). 
  For 9 out of 10 times of such cases, 
  an average of 4.29 casualties was observed 
  (based on the 90% of cases with the lower impact 
  for which 1194 observations were available, 
  that had moderate positive skewness equal to 1.936),
  while for the remaining 1 out of 10 times 
  it caused around 77.9 casualties on average 
  (based on the 10% of cases with the higher impact 
  for which 133 observations were available,
  that had high positive skewness equal to 6.2215).  
  4. When a weather event of type **DUST STORM** resulted in casualties, 
  it caused about 9.7 casualties on average 
  (based on 23 observations 
  that had moderate positive skewness equal to 1.5025). 
  For 9 out of 10 times of such cases, 
  an average of 6.35 casualties was observed 
  (based on the 90% of cases with the lower impact 
  for which 20 observations were available, 
  that had moderate positive skewness equal to 1.2737), 
  while for the remaining 1 out of 10 times 
  it caused around 32 casualties on average 
  (based on the 10% of cases with the higher impact 
  for which only 3 observations were available, 
  that had low positive skewness equal to 0.4703).  
  5. When a weather event of type **HEAT** resulted in casualties, 
  it caused about 9.43 casualties on average 
  (based on 154 observations 
  that had high positive skewness equal to 5.2894). 
  For 9 out of 10 times of such cases, 
  an average of 1.7 casualties was observed 
  (based on the 90% of cases with the lower impact 
  for which 138 observations were available, 
  that had moderate positive skewness equal to 2.459), 
  while for the remaining 1 out of 10 times 
  it caused around 76.12 casualties on average 
  (based on the 10% of cases with the higher impact 
  for which 16 observations were available, 
  that had low positive skewness equal to 0.9965).  
  6. When a weather event of type **TROPICAL STORM** resulted in casualties,
  it caused about 9.32 casualties on average 
  (based on 34 observations 
  that had high positive skewness equal to 5.3288). 
  For 9 out of 10 times of such cases, 
  an average of 1.9 casualties was observed 
  (based on the 90% of cases with the lower impact 
  for which 30 observations were available, 
  that had moderate positive skewness equal to 1.4887), 
  while for the remaining 1 out of 10 times 
  it caused around 65 casualties on average 
  (based on the 10% of cases with the higher impact 
  for which only 4 observations were available, 
  that had moderate positive skewness equal to 1.1226).  
  7. When a weather event of type **DENSE FOG** resulted in casualties, 
  it caused about 7.6 casualties on average 
  (based on 20 observations 
  that had moderate positive skewness equal to 1.3831). 
  For 9 out of 10 times of such cases, 
  an average of 5.83 casualties was observed 
  (based on the 90% of cases with the lower impact 
  for which 18 observations were available, 
  that had low positive skewness equal to 0.5675), 
  while for the remaining 1 out of 10 times 
  it caused around 23.5 casualties on average 
  (based on the 10% of cases with the higher impact 
  for which only 2 observations were available, 
  that had low positive skewness equal to 0).  

```{r table_with_results_of_harm_on_population_health_with_respect_to_casualties}

# Create an interactive table to present present the results 
# for the harm on population health with respect to casualties.  
datatable(
  data = summary_____harm_on_population_health______casualties[order(RANK)],
  caption = paste0(
    "Table 10.1.4-1: ",
    "Harm on Population Health with respect to Casualties ", 
    "by Each Weather Event Type"
  ),
  colnames = c(
    "RANK", 
    "WEATHER EVENT TYPE", 
    "NUMBER OF ALL AVAILABLE OBSERVATIONS", 
    "AVERAGE NUMBER OF CASUALTIES FOR ALL AVAILABLE CASES", 
    "SKEWNESS IN CASUALTIES FOR ALL AVAILABLE CASES", 
    "NUMBER OF OBSERVATIONS FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "AVERAGE NUMBER OF CASUALTIES FOR THE 90% OF CASES WITH LOWEST IMPACT",
    "SKEWNESS IN CASUALTIES FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "NUMBER OF OBSERVATIONS FOR THE 10% OF CASES WITH HIGHEST IMPACT", 
    "AVERAGE NUMBER OF CASUALTIES FOR THE 10% OF CASES WITH HIGHEST IMPACT",
    "SKEWNESS IN CASUALTIES FOR THE 10% OF CASES WITH HIGHEST IMPACT"
  ),
  rownames = FALSE,
  escape = TRUE,
  options=list(
    pageLength = nrow(summary_____harm_on_population_health______casualties),
    dom = "t",
    initComplete = JS(
      "function(settings, json) {",
      "$(this.api().table().header()).css({'font-size': '50%'});",
      "}"
    )
  )
) %>% 
  formatStyle(columns = c(1, 3:11), fontSize = '70%')%>% 
  formatStyle(columns = 2, fontSize = '35%')

```


<br>  

<font size="1">[back to start of this subsection](#ind-10-1-4--Most-harmful-weather-event-types-with-respect-to-casualties)</font>  
<font size="1">[back to start of this section](#ind-10-1--results-harm-on-population-health)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 10.2 Question 2 : Across the United States, which types of events have the greatest economic consequences? {#ind-10-2--results-harm-on-economy}  

In an attempt to identify the most harmful weather event types 
with respect to economy three different perspectives were examined 
(for which the analysis can be examined at the chapter 
[9 HARM ON ECONOMY](#ind-9--HARM-ON-ECONOMY).  

A short overview of the results was presented at the subsection:  

* [10.2.1 Overview of results for the harm on economy
](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy)  

Further details, at each of the three perspectives, 
are available at the following subsections:  

* [10.2.2 Most harmful event types with respect to property damage
  ](#ind-10-2-2--Most-harmful-weather-event-types-with-respect-to-property-damage)  
* [10.2.3 Most harmful event types with respect to crop damage
  ](#ind-10-2-3--Most-harmful-weather-event-types-with-respect-to-crop-damage)  
* [10.2.4 Most harmful event types with respect to economic damage
  ](#ind-10-2-4--Most-harmful-weather-event-types-with-respect-to-economic-damage)  
 
It is highlighted that the results 
must be evaluated under the following context in order to be meaningful: 

* __The results for a perspective 
(property damage, crop damage or economic damage) 
refer specifically to the harm that was caused 
when harm with respect to that perspective was observed.__

(*In other words the results do not refer 
to the harm caused for a perspective of interest 
when a weather phenomenon of an included weather event type occurred 
independently of whether or not it caused harm 
with respect to the perspective that was examined.*)  

In addition, due to the fact that it was decided 
to include only the weather event types 
for which there were available at least 10 observations 
that corresponded to weather events that resulted in non-zero harm 
with respect to each perspective examined, 
the composition of weather event types 
for the three perspectives is different.  

For each perspective, it was consider appropriate to present 
three aspects in order to supply an insightful picture of the 
consequences caused by each weather event type: 

* the overall average harm  
* the average harm of 90% of cases with lower impact  
* the average harm of 10% of cases with higher impact  

The number of observations as well as their skewness 
were summarized by each weather event types for every aspect 
and presented along with the corresponding average. 

Although the overall average harm was used as the primary criterion 
to determine the most harmful events, it should be examined along with the 
average harm for the two other subgroups, especially when the overall skewness 
for a weather event type of interest is high.  

<br>  

<font size="1">[back to start of this section](#ind-10-2--results-harm-on-economy)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 10.2.1 Overview of results for the harm on economy {#ind-10-2-1--Overview-of-results-for-the-harm-on-economy}  

In order to display an overview of the results 
for the harm on economy by each weather event type 
the Figure 2 was created. 
  
```{r compose_figure_2}

# Compose the Figure 1, by combining
#   - Multiplot 2.1
#   - Multiplot 2.2
#   - Multiplot 2.3
figure_2 <- arrangeGrob(
  grobs = list(
      ## TITLE
      textGrob(
          label = paste0(
              "FIGURE 2: SUMMARY OF HARM ON ECONOMY BY EACH WEATHER EVENT TYPE."
          ),
          gp=gpar(
              fontsize = 20, 
              fontface = "bold"
          )
      ),
      ## PART 1.
      multiplot_2_1,
      ## PART 2
      multiplot_2_2,
      ## PART 3
      multiplot_2_3,
      ## CAPTION
      textGrob(
          label = paste0(
              "\n",
              "All details on the source data, the data processing procedure and other ",
              "aspects of the analysis from which these results were obtained ", "\n",
              "are available at the associated github repository: ",
              "https://github.com/jzstats/Reproducible-Research--2nd-Assignment",
            "\n"
        ),
        gp=gpar(
            fontsize = 14
        )
    )
  ),
  layout_matrix = matrix(
      data = c(1,
               2,
               2,
               2,
               2,
               2,
               2,
               NA,
               3,
               3,
               3,
               3,
               3,
               NA,
               4,
               4,
               4,
               4,
               4,
               4,
               5
      ),
      byrow = TRUE,
      ncol = 1
  )
)

```
  
The *Figure 2* consists of three parts, 
one for each of the three perspective examined:  

* **PART 1**  
  * Contains the *Multiplot 2.1* which was constructed at the subsection 
  [9.2.4 Visualize the results of the summary for the harm on economy with respect to crop damage by each weather event type
  ](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type) 
  and displays the results for the harm on economy 
  with respect to property damage by each weather event type 
  for all the aspects that were examined. 
  It consists of four plots:  
    * The Plot 2.1.1  
      * Displays the overall average property damage 
      caused by each weather event type based 
      on all the cases of weather events 
      that resulted in non-zero property damage.  
    * Plot 2.1.2  
      * Displays the average property damage 
      caused by each weather event type based on 90% of weather events 
      with the lowest impact (for each weather event type) 
      that resulted in non-zero property damage.  
    * Plot 2.1.3  
      * Displays the average property damage 
      caused by each weather event type based on 10% of weather events 
      with the highest impact (for each weather event type) 
      that resulted in non-zero property damage.  
    * Plot 2.1.4  
      * Displays a comparison for each weather event type, 
      of the average property damage for the 90% of its observations 
      with the lowest impact versus the average property damage 
      for the 10% of its observations with the highest impact 
      based only on the weather events that resulted 
      in non-zero property damage.  
* **PART 2**  
  * Contains the *Multiplot 2.2* which was constructed at the subsection 
  [9.2.4 Visualize the results of the summary for the harm on economy with respect to crop damage by each weather event type
  ](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type) 
  and displays the results for the harm on economy 
  with respect to crop damage by each weather event type 
  for all the aspects that were examined.
  It consists of four plots:  
    * Plot 2.2.1  
      * Displays the overall average crop damage 
      caused by each weather event type based 
      on all the cases of weather events 
      that resulted in non-zero crop damage.  
    * Plot 2.2.2  
      * Displays the average crop damage 
      caused by each weather event type based on 90% of weather events 
      with the lowest impact (for each weather event type) 
      that resulted in non-zero crop damage.  
    * Plot 2.2.3  
       * Displays the average crop damage 
      caused by each weather event type based on 10% of weather events 
      with the highest impact (for each weather event type) 
      that resulted in non-zero crop damage.  
    * Plot 2.2.4  
      * Displays a comparison for each weather event type, 
      of the average crop damage for the 90% of its observations 
      with the lowest impact versus the average crop damage 
      for the 10% of its observations with the highest impact 
      based only on the weather events that resulted 
      in non-zero crop damage.  
* **PART 3**  
  * Contains the *Multiplot 2.3* which was constructed at the subsection 
  [9.2.4 Visualize the results of the summary for the harm on economy with respect to crop damage by each weather event type
  ](#ind-9-2-4--Visualize-the-results-of-the-summary-for-the-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type) 
  and displays the results for the harm on economy 
  with respect to economic damage by each weather event type 
  for all the aspects that were examined. 
  It consists of four plots:  
    * Plot 2.3.1  
      * Displays the overall average economic damage 
      caused by each weather event type based 
      on all the cases of weather events 
      that resulted in non-zero economic damage.  
    * Plot 2.3.2  
      * Displays the average economic damage 
      caused by each weather event type based on 90% of weather events 
      with the lowest impact (for each weather event type) 
      that resulted in non-zero economic damage.  
    * Plot 2.3.3  
      * Displays the average economic damage 
      caused by each weather event type based on 10% of weather events 
      with the highest impact (for each weather event type) 
      that resulted in non-zero economic damage.  
    * The Plot 2.3.4  
      * Displays a comparison for each weather event type, 
      of the average economic damage for the 90% of its observations 
      with the lowest impact versus the average economic damage 
      for the 10% of its observations with the highest impact 
      based only on the weather events that resulted 
      in non-zero economic damage.  

```{r display_figure_2, fig.width=17, fig.height=50}

# Display the Figure 2
grid.draw(figure_2)

```

The *Figure 2* was exported (as a png file), 
in the folder of the working directory: 

* *outputs --> harm_on_economy --> figures* 
  
with filename:  

* *figure_2.png*

```{r export_figure_2}

# Export Figure 1
ggsave(
  filename = "figure_2.png",
  plot = figure_2,
  device = "png",
  path = directory_tree_____outputs[[
    "filepath_____outputs_____harm_on_economy_____figures"
    ]],
  width = 15,
  height = 50,
  limitsize = FALSE
)

```

<br>  

<font size="1">[back to start of this subsection](#ind-10-2-1--Overview-of-results-for-the-harm-on-economy)</font>  
<font size="1">[back to start of this section](#ind-10-2--results-harm-on-economy)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 10.2.2 Most harmful event types with respect to property damage {#ind-10-2-2--Most-harmful-weather-event-types-with-respect-to-property-damage}  

According to the summary for the harm on economy 
with respect to property damage by each weather event type 
(that were obtained at the section 
[9.1 Harm On Economy With Respect To Property Damage By Each Weather Event Type
](#ind-9-1--Harm-On-Economy-With-Respect-To-Property-Damage-By-Each-Weather-Event-Type)) 
out of the 37 included weather event types 
(for each of which at least 10 observations 
that resulted in non-zero property damage  
at United States in the period from 2001 to 2011 were available) 
there were 2 of them that stand out:  

  1. When a weather event of type **HURRICANE/TYPHOON** resulted in property damage, 
  it caused about 676106028$ of property damage on average 
  (based on 107 observations 
  that had high positive skewness equal to 4.9333). 
  For 9 out of 10 times of such cases, 
  an average of 81701511$ of property damage was observed 
  (based on the 90% of cases with the lower impact 
  for which 96 observations were available, 
  that had high positive skewness equal to 3.4556), 
  while for the remaining 1 out of 10 times 
  it caused around 5863636364$ of property damage on average 
  (based on the 10% of cases with the higher impact 
  for which 11 observations were available, 
  that had moderate positive skewness equal to 1.5154).  
  2. When a weather event of type **STORM SURGE/TIDE** resulted in property damage, 
  it caused about 364969183$ of property damage on average 
  (based on 131 observations 
  that had extreme positive skewness equal to 9.6344). 
  For 9 out of 10 times of such cases, 
  an average of 749256$ of property damage was observed 
  (based on the 90% of cases with the lower impact 
  for which 117 observations were available, 
  that had moderate positive skewness equal to 2.9093), 
  while for the remaining 1 out of 10 times 
  it caused around 3408807143$ of property damage on average 
  (based on the 10% of cases with the higher impact 
  for which 14 observations were available, 
  that had moderate positive skewness equal to 2.7389).  

```{r table_with_results_of_harm_on_population_health_with_respect_to_property_damage}

# Create an interactive table to present present the results 
# for the harm on economy with respect to property damage.  
datatable(
  data = summary_____harm_on_economy______property_damage[order(RANK)],
  caption = paste0(
    "Table 10.2.2-1: ",
    "Harm on Population Health with respect to Property Damage ", 
    "by Each Weather Event Type"
  ),
  colnames = c(
    "RANK", 
    "WEATHER EVENT TYPE", 
    "NUMBER OF ALL AVAILABLE OBSERVATIONS", 
    "AVERAGE PROPERTY DAMAGE FOR ALL AVAILABLE CASES", 
    "SKEWNESS IN PROPERTY DAMAGE FOR ALL AVAILABLE CASES", 
    "NUMBER OF OBSERVATIONS FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "AVERAGE PROPERTY DAMAGE FOR THE 90% OF CASES WITH LOWEST IMPACT",
    "SKEWNESS IN PROPERTY DAMAGE FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "NUMBER OF OBSERVATIONS FOR THE 10% OF CASES WITH HIGHEST IMPACT", 
    "AVERAGE PROPERTY DAMAGE FOR THE 10% OF CASES WITH HIGHEST IMPACT",
    "SKEWNESS IN PROPERTY DAMAGE FOR THE 10% OF CASES WITH HIGHEST IMPACT"
  ),
  rownames = FALSE,
  escape = TRUE,
  options=list(
    pageLength = nrow(summary_____harm_on_economy______property_damage),
    dom = "t",
    initComplete = JS(
      "function(settings, json) {",
      "$(this.api().table().header()).css({'font-size': '50%'});",
      "}"
    )
  )
) %>% 
  formatStyle(columns = c(1, 3:11), fontSize = '50%')%>% 
  formatStyle(columns = 2, fontSize = '35%') 

```

<br>  

<font size="1">[back to start of this subsection](#ind-10-2-2--Most-harmful-weather-event-types-with-respect-to-property-damage)</font>  
<font size="1">[back to start of this section](#ind-10-2--results-harm-on-economy)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 10.2.3 Most harmful event types with respect to crop damage {#ind-10-2-3--Most-harmful-weather-event-types-with-respect-to-crop-damage}  

According to the summary for the harm on economy 
with respect to crop damage by each weather event type 
(that were obtained at the section 
[9.2 Harm On Economy With Respect To Crop Damage By Each Weather Event Type
](#ind-9-2--Harm-On-Economy-With-Respect-To-Crop-Damage-By-Each-Weather-Event-Type)) 
out of the 16 included weather event types 
(for each of which at least 10 observations 
that resulted in non-zero crop damage  
at United States in the period from 2001 to 2011 were available) 
there were 2 of them that stand out:  

  1. When a weather event of type **HURRICANE/TYPHOON** resulted in crop damage, 
  it caused about 63684017$ of crop damage on average 
  (based on 48 observations 
  that had high positive skewness equal to 5.6962). 
  For 9 out of 10 times of such cases, 
  an average of 13275181$ of crop damage was observed 
  (based on the 90% of cases with the lower impact 
  for which 43 observations were available, 
  that had moderate positive skewness equal to 2.4986), 
  while for the remaining 1 out of 10 times 
  it caused around 497200000$ of crop damage on average 
  (based on the 10% of cases with the higher impact 
  for which only 5 observations were available, 
  that had moderate positive skewness equal to 1.3378).  
  2. When a weather event of type **DROUGHT** resulted in crop damage, 
  it caused about 42389146$ of crop damage on average 
  (based on 158 observations 
  that had high positive skewness equal to 4.9333). 
  For 9 out of 10 times of such cases, 
  an average of 11981373$ of crop damage was observed 
  (based on the 90% of cases with the lower impact 
  for which 142 observations were available, 
  that had moderate positive skewness equal to 2.3645), 
  while for the remaining 1 out of 10 times 
  it caused around 312258125$ of crop damage on average 
  (based on the 10% of cases with the higher impact 
  for which 16 observations were available, 
  that had moderate positive skewness equal to 1.8881).  

```{r table_with_results_of_harm_on_population_health_with_respect_to_crop_damage}

# Create an interactive table to present present the results 
# for the harm on economy with respect to crop damage.  
datatable(
  data = summary_____harm_on_economy______crop_damage[order(RANK)],
  caption = paste0(
    "Table 10.2.3-1: ",
    "Harm on Population Health with respect to Crop Damage ", 
    "by Each Weather Event Type"
  ),
  colnames = c(
    "RANK", 
    "WEATHER EVENT TYPE", 
    "NUMBER OF ALL AVAILABLE OBSERVATIONS", 
    "AVERAGE CROP DAMAGE FOR ALL AVAILABLE CASES", 
    "SKEWNESS IN CROP DAMAGE FOR ALL AVAILABLE CASES", 
    "NUMBER OF OBSERVATIONS FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "AVERAGE CROP DAMAGE FOR THE 90% OF CASES WITH LOWEST IMPACT",
    "SKEWNESS IN CROP DAMAGE FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "NUMBER OF OBSERVATIONS FOR THE 10% OF CASES WITH HIGHEST IMPACT", 
    "AVERAGE CROP DAMAGE FOR THE 10% OF CASES WITH HIGHEST IMPACT",
    "SKEWNESS IN CROP DAMAGE FOR THE 10% OF CASES WITH HIGHEST IMPACT"
  ),
  rownames = FALSE,
  escape = TRUE,
  options=list(
    pageLength = nrow(summary_____harm_on_economy______crop_damage),
    dom = "t",
    initComplete = JS(
      "function(settings, json) {",
      "$(this.api().table().header()).css({'font-size': '50%'});",
      "}"
    )
  )
) %>% 
  formatStyle(columns = c(1, 3:11), fontSize = '50%')%>% 
  formatStyle(columns = 2, fontSize = '35%')

```

<br>  

<font size="1">[back to start of this subsection](#ind-10-2-3--Most-harmful-weather-event-types-with-respect-to-crop-damage)</font>  
<font size="1">[back to start of this section](#ind-10-2--results-harm-on-economy)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 10.2.4 Most harmful event types with respect to economic damage {#ind-10-2-4--Most-harmful-weather-event-types-with-respect-to-economic-damage}

According to the summary for the harm on economy 
with respect to economic damage by each weather event type 
(that were obtained at the section 
[9.3 Harm On Economy With Respect To Economic Damage By Each Weather Event Type
](#ind-9-3--Harm-On-Economy-With-Respect-To-Economic-Damage-By-Each-Weather-Event-Type)) 
out of the 16 included weather event types 
(for each of which at least 10 observations 
that resulted in non-zero economic damage  
at United States in the period from 2001 to 2011 were available) 
there were 2 of them that stand out:  

  1. When a weather event of type **HURRICANE/TYPHOON** resulted in economic damage, 
  it caused about 698149795$ economic damage on average 
  (based on 108 observations 
  that had high positive skewness equal to 4.7929). 
  For 9 out of 10 times of such cases, 
  an average of 92388431$ economic damage was observed 
  (based on the 90% of cases with the lower impact 
  for which 97 observations were available, 
  that had high positive skewness equal to 3.0615), 
  while for the remaining 1 out of 10 times 
  it caused around 6039863636$ economic damage on average 
  (based on the 10% of cases with the higher impact 
  for which 11 observations were available, 
  that had moderate positive skewness equal to 1.3803).  
  2. When a weather event of type **STORM SURGE/TIDE** resulted in economic damage, 
  it caused about 364975672$ economic damage on average 
  (based on 131 observations 
  that had extreme positive skewness equal to 9.6344). 
  For 9 out of 10 times of such cases, 
  an average of 756521$ economic damage was observed 
  (based on the 90% of cases with the lower impact 
  for which 117 observations were available, 
  that had moderate positive skewness equal to 2.898), 
  while for the remaining 1 out of 10 times 
  it caused around 3408807143$ economic damage on average 
  (based on the 10% of cases with the higher impact 
  for which 14 observations were available, 
  that had moderate positive skewness equal to 2.7389).  

```{r table_with_results_of_harm_on_population_health_with_respect_to_economic_damage}

# Create an interactive table to present present the results 
# for the harm on economy with respect to economic damage.  
datatable(
  data = summary_____harm_on_economy______economic_damage[order(RANK)],
  caption = paste0(
    "Table 10.2.4-3: ",
    "Harm on Population Health with respect to Economic Damage ", 
    "by Each Weather Event Type "
  ),
  colnames = c(
    "RANK", 
    "WEATHER EVENT TYPE", 
    "NUMBER OF ALL AVAILABLE OBSERVATIONS", 
    "AVERAGE ECONOMIC DAMAGE FOR ALL AVAILABLE CASES", 
    "SKEWNESS IN ECONOMIC DAMAGE FOR ALL AVAILABLE CASES", 
    "NUMBER OF OBSERVATIONS FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "AVERAGE ECONOMIC DAMAGE FOR THE 90% OF CASES WITH LOWEST IMPACT",
    "SKEWNESS IN ECONOMIC DAMAGE FOR THE 90% OF CASES WITH LOWEST IMPACT", 
    "NUMBER OF OBSERVATIONS FOR THE 10% OF CASES WITH HIGHEST IMPACT", 
    "AVERAGE ECONOMIC DAMAGE FOR THE 10% OF CASES WITH HIGHEST IMPACT",
    "SKEWNESS IN ECONOMIC DAMAGE FOR THE 10% OF CASES WITH HIGHEST IMPACT"
  ),
  rownames = FALSE,
  escape = TRUE,
  options=list(
    pageLength = nrow(summary_____harm_on_economy______economic_damage),
    dom = "t",
    initComplete = JS(
      "function(settings, json) {",
      "$(this.api().table().header()).css({'font-size': '50%'});",
      "}"
    )
  )
) %>% 
  formatStyle(columns = c(1, 3:11), fontSize = '50%')%>% 
  formatStyle(columns = 2, fontSize = '35%') 

```

<br>  

<font size="1">[back to start of this subsection](#ind-10-2-4--Most-harmful-weather-event-types-with-respect-to-economic-damage)</font>  
<font size="1">[back to start of this section](#ind-10-2--results-harm-on-economy)</font>  
<font size="1">[back to start of this chapter](#ind-10--RESULTS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 11 REPRODUCIBILITY DETAILS {#ind-11--REPRODUCIBILITY-DETAILS}  
***  

To help in any attempt to reproduce the report with this analysis 
beyond the structure and the in-detail description of the procedure 
that took place during the execution of the script, 
several details are provided to make it as easy as possible. 

Specifically, in this chapter, information is supplied about:  

  1. [the r session](#ind-11-1--Session-Info)  
  2. [the r options](#ind-11-2--Options)  
  3. [the MD5 checksums of some important files](#ind-11-3--MD5-Checksums)  
  4. [the random seed](#ind-11-4--Random-Seed)  

<br>  

<font size="1">[back to start of this chapter](#ind-11--REPRODUCIBILITY-DETAILS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

## 11.1 Session Info {#ind-11-1--Session-Info}  

The details with respect to the operating system, 
R version as wells as the versions of the libraries 
used to create this report are supplied 
to help in any attempt to reproduce the report.  

```{r capture_and_diplay_the_session_info}

# Captures the session info.
session_info <- sessionInfo()

# Display the session info.
session_info

```

An object with the information on the session was also exported 
at the folder of working directory:  

* *outputs --> reproducibility_support --> r_session* 

with filename:  

* *session_info.R*

```{r export_an_R_file_with_the_session_info}

# Supply the filepath at which the R file with the session info will be exported.
filepath_____session_info <- file.path(
directory_tree_____outputs[[
    "filepath_____outputs_____reproducibility_support_____r_session"
  ]],
  "session_info.R"
)

# Export the session info as an R file.
saveRDS(
  object = session_info, 
  file = filepath_____session_info
)

```

<br>  

<font size="1">[back to start of this section](#ind-11-1--Session-Info)</font>  
<font size="1">[back to start of this chapter](#ind-11--REPRODUCIBILITY-DETAILS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 11.2 Options {#ind-11-2--Options}  

The details with respect to the r options 
active while the script that produced the report were executed 
are supplied to help in any attempt to reproduce the report. 

```{r capture_and_diplay_the_r_options}

# Captures the R options. 
r_options <- options()

# Displays the R options
r_options

```

An object with the information for r option was also exported 
at the folder of working directory:  

* *outputs --> reproducibility_support --> r_session* 

with filename:  

* *r_options.R*

```{r export_an_R_file_with_the_session_options}

# Supply the filepath at which the R file with the R options will be exported.
filepath_____r_options <- file.path(
directory_tree_____outputs[[
    "filepath_____outputs_____reproducibility_support_____r_session"
  ]],
  "r_options.R"
)
# Export the R options as an R file.
saveRDS(
  object = r_options, 
  file = filepath_____r_options
)

```

<br>  

<font size="1">[back to start of this section](#ind-11-2--Options)</font>  
<font size="1">[back to start of this chapter](#ind-11--REPRODUCIBILITY-DETAILS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 11.3 MD5 Checksums {#ind-11-3--MD5-Checksums}  

To easily verify the integrity and validity of some important files 
that were either imported or exported through the execution of the script 
that produces the report with the analysis their MD5 checksums were computed 
and exported as txt files with the help of a utility function 
that was created and used, [export_md5sums()
](#ind-11-3-1--Create-a-utility-function-to-export-MD5-checksums).  

Three txt files with MD5 checksums were created:  
  
  1. [unprocessed_data_____MD5_checksum.txt
  ](#ind-11-3-2--MD5-checksum-of-the-input-file-with-the-unprocessed-data)  
  2. [processed_data_____MD5_checksum.txt
  ](#ind-11-3-3--MD5-checksum-for-the-output-file-with-the-processed-data)  
  3. [results_____MD5_checksum.txt
  ](#ind-11-3-4--MD5-checksum-of-the-output-files-with-the-results) 

and exported at the subdirectory of the working directory: 

* *output --> reproducibility_support --> MD5_checksums* 

The [original files with the MD5 Checksums
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/tree/master/outputs/reproducibility_support/MD5_checksums) 
have been uploaded to github.

<br>  

<font size="1">[back to start of this section](#ind-11-3--MD5-Checksums)</font>  
<font size="1">[back to start of this chapter](#ind-11--REPRODUCIBILITY-DETAILS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  

### 11.3.1 Create a utility function to export MD5 checksums {#ind-11-3-1--Create-a-utility-function-to-export-MD5-checksums}  

To create txt files with the MD5 checksums 
the utility function *export_md5sums()* was created and used.

It takes as input two arguments:  

  1. target_files
     * the paths to the files of which we want to compute the MD5 checksums  
  2. output_file 
     * the path at which the txt file with the MD5 checksums of the 
     target files will be exported 
     
Upon execution, 
it creates a txt file at the path denoted by the argument 'output_file' 
in which it stores the MD5 checksums of the files found at the paths supplied 
via the 'target_files' argument.  

The txt files consists of one row for each of the target files, which:  

* begins with MD5 checksum  
* followed by two spaces   
* ends the the path of the file to which the MD5 corresponds  
     
```{r create_the_utility_function_____export_md5sums}

# utility function: export_md5sum()
#
# Creates and exports a txt file with the MD5 checksums of some target files.  
#
# Arguments:
#  'target_files'  :  A character vector with the paths of the target files,
#                     of which the MD5 checksums will be computed.
#                     All supplied files must exist.
#
#  'output_file'   :  A character string with the path to file 
#                     which will be created to store the MD5 checksums
#                     of the target files.
#                     The output file must end with the txt extenrgtion.
#                     Any number of directories can be included in the path 
#                     prior to the filename, that will be created 
#                     even if they don't exist. 
#
# Return: 
#  If the function executes to correctly it returns a named vector 
#  with the MD5 checksums of the target file, 
#  named after their corresponding paths. 

# Define a utility function to use in order to compute and export 
# the MD5 checksums of the files of interest. 
export_md5sum <- function(target_files, output_file = "MD5.txt") {

  # Check the validity of the supplied arguments.
  ## a single character string with a txt extention must have been supplied 
  ## as the value of 'output_file' argument.
  stopifnot(
    is.character(output_file) &&
      ( length(output_file) == 1 ) &&
      ( tools::file_ext(output_file) == "txt" )
  )
  ## An character vector with arbitrary number of EXISTING files 
  ## must have been supplied as the value of 'target_files' argument. 
  do_all_target_files_exist <- file.exists(target_files) & !dir.exists(target_files)
  if (!all(do_all_target_files_exist)) {
    not_existing_target_files <- target_files[!do_all_target_files_exist]
    stop(
      "\n",
      "The following supplied target files do not exists: ", "\n",
      paste("\t", not_existing_target_files, "\n", sep = "")
    )
  }

  # Computes the MD5 checksums of the target files.
  md5_checksums_of_target_files <- tools::md5sum(target_files)

  # Creates the content of that will be written inside the output file.
  content_of_output_file <- paste(
    unname(md5_checksums_of_target_files),
    "  ",
    names(md5_checksums_of_target_files)
  )

  # If the value of output file contains some directory name 
  # it is identified and created.
  dest_dir <- dirname(output_file)
  if (!dir.exists(dest_dir)) {
    dir.create(dest_dir)
  }
  # A blank output file is created.
  file.create(output_file)

  # If the output file was successfully created..
  if (file.exists(output_file)) {
    # ...it get populated with contents.
    con_to_output_file <- file(output_file)
    writeLines(text = content_of_output_file, con = output_file)
    close(con = con_to_output_file)
  } else {
    # else the operation fails and the execution stops.
    stop(
      "\n",
      "Failed to create the output file at the path:", "\n",
      "\t", output_file,
      "\n"
    )
  }
}


```

<br>  

<font size="1">[back to start of this subsection](#ind-11-3-1--Create-a-utility-function-to-export-MD5-checksums)</font>  
<font size="1">[back to start of this section](#ind-11-3--MD5-Checksums)</font>  
<font size="1">[back to start of this chapter](#ind-11--REPRODUCIBILITY-DETAILS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 11.3.2 MD5 checksum of the input file with the unprocessed data {#ind-11-3-2--MD5-checksum-of-the-input-file-with-the-unprocessed-data}  

The input file, *repdata_data_StormData.csv.bz2*, 
with the unprocessed data was downloaded from the 
[link](https://d396qusza40orc.cloudfront.net/repdata%2Fdata%2FStormData.csv.bz2) 
that was supplied by the instructions of the assignment. 

The same file that was download and used 
to produce the original report for this analysis was also uploaded at 
the github and can be accessed from the following link: 

* [repdata_data_StormData.csv.bz2 on GitHub
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/repdata_data_StormData.csv.bz2)

A txt file with the MD5 checksum of the input file, 
*repdata_data_StormData.csv.bz2*, 
was exported at the subdirectory of the working directory:  

* *output --> reproducibility_support --> MD5_checksums* 

with name:  

* *unprocessed_data_____MD5_checksum.txt*  

```{r export_a_txt_file_with_the_MD5_checksums_of_the_input_file_with_the_unprocessed_data}

# Supply the filepath at which the txt file with MD5 checksum 
# of the file with the unprocessed data will be exported.
filepath_____unprocessed_data_____MD5_checksum <- file.path(
  directory_tree_____outputs[[
    "filepath_____outputs_____reproducibility_support_____MD5_checksums"
  ]],
  "unprocessed_data_____MD5_checksum.txt"
) 

# Create and export a txt file with MD5 checksum 
# of the file with the unprocessed data .
export_md5sum(
  target_files = filepath_____unprocessed_data,
  output_file = filepath_____unprocessed_data_____MD5_checksum
)

```

To verify the input file with the unprocessed data, 
*repdata_data_StormData.csv.bz2*, compare the MD5 checksum 
contained at the file with name, 
*unprocessed_data_____MD5_checksum.txt* 
that was exported when you reproduced the analysis 
with the the original which was uploaded at github 
and can be accessed through the following link:  

* [original unprocessed_data_____MD5_checksum.txt 
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/tree/master/outputs/reproducibility_support/MD5_checksums/unprocessed_data_____MD5_checksum.txt)

<br>  

<font size="1">[back to start of this subsection](#ind-11-3-2--MD5-checksum-of-the-input-file-with-the-unprocessed-data)</font>  
<font size="1">[back to start of this section](#ind-11-3--MD5-Checksums)</font>  
<font size="1">[back to start of this chapter](#ind-11--REPRODUCIBILITY-DETAILS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 11.3.3 MD5 checksum of the output file with the processed data {#ind-11-3-3--MD5-checksum-for-the-output-file-with-the-processed-data}  

An R file with the table with the processed data was 
[exported](#ind-7-3--Export-The-Table-With-The-Processed-Data) 
through the execution of the script.  

The original file have been uploaded at the github 
and can be accessed from the following link:  

* [table_with_the_processed_data.R
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/tree/master/outputs/processed_data) 

A txt file with the MD5 checksum of the output R file, 
*table_with_the_processed_data.R*, 
was exported at the subdirectory of the working directory:  

* *output --> reproducibility_support --> MD5_checksums* 

with name:  

* *processed_data_____MD5_checksum.txt*  

```{r export_a_txt_file_with_the_MD5_checksums_of_the_exported_table_with_the_processed_data}

# Supply the filepath at which the txt file with MD5 checksum 
# of the file with the table with the processed data will be exported.
filepath_____processed_data_____MD5_checksum <- file.path(
  directory_tree_____outputs[[
    "filepath_____outputs_____reproducibility_support_____MD5_checksums"
  ]],
  "processed_data_____MD5_checksum.txt"
)

# Create and export a txt file with MD5 checksum 
# of the file with the table with the processed data.
export_md5sum(
  target_files = filepath_____processed_data,
  output_file = filepath_____processed_data_____MD5_checksum
)

```

To verify the table with the processed data, 
*table_with_the_processed_data.R*, compare the MD5 checksum 
contained at the file with name, 
*processed_data_____MD5_checksum.txt* 
that was exported when you reproduced the analysis 
with the the original which was uploaded at github 
and can be accessed through the following link:  

* [original processed_data_____MD5_checksum.txt
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/tree/master/outputs/reproducibility_support/MD5_checksums/processed_data_____MD5_checksum.txt)

<br>  

<font size="1">[back to start of this subsection](#ind-11-3-3--MD5-checksum-for-the-output-file-with-the-processed-data)</font>  
<font size="1">[back to start of this section](#ind-11-3--MD5-Checksums)</font>  
<font size="1">[back to start of this chapter](#ind-11--REPRODUCIBILITY-DETAILS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  


### 11.3.4 MD5 checksum of the output files with the results {#ind-11-3-4--MD5-checksum-of-the-output-files-with-the-results}  

The results obtained in this analysis consist of 6 summary tables. 

Those that correspond to the results for the harm on population health 
(over each of the three perspectives examined)
which were exported as R files through the execution of the script, with names: 

  1. summary_____harm_on_population_health______fatalities.R  
     * for the 
     [table with the summary for harm on population health with respect to fatalities
     ](#ind-8-1-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-fatalities-by-each-weather-event-type)  
  2. summary_____harm_on_population_health______injuries.R  
     * for the 
     [table with the summary for harm on population health with respect to injuries
     ](#ind-8-2-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-injuries-by-each-weather-event-type)  
  3. summary_____harm_on_population_health______casualties.R  
     * for the 
     [table with the summary for harm on population health with respect to casualties
     ](#ind-8-3-3--Summarize-the-processed-data-for-harm-on-population-health-with-respect-to-casualties-by-each-weather-event-type)  
     
And those that correspond to the results for the harm on economy
(over each of the three perspectives examined) 
which were exported as R files through the execution of the script, with names: 

  1. summary_____harm_on_economy______property_damage.R  
     * for the 
     [table with the summary for harm on economy with respect to property damage
     ](#ind-9-1-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-property-damage-by-each-weather-event-type)
  2. summary_____harm_on_economy______crop_damage.R*  
     * for the 
     [table with the summary for harm on economy with respect to crop damage
     ](#ind-9-2-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-crop-damage-by-each-weather-event-type)
  3. summary_____harm_on_economy______economic_damage.R  
     * for the 
     [table with the summary for harm on economy with respect to economic damage
     ](#ind-9-3-3--Summarize-the-processed-data-for-harm-on-economy-with-respect-to-economic-damage-by-each-weather-event-type)  
  

A txt file with the MD5 checksum of all 6 output R files described above, 
was exported at the subdirectory of the working directory:  

* *output --> reproducibility_support --> MD5_checksums* 

with name:  

* *resulsts_____MD5_checksum.txt*  

```{r export_a_txt_file_with_the_MD5_checksums_of_the_exported_tables_with_the_results}

# Supply the filepath at which the txt file with MD5 checksums 
# of the files with the tables with the results will be exported.
filepath_____results_____MD5_checksum <- file.path(
  directory_tree_____outputs[[
    "filepath_____outputs_____reproducibility_support_____MD5_checksums"
  ]],
  "results_____MD5_checksum.txt"
)

# Create and export a txt file with MD5 checksums 
# of the files with the tables with the results.
export_md5sum(
  target_files = c(
    filepath_____summary_____harm_on_population_health______fatalities,
    filepath_____summary_____harm_on_population_health______injuries,
    filepath_____summary_____harm_on_population_health______casualties,
    filepath_____summary_____harm_on_economy______property_damage,
    filepath_____summary_____harm_on_economy______crop_damage,
    filepath_____summary_____harm_on_economy______economic_damage
  ),
  output_file = filepath_____results_____MD5_checksum
)


```

To verify the results compare the MD5 checksum 
contained at the file with name, 
*results_____MD5_checksum.txt* 
that was exported when you reproduced the analysis 
with the the original which was uploaded at github 
and can be accessed through the link:  

* [original results_____MD5_checksum.txt
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/tree/master/outputs/reproducibility_support/MD5_checksums/results_____MD5_checksum.txt)

<br>  

<font size="1">[back to start of this subsection](#ind-11-3-4--MD5-checksum-of-the-output-files-with-the-results)</font>  
<font size="1">[back to start of this section](#ind-11-3--MD5-Checksums)</font>  
<font size="1">[back to start of this chapter](#ind-11--REPRODUCIBILITY-DETAILS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  



## 11.4 Random Seed {#ind-11-4--Random-Seed}  

At the beginning of the analysis a random seed was selected 
equal to **1234567890** to enhance the reproducibility of the report.

If the procedure have been reproduced correctly,
(with respect to random events) at this point it is expected 
to produce a sample from standard normal distribution 
with the following 5 values :  

* -2.2152999  
* 0.4738228 
* -0.4869480 
* -0.5343663  
* 1.3206245

```{r produce_random_normal_values_for_control}

# Creates 5 random values out of typical normal distributions 
# to check the reproducibility of random events.  
expected_values_of_final_random_event <- rnorm(5)

# Display the 5 random values. 
expected_values_of_final_random_event

```

However, keep in mind that the only random events that took place 
through the execution of the script that produces this report 
happened at the creation of the plots:  
  
  1. [Plot 1.1.4](#Create-The-Plot-1-1-4)  
  2. [Plot 1.2.4](#Create-The-Plot-1-2-4)  
  3. [Plot 1.3.4](#Create-The-Plot-1-3-4)  
  4. [Plot 2.1.4](#Create-The-Plot-2-1-4)  
  5. [Plot 2.2.4](#Create-The-Plot-2-2-4)  
  6. [Plot 2.3.4](#Create-The-Plot-2-3-4)  

by the function *geom_repel_label()* in order to assign randomly 
the positions of the labels. 

So even if the random seed is not the same 
only the labels in those plots should be in different places, 
while the actual results are expected to be the identical. 

<br>  

<font size="1">[back to start of this section](#ind-11-4--Random-Seed)</font>  
<font size="1">[back to start of this chapter](#ind-11--REPRODUCIBILITY-DETAILS)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 12 LICENSE {#ind-12--LICENSE}  
***  

The script [RepRes_analysis.Rmd
](https://github.com/jzstats/Reproducible-Research--2nd-Assignment/blob/master/RepRes_analysis.Rmd) 
with the code to conduct the analysis as well as any of the results and outputs 
obtained when it is executed can be used freely for any propose 
under the terms of MIT License. 

> Copyright (c) <year> <copyright holders>
> 
> Permission is hereby granted, free of charge, to any person obtaining a copy
> of this software and associated documentation files (the "Software"), to deal
> in the Software without restriction, including without limitation the rights
> to use, copy, modify, merge, publish, distribute, sublicense, and/or sell
> copies of the Software, and to permit persons to whom the Software is
> furnished to do so, subject to the following conditions:
> 
> The above copyright notice and this permission notice shall be included in all
> copies or substantial portions of the Software.
> 
> THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
> IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
> FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
> AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
> LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
> OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
> SOFTWARE.


<br>  

<font size="1">[back to start of this chapter](#ind-12--LICENSE)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
# 13 REFERENCES {#ind-13--REFERENCES}  
***  

NATIONAL WEATHER SERVICE INSTRUCTION 10-1605, AUGUST 17, 2007. 
URL https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2Fpd01016005curr.pdf

<br> 

Storm Data FAQ Page (2008). 
URL https://d396qusza40orc.cloudfront.net/repdata%2Fpeer2_doc%2FNCDC%20Storm%20Events-FAQ%20Page.pdf

<br> 

The History of the Strom Events Database (2014).
URL https://www.ncdc.noaa.gov/stormevents/versions.jsp

<br>

R Core Team (2020). 
R: A language and environment for statistical computing. 
R Foundation for Statistical Computing, Vienna, Austria. 
URL https://www.R-project.org/.

<br> 

RStudio Team (2019). 
RStudio: Integrated Development for R. RStudio, Inc., Boston, MA 
URL http://www.rstudio.com/.

<br>

JJ Allaire and Yihui Xie and Jonathan McPherson and Javier Luraschi and Kevin
Ushey and Aron Atkins and Hadley Wickham and Joe Cheng and Winston Chang and
Richard Iannone (2020). 
rmarkdown: Dynamic Documents for R. R package version 2.1. 
URL https://rmarkdown.rstudio.com. 

<br>

Yihui Xie and J.J. Allaire and Garrett Grolemund (2018). 
R Markdown: The Definitive Guide. 
Chapman and Hall/CRC. 
ISBN 9781138359338. 
URL https://bookdown.org/yihui/rmarkdown.

<br>

Yihui Xie (2020). 
knitr: A General-Purpose Package for Dynamic Report Generation in R. 
R package version 1.28.

<br>

Yihui Xie (2015) Dynamic Documents with R and knitr. 
2nd edition. 
Chapman and Hall/CRC. 
ISBN 978-1498716963

<br>

Yihui Xie (2014) knitr: A Comprehensive Tool for Reproducible Research in R. 
In Victoria Stodden, Friedrich Leisch and Roger D. Peng, editors, 
Implementing Reproducible Computational Research. 
Chapman and Hall/CRC. 
ISBN 978-1466561595

<br>

Hao Zhu (2019). 
kableExtra: Construct Complex Table with 'kable' and Pipe Syntax. 
package version 1.1.0. 
https://CRAN.R-project.org/package=kableExtra

<br>

Stefan Milton Bache and Hadley Wickham (2014). 
magrittr: A Forward-Pipe Operator for R. 
R package version 1.5. 
https://CRAN.R-project.org/package=magrittr

<br>

Yihui Xie, Joe Cheng and Xianying Tan (2020). 
DT: A Wrapper of the JavaScript Library 'DataTables'. 
R package version 0.13. 
https://CRAN.R-project.org/package=DT

<br>

Julien Barnier (2020). 
rmdformats: HTML Output Formats and Templates for 'rmarkdown' Documents. 
R package version 0.3.7. 
https://CRAN.R-project.org/package=rmdformats

<br>

Matt Dowle and Arun Srinivasan (2019). 
data.table: Extension of `data.frame`. 
R package version 1.12.8. 
https://CRAN.R-project.org/package=data.table

<br>

van der Loo M, de Jonge E (2019). 
“Data Validation Infrastructure for R.”
_Journal of Statistical Software_, Accepted for publication. 
<URL:https://CRAN.R-project.org/package=validate>.

<br>  

Hadley Wickham (2019). 
stringr: Simple, Consistent Wrappers for Common String Operations. 
R package version 1.4.0. 
https://CRAN.R-project.org/package=stringr

<br>  

Lukasz Komsta and Frederick Novomestky (2015). 
moments: Moments, cumulants, skewness, kurtosis and related tests. 
R package version 0.14. 
https://CRAN.R-project.org/package=moments

<br>  

H. Wickham. 
ggplot2: Elegant Graphics for Data Analysis. 
Springer-Verlag New York, 2016.  

<br>  

Kamil Slowikowski (2020). 
ggrepel: Automatically Position Non-Overlapping Text Labels with 'ggplot2'. 
R package version 0.8.2. 
https://CRAN.R-project.org/package=ggrepel

<br>  

Baptiste Auguie (2017). 
gridExtra: Miscellaneous Functions for "Grid" Graphics. 
R package version 2.3. 
https://CRAN.R-project.org/package=gridExtra

<br>  

Yan Holtz (2018). 
PIMP MY RMD: GitHub Page with tips on refining an rmarkdown document. 
URL https://holtzy.github.io/Pimp-my-rmd/#github-link

<br>  

<font size="1">[back to start of this chapter](#ind-13--REFERENCES)</font>  
<font size="1">[back to *TABLE OF CONTENTS*](#ind-1--TABLE-OF-CONTENTS)</font>  

<br>  
<br>  
<br>  
<br>  
<br>  
<br>  






***  
<font size="1">END OF THE REPORT</font>