add Patrick`s changes in tbl_treatment and tbl_logremoval

README.md

@@ -1,3 +1,17 @@
+# v0.8.0
+"rawdata" folder: 
+- added Patrick's changes made in EXCEL files "tbl_logremoval.xlsx" and "tbl_treatment.xlsx"(sent to Michael on 
+2018-11-08 via email) in "rawdata" folder
+
+tbl_treatment: 
+- added TreatmentDescription: from Patrick's "tbl_logremoval.xlsx" (sent on 2018-11-08 via email)
+- renamed/added TreatmentNames: UV disinfection 20 mJ/cm2, drinking and UV disinfection 40 mJ/cm2, drinking
+
+tbl_logRemoval
+- deleted entries for TreatmentID 15 (RO) from WHO (2011) (Reference: 8), now default RO data are based on 
+NSF/ANSI 419  validation (referenceID = 47)
+
+
 # v0.7.1
 
 tbl_treatment: 

qmra-db_accdb/tbl_logRemoval.csv

@@ -31,9 +31,9 @@
 14,2,2,40,1,NA,NA,NA,"uniform",NA
 14,2,2,40,2,NA,NA,NA,"uniform",NA
 14,2,2,40,3,NA,NA,NA,"uniform",NA
-15,4,4,40,1,NA,NA,NA,"uniform",NA
-15,4,4,40,2,NA,NA,NA,"uniform",NA
-15,4,4,40,3,NA,NA,NA,"uniform",NA
+15,4.6,6,50,1,NA,NA,NA,"uniform","based on Streptococcus faecalis: kmin = 0.312, kmax = 0.88, MICmax_min = 4.6, MICmax_max = 6,  dose = 20"
+15,2,3.1,50,2,NA,NA,NA,"uniform","based on Rotavirus (MC vs PC): kmin = 0.102, kmax = 0.1514, MICmax_min = 4.1, MICmax_max = 5.9,  dose = 20"
+15,2.4,3,50,3,NA,NA,NA,"uniform","based on Giardia lambia: kmin = 0.122, kmax = 0.243, MICmax_min = 2.5, MICmax_max = 3,  dose = 20"
 16,0,0.5,8,1,NA,NA,NA,"uniform",NA
 16,0,0.1,8,2,NA,NA,NA,"uniform",NA
 16,0,1,8,3,NA,NA,NA,"uniform",NA
@@ -49,9 +49,6 @@
 20,2,6,8,1,NA,NA,NA,"uniform",NA
 20,1,3,8,2,NA,NA,NA,"uniform",NA
 20,0,1.5,8,3,NA,NA,NA,"uniform",NA
-21,6,6,8,1,NA,NA,NA,"uniform",NA
-21,6,6,8,2,NA,NA,NA,"uniform",NA
-21,6,6,8,3,NA,NA,NA,"uniform",NA
 22,2,6,8,1,NA,NA,NA,"uniform",NA
 22,3,6,8,2,NA,NA,NA,"uniform",NA
 23,1.5,2.5,8,1,NA,NA,NA,"uniform",NA
@@ -73,3 +70,6 @@
 21,5.44,6,47,1,NA,NA,NA,"uniform","identical to Nanofiltration"
 21,5.44,6,47,2,NA,NA,NA,"uniform","identical to Nanofiltration"
 21,5.75,6.32,47,3,NA,NA,NA,"uniform","identical to Nanofiltration"
+29,4.6,6,50,1,NA,NA,NA,"uniform","based on Streptococcus faecalis: kmin = 0.312, kmax = 0.88, MICmax_min = 4.6, MICmax_max = 6,  dose = 40"
+29,4.1,5.9,50,2,NA,NA,NA,"uniform","based on Rotavirus (MC vs PC): kmin = 0.102, kmax = 0.1514, MICmax_min = 4.1, MICmax_max = 5.9,  dose = 40"
+29,2.5,3,50,3,NA,NA,NA,"uniform","based on Giardia lambia: kmin = 0.122, kmax = 0.243, MICmax_min = 2.5, MICmax_max = 3,  dose = 40"

qmra-db_accdb/tbl_reference.csv

@@ -47,4 +47,5 @@
 46,"MICRORISK final report chapter 4 Table 4.11","https://www.kwrwater.nl/wp-content/uploads/2016/09/MICRORISK-FINAL-REPORT-Quantitative-microbial-risk-assessment-in-the-Water-Safety-Plan.pdf"
 47,"NSF/ANSI 419  validation","http://info.nsf.org/Certified/pdwe/Listings.asp"
 48,"EPHC, NRMMC, AHMC (2006)","https://www.susana.org/en/knowledge-hub/resources-and-publications/library/details/1533"
-49,"WHO 2017",NA
+49,"WHO 2017","https://www.who.int/water_sanitation_health/publications/drinking-water-quality-guidelines-4-including-1st-addendum/en/"
+50,"Hijnen et al. (2006)","https://doi.org/10.1016/j.watres.2005.10.030"

qmra-db_accdb/tbl_treatment.csv

@@ -1,43 +1,38 @@
 "TreatmentID","TreatmentName","TreatmentGroup","TreatmentDescription"
-1,"Conventional clarification","Coagulation, flocculation and sedimentation","Depends on coagulation conditions"
-2,"Dissolved air flotation","Coagulation, flocculation and sedimentation","Depends on coagulant dose"
-3,"High-rate clarification","Coagulation, flocculation and sedimentation","Depends on use of appropriate
-blanket polymer"
-4,"Lime softening","Coagulation, flocculation and sedimentation","Depends on pH and settling time"
-5,"Granular high-rate filtration","Filtration","Depends on filter media and coagulation pretreatment; filtered water turbidity of ? 0.3 NTU in 95% of
-samples (and none to exceed 1 NTU)
-associated with 1�2 log reduction
-of viruses and 3 log reduction of
-Cryptosporidiuma"
-7,"Precoat filtration","Filtration","If filter cake is present. Depends on chemical pretreatment,  media grade and filtration
-rate"
-8,"Slow sand filtration","Filtration","Depends on presence of schmutzdecke, grain size, flow rate, operating conditions (mainly temperature, pH); filtered water turbidity of ? 1NTU in 95% of samples (and none to exceed 5 NTU)
+29,"UV disinfection 40 mJ/cm2, drinking","Primary disinfection","UV-light is mostly effective at 254 nm where it affects DNA or RNA thus preventing reproduction of the organism (inactivation). Log reduction for drinking water UV is based on closed UV-reactors wich have been validated according to appropriate standards (e.g. USEPA or DVGW). Effectiveness of disinfection depends on delivered fluence (dose in mJ/cm2), which varies with lamp intensity, exposure time (flow rate) and UV-absorption by the water (organics). Excessive turbidity and certain dissolved species inhibit this process; hence, turbidity should be kept below 1 NTU to support effective disinfection."
+1,"Conventional clarification","Coagulation, flocculation and sedimentation","Consists of coagulant and/or flocculant aid (e.g. polymer) dosing, rapid mixing, slow mixing and sedimentation. Log removal depends on process optimisation. Rapid changes in source water quality such as turbidity increase due to monsoon rainfall or algeal blooms may decrease treatment effect and require adjustment of process settings."
+2,"Dissolved air flotation","Coagulation, flocculation and sedimentation","Compressed air is injected in the water such that air bubbles bring suspended solids to the water surface where they are skimmed off. Coagulant may be dosed.  Log removal depends on process optimisation. Rapid changes in source water quality such as turbidity increase due to monsoon rainfall or algeal blooms may decrease treatment effect and require adjustment of process settings."
+3,"High-rate clarification","Coagulation, flocculation and sedimentation","Consists of coagulant and/or flocculant aid (e.g. polymer) dosing, mixing and enhanced sedimentation by flock blankets, lamellae- or tube settlers. Log removal depends on process optimisation. Rapid changes in source water quality such as turbidity increase due to monsoon rainfall or algeal blooms may decrease treatment effect and require adjustment of process settings."
+4,"Lime softening","Coagulation, flocculation and sedimentation","Lime is dosed to the water to reduce hardness. When flocks are formed, they can entrap pathogens. Note that the technical design of the softening process affects the log reduction. e.g. pellet-softening has no effect on pathogens."
+5,"Granular high-rate filtration","Filtration","Water is filtered through a fixed bed of granular media (e.g. sand) generally operatied down flow with rates of 5 to 20 m/h and contact times of 4 to 15 minutes. They are regularly backwashed to remove built up solids in the filter. Log removal depends on filter media and coagulation pretreatment;consistent low filtered water turbidity of ? 0.3 NTU (none to exceed 1 NTU) are associated higher log removal of pathogens"
+7,"Precoat filtration","Filtration","Consist of a fine filter (e.g. candle filter or drum filter) that is precoated by dosing fine granular material (often diatomaceous earth). This material forms a fine filter cake that removes solids from the water. The log removal can only be achieved if the filter cake is present and depends on precoat media grade and filtratin rate."
+8,"Slow sand filtration","Filtration","Water is filtered through a fixed bed sand operatied down flow with rates of 0.1 to 1 m/h and contact times of 3 to 6 hours. The filter is not backwashed. In weeks to months a 'schmutzdecke' will develop on the filter which enhances log removal. Grain size, flow rate and temperature also affect log removal. Consistent low filtered water turbidity of ? 0.3 NTU (none to exceed 1 NTU) are associated higher log removal of pathogens
 associated with 1�2 log reduction of viruses and 2.5�3 log reduction of Cryptosporidiuma"
-9,"Bank filtration","Pretreatment","Depends on travel distance, soil type,
-pumping rate, pH, ionic strength"
-10,"Roughing filters","Pretreatment","Depends on filter medium, coagulant"
-11,"Storage reservoirs","Pretreatment","Residence time > 40 days (bacteria), 160 days (protozoa)"
-12,"Chlorine","Primary disinfection","Free chlorine � contact time predicts efficacy; not effective against Cryptosporidium oocysts. Turbidity and chlorine-demanding solutes inhibit this process; hence, turbidity should be kept below 1 NTU to support
-effective disinfection. Where this is not practical, turbidities should be kept below 5 NTU with higher chlorine doses or contact times. In addition to initial disinfection, the benefits of maintaining free chlorine residuals throughout distribution systems at or above 0.2 mg/l should be considered"
-13,"Chlorine dioxide","Primary disinfection",NA
-14,"Ozonation, drinking water","Primary disinfection","Viruses generally more resistant than bacteria. Protozoa: depends on temperature;
+9,"Bank filtration","Pretreatment","Water is abstracted through wells located close to surface water, thus the bank serves as a natural filter. Log removal depends on travel distance and time, soil type (grain size), and geochemicl conditions (oxygen level, pH)"
+10,"Roughing filters","Pretreatment","Water is filtered through a fixed bed of coarse granular media (e.g. rocks 5-20 mm) operated at high rates. They are not backwashed. Log removal depends on filter media and coagulation pretreatment."
+11,"Storage reservoirs","Pretreatment","Water is protected from human recontamination in reservoirs, however wildlife and waterfoul may introduce pathogens. Log reduction occurs due to sedimentation, UV radiation from sunlight and die-off in time,  depending on construction (mixing) and temperature. Reporded reduction based on residence time > 40 days (bacteria), 160 days (protozoa)"
+12,"Chlorination, wastewater","Primary disinfection","Log inactivation depends on free chlorine concentration and contact time (CT); not effective against Cryptosporidium oocysts, reported protozoan log reduction is mostly for Giardia. Turbidity and chlorine-demanding solutes inhibit this process; hence, effect in wastewater is limited since free chlorine will rapidly decay. 
+Effective disinfection. Where this is not practical, turbidities should be kept below 5 NTU with higher chlorine doses or contact times. In addition to initial disinfection, the benefits of maintaining free chlorine residuals throughout distribution systems at or above 0.2 mg/l should be considered"
+13,"Chlorine dioxide","Primary disinfection","Log inactivation depends on chlorine dioxide concentration and contact time (CT); Turbidity and organics inhibit this process; hence, turbidity should be kept below 1 NTU to support effective disinfection Chlorine dioxide degrades rapidly and doesn't leave a disinfectand residual for distribution."
+14,"Ozonation, drinking water","Primary disinfection","Log inactivation depends on dissolved ozone concentration and contact time (CT); Turbidity and organics inhibit this process; hence, turbidity should be kept below 1 NTU to support
+ effective disinfection. Ozone degrades rapidly and doesn't leave a disinfectand residual for distribution. Effective mixing and consistent contact time are crucial for disinfection due to the rapid degradation of ozone.
 Cryptosporidium varies widely"
-15,"UV disinfection, drinking water","Primary disinfection","Effectiveness of disinfection depends on delivered fluence (dose), which varies with intensity, exposure time and UV wavelength. Excessive turbidity and certain dissolved species inhibit this process; hence, turbidity should be kept below 1 NTU to support effective disinfection. Where this is not practical, turbidities should be kept below 5 NTU with higher fluences"
-16,"Primary treatment","Pretreatment",NA
-17,"Secondary treatment","Pretreatment",NA
-18,"Dual media filtration","Filtration",NA
-19,"Membrane filtration","Filtration",NA
-20,"Chlorination","Primary disinfection",NA
+15,"UV disinfection 20 mJ/cm2, drinking","Primary disinfection","UV-light is mostly effective at 254 nm where it affects DNA or RNA thus preventing reproduction of the organism (inactivation). Log reduction for drinking water UV is based on closed UV-reactors wich have been validated according to appropriate standards (e.g. USEPA or DVGW). Effectiveness of disinfection depends on delivered fluence (dose in mJ/cm2), which varies with lamp intensity, exposure time (flow rate) and UV-absorption by the water (organics). Excessive turbidity and certain dissolved species inhibit this process; hence, turbidity should be kept below 1 NTU to support effective disinfection."
+16,"Primary treatment","Pretreatment","Primary treatment consists of temporarily holding the sewage in a quiescent basin where heavy solids can settle to the bottom while oil, grease and lighter solids float to the surface. The settled and floating materials are removed and the remaining liquid may be discharged or subjected to secondary treatment"
+17,"Secondary treatment","Pretreatment","Secondary treatment consists of an activated sludge process to break down organics in the wastewater and a settling stage to separate the biologiscal sludge from the water."
+18,"Dual media filtration","Filtration","Water is filtered through a fixed bed consisting of two layers of granular media (e.g. antracite and sand) generally operatied down flow with rates of 5 to 20 m/h and contact times of 4 to 15 minutes. They are regularly backwashed to remove built up solids in the filter. Log removal depends on filter media and coagulation pretreatment;consistent low filtered water turbidity of ? 0.3 NTU (none to exceed 1 NTU) are associated higher log removal of pathogens"
+19,"Membrane filtration","Filtration","A membrane is a thin sheet with small openings that removes solids and depending on membrane type, solutes from the water when this is led through the membrane."
+20,"Chlorination, drinking water","Primary disinfection","Log inactivation depends on free chlorine concentration and contact time (CT); not effective against Cryptosporidium oocysts, reported log reduction is mostly for Giardia. Turbidity and chlorine-demanding solutes inhibit this process; hence, turbidity should be kept below 1 NTU to support effective disinfection. Where this is not practical, turbidities should be kept below 5 NTU with higher chlorine doses or contact times. In addition to initial disinfection, the benefits of maintaining free chlorine residuals throughout distribution systems at or above 0.2 mg/l should be considered"
 21,"Reverse osmosis
 os-
-mosis","Filtration",NA
-22,"Ozonation, wastewater","Primary disinfection",NA
+mosis","Filtration","A reverse osmosis membrane is a thin sheet with small openings that removes solids and most soluble molecules, including salts (< 0,004 �m depending on selected membrane) from the water when this is led through the membrane. It can take the form of spiral wound membranes, hollow fibers or sheets. Actual log reduction depends on the selected membrane and is determined by challenge testing."
+22,"Ozonation, wastewater","Primary disinfection","Log inactivation depends on dissolved ozone concentration and contact time (CT); Turbidity and organics inhibit this process; Since wastewater is often turbidity and contains high organics that consume ozone, the actual CT cannot be determined accurately and therefore inactivation cannot be determined accurately. Still, effective mixing and consistent contact time are crucial for disinfection due to the rapid degradation of ozone."
 23,"Wetlands, surface flow
 (surface 
-Wetlands, surface flow","Wetlands",NA
-24,"Wetlands, subsurface flow","Wetlands",NA
+Wetlands, surface flow","Wetlands","An artificial wetland to treat municipal or industrial wastewater, greywater or stormwater runoff by a combination of sedimentation and biological processes including plants. Effect depends on design and climate, especially les log reduction at lower temperatures."
+24,"Wetlands, subsurface flow","Wetlands","An artificial wetland to treat municipal or industrial wastewater, greywater or stormwater runoff by a combination of sedimentation, filtration and biological processes including plants. Effect depends on design, soil/filter media and climate, especially les log reduction at lower temperatures."
 25,"UV disinfection, wastewater
-UV","Primary disinfection",NA
-26,"Microfiltration","Filtration",NA
-27,"Ultrafiltration","Filtration",NA
-28,"Nanofiltration","Filtration",NA
+UV","Primary disinfection","UV-light is mostly effective at 254 nm where it affects DNA or RNA thus preventing reproduction of the organism (inactivation). Effectiveness of disinfection depends on delivered fluence (dose in mJ/cm2), which varies with lamp intensity, exposure time (flow rate) and UV-absorption by the water (organics). Wastewater UV-reactors are generally open-channel reactors in which UV lamps are placed. Excessive turbidity and certain dissolved species inhibit this process; hence the effect in wastewater highly depends on the water quality an is generally lower than in drinking water at the same dose."
+26,"Microfiltration","Filtration","A microfiltration membrane is a thin sheet with small openings that removes solids (0.1-10 �m depending on selected membrane) from the water when this is led through the membrane. It can take the form of capilary tubes, hollow fibers or sheet membranes. Actual log reduction depends on the selected membrane and is determined by challenge testing."
+27,"Ultrafiltration","Filtration","An ultrafiltration membrane is a thin sheet with small openings that removes solids (0.005-0,2 �m depending on selected membrane) from the water when this is led through the membrane. It can take the form of capilary tubes, hollow fibers, spiral wound or sheet membranes. Actual log reduction depends on the selected membrane and is determined by challenge testing."
+28,"Nanofiltration","Filtration","An nanofiltration membrane is a thin sheet with small openings that removes solids and larger soluble molecules (0.001-0,03 �m depending on selected membrane) from the water when this is led through the membrane. It can take the form of spiral wound or hollow fiber membranes. Actual log reduction depends on the selected membrane and is determined by challenge testing."