Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Download enhacements #166

Closed
omarbenites opened this issue Feb 8, 2019 · 47 comments
Closed

Download enhacements #166

omarbenites opened this issue Feb 8, 2019 · 47 comments
Assignees

Comments

@omarbenites
Copy link
Contributor

omarbenites commented Feb 8, 2019

[NOW FIXED! 👍 ]

  1. Se va exportar un sheet llamado Trait List donde
  • Los labels del field operations deben estar acompañados de: Group, Subgroup, ... Label
  1. Los trait con unidades deben ser exportado como
    Ex.
    harvest_cm
    12
@omarbenites omarbenites self-assigned this Feb 8, 2019
@omarbenites
Copy link
Contributor Author

omarbenites commented Feb 8, 2019

@marieALaporte here you can attach the excel file

@omarbenites
Copy link
Contributor Author

omarbenites commented Feb 20, 2019

[NOW FIXED! 👍 ]

Fix issues in metadata as follow

  • experimental unit
  • factor label name
  • inclide expeirmwntal design and parameters
    screenshot_2019-02-19-10-32-39
    screenshot_2019-02-19-10-32-28

@omarbenites
Copy link
Contributor Author

omarbenites commented Feb 26, 2019

  • Seedbed preparation: list only the variables for the method chosen in AgroFIMS. I have selected tillage in AgroFIMS, but I also get the variables for ''puddling'', and ''land levelling'' in the fieldbook.
  • Planting-transplanting: list only the variables for the method selected in AgroFIMS. I have selected ''direct seeding'' but I also get the variables for ''transplanting''
  • Trait list : This is what I get:

image

  • Phenology: should be like ''Fieldbook'' with PLOT, ROW, COL, TREATMENT, and the variables selected
    image

  • Weather and Soil : the column header should be the variables name, without PLOT, ROW, COL, TREATMENT.
    image

  • What is ''Input''?

This is how is should be:

@omarbenites
Copy link
Contributor Author

  • Intecrop fails with soil and fertitlity (solved 👍 )
    image

@omarbenites
Copy link
Contributor Author

omarbenites commented Mar 6, 2019

🚫 This issues is not valid any more. Please check the next issue ⏭ #166 (comment)

  • KDSMART RULES

We had a call with Brian and Medha this morning about the ''NumberofMeasurementperPlot''. In KDSmart, they add a # in the trait name to give the number of measurement per plot. I put an example in the attached file with 2 variables in yellow in the Trait List and in the Fieldbook tab.

HEADER RULE IN FIELDBOOK: TraitName__(NumberMeaPerSeason)#(NumberMeaPerPlot)

  • Case 1

    • Number of Measurement per season = 1
    • Number of measurement per plot = 1
      Outcome: The Trait name in the field book will be: TraitName__1
  • Case 2

    • Number of Measurement per season = 2
    • and Number of measurement per plot = 3
      Outcome: The Trait name in the fieldbook will be:
      TraitName__1#1, TraiName__1#2, TraitName__1#3, TraitName__2#1, TraitName__2#2, TraitName__2#3
  • Case 3

    • Number of Measurement per season = 1
    • and Number of measurement per plot = 3
      Outcome: The Trait name in the fieldbook will be:
      TraitName__1#1 , TraitName__1#2, TraitName__1#3, TraitName__2#1, TraitName__2#2, TraitName__2#3

@omarbenites omarbenites reopened this Mar 6, 2019
@omarbenites
Copy link
Contributor Author

omarbenites commented Mar 6, 2019

METADATA

  • Treatment: should use the traitName label - should not be called ''Technique'' but ''tillage_technique''

Residue management tab

  • Residue_management_residue_incorporation_depthcm - should be Residue_management_residue_incorporation_depth_cm
  • Residue_management_description_start date - should be Residue_management_description_start_date
    The names are correct tin the Datadictionnary

Irrigation tab

  • only 1 underscore instead of the 2 required by KDSmart: Irrigation_splinkler_irrigation_system_1 should be Irrigation_splinkler_irrigation_system__1

Harvest tab

  • why is there a « __1 » when there is only one Harvest process? Whereas the is no « __1 » in the residue management tab, for which there is only one process too. Make it consistent.

  • In AgroFIMS I entered ''Harvest cut height''= 15cm, in the fieldbook the 15 is under Harvest_amount

TraitList

  • There are more variables in the TraitList than in the process tabs: Weeding_end_date and residue management_end_date for instance
  • Could you please change ''CropMeasurementPerPlot'' to ''NumberofMeasurementPerPlot''
  • Could you please change ''CropMeasurementPerSeason'' to ''NumberofMeasurementPerSeason''

@omarbenites
Copy link
Contributor Author

omarbenites commented Mar 7, 2019

Celine reported:
checked the Excel file and it seems that they are still some little bugs:

  • Funding Agency name: name of the CGIAR center is missing. I enterted Bioversity International in AgroFIMS :

  • Experiment lead: I entered nothing in AgroFIMS, but it automatically selected CGIAR center in the fieldbook.

  • Factor: I have 5 factors in my experiment. Why is there only 3 of them in a single column in the fieldbook?
    Ans: I added an underscore for every factor that user is adding

  • Crop: Other I have an ''Other'' crop. In AgroFIMS, the crop measurement tab didn't appear for ''other''. In the fieldbook, the measurements selected for Maize appear also in the tab for Other

  • Name of weather variable: should use TraitName

  • Name of soil variable in labbook: should use TraitName

  • Variables:
    not the same name used in TraitList and in the tab. Ex: in Traitlist: Soil_fertility_Product_rate , in Soil fertility tab: Soil_fertility_product_rate_(kg/ha)__1
    more variables in the TraitList than in the Soil fertility tab. I didn't find the names of the variables in the red square in the DataDictionnary in the Drive. Please use the names listed in the TraitName colunm.
    the variables without a VariableiD should not appear in the fieldbook (ex: Soil_fertility_biofertilizer_other)

  • Direct seeding variables are in the trait list, but there is no ''Direct seeding'' tab. Plus I only selected - [x] Direct seeding and there are also variables for Transplanting.

@celineaubert
Copy link
Collaborator

celineaubert commented Mar 11, 2019

  • In the TraitList, add name of the Crop in the ''Crop'' column for phenology.
  • For intercrop, concatenate the name of the crop with the name of the variable for Phenology, planting and harvest. ex'' cassava_harvest_start_date

@celineaubert
Copy link
Collaborator

Better if the cells that have not been fill in AgroFIMS are blank. Don't add ''NA''
image

@celineaubert
Copy link
Collaborator

celineaubert commented Mar 12, 2019

In the Excel fielbook, there is a mix between the factor -levels.

This is what I get:
image

It should be like this:

  • [ ]
    image

@celineaubert
Copy link
Collaborator

celineaubert commented Mar 13, 2019

@celineaubert
Copy link
Collaborator

celineaubert commented Mar 19, 2019

  • In Metadata, ''Select crop 1'' , call it ''Crop 1'' (same for crop 2,3, ...)

  • ''Crop variety(s) 1 '', call it ''Crop variety 1'' (same for variety 2,3, ...)

  • In Metadata find a better way to link Crop and Crop variety. In the example it is not possible to know which variety is maize and which on is soybean
    Example:
    image

Possible solutions

  1. list the varieties under the Crop
    image

  2. Add the name of the crop into the row header (Selected option)
    image

  3. any other solution you think off

@celineaubert celineaubert added this to the First release milestone Mar 21, 2019
@celineaubert
Copy link
Collaborator

celineaubert commented Mar 25, 2019

  • Downloaded fielbook metadata should have the AgroFIMS version - to help to find issues

@celineaubert
Copy link
Collaborator

celineaubert commented May 28, 2019

  • Name of the Fielbook file instead of fileNameBook: Fieldbook ID-System ID

@celineaubert
Copy link
Collaborator

celineaubert commented Jun 18, 2019

  • Have info about Person group per person number. All info about person 1 should be display together, all info about person 2 should be display together
    how it is currently (info mixed between person 1 and 2)
    image

How it should be
image

@celineaubert
Copy link
Collaborator

celineaubert commented Jun 18, 2019

Have different Ids, trait names and trait alias when a measurement is used for 2 crops in the same expriment.

  • How it is currently in the Excel fieldbook
    image

  • image

@celineaubert Thanks for reminding this issue. As we discussed in MPL, We are going to generate a random ID (for KDSMART) for all the traits in order to avoid duplications.

@celineaubert
Copy link
Collaborator

Hi @omarbenites

here is the last
HEADER RULE IN FIELDBOOK: (NumberMeaPerSeason):TraitName__(NumberMeaPerPlot)
ex:
NumberMeaPerSeason =2
NumberMeaPerPlot= 3

Header in fieldbook, in the Soil tab:
1:SoilPorosity__1, 1:SoilPorosity__2, 1:SoilPorosity__3, 2:SoilPorosity__1, 2:SoilPorosity__2, 2:SoilPorosity__3
see Excel file

Explanation for this choice from Brian
Naming of Traits using nMeasurementsPerSeason and nMeasurementsPerPlot.

It is better to use the "nPerSeason" to specify the "prefix" and the "nPerPlot" for the TraitInstance suffix.
By doing it in this way it will be much easier for the user in KDSmart.
When KDSmart asks the user to select the "active" Traits, it presents each of the TraitInstances grouped within the Trait.
So by using the TraitInstance-number for the "nPerPlot" they will see the following for nPerSeason==3 and nPerPlot==2:

.---- nPerSeason
|
v
( ) 1:PH
( ) 1:PH__1 <--- nPerPlot
( ) 1:PH__2

() 2:PH <--- One click selects all the "children"
(
) 2:PH__1
(*) 2:PH__2

( ) 3:PH
( ) 3:PH__1
( ) 3:PH__2

Each "nPerSeason" Trait collects its instances below it.
And you can quickly select "all of the TraitInstances for nPerSeason==2" at the same time.

Doing it the other way around the user would get:

.--- this was where you had the "nPerPlot"
|
v
( ) 1:PH
( ) 1:PH__1 <--- you had this as nPerSeason
(*) 1:PH__2
( ) 1:PH__3

( ) 2:PH
( ) 2:PH__1
(*) 2:PH__2
( ) 2:PH__3

So to choose "nPerSeason==2" the user would have to expand each of the "nPerPlot" items and then choose the "__2" items individually.

As you can image it gets even worse when you have nPerSeason==12 !

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 12, 2019

@omarbenites

  • Add the TraitLevel colomn in the TraitList tab of the Excel file . the colunm is already in the data dictionnary

  • @celineaubert The column is already there (⬇️ ), or are you requesting for other values?
    image

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 13, 2019

@omarbenites

  • Info filled in the module Planting and transplanting are not exported in the Excel file.

-Solved for the next update

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 22, 2019

@omarbenites

  • Choice for ''other'' type of experiment are not exported in the Excel file (ex: blabla is missing in the Excel)

image
image

Fixed for the next update ✔️

@omarbenites

remove the ''other'' in the list. Keep only the value of ''other'' (here: oth type) but not the name '' other''
image

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 29, 2019

@omarbenites

  • List the project management info about a Project entity together (like pic 2). Do the same for Funding agency

Currently
image

Info grouped by number
image

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 29, 2019

  • @omarbenites In the Excel file, change ''Row geometry Maize'' to '' Number of row Maize'' (same for all the crop)

AgroFIMS
image

Current Excel file
image

✅ fixed for the next update

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 29, 2019

@omarbenites In Intercropp, protocol info for the second crop is not exported in the Excel file.

image

image

A: @celineaubert look that you should have not selected the check box to export the information
image

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 29, 2019

  • Did not export in the Excel file: Plant density for Maize, and all the info about Planting_Cassava
    image
    image

✅ Solved for the next update

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 29, 2019

Timing for Crop Measurement:

  • The value is missing for other

  • Days after planting: I did not choose it, it was automatically added. Make sure it's not automatically added to the fieldbook.

image

  • @celineaubert that is because in the interface, we pre-filled with one value (in one call we agreed on it should have at least one value to know how they are measuring)
    image

@omarbenites it is better to not have any prefilled value.

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 29, 2019

Crop Phenology

Column alignement issue in the Traitlist
image

  • ✅ fixed for the next update

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 29, 2019

@omarbenites

  • Nomenclature is: (NumberMeaPerSeason):TraitName__(NumberMeaPerPlot)

image

Change the # for :

✅ Solved next update

@celineaubert
Copy link
Collaborator

celineaubert commented Aug 29, 2019

@omarbenites I have highlighted in yellow the tabs where the issues are.

CRD_rice_issues in yellow.xlsx

The issue for missing values in Traitlist for the measurement ''Plant density'' comes from AgroFIMS as it allows to select ''grain'' for ''Plant density''.
image

However, in the Crop_measurement file in the Drive, '' Plant density'' is only for whole plant

image

  • ✅ Solved for the next update

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 9, 2019

@omarbenites

  • CGIAR center name are missing in the list
    image

image

✅ Fixed for the next update

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 9, 2019

@omarbenites

  • Affilitation name is missing - and ''Organization name 1'' doesn't seems to be linked to any box in AgroFIMS
    image

image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 9, 2019

@omarbenites

  • Factor notes is not listed
    image

image

✅ Fixed for next update

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 9, 2019

@omarbenites

  • factor level is written twice
    image

✅ Ready for the next update

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 9, 2019

@omarbenites

  • info on Planting and Transplanting are not exported in the TraitList but some variable are missing in the Planting tab
    fileNameBook (3).xlsx
    ✅ Already fixed. Just need to select the check box to export the values

  • Residue info missing in trait lits (from To be collected)
    image
    image
    ⚠️ 💬 Residue incorporation depth will appear in case you select in the combo
    ✅ Fixed for the next update

  • Weeding info missing

image

image

✅ fixed for the next update

  • Harvest info missing
    image

image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 10, 2019

  • Irrigation - To be collected

  • Remove : Surface irrigation, Localized irrigation, Irrigation sprinkler technique from the list

  • Add Irrigation technique (listed in Datadictionnary, in tab Irrigation line 6)

image

  • Crop Phenology - TraitLevel

Please refer to the DataDictionnary when adding TraitLevel - TraitLevel for Phenology is Subplot

Info in the DataDictionnary:

image

Wrong info in Excel file exported from AgroFIMS

image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 10, 2019

  • Notes-Deviations - Change the content of this tab

Delete the current content
image

Replace with column Header : ''Label'', ''Description''
image

@omarbenites
Copy link
Contributor Author

omarbenites commented Sep 10, 2019

  • Update Tillage management data
  • Update soil, weather and phenology data

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 11, 2019

@omarbenites
''other'' type of experiment

  • remove the ''other'' in the list. Keep only the value of ''other'' (here: oth type) but not the name '' other''

image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 11, 2019

@omarbenites

  • review line Header in Excel file

current names --> Change to

  • Project management center 1 --> Project management CGIAR center 1

  • Project management contributor 1 --> Project management CRP contributor 1

  • Experiment, lead organization name 1 --> Experiment lead organization 1

  • Experiment, CGIAR center name 1 --> Experiment lead CGIAR center 1

  • Experiment, lead contributor crp 1 --> Experiment lead CRP contributor 1

image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 11, 2019

@omarbenites

  • ''Other'' info for Site, Vegetation surronding the exp site not reported in Excel
    image

image

image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 11, 2019

@omarbenites

  • In Design, Crop info (when in intercrop) is not exported for the factors where it's needed (harvest date, planting date, crop variety, ...)
    image

image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 11, 2019

@omarbenites

Management practices

  • When adding a second ''harvest'',''Irrigation'', ''weeding'', info are not reported in Excel. Be careful, when the info are reported they need to be numbered (ex: Harvest_start_date_2)

  • Irrigation

  • Weeding

  • Harvest
    image

@celineaubert You mean in the Protocol Sheet? @omarbenites Yes in the Protocol sheet
⚠️ I have modified some variables in the Data Dict. becuase there were not filtering correctly due to misspellings.

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 11, 2019

@omarbenites
Intercrop

  • Some variables are not all reported in Excel.
  • Also, why Seeding rate for common bean is in lb/ac? put it in kg/ha
    image

image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 11, 2019

@omarbenites

  • Info on TraitLevel missing for Phenology

image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 11, 2019

@omarbenites

fileNameBook (5).xlsx

  • Transplanting variables listed in Planting tab but not listed in TraitList

  • TraitAlias are missing for Phenology variables in TraitList

  • Irrigation technique listed in Irrigation tab but not listed in TraitList. 📑 Fixed in the data dict.

  • ''Amount harvested'' listed twice. Keep only Amount_harvested_kg

  • Crop_residue_thickness_ft change to Crop_residue_thickness_cm

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 11, 2019

@omarbenites

  • In Excel tab name, remove space between Planting-Crop
    image

@celineaubert
Copy link
Collaborator

celineaubert commented Sep 26, 2019

  • In Intercrop, KDSmart script doesn't work because there are similar parameter names in the Metadata sheet in Excel
    image
    image

Change Parameter names for the one below and remove ''Information on experimental unit'':
image

@celineaubert
Copy link
Collaborator

celineaubert commented Oct 3, 2019

@omarbenites

  • The info from Fertilizer management (soil fertility) module in Management practices should go in the Excel sheet called ‘’Fertilizer management’’ and not ‘’soil_sheet‘’. This is the sheet name recognized by KDSMart.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants