FY19Q4 Initial Panorama Testing Dates 11/19-11/20 COB

[KatieOC]

Testing Timeline and Instructions

Timeline

Friday 11/15 - initial Q4 clean data entry closes in DATIM
Tuesday 11/19 - Wednesday 11/20 QC Pano dashboards/dossiers in dev
Friday, 11/22 - Pano Q4 release

Scope - Instruction

See PPT (does not include log in info)
FY19Q4 Pre-Clean_Panorama_QC_Testing_no password.pptx

• Refer to the powerpoint for testing instructions (email from Pilar).
• Review functionality of each dashboard (remember to test OU/SNU, Partner/Mech, and Global if applicable)
• Review data (focus on Q4, but check prior periods as well) against the draft MSD that will be posted to SharePoint. We will send a message to you when this is ready and posted.
  ACTION:
• Compare data between test MSD and Pano, and enter information and screen shots with the incorrect data in the Analytics repo ticket that you are assigned to AND TAG Janice and Renee
• Make sure layout and functionality work and post any issues (labeling cut off, filters not working, etc) to the issue in the analytics repo.

Testing Assignments/Dashboard PoCs

• OVC OU https://github.com/pepfar-datim/Analytics/issues/541 - @mahirnkhan @jleehurst
• OVC P/M https://github.com/pepfar-datim/Analytics/issues/549 - @mahirnkhan @jleehurst
• OVC Global https://github.com/pepfar-datim/Analytics/issues/675 - @mahirnkhan @jleehurst
• PMTCT OU https://github.com/pepfar-datim/Analytics/issues/520 - @KatieOC
• PMTCT P/M https://github.com/pepfar-datim/Analytics/issues/552 - @KatieOC
• VMMC OU https://github.com/pepfar-datim/Analytics/issues/1193 - @vanamala-narasimhan /Stacey @aliyahwakil
• VMMC P/M https://github.com/pepfar-datim/Analytics/issues/1194 - @vanamala-narasimhan /Stacey @aliyahwakil
• VMMC GLOBAL https://github.com/pepfar-datim/Analytics/issues/674 - @vanamala-narasimhan /Stacey @aliyahwakil

Testing Assignments/Dossier PoCs

• Testing (1st 90) Single OU https://github.com/pepfar-datim/Analytics/issues/2191 @shazadahmed10 @randyyee
• Testing (1st 90) Global/All OU https://github.com/pepfar-datim/Analytics/issues/2192 @shazadahmed10 @randyyee
• Treatment (2nd 90): Single OU should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2472 (not https://github.com/pepfar-datim/Analytics/issues/2193) @aliyahwakil @nmcarloni - QC has been completed, waiting for issues to be resolved
• Treatment (2nd 90): Global/All should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2529 @aliyahwakil @nmcarloni - QC has been completed, waiting for issues to be resolved
• Viral Load (3rd 90): Single OU should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2463 (not https://github.com/pepfar-datim/Analytics/issues/2195) @anu87 @mackenziecox1
• Viral Load (3rd 90): Global/All should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2530 @anu87 @mackenziecox1
• Health Systems (HSS) Single OU should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2455 (not https://github.com/pepfar-datim/Analytics/issues/2197) @Yabayabadoo @ERottinghaus @vanamala-narasimhan
• DREAMS pepfar-datim/Analytics#2115 @kimisatoPC
• PMTCT-HEI Single OU should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2531 @KatieOC
• TB/HIV Single OU should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2532 @cnichols3h @HosseiniPR @LaChandraS
• OVC Global/All should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2534 @jleehurst @HosseiniPR
• Prevention Single OU should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2535 @BarbaraDdamulira @vanamala-narasimhan
• Prevention Global/All should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2536 @BarbaraDdamulira @vanamala-narasimhan
• Index Testing Global/All should reference Integration Testing ticket: pepfar-datim/Analytics#2251 @shazadahmed10 @kkale25

PRIME Led Dossier QC

• Clinical Cascade (CCC) Age/Sex should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2136 @SpaceForceOne @henry-miller-ogac @EAwong
• Clinical Cascade (CCC) All OU https://github.com/pepfar-datim/Analytics/issues/2132 @henry-miller-ogac @SpaceForceOne @EAwong
• Clinical Cascade (CCC) Single OU https://github.com/pepfar-datim/Analytics/issues/2133 @SpaceForceOne @henry-miller-ogac @EAwong
• Clinical Cascade (CCC) Site Level https://github.com/pepfar-datim/Analytics/issues/2261 @SpaceForceOne @henry-miller-ogac @EAwong
• Mapping Dossier Single OU should reference Integration Testing ticket: https://github.com/pepfar-datim/Analytics/issues/2533 @SpaceForceOne @NateHeard
• GEND_GBV OU https://github.com/pepfar-datim/Analytics/issues/1191 - @HosseiniPR
• GEND_GBV P/M https://github.com/pepfar-datim/Analytics/issues/598 - @HosseiniPR
• GEND_GBV Global https://github.com/pepfar-datim/Analytics/issues/2114 - @HosseiniPR
• Data Tables should reference Integration Testing ticket: pepfar-datim/Analytics#2550 @pvinayak001 / @HoustonJamie
• Narratives should reference Integration Testing ticket: pepfar-datim/Analytics#2549 Ebonnie

PQ Led Dossier QC

• SIMS Testing Dossiers pepfar-datim/Analytics#2410 @kayla-z @mehtasp
• PrEP Dossier https://github.com/pepfar-datim/Analytics/issues/2116 @kayla-z
• Cervical Cancer Dossier Global/All https://github.com/pepfar-datim/Analytics/issues/1718- @kayla-z @kkale25

If a PoC is unavailable during the proposed testing time period, they are welcome to transfer testing responsibilities to another colleague by editing the above comment and assigning the new tester, and writing a new comment to inform test leads that a new assignment has been made.

[reneerace]

Index Testing: https://github.com/pepfar-datim/Analytics/issues/2251
Narratives: https://github.com/pepfar-datim/Analytics/issues/2549
Data Tables: https://github.com/pepfar-datim/Analytics/issues/2550
If needed, Financial Management: https://github.com/pepfar-datim/Analytics/issues/2541

[kimisatoPC]

@reneerace @KatieOC @HoustonJamie Confirming that GEND_GBV dashboards (Global, OU, Mech) will be retired at Q4 initial?

[HoustonJamie]

@kimisatoPC they will not be, the PSC did not approve this request, they will be retired at clean Q1

[kimisatoPC]

@HoustonJamie I don't see anyone assigned to QC them and I unfortunately don't have time.

[HoustonJamie]

@KatieOC @kimisatoPC we were aware of this and someone was assigned, Katie do you remember who?

[kimisatoPC]

@HoustonJamie @KatieOC I see that Parviez has been assigned. Sorry! I didn't look under PRIME section. We are all good.

[KatieOC]

@mahirnkhan @jleehurst @aliyahwakil @shazadahmed10 @randyyee @cnichols3h @mackenziecox1 @cnichols3h @HosseiniPR @anu87 @Yabayabadoo @vanamala-narasimhan @LaChandraS @BarbaraDdamulira @kkale25 @HoustonJamie how goes testing?? the day is half done! Will you finish?
If you completed your QC and submitted tickets, please tick your box above. You can edit your section and say you submitted issues that still need to be resolved, if that's the case.

[jleehurst]

@mahirnkhan @jleehurst @aliyahwakil @shazadahmed10 @randyyee @cnichols3h @mackenziecox1 @cnichols3h @HosseiniPR @anu87 @Yabayabadoo @vanamala-narasimhan @LaChandraS @BarbaraDdamulira @kkale25 @HoustonJamie how goes testing?? the day is half done! Will you finish?
If you completed your QC and submitted tickets, please tick your box above. You can edit your section and say you submitted issues that still need to be resolved, if that's the case.

@KatieOC @erinschelar We have done a lot of work on our dossier, but there are a number of issues. I will continue working, but I will need the morning. I can finish by noon tomorrow.

[aliyahwakil]

@KatieOC Yes, will be completed by today.

[KatieOC]

@kkale25 @shazadahmed10 @HoustonJamie @randyyee @Yabayabadoo how's it going?

[kkale25]

@KatieOC - updated assigned dossiers!

[ERottinghaus]

Dossier/dashboard name: Health Services: Single OU
Chapter/page: OU Lab Quality
OU: All
Issue: Number of specimens received KPIs (all 7 boxes) are not changing when Implementing Mechanism + Partner selector is changed.

[anu87]

Dossier: VL Single OU
Chapter 2, Page: Testing Gap & VL Labs
OU: Mozambique
Issue: For some countries like Mozambique we can't see lab sites without zooming in on the map:

[anu87]

Dossier: Viral Load Single OU
Chapter 2, page: Specimen at Lab vs. Patients
OU: All
Issue: Note in red is redundant and needs to be removed

[Yabayabadoo]

Dossier: Health Services: Single OU
Chapter: N/A
OU: All
Issue: Name of dossier is incorrect, Health Systems OR Health Systems Strengthening not Health Services

[Yabayabadoo]

Dossier: Health Services: Single OU
Chapter/Page: HRH Support Overview/HRH At a Glance- OU
OU: All
Issue: No Scroll bar for page, visual truncated

[Yabayabadoo]

Dossier: Health Services: Single OU
Chaper/Page: HRH Support Overview/HRH Coverage Comparison
OU: South Africa
Issue: No data displaying for any fiscal year

[Yabayabadoo]

Dossier: Health Services: Single OU
Chapter/Page: HRH Support Overview/HRH Above Site comparison
OU: SA
Issue: Y axis generating odd intervals

[Yabayabadoo]

Dossier: Health Services: Single OU
Chapter /Page: HRH_CURR Cadre Mix/Average HRH team composition
OU: South Africa
Issue: left to right scrolling not working on this page. Visuals truncated

[HosseiniPR]

GEND_GBV OU Level and Global are agree with MSDs. GEND_GBV Mechanism is still defaults to 2018. Panorama and the MSDs don't agree with DATIM, but because it seems to be an issue with the DATIM cleaning favorite not including TA results, I've filed a DATIM ticket, #30850, on the helpdesk for DATIM.

[jleehurst]

@erinschelar

On OVC_SERV Coarse Age Comparison Chapter, the wrong StandardDisaggregates are selected in the dossier, thus creating a discrepancy with the Targets. The Dossier has "Total Numerator" selected as the disagg, but it should be "Age/Sex" and "Age/Sex Program Status"

For the Dashboard:

[kayla-z]

@shabeenally

Dossier: SIMS-MER Integrated Analysis
Chapter/Page: Partner Performance - SIMS 4.0 Assessments by Partner
OU: Botswana
(small) Issue: Title has a large space between the words "by" and "Partner"

[kayla-z]

@shabeenally

Dossier: SIMS-MER Integrated Analysis
Chapter/Page: Site Level Analysis - SIMS 4.0 Site Performance Over Time
OU: Botswana
Issue: Can't select more than one Organisation Site - no checkboxes

[kayla-z]

@shabeenally

Dossier: SIMS-MER Integrated Analysis
Chapter/Page: SIMS 4.0 Snapshots - Elective CEE Performance
OU: Botswana
Issue: Can't select more than one SIMS Set Name in drop down menu above, but can select more than one SIMS set name on side - do we need two drop down menus that are the same?

[kayla-z]

Dossier: Cervical Cancer Global
Chapter/Page: Cervical Cancer Cascade - Cervical Cancer Cascade Results by OU
Issue: When user first opens page, they can't see CXCA_TX_N results in table unless they scroll to side

[rblakeds]

Hi @kayla-z - I am reviewing item: #158 (comment)

No data is displaying for Botwana for the three metrics CXCA_SCRN_N, CXCA_SCRN_POS, and CXCA_TX_N in the grid as there are no values for Botswana in the graph (CXCA_SRCN_D is not in the graph); if you scroll down to Eswatini, there are values there

• Botswana returns in the grid because it has values for the CXCA_SRCN_D metric (which is not in the graph)
  

By default, it is my understanding that the Funding Agency should be set to a default of 'All' - is that correct? We can fix the Funding Agency selector to display all Funding Agencies by default.

[rblakeds]

Hi @randyyee - we researched the following item:
#158 (comment)

We found that the Target display value is rounded (to account for larger numbers), such that the 2K value is 1,778 and aligns with the left access. Please let us know if you have any questions.

[EAwong]

Dossier: Testing: Single OU
Chapter/Page: HTS_TST_POS, Pos: Pos trends by age/sex
OU: Mozambique
Issue: Extra "n/a" on x-axis

[rblakeds]

Hi @EAwong - for the issue #158 (comment)

Dossier: Testing: Single OU
Chapter/Page: HTS_TST_POS, Pos: Pos trends by age/sex
OU: Mozambique
Issue: Extra "n/a" on x-axis

Fix: the N/A has been filtered out in the visualization.

Fix availability: This fix will be available in Panorama Production for the 12/2/2019 Fast Follow Release.

[rblakeds]

Hi @cnichols3h for the issue #158 (comment)

Dossier/dashboard name: TB Screening and TPT: Single OU
Chapter/page: CH2 D1 and CH2 D2.
OU: Kenya
Our html code does not work on these pages. For ex, one should be able to enter a # and that will return the appropriate # of listings/rankings.

Fix: We found that there is no metric behind the filter selector, such that entering a # will not impact the results on the grid. This has been modified to use the percentage metric for filtering on those pages and those now filter the grid based upon the selection.

Fix availability: This fix will be available in Panorama Production for the 12/2/2019 Fast Follow Release.

Chapter 2 - D1:

Chapter 2 - D2:
Note: The Highest 7 are more than 7 values as there are many 100% that would all rank the same.

[rblakeds]

Hi @nmcarloni and @HoustonJamie - regarding ticket #158 (comment)

Review/Findings: I compared the values in the Treatment Summary Table to the Treatment Dossiers and found that the Treatment Summary Table value is filtered for Q4 (2019) and the Treatment Dossier value is filtered upon 2019 (not specifically for Q4:

The visualization filter for Retention Proxy is Years Ago = 0 (Similar to other visualizations on the page).

If I can the visualization filter to Quarters Ago = 0 (Q4 FY2019) to test this out, the value is then the expected 92%:

[rblakeds]

Hi @Yabayabadoo - regarding ticket comment: #158 (comment)

Dossier: Health Services: Single OU
Chapter/Page: HRH Support Overview/HRH Above Site comparison
OU: SA
Issue: Y axis generating odd intervals

Finding: The values for the particular selection require display of decimal places:

[rblakeds]

Hi @Yabayabadoo - regarding #158 (comment)

Dossier: Health Services: Single OU
Chaper/Page: HRH Support Overview/HRH Coverage Comparison
OU: South Africa
Issue: No data displaying for any fiscal year

Findings (from Renee):
The visualization filter as it is excludes results because HRH_STAFF does not have results for Disaggregate = CadreCategory/FinancialSupport:

See red box below.

Fix:
Fix availability: This fix will be available in Panorama Production for the 12/2/2019 Fast Follow Release.

Changed the filter to the following:

• (Indicator = 'HRH_CURR' AND Disaggregate = 'CadreCategory/Financial Support')
  OR
  (Indicator = 'HRH_STAFF_NAT' AND Standardized Disaggregate = 'CadreCategory')

• The filter upon (Indicator = 'TX_CURR' and Standardized Disaggregate = 'Total Numerator') appears to be extraneous (per Naveen) - the results are the same if we remove that from the filter.

Screenshot in Pano Dev, per the visualization filter changes:

[rblakeds]

Hi @Yabayabadoo - #158 (comment)

Dossier: Health Services: Single OU
Chapter /Page: HRH_CURR Cadre Mix/Average HRH team composition
OU: South Africa
Issue: left to right scrolling not working on this page. Visuals truncated

The visualizations on this page are set to custom settings to only display values between 0 and 2 (0 and 200%), such that is the reason that the visuals only display values between 0 and 200%.

If the custom setting is removed, all points are displayed on the visual (however, with no scrolling), as follows:

We are researching if there is a way to display a portion of the graph and allow scrolling.

[rblakeds]

Hi @Yabayabadoo - #158 (comment)

Dossier: Health Services: Single OU
Chapter/Page: HRH Support Overview/HRH At a Glance- OU
OU: All
Issue: No Scroll bar for page, visual truncated

We reviewed this item and found that the visualization is compressed; the visualization doesn't allow for scrolling as it returns the all of values in the heat map within the visualization display (compresses the content):
If you hover over the last heat map box on the far right, the value displays in the hover:

If expanded, this returns the same 7 breakouts:

Additionally, we tested this with a different attribute with more values to test how this will return and with more values and the values are compressed and returned within the particular space allocated:

[kimisatoPC]

@janholcombe @pilarbullis
Dossier: Prevention Global
Page: Prevention continuum by KP
OU: All

KP_PREV isn't populating as the first bar in the bar charts. It is populating in the Prevention Single OU dossier.

[pilarbullis]

@kimisatoPC After the two fast follows post 11/22 release, all issues found in Panorama production need to be submitted to Panorama support: https://pepfar-panorama.zendesk.com/hc/en-us

Thank you.

[janholcombe]

The issue with Prevention Global has been logged in Zendesk: https://datim.zendesk.com/agent/tickets/30917.