Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CBS TECO demo - video script #17

Closed
NMichas opened this issue Feb 6, 2018 · 58 comments
Assignees

Comments

@NMichas
Copy link
Contributor

@NMichas NMichas commented Feb 6, 2018

Hi and welcome to OpenWIS 2.0 proof of concept. Let's walk you through some work we have been doing over the last couple of months.


So, here is the current OpenWIS we all know and love.
People are searching for weather products all over the world. Data producers are producing data, and GISCs harvest and index data.
but... real-time access to data is limited.


So we asked... how can we make it better?


We'll tell you a story... but let's first introduce our heroes!
Here's Mouktar who runs a small server in a remote location.
He's not a computer expert, so he installs a Local Data Sharing Hub, using a fully automated procedure that only takes a few minutes.


Say hello to Omar.
Omar is pretty good with computers and wants to distribute Mouktar's data.
Omar installs a Regional Data Sharing Hub using a fully automated procedure that only takes a few minutes.


Hey Vicky!
Vicky works for a large association and wants to provide a comprehensive, curated list of weather-related products and data.
Vicky install an AWISC - the Authoritative WIS Catalogue.


Here's Mohamed and Dave.
Mohamed is working outdoors and wants to google today's weather conditions.
Dave is a seasoned meteorologist.
Ohh, it seems we forgot Mariam! Mariam is working on a weather prediction model for which she needs real-time access to Mouktar's data.


So, these are our heroes.
Mouktar, running the Local Data Sharing Hub.
Omar, running the Regional Data Sharing hub.
Vicky, running the Authoritative WIS catalogue.
Mohamed and Dave searching for information
and Mariam wanting real-time access to data.


So here's how the system works:
As soon as Mouktar pushes data to its local system, it is automatically transmitted in real-time to Omar's system.
Vicky's system is indexing Mouktar's data too, to update its local list of curated entries.
Google is also indexing Mouktar's data.


When Mohamed is looking for data, he can use google like he is used to.
Dave, wants and expert search interface, one that google cant' provide, so he is using AWISC.
Mariam can subscribe to the RDSH to get notifications as soon as new data is available.

@woollattd

This comment has been minimized.

Copy link

@woollattd woollattd commented Feb 9, 2018

My thoughts on changes to the intro section (changes in Bold):

Hi and welcome to the OpenWIS Association's proof of concept. Let's walk you through some work we have been doing over the last couple of months.

So, here is the current WIS 1.0 concept we all know and love.
People are searching for weather products all over the world. Data producers are producing data, and GISCs harvest and index data.
but... real-time access to data is limited.

So we asked ourselves... how can we make it better for WIS 2.0?

@solson-nws

This comment has been minimized.

Copy link
Contributor

@solson-nws solson-nws commented Feb 13, 2018

@solson-nws

This comment has been minimized.

Copy link
Contributor

@solson-nws solson-nws commented Feb 13, 2018

Added a narrative for CBS Demo. Jeremy and others, please feel free to review and comment.

Thanks!

Steve

@solson-nws

This comment has been minimized.

Copy link
Contributor

@solson-nws solson-nws commented Feb 13, 2018

Please comment by next thursday to allow enough time to redo the video before CBS TECO

Thanks!

Steve

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Feb 13, 2018

@solson-nws ... will do my best to review on the requested timescale

@rogers492

This comment has been minimized.

Copy link
Contributor

@rogers492 rogers492 commented Mar 8, 2018

The TECO slot is 30 mins. We are planning for:
5 mins video
15 mins demo
10 mins Q&A

@rogers492

This comment has been minimized.

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 9, 2018

Hi - having seen what ED have developed for the PoC, I have developed a narrative that walks us through all the important parts of the systems ...

See the attached PDF. I hope you can read my handwriting!

OpenWIS2.0 demonstration script for CBS TECO.pdf

(note: I am on vacation during the early part of next week, so may be slow in answering any emails for clarification. If it's urgent, please get Paul to call me on the phone)

@tg4444

This comment has been minimized.

Copy link
Contributor

@tg4444 tg4444 commented Mar 12, 2018

Hi all,

Here's a little feedback on Jeremy's pdf.

  1. We will provide you with the configuration (URLs, names, etc.) required for the integration of the Gaul LDSH with AWISC and RDSH, by Thursday the 14th.
  2. Step/Section 8: There is no QR-code that takes you to the page where you subscribe to the dataset. The subscription URI exists in textual form on the "human-radable webpage".
  3. Step/Section 9: After a new dataset is added to the LDSH, it will be necesssary to use the "Index now" button of the AWISC, in order to get information from the LDSH immediately, and not have to wait for the scheduled job to execute.
  4. Step/Section 10: Please note that the channel will be created only when the first piece of data/notification has been disseminated, because it is created on-the-fly.
  5. Step/Section 11: We intended to provide a QR-code that could be used to automatically subscribe to the channel, but we could not find a mobile MQTT client that could function by direct/indirect scanning of a QR-code, so we scrapped the idea. As a result, the URL will need to be entered manually into the mobile app. (Please note that @dimipapadeas has provided a selection of MQTT clients that could be used, here: #18)
  6. Step/Section 12: We did not manage to find a way to provide a browser-based FTP file upload, so an actual FTP client will have to be used. We can provide you with options for specific O/S's if you wish.
@rogers492

This comment has been minimized.

Copy link
Contributor

@rogers492 rogers492 commented Mar 13, 2018

One more thought.

Everything is browser based (LDSH, RDSH, AWISC ... and even the FTP client) so I can run each one of those bits myself - or with help from Rémy and others actually in Geneva.

I can even use different browsers (edge, chrome, Firefox etc) to make it look even more distributed...

The only bit we won’t have software for will be the MQTT client.

Suggest that Nassos (or one the ED team) play the role of Mariam via WebEx ...

They can share their screen and show the MQTT client receiving the data.

I think this would improve the demo anyway, because Mariam would be a remote user - like in real life.

See what the ED guys think?

Also- if we need a plug in for the FTP client in the browser, I need to know ahead of time so that I can get it installed.

Jeremy

@rogers492 rogers492 closed this Mar 13, 2018
@rogers492 rogers492 reopened this Mar 13, 2018
@dimipapadeas

This comment has been minimized.

Copy link
Contributor

@dimipapadeas dimipapadeas commented Mar 13, 2018

We will be happy to join through Webex and play the Mariam role. Just please provide us with the script/use-cases you want us to act.

Concerning the browser FTP plugin, the best we could come find is a Chrome App, called sFTP.
The bad news with it is that it is not actually integrated within chrome, but starts like an external application, much like Filezilla.
Also, to launch it, you need to either do it from your O/S start menu, or do the following:

  1. Open Chrome.
  2. In the address bar at the top, type chrome://apps.
  3. Press Enter.
  4. Click the app you want to open.
@solson-nws

This comment has been minimized.

Copy link
Contributor

@solson-nws solson-nws commented Mar 13, 2018

@rogers492

This comment has been minimized.

Copy link
Contributor

@rogers492 rogers492 commented Mar 13, 2018

Do we know what time of day the demo session is scheduled for? We probably want someone playing Mariam who was going to be awake anyway - so afternoon in Geneva would be OK for Mark, anytime would be OK for europeans, most times would be tricky for Korea and Australia.

@rogers492

This comment has been minimized.

Copy link
Contributor

@rogers492 rogers492 commented Mar 13, 2018

I think the demo session begins at 27/3/2018 14:00 Geneva time, or later in the afternoon.

@rogers492

This comment has been minimized.

Copy link
Contributor

@rogers492 rogers492 commented Mar 13, 2018

@6a6d74 George has added some useful notes above about your narrative. When discussing it, we also thought you might like to mention that Google does not crawl/index a NEW data set instantaneously. However, if you have subscribed to a data set, new data is notified/sent immediately.

@NMichas

This comment has been minimized.

Copy link
Contributor Author

@NMichas NMichas commented Mar 13, 2018

Please check the attached consolidated version having the gaps filled-in. If someone could address my comments within the document we may consider the script finalised.
video-script.docx

@wqu-bom

This comment has been minimized.

Copy link

@wqu-bom wqu-bom commented Mar 13, 2018

In video-script.docx, Nassos ask to confirm whether to inlcude "some goals of this Proof of Concept study and how they could fulfill WIS 2.0 objectives". I think this is necessary, as we need to introduce or reinforce (if already introduced eleswhere) the main ideas of WIS2.0, at least those ideas that this PoC tried to explore. The first goal is ok to me and relevant to WIS2.0. I am not sure about the second and third dot points (the fourth one is the repeat of third one) and whether they are relevant to the PoC and in what way. By look at the vedio, this PoC is mainly about "to increase the discoverability and accessibility of authoritative weather, water and climate data", although WIS2.0 may involve other innovations. I suggest to restrict to the first goal, which could save a couple of slides.

@NMichas

This comment has been minimized.

Copy link
Contributor Author

@NMichas NMichas commented Mar 16, 2018

Final version proposal

Hi and welcome to OpenWIS Association's proof of concept. Let's walk you through some work we have been doing over the last couple of months.

So, here is the current OpenWIS 1.0 concept we all know and love.
People are searching for weather products all over the world. Data producers are producing data, and GISCs harvest and index data.
but... real-time access to data is limited. And for that matter, so is the ability to discover this data publicly

So we asked ourselves... how can we make it better for WIS 2.0?

Let’s start with some goals of this Proof of Concept study and how they could fulfill WIS 2.0 objectives:

  • The first goal is to increase the discoverability and accessibility of authoritative weather, water and climate data.
  • The second goal is to show real-time data transfer using commodity open-standard software instead of the WMO Global Telecommunication System.

Now let's introduce the cast and their roles!

First, there’s John who wants to publish datasets to the web from a remote location.
He's not a computer expert, so he installs a Local Data Sharing Hub, using a fully automated procedure that only takes a few minutes. Think of a Local Data Sharing Hub as a small piece of software allowing anyone to publish datasets on the Web.

Say hello to Omar.
Omar wants to distribute John's data, he installs a Regional Data Sharing Hub using a fully automated procedure that only takes a few minutes. A Regional Data Sharing Hub allows end-users to receive real-time notifications about data updates from Local Data Sharing Hubs.

Now say hello to Vicky!
Vicky works for a large association and wants to provide a comprehensive, curated list of weather-related products and data.
Vicky installs an AWISC - An Authoritative WIS Catalogue. An Authoritative WIS Catalogue is designed to provide a curated view of all datasets registered in WIS.

Next, meet Mohamed and Dave.
Mohamed is working outdoors and wants to google today's weather conditions.
Dave is a seasoned meteorologist. Dave wants access to an expert search interface and a curated list of WIS datasets.

Oh, it seems we forgot Mariam! Mariam is working on a weather prediction model for which she needs real-time access to John's data.

So, this is our cast:
John, running the Local Data Sharing Hub.
Omar, running the Regional Data Sharing hub.
Vicky, running the Authoritative WIS catalogue.
Mohamed and Dave searching for information
and Mariam wanting real-time access to data.

So here's how the Proof of Concept system works:

As soon as John pushes data to its local system, it is automatically transmitted in real-time to Omar's system.
 Vicky's system is indexing John's data too, to update its local list of curated entries.
Google is also indexing John's data.

When Mohamed is looking for data, he can use google like he is used to.
Dave, wants and expert search interface, one that google cant' provide, so he is using AWISC. AWISC provides a customised user interface to perform weather-related searches.
Mariam can subscribe to the RDSH to get notifications as soon as new data is available.

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 19, 2018

Hi - I've created some slides to run through during the demo. There are some bits (the text in red) that need to be finalized e.g. the subscribtion URL ...

Also, I think that Paul took a few notes when we met on Friday about small amendments in the demonstration. I'm not sure if I captured all these ... worth cross-referencing with Paul.

openwis-wis2-demo-cbsteco-ii.pptx

@rogers492

This comment has been minimized.

Copy link
Contributor

@rogers492 rogers492 commented Mar 20, 2018

Notes for the demo (JT narrative):

  1. Mention that the LDSH can be an NC or DCPC etc, to explain the new vocab in WIS 1.0 terms.
  2. Explain the advantages of having an LDSH - can do local searches, ease of pub to web etc.
  3. Also explain the value of the RDSH and AWISC.
  4. Merge section section 10 and 12 because the channel only appears when you push data. Make the point that the channel is automatically created when you push data.
  5. Update section 11 to show how Mariam searches in the AWISC and finds the data set, then uses the MQTT client to subscribe.
  6. Demo slot is 25 mins but will be at end of day, so could sneak a few more mins. Aim for 5 min intro, 15 min demo, 5 min Q&A.
  7. Remy can know the name of the channel to subscribe to beforehand.
  8. Remy's phone could raise an alert when a message arrives.
@rogers492 rogers492 closed this Mar 20, 2018
@rogers492 rogers492 reopened this Mar 20, 2018
@rogers492

This comment has been minimized.

Copy link
Contributor

@rogers492 rogers492 commented Mar 20, 2018

@6a6d74 The animation at the end is great - it makes the process clear.

@tg4444

This comment has been minimized.

Copy link
Contributor

@tg4444 tg4444 commented Mar 20, 2018

This is the cast of the video presentation
Dave:
dave

John:
john

Mariam:
mariam

Mohamed:
mohamed

Omar:
omar

Vicky:
vicky

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 21, 2018

@NMichas

This comment has been minimized.

Copy link
Contributor Author

@NMichas NMichas commented Mar 21, 2018

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 24, 2018

I'll reload all the browser sessions on Tuesday afternoon before the demonstration.

@tg4444 / @NMichas - the initial state for the demo should be:

  • Britannia LDSH is registered with AWISC & RDSH, and has some datasets configured
  • Gaul LDSH is already registered with AWISC
  • Gaul LDSH is not registered with RDSH
  • Bibracte dataset is already configured & indexed by AWISC
  • Bibracte dataset has no data

Please can you make sure that things are set up like this? Thank you.

@NMichas

This comment has been minimized.

Copy link
Contributor Author

@NMichas NMichas commented Mar 24, 2018

Sure, we'll have these configured for Tuesday morning.

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 24, 2018

Hi @NMichas

Also, please can you remove "wind speed" from the Cenabum dataset (Gaul LDSH) ... I want only to find Bibracte when I do expert search

I've done this in the live Web app - but you might restart / reload the data at some point

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 24, 2018

@NMichas

One more thing - just in case the net2ftp service is down during the demo, can you have an FTP client & data files ready to go? Thanks...

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 24, 2018

Updated presentation (and notes)

It's pretty close to 15-minutes plus the video. ED team will need to get involved at the end when they play Mariam....

openwis-wis2-demo-cbsteco-vi.pptx

openwis-wis2-demo-cbsteco-vi-notes.pdf

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 25, 2018

Final (hopefully!) update to the presentation - making the summary points on a separate slide.

openwis-wis2-demo-cbsteco-vii.pptx

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 26, 2018

Thinking about tomorrow's live demo, I though I would explain the logistics and running order...

I will be hosting a WebEx for the demo tomorrow. Details are:

The demo itself is due to start at 5:30 pm CEST - but please get online earlier.

I've asked Paul to send around the details by email - including the password!

  1. Slides 1-17 is me, switching to the various Web pages as needed
  2. Slide 18 - check with Remy that his mobile phone is configured for subscription to Bibracte dataset via MQTT
  3. Slides 19-20 is me in the driving seat again
  4. Slide 21: EuroDyn play the role of Mariam ... I pass the WebEx presenter mode to EuroDyn and show the WebEx screens-share ... EuroDyn then (I) show https://openwis2.eurodyn.com/awisc; (ii) type "bibracte" into the search field; (iii) click through to the Bibracte dataset page; (iv) find the ; (v) copy this into the MQTT client ... for speed, EuroDyn keep the presenter mode, but I go back to presenting the slides
  5. Slide 22-24 is me again
  6. Slide 25 is the complicated one for the demo- see below
  7. Slides 26-27 is me to summarise and finish

Note: quite a few slides are hidden!

Slide 25:

  1. Check that EuroDyn (Mariam) and Remy are ready to receive data
  2. I switch to net2ftp.com FTP client and find a "bibracte" data set to upload
  3. I show both my browser and the WebEx screen share on the screen ... so that we can see when the data arrives at the MQTT client
  4. I press "submit" on the FTP client
  5. We should see the data arrive on Mariam's MQTT client and hear data arrive on Remy's phone
  6. I check with Remy that he received the data
@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 26, 2018

@NMichas -

Have you decided who from EuroDyn will be Mariam tomorrow?

See above.

@NMichas

This comment has been minimized.

Copy link
Contributor Author

@NMichas NMichas commented Mar 26, 2018

Dimitris Papadeas will be Mariam.

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 26, 2018

Thanks -

@dimipapadeas - please let me know if you have any questions about the demo. The Notes in the PowerPoint presentation should show what you need to do.

@dimipapadeas

This comment has been minimized.

Copy link
Contributor

@dimipapadeas dimipapadeas commented Mar 27, 2018

@6a6d74 No questions from my side, the Notes are quite clear.

@dimipapadeas

This comment has been minimized.

Copy link
Contributor

@dimipapadeas dimipapadeas commented Mar 27, 2018

@6a6d74, @rogers492 , @woollattd We are ready for the Demo, LDSHs, RDSH and AWISC are set as requested.

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

@dimipapadeas - thank you. I've been through and reloaded all my tabs :-)

I noticed that LDSH Gaul was still shown in the RDSH. I have deleted it ...

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

@dimipapadeas

My audio (on the WebEx) isn't going to be connected from the laptop I'm using ...

So - I will dial into the WebEx on my iPhone for audio (speaker phone) ... I'll be able to talk to you through that. Hopefully we'll not get feedback from the conference audio system!

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

All - for those who wish to follow the demo live, WMO are broadcasting the session live ....

"""
The Plenary discussion will be broadcasted through Web-streaming; please follow the link below for accessing it:

https://c.connectedviews.com/01/WMOPublic
"""

(see http://meetings.wmo.int/cbs-teco-2018/SitePages/Session%20Information.aspx)

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

@dimipapadeas

I should add that the WMO broadcast has about a 60-second delay, so don't rely on that for knowing when you need to be Mariam!

@tg4444

This comment has been minimized.

Copy link
Contributor

@tg4444 tg4444 commented Mar 27, 2018

Concerning the Google search, it has not indexed the dataset pages yet.
Furthermore, the search results for "ldsh britannia" (without quotes) are inconsistent when searching from Greece. If including the quotes, we appear as the first result.

I also tried using a Swiss proxy server to do the search (a server of the World Health Organization in Geneva), and "ldsh britannia" (without quotes) did return as the first result.

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

@tg4444 -

In the demo I talk about our WIS2 pilot application "not being popular enough yet" to be regularly indexed or to rank highly in the result.

Then I do an alternate search for the LDSH itself. I noticed this morning that "ldsh britannia" didn't come up in the first page either ... but I found that if I mis-spelled the search as "ldsh brittania" it comes up third in the search results.

Thanks for reminding me that I can search with quoted text!

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

All - just to be aware that the CBS TECO session is currently running 30-minutes early. I doubt that it will affect the start time of the demo ... but @dimipapadeas: please be ready a little early!

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

Hello ... me again! The demo will now be from the Press Room at WMO rather than the main conference room; probably to make it easier to hook up my laptop etc. This means that WMO will not be broadcasting the WIS2 side event (and our demo).

WMO will still record the session (via BlueJeans videoconference). I will still be using WebEx as per our plan.

You folks can follow the demo via WebEx; hopefully you'll be able to hear me via my phone audio (on speaker phone) as I talk through the presentation.

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

Update on side event start time! (session agenda was just updated)

Scheduled start time for the WIS 2.0 side event is now 17:00 CEST (GMT+2)

@rogers492

This comment has been minimized.

Copy link
Contributor

@rogers492 rogers492 commented Mar 27, 2018

Demo presented to WMO CBS TECO Geneva at 17:00 CEST 27th March 2018.

@rogers492 rogers492 closed this Mar 27, 2018
@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

Hi all - other than a few errors (from me! apologies for not starting the screen share) I think it went well ... the software worked without a problem. I think that people are beginning to get the idea about what we're trying to achieve.

@dimipapadeas - thanks for being Mariam!
@remygiraud - thanks for being yourself :-)

@solson-nws

This comment has been minimized.

Copy link
Contributor

@solson-nws solson-nws commented Mar 27, 2018

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

I've cleaned up the presentation notes & removed the config details etc. See below...

I'll share this with WMO for publication on the CBS TECO meeting pages.

openwis-wis2-demo-cbsteco-vii-clean.pptx

@6a6d74

This comment has been minimized.

Copy link

@6a6d74 6a6d74 commented Mar 27, 2018

Thanks @solson-nws

I think that the video and the demo will be useful for lots of outreach type activities - trying to get the WMO community to understand how WIS 2 is different.

@6a6d74

This comment has been minimized.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
8 participants
You can’t perform that action at this time.