NASA ARSET Introduction and Demonstration of STREAM
The Story
Welcome to this highly practical and insightful episode of the NASA Live Video Podcast: "NASA ARSET: Introduction and Demonstration of STREAM."In this episode, we turn our attention to the critical frontier of water resource management and flood forecasting. As global weather patterns become increasingly unpredictable, having access to accurate, scalable, and timely streamflow data is vital for disaster preparedness, agricultural planning, and water security. To address this, we explore the capabilities of STREAM—a cutting-edge streamflow prediction and routing tool designed to optimize hydrological modeling.
Through the framework of NASA’s Applied Remote Sensing Training (ARSET) program, we provide a comprehensive introduction and a hands-on demonstration of the STREAM platform. We break down how this tool integrates satellite-derived precipitation data, land surface models, and geographic information systems (GIS) to simulate and forecast river discharge and streamflow dynamics across varied watersheds. Watch and learn how to navigate the user interface, input parameters, extract localized hydrological data, and interpret predictive graphs for real-world decision-making.
Whether you are a hydrologist, a water resource manager, an emergency responder, or a space enthusiast eager to see how Earth observation data translates into localized flood-warning systems, this episode is a must-watch. Subscribe to the NASA Live Video Podcast to stay at the absolute forefront of space exploration, remote sensing software demonstrations, and cutting-edge earth science!
Speaker 1: Hello, and welcome everyone to this training on monitoring water
Speaker 1: quality in lakes and coastal regions using satellite based tool
Speaker 1: for Rapid Evaluation of Aquatic environments or STREAM. My name
Speaker 1: is a meta meta from NASA's Applied Remote Sensing Training
Speaker 1: Program or our SET program, and we have a guest
Speaker 1: speaker today, William Wainwright from NASA Goddard Spaceword Center, who
Speaker 1: will be focusing on introduction and demonstration of STREAM. We
Speaker 1: will start with a brief overview of our SET program.
Speaker 1: Our SET is part of NASA's Applied Sciences Program, its
Speaker 1: capacity building program, and provides accessible, relevant and cost free
Speaker 1: training on remote sensing satellites, sensors, methods, and tools. Trainings
Speaker 1: include a variety of applications of satellite data and our
Speaker 1: tailor to audiences with a variety of experience levels. Specific
Speaker 1: are SET focuses on these thematic areas for applications agriculture,
Speaker 1: climatory resilience, disasters, ecological conservation, health and air quality, water resources,
Speaker 1: and wildland fires. SET trainings are offered online or there
Speaker 1: are in person trainings offered as well. Online trainings can
Speaker 1: be live and instructor led like this one or They
Speaker 1: can be asynchronous and self based, available from our set website.
Speaker 1: The link is provided here. These trainings are cost free
Speaker 1: as I mentioned earlier, and only use open source software
Speaker 1: and data. Many of our trainings are offered in multiple languages,
Speaker 1: especially their material is available in Spanish for many trainings,
Speaker 1: and they accommodate differing levels of expertise. Please visit ourset
Speaker 1: website for more information. We'll start with an overview of
Speaker 1: this training, monitoring what quality in lakes and coastal regions
Speaker 1: using stream now. It is well recognized that monitoring water
Speaker 1: quality is vital for planning and managing drinking water treatment,
Speaker 1: for public health and ecosystem advisories, and also for assessing
Speaker 1: health and productivity of fresh water and saltwater fisheries. Conventional
Speaker 1: INC two measurements of water quality parameters are expensive and
Speaker 1: have limited spatial and temporal coverage. As you can see
Speaker 1: here there's an example of Lake Aria in the US.
Speaker 1: Is the western part of the lake which is prone
Speaker 1: to have harmful alcohol bloom or ABS. And if you
Speaker 1: can see these dots they represent where INCIT two measurements
Speaker 1: are taken. As you can see, not the entire lake
Speaker 1: is covered, just a few locations are covered these. Some
Speaker 1: of these measurements are weekly. There's buis which provide continuous data,
Speaker 1: but there are very few. Also, there are so many
Speaker 1: water bodies in the world and long coastal areas, they
Speaker 1: all cannot be measured with in water samples and water
Speaker 1: quality parameters cannot be assessed that way. On the other hand,
Speaker 1: if you can see this lenset image on August thirteen,
Speaker 1: twenty thirty four where alcohol bloom occurred in lake around
Speaker 1: the same area, now you can see a continuous picture
Speaker 1: and also see pattern where intensity of HEB was low
Speaker 1: and high in the lake. So that way, remote sensing
Speaker 1: provides a cost effective way to assess water quality. Also,
Speaker 1: it can cover thousands of lakes and coastal waters with
Speaker 1: improved coverage. Currently there are several satellites flying with sensors
Speaker 1: allowing water quality monitoring. The table here is for your
Speaker 1: reference and provides information about the satellites, sensors, measurements they do,
Speaker 1: and their special and temporal resolutions. Just briefly going over
Speaker 1: the current satellites, it's lens AT eight, lands At nine, Tera,
Speaker 1: Aqua S and pp GPSS GPSS are Noah satellites. NOAH
Speaker 1: twenty and twenty one, Sentinel two A, two B, two C,
Speaker 1: and Sentinel three A and three B. These are European
Speaker 1: Space Agency satellites and the latest NASA mission base that
Speaker 1: is flying currently as well. All these satellites are in
Speaker 1: polar orbits as you can see, and these are the
Speaker 1: sensors flying on these satellites. All these acronyms are defined
Speaker 1: at the end of this presentation should be available to
Speaker 1: you in your dog so this is only only two
Speaker 1: mods weirs, MSI OLG and o CI. These are the
Speaker 1: water quality monitoring sensors. They have spectral measurements in optical
Speaker 1: bands ranging from visible, near infrared, middle infrared, and some
Speaker 1: also have thermal infrared bands. So all these can be
Speaker 1: used to monitor water quality parameters. They can be derived
Speaker 1: from these data top of the atmosphere reflectance in optical bands.
Speaker 1: As you can see, they all have different temporal and
Speaker 1: special coverage and resolutions. Thing to note here is that
Speaker 1: Lenset eight and nine and Sentinel two series they have
Speaker 1: the highest special resolutions it's intensive meters and the other
Speaker 1: sensors like motor spheres o g oci, they have low
Speaker 1: to medium resolutions ranging from two fifty meters all the
Speaker 1: way to one kilometer. On the other hand, Lancet and
Speaker 1: Centinal two they have narrow swarths, whereas Terra acquire S
Speaker 1: and ppgps as Sentinel three and Pace have broad swaths
Speaker 1: in thousands of kilometers as you can see here, so
Speaker 1: they all can be used for water quality monitoring at
Speaker 1: different special and temporal resolutions. Lancet each one has sixteen
Speaker 1: dairy revisit time, so with both of them it's about
Speaker 1: eight day, and Sentinal two series has about five day
Speaker 1: revisit time. All other sensors that we have there one
Speaker 1: to two day revisit time, so there are trade offs
Speaker 1: between temporal and special resolutions.
Speaker 2: As you can.
Speaker 1: See, our set has several trainings on water quality monitoring
Speaker 1: using remote sensing, and the links and titles are provided here.
Speaker 1: These are set trainings focused on water quality parameters derived
Speaker 1: from sensors like motives, WIRs, OLG and oci with relatively
Speaker 1: low to medium resolutions from two fifty meters to one kilometer.
Speaker 1: Before stream higher resolution data that is, at twenty to
Speaker 1: thirty meter resolution data, water quality parameters were not readily
Speaker 1: available and had to be derived by using algorithms developed
Speaker 1: from satellite data and in CITU measurements for the water
Speaker 1: body of your interest. An example of that can be
Speaker 1: found here in this training. So here is an example
Speaker 1: of chlorophyll a concentration from pace oci at one kilometer.
Speaker 1: I can clearly see that coastal areas and open oceans
Speaker 1: are resolved and covered nicely in pace oci, and bigger
Speaker 1: lakes can also be seen like Great Lakes and other
Speaker 1: bigger water body can be resolved. But there are several
Speaker 1: small water bodies that are not resolved by this medium
Speaker 1: to low resolution sensors. And that brings us to today's topic,
Speaker 1: and that is Stream for water quality monitoring. Stream, as
Speaker 1: we will see later, uses LENST eight and nine and
Speaker 1: sentinal two series data and derives water quality parameters at
Speaker 1: twenty to thirty meters special resolution. It's an interactive web
Speaker 1: tool and an API enabling monitoring or water quality in
Speaker 1: near real time since twenty eighteen. Using Stream, you can
Speaker 1: see that they can resolve smaller water bodies if the
Speaker 1: lake or water body is one hundred meters square or
Speaker 1: bigger than STREAM can resolve it. Currently, Stream focuses on
Speaker 1: inland lakes and coastal areas in the US and some
Speaker 1: lakes in certain countries are also available from stream. What
Speaker 1: quality data are derived by using an open source model
Speaker 1: and we will cover that as well. An example shown
Speaker 1: here again is pace OCI and stream chlorophile A concentration.
Speaker 1: This is in Montana, uh This is Lake Canyon Ferry
Speaker 1: and you can see that this is a fairly large
Speaker 1: lake and can be seen in both pace OCI data
Speaker 1: as well as sentinel to data. Thing to notice here
Speaker 1: is that there are several small lakes that we see
Speaker 1: here in stream. They are not visible here in pace OCI.
Speaker 1: Also you can see that being this being high resolution,
Speaker 1: you can see more details in chlorophil A concentration distribution
Speaker 1: in the lake. With that, our training learning objectives are
Speaker 1: that by the end of this training you will be
Speaker 1: able to identify the purpose, capabilities, and benefits of this
Speaker 1: stream tool for analyzing inland and coastal water bodies. Identify
Speaker 1: the process to use stream to monitor chlorophil A concentration,
Speaker 1: secut disk depths and total suspended solids in lakes and
Speaker 1: coastal waters. Identify the steps to use stream API to
Speaker 1: search and download these parameters for a specific time period.
Speaker 1: Examine time series of chlorophil A concentration SECHI disk steps
Speaker 1: and total susmcted solids using QGIS and identify how an
Speaker 1: open source machine learning model based on mixture density network
Speaker 1: enables users to estimate water quality parameters for any inland
Speaker 1: or coastal water body which is greater than one hundred
Speaker 1: meters square or so worldwide. Here are the prerequisites for
Speaker 1: the strain. First one is Fundamentals of remote sensing. This
Speaker 1: ur set training provides background about satellite remote sensing principles,
Speaker 1: different satellite orbits, different data levels that described in here.
Speaker 1: The second training is monitoring water quality of inline leaks
Speaker 1: using remote sensing. This training provides information about how to
Speaker 1: use satellite data together with institute data to develop statistical
Speaker 1: algorithm and then can be used with satellite data to
Speaker 1: drive water quality parameters. There will be two parts to
Speaker 1: this training. Today Part one will focus on introduction and
Speaker 1: demonstration of stream and part two next week on February seventeenth,
Speaker 1: will focus on introduction to a machine learning model to
Speaker 1: estimate water quality parameters based on satellite observations. There will
Speaker 1: be one homework assignment will be open on February seventeenth
Speaker 1: and it will be due on March tenth posted on
Speaker 1: our set website. Our certificate of completion will be awarded
Speaker 1: to those who attend all live sessions and complete the
Speaker 1: homework assignment before the given due date. We'll start with
Speaker 1: today's session on introduction and demonstration of Stream and specific
Speaker 1: objectives for today are that by the end of part one,
Speaker 1: you will be able to identify features of stream website
Speaker 1: and API for selection and display water quality parameters for
Speaker 1: selected leaks and coastal areas. Recognize how to download water
Speaker 1: quality parameters using stream API, and recognize how to display
Speaker 1: maps and time series of Chlorophila concentration, secy disk depth
Speaker 1: and total suspended solids for selected water body. Outline for
Speaker 1: today is that our guest speaker, William Wainwright, will start
Speaker 1: by providing an overview of stream. He will also have
Speaker 1: demonstration of making maps of water quality parameters using stream
Speaker 1: web tool and how to use stream API to find
Speaker 1: water quality parameters multiple days, and then we will use
Speaker 1: qgis to make time series of these water quality parameters.
Speaker 1: Just a note about asking questions. Please put your questions
Speaker 1: in the question box and we will attest them at
Speaker 1: the end of the webinar.
Speaker 2: Feel free to enter.
Speaker 1: Your questions as we go and we'll try to get
Speaker 1: to all the questions during the Q and A session.
Speaker 1: After the webinar, the remainder of the questions will be
Speaker 1: answered in the Q and A document which will be
Speaker 1: posted to the training website about a week after the training.
Speaker 1: With that, we introduce our guest speaker for today, William Wainwright.
Speaker 1: William is a senior scientific programmer with the Freshwater Sensing
Speaker 1: Group at Science System and Applications in Code with CAR
Speaker 1: Space Flight Center Code six nineteen, that is, in the
Speaker 1: Terrestrial Information Lab. William comes from a background of astronomy
Speaker 1: and physics, with a master's in estrophysics from Rochester Institute
Speaker 1: of Technology. Now, William applies his skill set to the
Speaker 1: development of a remote sensing water quality platform called Stream.
Speaker 1: With that, we invite William to talk about Stream.
Speaker 3: William, thanks, Amita. My name is will Waynwright. I'm the
Speaker 3: developer of Stream along with my colleagues Akash, Navide, Arun
Speaker 3: and Ryan. Together we make up the Freshwater Sensing Group
Speaker 3: at SSAI and as a team we developed the models
Speaker 3: behind as well as the platform itself of Stream. Stream
Speaker 3: is a water quality portal developed by the Freshwater Sensing group.
Speaker 3: We are motivated by real issues like public health impacts
Speaker 3: to aquaculture and the larger ecosystem, as well as changing
Speaker 3: health of water systems from events like harmful alga blooms.
Speaker 3: Our main goals as a group are to improve the
Speaker 3: accuracy of remote sensing derived water quality observations in both
Speaker 3: inland and coastal waters, as well as making those products
Speaker 3: more accessible. The natural endpoint of those goals is the
Speaker 3: tool that we call Stream. The data pipeline for Stream
Speaker 3: starts with the top of atmosphere satellite data. Our team
Speaker 3: has developed water quality models for many different satellites and sensors,
Speaker 3: but we chose to begin with Stream, supporting these two
Speaker 3: groups here lands At eight and nine and the Sentinel
Speaker 3: two family. These satellites all have the optical band its
Speaker 3: necessary for us to derive water quality measurements, as well
Speaker 3: as relatively high spatial resolution compared to some of the
Speaker 3: other water quality compatible satellites that are available. This increased
Speaker 3: spatial resolution does come at the cost of temporal resolution,
Speaker 3: though Lanset features an eight day revisit rate. Between the
Speaker 3: pair of Lancet eight and nine and Sentinel to A
Speaker 3: and B operate as a pair, giving us a five
Speaker 3: day revisit rate. Sentinel two C operates out of phase
Speaker 3: with A and B and gives you an extra overpass
Speaker 3: of your site between those five days. In order to
Speaker 3: retrieve water quality products, we do a few steps to
Speaker 3: atmospherically correct the top of atmosphere data that Landset and
Speaker 3: Sentinel two provide. The main engine of this atmospheric correction
Speaker 3: is a pair of mixture density networks. These are a
Speaker 3: type of neural network that predict all of the water
Speaker 3: quality metrics at once, as well as an estimated uncertainty.
Speaker 3: This methodology is particularly useful in our application, as we're
Speaker 3: trying to get a sense of how all of the
Speaker 3: key parameters operate as a connected system rather than just individually.
Speaker 3: After the first round of atmosphere correction, we're left with
Speaker 3: the remote sensing reflectants. Then we use a second mixture
Speaker 3: density network to estimate the water quality parameters, namely chlorophyl a,
Speaker 3: total suspended solids, and the SECI disk depth. If you'd
Speaker 3: like to learn more about the methodology and the models
Speaker 3: that we use, the next r set training will be
Speaker 3: a deep dive into these models.
Speaker 4: By Ryan o'she.
Speaker 3: What really enables Stream to deliver water quality estimates, though,
Speaker 3: are large training data sets like Gloria and airnet oc.
Speaker 3: These data sets contain thousands of in situ water samples
Speaker 3: that were co witnessed by satellite overpass from water bodies
Speaker 3: of all sizes and all makeups across many different areas
Speaker 3: around the world and across decades. The matchup between in
Speaker 3: situ and satellite observations are what allow for us to
Speaker 3: fine tune our models, and the sheer diversity of water
Speaker 3: bodies represented are what allows Stream to offer such effective
Speaker 3: water quality estimates for the wide array of inland and
Speaker 3: coastal waters across the US and more, and that leads
Speaker 3: us to the website and API where you can access
Speaker 3: these water quality maps. The main tool on Stream is
Speaker 3: the interactive map page, where you can see all of
Speaker 3: the day for a given day's satellite overpass at once. Normally,
Speaker 3: the data from these satellites are segmented into square tiles
Speaker 3: in a grid. Stream stitches these tiles back together so
Speaker 3: you can see the connected water systems in full context.
Speaker 3: The webmap has many other features that I'm excited to
Speaker 3: get into shortly in our demo.
Speaker 4: Aside from the map.
Speaker 3: You can search and download scenes from the archive, which
Speaker 3: stores the results of our daily processing since it began
Speaker 3: in June of twenty twenty four.
Speaker 4: These products on.
Speaker 3: The archive are full resolution and georeferenced, and they represent
Speaker 3: an individual tile in the satellite's grid. If you'd prefer
Speaker 3: to do things in a more automated fashion, you can
Speaker 3: use our Wristful API to perform most of the same
Speaker 3: fund that you're able to on the website, such as
Speaker 3: query and downloading product maps, and that takes us to
Speaker 3: our demo. In this demo, I'll show you more of
Speaker 3: Stream's features as well as an example of how to
Speaker 3: search water quality maps. I'll show you how to query
Speaker 3: and download scenes of an area of interest, in this
Speaker 3: case Pyramid Lake. Stream does have full Conus coverage though,
Speaker 3: so the things that I'm about to demo are applicable
Speaker 3: to many inland and.
Speaker 4: Coastal water bodies.
Speaker 3: If you have any questions, please enter them in the
Speaker 3: chat and I will address as many as I can
Speaker 3: at the end. All right, so here we are on
Speaker 3: the home page of Stream, and as you scroll down
Speaker 3: you'll see a little bit about Stream and some of
Speaker 3: the things that we talked about in our presentation, you'll
Speaker 3: also find video demo on using.
Speaker 4: Streams, map page and.
Speaker 3: Features, and some of the latest updates that we are
Speaker 3: excited to announce.
Speaker 4: Back up at the top.
Speaker 3: If you go on to the map page, you can
Speaker 3: get there from either the nav bar or this explore
Speaker 3: map button that takes us to the map page with
Speaker 3: nothing loaded in. And if we're looking for an area
Speaker 3: that we know, we can go ahead and type it
Speaker 3: into this location search bar. So here we'll look for
Speaker 3: Pyramid Lake and it's found it and taken us right
Speaker 3: over to Peermid Lake. Now the easiest way to search
Speaker 3: for data for Pyramid Lake.
Speaker 4: We're going to go ahead and zoom out a.
Speaker 3: Bit here because the satellite tiles are quite large, and
Speaker 3: then we're going to enable one of our satellite grids.
Speaker 3: So here we'll look at the Sentinel two grid and
Speaker 3: you can see those square tiles that the satellite breaks
Speaker 3: data up into that I was talking about. This lake
Speaker 3: is a good example because you can see it also
Speaker 3: falls on the border of two different tiling schemes. So
Speaker 3: here we've got the one starting with ten, on the right,
Speaker 3: we've got the one starting with eleven, and in the
Speaker 3: middle there's a bit of overlap. What that is is
Speaker 3: just different segments of the satellite grid, so these tiles
Speaker 3: can sometimes be represented by more than one satellite overpass.
Speaker 3: When you've identified the area that you're interested in and
Speaker 3: you've got your satellite grid enabled, you can just go
Speaker 3: ahead and click on that tile and it will bring
Speaker 3: up the search results for that tile. So here it's
Speaker 3: brought us to the search results for the sentinel tile
Speaker 3: eleven TKE and you can see the results as sorted
Speaker 3: by date of availability. And we want to look at
Speaker 3: an example of a harmful alghol bloom affecting pyramid lakes,
Speaker 3: So we're going to go back to October the tenth
Speaker 3: of last year. When you click on one of these results,
Speaker 3: it'll bring you to the archive page where you can
Speaker 3: download all of the results. So clicking anything in this
Speaker 3: middle column would download the product represented on the rate.
Speaker 3: So this would download the full resolution chlorophyl a map
Speaker 3: as well as some of the other products. The bottom
Speaker 3: you can also find the compressed archive for all the products.
Speaker 3: But on the left column we have the map link
Speaker 3: and so here I'm going to click on the map
Speaker 3: link for chlorophyl a.
Speaker 4: And that will take us back to our map.
Speaker 3: Zoom back to the tile we were looking at, but
Speaker 3: it will populate all the data for the day that
Speaker 3: we clicked on. So again we got here by clicking
Speaker 3: on the data for this tile, but you can see
Speaker 3: the data for other tiles that were observed on the
Speaker 3: same day are also loaded in. We can go ahead
Speaker 3: and turn off the grid now and we're going to
Speaker 3: zoom in. You can see as we zoom in, the
Speaker 3: map will increase in resolution, so we can see on
Speaker 3: October tenth, there's a bit of a powerful happening in
Speaker 3: the water, but it's it's not extreme and I wouldn't
Speaker 3: constitute a harmful alglorbim just quite yet. On the right panel,
Speaker 3: you can add additional layers. So when we were looking
Speaker 3: in the archive, I saw that the next day that
Speaker 3: had data was the seventeenth. So if we go ahead
Speaker 3: and select the seventeenth and add layer, it'll load another
Speaker 3: layer on top for the seventeenth, And now you can
Speaker 3: see on the seventeenth there's quite a bit.
Speaker 4: Of action happening.
Speaker 3: We want to step back and forth between them. We
Speaker 3: can scroll down to the active layer menu. We can
Speaker 3: see the layer for the seventeenth is on top and
Speaker 3: the layer for the tenth is on the bottom. You
Speaker 3: can drag to reorder the layers if you'd like, but
Speaker 3: you can also toggle and hide them to step between
Speaker 3: them as well as if you click expand on any
Speaker 3: of the individual layers options, you can change the color
Speaker 3: palette to.
Speaker 4: Your suiting.
Speaker 3: When you are looking at multiple layers, though, as you
Speaker 3: move your cursor around, you'll see that on the right
Speaker 3: the coordinates update to where your mouse cursor is hovering,
Speaker 3: as well as the live redout of the pixel value
Speaker 3: for each layer. So if we hover a particularly area here,
Speaker 3: you can see that on the tenth it was a
Speaker 3: pretty low chlorophyll concentration of two point four seven, but
Speaker 3: on the seventeenth it was high at fifty five point
Speaker 3: four to two, and you can get a sense of
Speaker 3: that as you move your mouth around to different areas.
Speaker 4: So if you want to access your.
Speaker 5: Data via the API, we can go back to the
Speaker 5: homepage and on the rate here we have the API documentation.
Speaker 3: This is in an open API document for the RESTful
Speaker 3: API that serves stream, so on the left you can
Speaker 3: see the various endpoints and details of how to access them.
Speaker 3: The parameters that they require and everything you need to
Speaker 3: get off the ground with scripting. But in the top
Speaker 3: right we also have a button to download the example
Speaker 3: script that I've created in Python that you can modify
Speaker 3: to get working with Stream a little easier. So here
Speaker 3: I've pulled up the API example scripts and at the
Speaker 3: top you can see some configuration values that you can change.
Speaker 3: So we've got a tile list, which is just a
Speaker 3: list of the tiles sentinel to or landst format. There's
Speaker 3: some examples here, the date range in the specified format
Speaker 3: for the start and end date of your query. And
Speaker 3: then the products list that you would like to download,
Speaker 3: and these are the shorthands that the API expects of.
Speaker 3: The valid options are specified here, but these are just
Speaker 3: your products for chlorophyl a, total suspended solids and the
Speaker 3: SECI disc depth. I've also tried to comment the rest
Speaker 3: of the script if it's something you'd like to dive
Speaker 3: into and tweak yourself, but for now let's stick to
Speaker 3: the examples. So it's very simple to run. You just
Speaker 3: need to run it with any version of Python, and
Speaker 3: you can see that it's found eight dates that stream
Speaker 3: has data for the tile that we've asked for in
Speaker 3: the date range that we've asked for. So this title
Speaker 3: here eighteen suj. It's a part of Chesapeake Bay and
Speaker 3: we're downloading data for most of January of twenty twenty six.
Speaker 3: It's also gone ahead and created a stream downloads folder
Speaker 3: in the location that we have this script, and it's
Speaker 3: downloading those full resolution product maps for the tile for
Speaker 3: Chlorophyla to that folder. And now that it's completed, we
Speaker 3: can go ahead and check and see that we have
Speaker 3: a new folder and it contains those products.
Speaker 4: That we requested.
Speaker 3: Now, if we want to look back at Pyramid Lake again,
Speaker 3: what we would do is I'm going to clear out
Speaker 3: the folder, going to delete the maps that we downloaded.
Speaker 3: So here I'm just deleting the folder to get the
Speaker 3: tiles out of the way so I don't get them
Speaker 3: confused between the next batch of tiles from Pyramid Lake.
Speaker 3: But you could rename the folder or even change the
Speaker 3: location of the download directory in the script. I'm going
Speaker 3: to go back to editing this script, so instead of
Speaker 3: eighteen suj, we want eleven tke. That's the tile for
Speaker 3: Pyramid Lake. If you don't remember or you need help
Speaker 3: finding the tile that you're interested in, remember that the
Speaker 3: satellite grid checkbox on the map page, load in the
Speaker 3: full satellite grid with all the title names in the
Speaker 3: middle of the grid. And then for the date range
Speaker 3: we were looking at October, we can download Let's just
Speaker 3: do the full month of October, and then we're going
Speaker 3: to go ahead and stick with chlorophyl a for the
Speaker 3: product because we're interested in looking at chlorophyl for the
Speaker 3: harmful algoa bloom. So we can save our changes, rerun
Speaker 3: the script the same way we just did, and it
Speaker 3: found seven products for Pyramid Week in October, so we
Speaker 3: can see it successfully downloaded everything, and if we look
Speaker 3: back at the folder again, we have our colorphal maps.
Speaker 3: So if you have any questions about the use of
Speaker 3: the stream website or the API or both, please go
Speaker 3: ahead and leave any questions that you have in the
Speaker 3: chat and I'll try to address as many as I can.
Speaker 3: At the end, I would like to briefly acknowledge the
Speaker 3: various grants and teams that have supported the continued development
Speaker 3: of Stream. I've also provided a QR code here for
Speaker 3: you to try Stream yourself. Going back to our example
Speaker 3: of Pyramid Lake, a MEETA will now show you how
Speaker 3: to use the products that we downloaded through the Stream
Speaker 3: API in order to create a time series.
Speaker 1: Thank you so much William for the excellent presentation and
Speaker 1: very informative demonstration of using stream webtool and API both
Speaker 1: and next moment to continue using stream to make time
Speaker 1: series of water quality parameters. So we'll download several images
Speaker 1: using stream API and use qgis.
Speaker 2: To make time series.
Speaker 1: We'll pick locations Pyramid Lake and also Chesapeake Bay. In
Speaker 1: Pyramid Lake, will follow what William showed and we'll have
Speaker 1: a few images to look at time series of chlorophyll
Speaker 1: a concentration and then pick a small region in Chisapeake
Speaker 1: Bay and look at total suspended sediment time series in
Speaker 1: the bay. So next time I will share my screen
Speaker 1: and show this demo. So first of all, I'm using
Speaker 1: the same script that William showed for Pyramid Lake. And
Speaker 1: as you can see, this is the same tile eleven
Speaker 1: Tkee from Sentinel two that covers Pyramid Lake. So choosen that,
Speaker 1: and I'm just choosing a few days so that we
Speaker 1: can make time series. To see the procedure here October
Speaker 1: twenty twenty five from fifth through twenty fifth, so just
Speaker 1: twenty days, and we'll see how many images we have,
Speaker 1: and then I picked LA as William showed, let's also
Speaker 1: look at what I chose in Chi's a big bay.
Speaker 1: So for that I went to the stream web tool
Speaker 1: and then entered Pig Bay. Here now you can see
Speaker 1: sentinel two grids, and this is the grid we want
Speaker 1: to focus on. It's eighteen suh. Here is where Puto
Speaker 1: mc river goes into the bay and brings a lot
Speaker 1: of sediment sometimes. And so we've chosen this as a
Speaker 1: case study that will look at this style, not to
Speaker 1: look at time series of total suspended sediments.
Speaker 2: So now I.
Speaker 1: Have this copy of this script for Chiesapeake Bay in
Speaker 1: which the tile is eighteen suh. It's a longer time
Speaker 1: period May twenty four to end of twenty twenty five.
Speaker 1: And I've picked product lists as TSS and when these
Speaker 1: both these scripts I executed just as how William demonstrated.
Speaker 1: I have a number of files in streamline downloads. These
Speaker 1: are tip files. I've saved files for Pyramid Lake in
Speaker 1: a directory and all these R files for Pchicipeke Bay.
Speaker 1: So now we will move on to qgis and see
Speaker 1: how to make time series. I have downloaded and installed
Speaker 1: qgs on my computer and once you have it, you
Speaker 1: can click on this qgis I can and it will
Speaker 1: open an empty project. Now, just a note here in
Speaker 1: the appendix of today's presentation there is a procedure and
Speaker 1: there is a link on how to download qgis and
Speaker 1: how to install qus, as well as different plugins for
Speaker 1: doing calculations that has been described in the appendix, so
Speaker 1: you can refer to that. Here we have opened this
Speaker 1: new project. First we'll start with go to web and
Speaker 1: a map through quick map services. This is open streetmap
Speaker 1: and we just load the standard streetmap so we get
Speaker 1: the geographical regions here. Now we can add data to this.
Speaker 1: So I'm going to start with Pyramid Lake and we
Speaker 1: have raster layers the data that we saved earlier, So
Speaker 1: say add raster layer and navigate to the directory where
Speaker 1: the data are. So this is streamed downloads and in
Speaker 1: Pyramid Lake directory, I have data here. I have four
Speaker 1: days and I'm going to load pick this to add
Speaker 1: to the raster and what I'm going to show here
Speaker 1: is how to let's let's close this and you will
Speaker 1: see that you can click here and go zoom to
Speaker 1: the layer. So now you can see Pyramid Lake. Here
Speaker 1: you can change colors by going to properties and symbology
Speaker 1: big single band pseudo color. This is maximum, minimum and
Speaker 1: maximum value, and you can change that to a reasonable range.
Speaker 2: So I'm just saying one to.
Speaker 1: See twenty five milligrams per meter cube, and I'm going
Speaker 1: to have instead of continuous, have equal interval, and I'm
Speaker 1: going to increase number of intervals here, label precision to
Speaker 1: two and inward color maps. So when there is red
Speaker 1: its higher values of chlorophyll. Once you do that, you
Speaker 1: can say okay, and you will see. This is for
Speaker 1: seventeenth the image that Williams shoot and this is what
Speaker 1: you will see. After symbology you can see this. One
Speaker 1: more thing I want to show before I add rest
Speaker 1: of the rashers and show you how to make time
Speaker 1: series is that if you want to find time series
Speaker 1: at one point, you will have to pick one point.
Speaker 1: If you want entire lake, you will have to pick
Speaker 1: entire lake by adding a vector shape file here. What
Speaker 1: I'm going to do is suppose you want to pick
Speaker 1: a site for either water atrol or for setting up
Speaker 1: an a culture site, or for fishing or recreation, and
Speaker 1: you want to know a particular area how chlorophill a
Speaker 1: consultation varies over that region.
Speaker 2: With time.
Speaker 1: You can add a shape file. So here we're going
Speaker 1: to go and say create layer. Add new shape file layer.
Speaker 1: Here you can give.
Speaker 2: A name, uh, say lake and save.
Speaker 1: Go to geometry type add polygon because you will be
Speaker 1: picking an area. And now you can just say okay,
Speaker 1: and now to add that polygon here, you will click
Speaker 1: on this big click on this touggle edit and polygon
Speaker 1: symbol and then start by clicking and adding a polygon.
Speaker 1: When you want to add the polygon, you can say
Speaker 1: control right click and you can give it ID, say
Speaker 1: number one, and say okay. Now you have picked a
Speaker 1: region over which you want to find time series for
Speaker 1: a number of days. Now, just to save some time,
Speaker 1: I've already loaded all the rosters in Project Pyramid time
Speaker 1: Series and we'll work with this. So we have chlorophyll
Speaker 1: A rasters for tenth, seventeenth, twenty eighth, and twenty fourth
Speaker 1: of October twenty twenty five.
Speaker 2: I've also added.
Speaker 1: A polygon where we will have time series values and
Speaker 1: I've named it region of Interest on ROI. So once
Speaker 1: let's look at the here. This is seventeenth, this is twentieth,
Speaker 1: and this is twenty fourth October, so you can see
Speaker 1: how it algal bloom started and it increased and then
Speaker 1: it went up and then bent down by down again.
Speaker 1: So we see that cycle here. Now, if you want
Speaker 1: to find time series of area averaged chlorophyll, you will
Speaker 1: want to use raster analysis and zonal statistics to find
Speaker 1: mean value for this polygon. Now, if you use this
Speaker 1: Zono statistics plug in, you will have to or tool.
Speaker 1: You will have to do it raster by raster. Here
Speaker 1: you we only have four rasters, but if you have many,
Speaker 1: then it's not very convenient to do one by one.
Speaker 1: So there is another raster. It is also raster analysis
Speaker 1: Zono statistics. But this is for multiband and this is
Speaker 1: this comes from an experimental plug in from Dimexian Labs.
Speaker 1: So you have to install this into your QGIS and
Speaker 1: procedure to do that is also provided in the appendix.
Speaker 1: There is a link where you can go and install
Speaker 1: this experimental plug in Dimexian Lab. So we're going to
Speaker 1: use this Sono statistics multi band to create time series
Speaker 1: area average value for this polygon. To do that, the
Speaker 1: first step is that you create a virtual raster. So
Speaker 1: you go to raster miscellaneous and click on build virtual roster. Here.
Speaker 1: What you're going to do is add all your rasters
Speaker 1: and make one raster in which all the images appear
Speaker 1: as different bands. So here you can pick your input
Speaker 1: rosters and you can arrange them by dates and say, okay,
Speaker 1: you want to place each input file into a separate band.
Speaker 1: And important thing is that there is no data value
Speaker 1: that you want to add here, so that when you
Speaker 1: calculate statistics, those points are.
Speaker 2: Excluded.
Speaker 1: And how do you find that. You can click on
Speaker 1: this layer and go to properties. Sometimes it's given in
Speaker 1: the information tab, or you here you go to transparency.
Speaker 1: No data value is minus three two seven six seven,
Speaker 1: So you can find out what the value is and
Speaker 1: then you can add that to this virtual raster formation.
Speaker 1: Then you can run this. And when you run this,
Speaker 1: it creates a virtual a aster which is already created here.
Speaker 1: If you click on this virtual a master and look
Speaker 1: at properties and go to information, you will see that
Speaker 1: all four images now they're stored in here as bands,
Speaker 1: different bands, and that will help us in finding statistics
Speaker 1: in just one go by using multi band zonal statistics.
Speaker 1: So now once we have that, we can go to
Speaker 1: the plug in sooner statistics here. This is the astra layer.
Speaker 1: Virtual layer would be an aster layer, and pick your
Speaker 1: region of interest polygon for which you want to find
Speaker 1: mean value and you can say ch L would be
Speaker 1: a column prefix. The statistics will be stored in attributeable
Speaker 1: for this polygon and it will have prefix CHL. You
Speaker 1: can select statistical quantities you want to make time series
Speaker 1: off here. Accounts is the number of points of pixels
Speaker 1: within that polygon that we pick. This is some of
Speaker 1: values mean, mediums and a deviation, et cetera. Let's fix
Speaker 1: and a deviation and maximum value. These three quantities for chlorophyll,
Speaker 1: I can say okay, and then you can click here
Speaker 1: to run this process and at the end you will
Speaker 1: get statistical quantities for all the days or all the
Speaker 1: bands in this case in the attribute table that is
Speaker 1: associated with this shape file. So you can right click
Speaker 1: and open attribute table. You will see that this is
Speaker 1: the prefix that we picked. Band one is day one,
Speaker 1: Day two, three and four means on aviation and mixing.
Speaker 1: These values are available here. You can save this file
Speaker 1: as I can click right click on this and export
Speaker 1: as saved features and then it's comma separated value or
Speaker 1: a CSV file you can save to the folder of
Speaker 1: your choice.
Speaker 2: I've already done.
Speaker 1: That and save this file as p l ts dot
Speaker 1: c s V. So these are the numbers that we
Speaker 1: got for four days, means, deviation and maximum value. I've
Speaker 1: just rearranged them in two columns so that it's easier
Speaker 1: to read. These are all the numbers, and you can
Speaker 1: separate means, deviation and maximum values in separate columns and
Speaker 1: then plot. But for simplicity, I've just plotted all of
Speaker 1: them here. Just use insert and then chart, and then
Speaker 1: you can say bar or here. You can choose from
Speaker 1: here and you will get a plot here. So what
Speaker 1: you see here is day one means and deviation and
Speaker 1: maximum value. This is for day two, day three, and
Speaker 1: day four. You can see day two and three. So
Speaker 1: seventeenth and twenty October quite a lot high intensity of
Speaker 1: fluorophila concentration about three hundred milligrams per meter cube. So
Speaker 1: this is a quick way to get data from stream,
Speaker 1: get them in qgis, and make time series. I take
Speaker 1: the same for Chesapeake Bay suspended solids. So I want
Speaker 1: to show that to you here. Procedure is the same.
Speaker 1: I have all a few rasters for May to October
Speaker 1: of twenty twenty four. Here I made virtual roster by
Speaker 1: adding all these days as bands in this raster and
Speaker 1: have a polygon that's sitting here at the where there's
Speaker 1: potomac coming into the bay. One thing to see here
Speaker 1: is if you click on different rastas, you will see
Speaker 1: that this is TSS and this is in grams per
Speaker 1: meter cube, so it's a scale is the same for everything.
Speaker 1: But in some cases you will see good coverage. Sometimes
Speaker 1: you don't see Some areas do not have data, and
Speaker 1: that is there are two reasons either maybe there is
Speaker 1: no overpass here now satellite data or sometimes there are
Speaker 1: clouds and you cannot see the surface anyway. But this
Speaker 1: is the area for which where I created virtual raster,
Speaker 1: used solo stakes statistics multi band and created.
Speaker 2: Time series for that as well. So the time series
Speaker 2: is here.
Speaker 1: Now I here I have mean values only of TSS,
Speaker 1: and this is for different days. You can have dates
Speaker 1: here and then you can make a proper time series.
Speaker 1: But this shows how it mean values of TSS varied
Speaker 1: in that polygon into the big bay with time. So
Speaker 1: this is a easier way to make time series from
Speaker 1: stream data and hope you can find it useful and
Speaker 1: you can explore this on your own as well. So
Speaker 1: that ends our demonstration for time series. So this brings
Speaker 1: us to the end of today's session, and just to summarize,
Speaker 1: we saw background overview and demonstration of Stream webtool and API.
Speaker 1: We saw that stream is based on lands set eight
Speaker 1: and nine and Sentinel two, A, B and C optical
Speaker 1: measurements to obtain water quality parameters including chlorophyl a concentration,
Speaker 1: total suspended solids, and secy disk depth in coastal estuaries
Speaker 1: and inland lakes in the US. It provides it's the
Speaker 1: water quality parameters at twenty to thirty meters special resolution,
Speaker 1: and the API allows search and download of multiple images
Speaker 1: of an area of interest. Then we saw a couple
Speaker 1: of examples of how to select water quality parameters in
Speaker 1: areas of interest using stream. We focused on Pyramid Lake
Speaker 1: and then also on a portion of Chesapeake Bay. William
Speaker 1: showed how to map the water quality parameters and how
Speaker 1: to access and download multiple water quality data using the
Speaker 1: Stream API, and then we saw how to make time
Speaker 1: series of area averaged water quality parameters using qgis so
Speaker 1: clear advantage of using Stream can be seen here. These
Speaker 1: two figure show chlorophyl a concentration in Pyramid Lake from
Speaker 1: a pasoci at one kilometer and sentinel to MSI from
Speaker 1: stream at twenty meters.
Speaker 2: So here.
Speaker 1: If your application requires with all of water for drinking
Speaker 1: utilities or for aquaculture site selection, you want to use
Speaker 1: high resolution data because it shows a lot of details
Speaker 1: and special variation of water quality parameters. Now next week,
Speaker 1: on seventeenth of February, we will have an introduction to
Speaker 1: a machine learning model to estimate water quality parameters based
Speaker 1: on satellite observations. This is the model that's been used
Speaker 1: to produce stream parameters. As I mentioned earlier, there will
Speaker 1: be one homework assignment posted on seventeenth of February on
Speaker 1: the training website and answers must be submitted via Google forms.
Speaker 1: The homework will be due on tenth of March. Certificate
Speaker 1: of completion will be awarded to those who attend all
Speaker 1: live webinars and complete the homework assignment by the deadline.
Speaker 1: You will receive a certificate by email approximately two months
Speaker 1: after completion of the course. Once again we thank William
Speaker 1: Wainwright for his excellent presentation and demonstration of stream and
Speaker 1: making the webtool and API available to the community. Here
Speaker 1: are some resources and links to important websites, and acronyms
Speaker 1: are defined for the satellite and censor table. This is
Speaker 1: the contact information from William Wainwright and you can always
Speaker 1: contact us at our set, our set website link and
Speaker 1: YouTube link they're provided here. For questions, comments, or to
Speaker 1: share how you have applied our trainings to your work
Speaker 1: or studies. Please email at NASA rset at gmail dot
Speaker 1: com and join our quarterly newsletter to stay up to
Speaker 1: date on our latest trainings. You can send an email
Speaker 1: here with no subject line and follow the instructions sent
Speaker 1: in response, and then you can have access to the newsletter.
Speaker 1: Thank you everyone. We'll start with our question and answer session.
Speaker 1: We have William wain right here and we'll start with
Speaker 1: the questions. Question one, is it possible to replicate this
Speaker 1: on another continent? Also? What processing scale is available?
Speaker 4: Okay?
Speaker 3: So I'll do my best to go through and answer
Speaker 3: as many questions as we saw. If by the end
Speaker 3: of it you feel like your question hasn't been answered,
Speaker 3: please ask again or ask what more details? And we
Speaker 3: have a Q and a document that will be sending
Speaker 3: out after all the trainings have been completed that will
Speaker 3: hopefully answer everything. So to get back to question one,
Speaker 3: is it possible to replicate this on another continent? It
Speaker 3: definitely is. The models that are behind stream. The aim
Speaker 3: in developing those models are to have a globally applicable
Speaker 3: model to any inland and coastal water body. They obviously
Speaker 3: do have varying performance in different regions, and that will
Speaker 3: depend some on the amount of insitu samples that we've
Speaker 3: been able to acquire and train on from that region.
Speaker 3: So if you want to improve the accuracy of STREAMS models,
Speaker 3: you can always try to help provide the Freshwater Sensing
Speaker 3: group with more institute data that we can train on
Speaker 3: and we can continually improve those models. Question two, What
Speaker 3: countries are covered by stream?
Speaker 4: Right now?
Speaker 3: Stream covers the continental US or Konis, Hawaii, Alaska, and
Speaker 3: then there's lots of many select water bodies and satellite
Speaker 3: tiles around the world, including but not limited to, areas
Speaker 3: in India, South Korea, South Africa, Benin, Ghana, Chile, Uruguay, Peru, Colombia, Mexico,
Speaker 3: and Cuba. A lot of these select tiles were born
Speaker 3: from partnerships with other research teams, but We're hoping to
Speaker 3: eventually be able to cover as much of the world
Speaker 3: as we can.
Speaker 2: Thank you, William.
Speaker 1: The next question is not directly relevant to this topic today.
Speaker 1: Is there any way to monitor groundwater data?
Speaker 2: It's TSAR.
Speaker 1: Is there any way to monitor seawater and groundwater intrusion
Speaker 1: rates in coastal areas like Sundarbans. Currently incitude data is
Speaker 1: being collected in very limited areas, but due to the
Speaker 1: complexity of the region, it's not very effective. I just
Speaker 1: want to point out here is that ARSET will have
Speaker 1: a training on groundwater in April, which you may want
Speaker 1: to check out and join, where we can editor some
Speaker 1: of these questions. This training is mostly focused on stream
Speaker 1: and water quality, so right now when we are not
Speaker 1: addressing this question, but we'll definitely think of it when
Speaker 1: we do their ground.
Speaker 2: Or to training.
Speaker 1: Next question is for William. Does the tool work well
Speaker 1: with touch screen based devices like iPads and so on?
Speaker 3: Unfortunately, stream does not work very well right now on
Speaker 3: mobile devices unless you enable desktop mode. It should work
Speaker 3: fine with touch screens on desktop mode, but the mobile.
Speaker 4: Display of the page is not great.
Speaker 3: That's something I'm working on improving pretty soon hopefully. But yeah,
Speaker 3: you'll find it works bested on desktops.
Speaker 2: Great.
Speaker 1: Can move on to next question as well, what is
Speaker 1: the special cover your products understream?
Speaker 3: So Landset eight and nine derived products retain the native
Speaker 3: spatial resolution of thirty meters. Sentinel two derived products the
Speaker 3: top of atmosphere level one data comes into between ten
Speaker 3: and sixty meter resolution. We resample everything to twenty meters,
Speaker 3: and then we also provide the water quality products at
Speaker 3: that twenty meter resolution.
Speaker 4: And that kind of ties into the.
Speaker 3: Another question of why not use kind of a fusion
Speaker 3: between those two satellites. If you're referring to like the
Speaker 3: harmonized Lancet Sentinel products, that unfortunately doesn't include all of
Speaker 3: the original bands from both sensors, and one of the
Speaker 3: bands that's missing from that harmonized Sentinel Landset product is
Speaker 3: actually pretty key in how we derive water quality, right.
Speaker 1: So I think that also takes care of question six.
Speaker 1: If I select a Sentinel two file, does that mean
Speaker 1: the data for that tile is estimated from Sentinel two?
Speaker 2: And so why not use fusion? So I think you
Speaker 2: just answered that question.
Speaker 3: If you select the tile, you will get results just
Speaker 3: for that satellite. There are other ways and We're in
Speaker 3: the future looking at something called domain adaptation, which will
Speaker 3: let us kind of harmonize the results ourselves from different satellites.
Speaker 4: But that's something that's still.
Speaker 3: Very much experimental and not ready for the deployment on stream.
Speaker 1: Also, I just wanted to add to question five when
Speaker 1: you talk about special coverage, these data are global lends
Speaker 1: AT eight and Sentinel two. They both have global coverage
Speaker 1: right now. What quality parameters are produced for the US
Speaker 1: and for a few selectric ties as William mentioned, but
Speaker 1: the model that will be presented next week that can
Speaker 1: be used to get aut quality parameters anywhere where you
Speaker 1: can see resolve lakes and coastal areas exactly.
Speaker 3: And next week's training with Ryan O'Shea will talk more
Speaker 3: about how to apply the models that we use to
Speaker 3: any tile by not just LANDSTT and Sentinel, but also Pace,
Speaker 3: Sentinel three and many more. So if there's a satellite
Speaker 3: that you want covered or a region that you want
Speaker 3: covered that isn't currently supported on stream, you almost certainly
Speaker 3: will be able to do it with the models, and
Speaker 3: you'll learn how to do that next week.
Speaker 1: Yes, next question is is base data on stream web.
Speaker 3: Pace is not currently supported on stream. But as I
Speaker 3: was just saying, the models that.
Speaker 4: Stream uses do support PACE, so we do have water
Speaker 4: quality data four PACE, it's just not currently on stream.
Speaker 2: Yeah.
Speaker 1: The next question is does it extract data from Sentinel
Speaker 1: to or LENST as soon as they are available, or
Speaker 1: are the water quality data uploaded to stream at set
Speaker 1: period when a considerable amount of products are generated.
Speaker 3: We automatically download the scenes in bulk from Copernicus for
Speaker 3: Sentinel two and USGS for LANSA eight and nine pretty
Speaker 3: much as soon as they become available at level one. Now,
Speaker 3: typically they become available at the end of the day
Speaker 3: that they were observed, and given that we're processing between
Speaker 3: six hundred and eight hundred tiles per day, it can
Speaker 3: sometimes take well into the next day to finish downloading
Speaker 3: and processing all you know, eight hundred of those tiles.
Speaker 3: We don't have any specific order that we process them.
Speaker 3: We just asked for data. It becomes available to us
Speaker 3: from the data providers, and then we process it as
Speaker 3: we receive it.
Speaker 2: Great.
Speaker 1: The next question also, you can at risk can I
Speaker 1: collect carring you previous data in the Gulf of America.
Speaker 3: Coastal regions of the Gulf are covered natively natively by stream.
Speaker 3: If you find that your site is not covered, you
Speaker 3: can either apply the models yourself or reach out to
Speaker 3: us about potentially including your region of interest.
Speaker 1: Question tense, stream gives model estimates, how do we get
Speaker 1: these standard errors of these those estimates? How do we
Speaker 1: get these standard errors for the model est mates of
Speaker 1: chlorophyl TSS and SICHI depth.
Speaker 3: Yeah, we're working to add uncertainty as an additional product
Speaker 3: to the archive as far as how we derive that
Speaker 3: air and kind of the training and validation in general.
Speaker 3: That's something that'll be covered a lot more in part
Speaker 3: two of the training next week.
Speaker 4: But you're right that we don't We don't provide.
Speaker 3: Air maps on stream currently, but we would like to
Speaker 3: soon provide uncertainty in the archive page at least.
Speaker 1: Great question eleven, is there any way that I can
Speaker 1: improve the temporal resolution of the data? I mean, if
Speaker 1: I need daily data, how can I get it?
Speaker 4: I'm gonna I'm going to jump back to question kind of.
Speaker 4: I thought of something else as well.
Speaker 3: In the case of training and validation, I think the
Speaker 3: standard air means a little bit more because we're comparing
Speaker 3: against institute, so we actually have a known.
Speaker 4: Thing to compare to.
Speaker 3: When that model is then applied to near real time data,
Speaker 3: we don't have it suits you validation. So the uncertainty
Speaker 3: from the daily derived products on stream is more of
Speaker 3: just the model's best guess at how accurate it thinks
Speaker 3: it is. So it's it's still valuable because it gives
Speaker 3: you a measurement of effectively how close the water quality
Speaker 3: parameters that you're looking at match up with something it
Speaker 3: was trained on. So if you have a high uncertainty
Speaker 3: from streams daily processing, that will mean that we're probably
Speaker 3: giving you water quality estimates for a water body that
Speaker 3: doesn't look very much like anything we've seen in training.
Speaker 3: So that's what an uncertainty map for the daily processing
Speaker 3: would mean.
Speaker 2: Okay, can go to the next question as well.
Speaker 4: Ye, so is there any way I can improve?
Speaker 3: So one of the trade offs of the increased special
Speaker 3: resolution of Landset and Sentinel two relative to the other
Speaker 3: water quality satellites available is that decreased temp resolution. In
Speaker 3: the future, we're gonna try to cover more satellites with
Speaker 3: an aim of increasing temporal resolution though.
Speaker 2: Great.
Speaker 1: Yes, so as we saw earlier, you know, other satellites
Speaker 1: like Taraqua SMPBGPS as base. They do have daily data available.
Speaker 1: The resolutions are not as high as sentinel two in
Speaker 1: lens a day, so there's there's always a trade off
Speaker 1: between temple.
Speaker 2: Special resolutions exactly.
Speaker 1: Next question is is this calibrated? How acurator of the results?
Speaker 1: Is there any way to calibrate the data.
Speaker 3: So the models behind Stream are pretty heavily calibrated and
Speaker 3: validated using data sets like Gloria and aironet oc, but
Speaker 3: they're also supplemented with lots of individual institute data sets
Speaker 3: from research partners. The accuracy of the result can vary
Speaker 3: depending on how many samples that we've had to train
Speaker 3: against in that region. The best way to help calibrate
Speaker 3: data for Stream as a whole would be to help
Speaker 3: us expand our.
Speaker 4: Institute data set.
Speaker 3: If you find the performance is lacking in a region
Speaker 3: of interests, you may be able to help us improve
Speaker 3: the performance in that region by providing insitu data. You
Speaker 3: can also run the models locally to assess performance on
Speaker 3: an area that STREAM doesn't cover.
Speaker 2: Right.
Speaker 1: Next question is are these values of different parameters only
Speaker 1: for surface water or do they represent subsurface water in
Speaker 1: the water bodies.
Speaker 3: That's a question I don't fully know The answer to
Speaker 3: my best understanding, although this may be a better question
Speaker 3: for Ryan o'sh next week, is the water quality parameters
Speaker 3: are derived from the remote sensing reflectance at the water's surface,
Speaker 3: but the properties derived from that reflectance are assumed to
Speaker 3: be indicative of the water the water column as a whole.
Speaker 4: Again, now that's my understanding, but.
Speaker 3: Please if someone knows better in the chat or you know,
Speaker 3: next week, Ryan will probably be better be able to
Speaker 3: better answer that question as well.
Speaker 1: So yeah, we can talk to Ryan more. But these
Speaker 1: parameters are for surface water, as we are using satellite
Speaker 1: would look at top like water, leaving that that's what
Speaker 1: is used, which has information about water column. But the
Speaker 1: the values that you see are for surface water.
Speaker 4: Yeah.
Speaker 1: Question fourteen, what is the model evaluation for the model
Speaker 1: used for estimating chlorophyl A and TSS for SENTILEL and
Speaker 1: that of lendset. Is there a reference that can be
Speaker 1: cited for this information?
Speaker 3: Yeah, The name of the model and specific is aquaverse.
Speaker 3: We have a paper and I'll try to include a
Speaker 3: link to the Q inside the Q and a document. Yeah,
Speaker 3: but if you search for aquaverse you should see a
Speaker 3: paper about our models. And then also Ryan O'shay's GitHub
Speaker 3: has some of the the MDM tutorials.
Speaker 1: So next question is interesting, does stream work in seasonal
Speaker 1: bodies of water around the world?
Speaker 3: If I'm understanding the question correctly, are those water bodies
Speaker 3: where there's only water prevalent during certain seasons and then.
Speaker 4: They dry up?
Speaker 2: Or yes, I think that's what it means.
Speaker 3: Yeah, the way we identify water pixels to process is
Speaker 3: not exclusive of those types of water bodies, which means
Speaker 3: that if there's water in an image, it should be
Speaker 3: processed by the dream and report water quality. But yes,
Speaker 3: stream should work in those seasonal water bodies if you
Speaker 3: have examples. I've never personally looked into it, but I'd
Speaker 3: be really interested to see how those look.
Speaker 2: Great.
Speaker 1: So question sixteen, is it possible to have a quick
Speaker 1: look at the data used in the estimation of glorophile
Speaker 1: A and other presentations?
Speaker 4: So go ahead.
Speaker 3: The Gloria and air onet oc data sets, I believe
Speaker 3: are publicly available, but you can learn a bit more
Speaker 3: about some of the data and products used and the
Speaker 3: estimations and the other predictors.
Speaker 4: And next week's session just.
Speaker 1: To add that Arsett did a training in which Gloria
Speaker 1: observations or measurements were covered, and that link you will
Speaker 1: find on the slides where gloria data was mentioned, so
Speaker 1: you will find link to the training where you have
Speaker 1: more information about gloria data. Next question is can we
Speaker 1: get information about other water quality parameters? For example, if
Speaker 1: need data regarding nutrients, can I get that? So William,
Speaker 1: we can add to this. But to my knowledge, we
Speaker 1: are looking at optical properties of water. So if it
Speaker 1: changes color of the water and if these spectral bands
Speaker 1: can see that, those are the parameters they are derived.
Speaker 1: For nutrients like nitrogen or phosphorus, you'd probably have to
Speaker 1: have some satistical measure model to use that to connect
Speaker 1: institute data with satellite data and then indirectly derived nutrients
Speaker 1: based on that.
Speaker 2: I believe.
Speaker 3: Yeah, the limiting factors really does the parameter you're interested
Speaker 3: in change the optical properties of the water. There are
Speaker 3: some parameters that are not on stream that can be derived,
Speaker 3: like color, dissolved organic.
Speaker 4: Matter re set on.
Speaker 3: That's something that the models can produce, but we don't
Speaker 3: currently offer on stream. But there are many properties that
Speaker 3: people are interested in, like you know, dissolved phosphorus or
Speaker 3: oxygen that can't really be measured from space because they
Speaker 3: don't really measurably change the optical properties of the water. Yeah.
Speaker 1: The next question, please clarify the data range is available
Speaker 1: for these analysis. What is the earliest data available to analyze?
Speaker 1: So online web tool will have data from twenty twenty
Speaker 1: four onwards, correct William.
Speaker 3: Yeah, so stream began daily processing, so downloading data the
Speaker 3: day it became available and then automatically publishing it in
Speaker 3: June of twenty twenty four. You made these themes from
Speaker 3: before then. Most of those were manually processed with collaborators,
Speaker 3: you know, wanted a time series for a specific tile
Speaker 3: or two from twenty eighteen onward, so you'll see individual
Speaker 3: tiles covered across many years before twenty twenty four.
Speaker 4: We're trying to fill in.
Speaker 3: Coverage that began after June twenty twenty four, at least
Speaker 3: back until June of twenty twenty four, to make everything synchronous.
Speaker 3: But right now, full CONUS coverage for Sentinel began at
Speaker 3: the start of twenty twenty five, and we've recently fixed
Speaker 3: our landset downloading, so full CONUS for Landset began.
Speaker 4: Twenty twenty six.
Speaker 3: Oh, okay, select regions for Lancet have been available since
Speaker 3: June of twenty twenty four though, and well I think
Speaker 3: I said full conis for Sentinel has been available since
Speaker 3: the start of twenty twenty five, So right now the
Speaker 3: coverage can dep a bit on what tile you're looking at,
Speaker 3: but that should be permanized pretty soon. Everything should go
Speaker 3: back to at least June of twenty twenty four.
Speaker 1: Great next question is when analyzing tts from satellite data,
Speaker 1: do we focus on the highest value the lowest value
Speaker 1: are a different metric like the average? I would say
Speaker 1: that average, so range and average they both should be
Speaker 1: looked at. But you know we can get more information
Speaker 1: about it. Well, we have a couple of more questions
Speaker 1: million if you can address we have a few minutes. Also,
Speaker 1: does the model only use land set and sentinel or
Speaker 1: there are other hydrological and minological parameters used.
Speaker 4: There are some additional parameters, namely in speed. There's also
Speaker 4: the sensor.
Speaker 3: Angle, but that's still kind of the part of the
Speaker 3: satellite data.
Speaker 4: We have wind speed, water vapor, and there's one more.
Speaker 3: Oh ozone and NO two concentration are also used to
Speaker 3: do the atmosphere correction. The aerosol contribution is taken care
Speaker 3: of by the MDN, but the rest of it, the
Speaker 3: really correction and the gashous absorption, we need the aforementioned parameters.
Speaker 1: Correct question twenty two. Is it possible to use HIMA?
Speaker 1: What did you stationary satellite with stream?
Speaker 4: It's not currently possible to use other satellites with STREAM.
Speaker 3: I would have to check if that satellite is supported
Speaker 3: by the models, namely aquiverse, and I think we skipped
Speaker 3: over twenty If we apply STREAM to a region like
Speaker 3: Jordan that is not explicitly listed, what type of local
Speaker 3: data would most improve model calibration and confidence in the results.
Speaker 3: Any in situ chlorophyl A, tss SECHI, disk depth and
Speaker 3: SETAM measurements would help. The ones that are most likely
Speaker 3: to help the most are institue measurements that coincide pretty
Speaker 3: closely with satellite observations in terms of time, But any
Speaker 3: institu data will help.
Speaker 1: Going down to question twenty three for the nutrient level analysis,
Speaker 1: since these are not optically these are not optically inherent
Speaker 1: properties of water, indirect methods such as empirical method. Emial
Speaker 1: method is the only way.
Speaker 4: If you're able to.
Speaker 3: Like empirically show that it correlates to something that is optically.
Speaker 4: Adherent to the water.
Speaker 3: So, in other words, if you're able to find an
Speaker 3: optical property that's a good tracer for the property you're
Speaker 3: actually interested in, then that's one way to do it.
Speaker 3: If you're not able to demonstrate that something like chlorophyla
Speaker 3: or TSS is a good tracer for your nutrient analysis,
Speaker 3: then to my understanding, you would have to find another
Speaker 3: way to measure it.
Speaker 1: Next question is how soon would the rest of the
Speaker 1: world be covered with this small especially North Africa region.
Speaker 3: We're able to add individual tiles pretty readily, but if
Speaker 3: you're talking about full global, inland and coastal coverage, that's
Speaker 3: an order of magnitude more processing than we already do,
Speaker 3: and we don't have the processing and storage available to
Speaker 3: do that yet.
Speaker 1: So that is one of the reasons why the model
Speaker 1: is open source and made available to anyone who wants
Speaker 1: to apply it in their own.
Speaker 3: Leg and our hope is that the model will at
Speaker 3: least be relevant in globally, which is why we continue
Speaker 3: to retrain and revalidate it with each new institute sample
Speaker 3: that we get. But as far as stream, I think
Speaker 3: global coverage is less of a priority than increasing temporal
Speaker 3: resolution currently for us.
Speaker 2: Right, thanks.
Speaker 1: Next question is can we use stream for monitoring water
Speaker 1: quality in reverse?
Speaker 3: If landst thirty meter resolution or Sentinel at twenty meter
Speaker 3: resolution can resolve your river or other water body, then yeah.
Speaker 1: The next one does the bacteria account like ecoli and
Speaker 1: fecal quliform also be found out through stream?
Speaker 3: I think that's kind of similar to the question about nutrients.
Speaker 3: If you can trace it with a water quality parameter
Speaker 3: like ESS or chlorophyla, then potentially, but it's not something
Speaker 3: we report on directly.
Speaker 1: Next question is what are the top five features for
Speaker 1: the model from the feature importance analysis? Are they the
Speaker 1: same for Lancet and Sentinel.
Speaker 4: Top five features for the model?
Speaker 1: We can address it next week as well.
Speaker 4: Yeah, I'm not sure, so I'll refer that to Ryan probably.
Speaker 1: Next question is is there any training for applying the
Speaker 1: model for individual location?
Speaker 4: There is.
Speaker 3: Next week's training with Ryan O'Shea will show you how
Speaker 3: to run model yourself on a tile of interest.
Speaker 1: Twenty Question twenty nine. When Stream is applying in regions
Speaker 1: without extensive institute data, what level of confidence is considered
Speaker 1: sufficient for decision making or policy applications.
Speaker 3: That is a really good question and I think the
Speaker 3: answer to that does depend somewhat on you know, the
Speaker 3: decision making person or body.
Speaker 4: But I mean, first of all, when you have remote.
Speaker 3: Remote sensing derived water quality, you're never going to be
Speaker 3: as accurate as in situ sampling. So I think the
Speaker 3: best use for remote sensing water quality in a decision
Speaker 3: making capacity is to guide use of your limited insitu resources.
Speaker 3: So if you see things from remote sensing that make
Speaker 3: you want to follow up with in citu data, I
Speaker 3: think that's the best use of the remote sensing for
Speaker 3: like actual decision making and policy applications.
Speaker 1: Yeah, I might add to that that depends first of all,
Speaker 1: if you have institute data, and then if you can
Speaker 1: compare with what remote sensing is showing that gives you
Speaker 1: somewhat some confidence or air bar for remote sensing parameters,
Speaker 1: And then how much tolerance your decision would have. What
Speaker 1: range can your decision tolerate? That also is important to know.
Speaker 4: That's a good point.
Speaker 1: And the next question is can stream be used for
Speaker 1: a river that is less than thirty meters wide but
Speaker 1: very long.
Speaker 4: It can definitely be.
Speaker 3: Used, but you may see a reduction and within them
Speaker 3: because some of the land from the area will have
Speaker 3: been averaged into that pixel.
Speaker 1: So you so accuracy may be less in that case.
Speaker 3: So yeah, and depending on how much land was averaged in,
Speaker 3: it may actually be filtered out as not water.
Speaker 1: I will also add that if it's less than thirty
Speaker 1: meters wide, even thirty meter is you need at least
Speaker 1: three pixels clear in water to get good water quality.
Speaker 2: Estimates from remote sensing.
Speaker 1: So that way, I would say there will be a
Speaker 1: lot of contamination from land if.
Speaker 3: You Yeah, it's not an ideal use case, and if
Speaker 3: you do get results from stream, it won't be nearly
Speaker 3: as reliable as if it were a much wider water body.
Speaker 2: Yeah.
Speaker 1: Next question is do you use Do you use any
Speaker 1: of the water processing software such as eco light CENT
Speaker 1: to corel light, to gen C, to our CEC for
Speaker 1: converting toa surface level reflectance to water living.
Speaker 3: We don't use any of those in specific, but we
Speaker 3: do regularly compare our performance to those. We use our
Speaker 3: own in house atmosphere correction that.
Speaker 4: Is a mixture of.
Speaker 3: Raley correction and Gassess absorption correction, and then we use
Speaker 3: a mixture density network to do the aerosol contribution.
Speaker 4: So as a as a package all of that atmosphere
Speaker 4: correction is done.
Speaker 3: Just by us, but we do compare it pretty regularly
Speaker 3: to some of those other processors.
Speaker 1: Yeah, just to add, we will have some information on
Speaker 1: this next session because md and model will require water
Speaker 1: living reflectancies. So you could start with any level of
Speaker 1: satellite data and use any of this atmospheric correction models
Speaker 1: to convert CoA to surface level reflectancy remote sen collectancies,
Speaker 1: and then to attend to m d N. Next question
Speaker 1: is what model was used, machine learning or physical model?
Speaker 1: Which particular ones were evaluated before the best was chosen.
Speaker 3: So we use machine learning for the aerosol contribution because
Speaker 3: that's something that's been proven to be pretty difficult to
Speaker 3: do with the physical model.
Speaker 4: We do.
Speaker 3: Raley correction with a physical model because we found it
Speaker 3: to be more performant than if we also let the
Speaker 3: make sure density NetWorld take care of the Raley contribution,
Speaker 3: so we did.
Speaker 4: We did evaluate it.
Speaker 3: For for the case of ralely, but for aerosol contribution
Speaker 3: much have to use the mixture density network to get
Speaker 3: good performance.
Speaker 1: Question is what are the most common misinterpretation or misuse
Speaker 1: of stream outputs that users should be aware of.
Speaker 4: My answer to that would probably be.
Speaker 6: Cloud pixels can still frequently show up. We do our
Speaker 6: best to remove cloud and land pixels before we create
Speaker 6: the water quality maps, but it's not hard to find
Speaker 6: examples where you know, some cloud pixels may have made
Speaker 6: it through the cloud masking, and naturally we'll throw off
Speaker 6: the results in that area, so you'll see what might
Speaker 6: appear to be really high chlorophyll a data that it's
Speaker 6: just because there's cloud. You should now for the last
Speaker 6: couple weeks of data be able to find RGB true
Speaker 6: color composite maps that should help you see what the
Speaker 6: scene looked like on that day and be able to
Speaker 6: see for yourself what the cloud cover looks like.
Speaker 4: But we still have to.
Speaker 3: Kind of backwards propagate those true color composite maps for
Speaker 3: the rest of the stream data.
Speaker 2: SEP great. Thank you all.
Speaker 1: I think we are almost at the end of this session.
Speaker 1: If there are any more questions, we will try to
Speaker 1: address them later on, but we hope to see you
Speaker 1: next week at the same time on seventeenth of February.
Speaker 1: Thank you all for attending this session. Thank you to
Speaker 1: our guest speaker once again, and all the r SET
Speaker 1: team for their help with this training. Yeah I think
Speaker 1: there's one more question. Can it monitor turbidity in lakes?
Speaker 4: I think rabidity correlates to.
Speaker 2: Seki depth. Yeah, yeah, so you.
Speaker 1: Can look at sechi depth and then you know that
Speaker 1: will show increase or decrease turbiitity. If you actually want
Speaker 1: to to relate it with turbidity units, then you probably
Speaker 1: need that conversion, a relationship between those two in the
Speaker 1: water body of your interest. Okay, thanks everyone, We'll see
Speaker 1: you next week now, thank you.
Podbean