|
41 | 41 | "\n", |
42 | 42 | "| Concepts | Importance | Notes |\n", |
43 | 43 | "| --- | --- | --- |\n", |
44 | | - "| [Times and Dates in Python](https://foundations.projectpythia.org/core/datetime/datetime.html) | Necessary | |\n", |
45 | | - "| [Intro to Xarray](https://foundations.projectpythia.org/core/xarray/xarray-intro.html) | Necessary | |\n", |
46 | | - "| [Intro to Cartopy](https://foundations.projectpythia.org/core/cartopy/cartopy.html) | Helpful | |\n", |
| 44 | + "| [Times and Dates in Python](https://foundations.projectpythia.org/core/datetime/datetime) | Necessary | |\n", |
| 45 | + "| [Intro to Xarray](https://foundations.projectpythia.org/core/xarray/xarray-intro) | Necessary | |\n", |
| 46 | + "| [Intro to Cartopy](https://foundations.projectpythia.org/core/cartopy/cartopy) | Helpful | |\n", |
47 | 47 | "| [Understanding of Zarr](https://zarr.readthedocs.io/en/stable/) | Helpful | |\n", |
48 | 48 | "| [Understanding of Dask](https://www.dask.org/) | Helpful | |\n", |
49 | 49 | "\n", |
|
168 | 168 | "cell_type": "markdown", |
169 | 169 | "metadata": {}, |
170 | 170 | "source": [ |
171 | | - "From this Python dictionary, there are a few things that we can learn. The `container` key tells us what form the data will be in when we read it. In this case it will be a [Xarray](https://foundations.projectpythia.org/core/xarray.html) `Dataset` The `user_parameters` key has a list containing parameters a user can set to control what data they get. The `metadata` key contains an arbitrary dictionary of information specified by the catalog author. A common things to find in the `metadata` field are plots you can use to get a quick peak at the data." |
| 171 | + "From this Python dictionary, there are a few things that we can learn. The `container` key tells us what form the data will be in when we read it. In this case it will be a [Xarray](https://foundations.projectpythia.org/core/xarray) `Dataset` The `user_parameters` key has a list containing parameters a user can set to control what data they get. The `metadata` key contains an arbitrary dictionary of information specified by the catalog author. A common things to find in the `metadata` field are plots you can use to get a quick peak at the data." |
172 | 172 | ] |
173 | 173 | }, |
174 | 174 | { |
|
284 | 284 | "source": [ |
285 | 285 | "Mesowest provides a [tutorial](https://mesowest.utah.edu/html/hrrr/zarr_documentation/html/xarray_one_day_analysis_example.html) for reading a days worth of surface temperature HRRR data from AWS. Lets see what the same task looks like using Intake.\n", |
286 | 286 | "\n", |
287 | | - "We will start by setting up our [Cartopy](https://foundations.projectpythia.org/core/cartopy.html) projection according to the information given in the readme source." |
| 287 | + "We will start by setting up our [Cartopy](https://foundations.projectpythia.org/core/cartopy) projection according to the information given in the readme source." |
288 | 288 | ] |
289 | 289 | }, |
290 | 290 | { |
|
304 | 304 | "cell_type": "markdown", |
305 | 305 | "metadata": {}, |
306 | 306 | "source": [ |
307 | | - "Now lets read in the data with Intake. To do this will create a [datetime](https://foundations.projectpythia.org/core/datetime.html) object with the date August 9, 2019. Then we will use list comprehension and `timedelta` objects to create a [datetime](https://foundations.projectpythia.org/core/datetime.html) object for each hour that day. Again, using list comprehension, we will create a list of datasets using Intake. In order to concatenate our list of datasets using [Xarray](https://foundations.projectpythia.org/core/xarray.html), we need a dimension to concatenate accross. Each dataset in our list contains a time variable with an array of just one timestamp. We can promote that variable to a coordinate using the `set_coords` method. This may take a few minutes to run." |
| 307 | + "Now lets read in the data with Intake. To do this will create a [datetime](https://foundations.projectpythia.org/core/datetime) object with the date August 9, 2019. Then we will use list comprehension and `timedelta` objects to create a [datetime](https://foundations.projectpythia.org/core/datetime) object for each hour that day. Again, using list comprehension, we will create a list of datasets using Intake. In order to concatenate our list of datasets using [Xarray](https://foundations.projectpythia.org/core/xarray), we need a dimension to concatenate accross. Each dataset in our list contains a time variable with an array of just one timestamp. We can promote that variable to a coordinate using the `set_coords` method. This may take a few minutes to run." |
308 | 308 | ] |
309 | 309 | }, |
310 | 310 | { |
|
325 | 325 | "cell_type": "markdown", |
326 | 326 | "metadata": {}, |
327 | 327 | "source": [ |
328 | | - "Now our data is ready to be analyzed in the normal way using [Xarray](https://foundations.projectpythia.org/core/xarray.html)." |
| 328 | + "Now our data is ready to be analyzed in the normal way using [Xarray](https://foundations.projectpythia.org/core/xarray)." |
329 | 329 | ] |
330 | 330 | }, |
331 | 331 | { |
|
371 | 371 | "cell_type": "markdown", |
372 | 372 | "metadata": {}, |
373 | 373 | "source": [ |
374 | | - "As you can see [Xarray](https://foundations.projectpythia.org/core/xarray.html) uses Dask arrays instead of [NumPy](https://foundations.projectpythia.org/core/numpy.html) arrays to hold the data when the `to_dask` method is used." |
| 374 | + "As you can see [Xarray](https://foundations.projectpythia.org/core/xarray) uses Dask arrays instead of [NumPy](https://foundations.projectpythia.org/core/numpy) arrays to hold the data when the `to_dask` method is used." |
375 | 375 | ] |
376 | 376 | }, |
377 | 377 | { |
|
391 | 391 | "- Intake can load data into Dask for use in parallel computing. \n", |
392 | 392 | "\n", |
393 | 393 | "### What's next?\n", |
394 | | - "In the next notebook we will look at writing a Intake catalog and making it available on [Github](https://foundations.projectpythia.org/foundations/getting-started-github.html)." |
| 394 | + "In the next notebook we will look at writing a Intake catalog and making it available on [Github](https://foundations.projectpythia.org/foundations/getting-started-github)." |
395 | 395 | ] |
396 | 396 | }, |
397 | 397 | { |
|
0 commit comments