Skip to content

Commit 85e9b9f

Browse files
authored
Merge pull request #38 from ProjectPythia/jukent
Fix foundations links
2 parents 5ea69c2 + 6624be4 commit 85e9b9f

File tree

3 files changed

+14
-14
lines changed

3 files changed

+14
-14
lines changed

README.md

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -57,7 +57,7 @@ and even change the example programs. You’ll see that the code cells
5757
have no output at first, until you execute them by pressing
5858
{kbd}`Shift`\+{kbd}`Enter`. Complete details on how to interact with
5959
a live Jupyter notebook are described in [Getting Started with
60-
Jupyter](https://foundations.projectpythia.org/foundations/getting-started-jupyter.html).
60+
Jupyter](https://foundations.projectpythia.org/foundations/getting-started-jupyter).
6161

6262
### Running on Your Own Machine
6363
If you are interested in running this material locally on your computer, you will need to follow this workflow:

notebooks/creating_catalogs.ipynb

Lines changed: 4 additions & 4 deletions
Original file line numberDiff line numberDiff line change
@@ -44,8 +44,8 @@
4444
"| --- | --- | --- |\n",
4545
"| [Intro to Intake](./intake_introduction.ipynb) | Necessary | |\n",
4646
"| [Understanding of yaml](https://yaml.org/spec/1.2.2/#chapter-1-introduction-to-yaml) | Necessary | |\n",
47-
"| [Getting Started with Github](https://foundations.projectpythia.org/foundations/getting-started-github.html) | Necessary | |\n",
48-
"| [Intro to Pandas](https://foundations.projectpythia.org/core/pandas/pandas.html) | Helpful | |\n",
47+
"| [Getting Started with Github](https://foundations.projectpythia.org/foundations/getting-started-github) | Necessary | |\n",
48+
"| [Intro to Pandas](https://foundations.projectpythia.org/core/pandas/pandas) | Helpful | |\n",
4949
"\n",
5050
"\n",
5151
"- **Time to learn**: 45 minutes"
@@ -139,7 +139,7 @@
139139
"metadata": {},
140140
"source": [
141141
"## Adding Your First Data Source\n",
142-
"Intake only knows how to handle a few different data formats. To handle other formats it uses plugable drivers. To use the [Mesowest's HRRR Zarr data](https://mesowest.utah.edu/html/hrrr/) we will use the intake-xarray package which provides a driver for reading Zarr data into [Xarray](https://foundations.projectpythia.org/core/xarray.html) datasets. Drivers are installed as python packages and integrate into the Intake library. When intalled Intake creates a open_{driver} method for each driver in the package. Installing the intake-xarray package allows us to access zarr data using the `open_zarr` method.\n",
142+
"Intake only knows how to handle a few different data formats. To handle other formats it uses plugable drivers. To use the [Mesowest's HRRR Zarr data](https://mesowest.utah.edu/html/hrrr/) we will use the intake-xarray package which provides a driver for reading Zarr data into [Xarray](https://foundations.projectpythia.org/core/xarray) datasets. Drivers are installed as python packages and integrate into the Intake library. When intalled Intake creates a open_{driver} method for each driver in the package. Installing the intake-xarray package allows us to access zarr data using the `open_zarr` method.\n",
143143
"\n",
144144
"Mesowest's HRRR Zarr data is stored in AWS. The [file structure](https://mesowest.utah.edu/html/hrrr/zarr_documentation/html/zarr_variables.html) of the [hrrrzarr S3 bucket](https://hrrrzarr.s3.amazonaws.com/index.html) looks like \n",
145145
"\n",
@@ -185,7 +185,7 @@
185185
"cell_type": "markdown",
186186
"metadata": {},
187187
"source": [
188-
"Above we used the `storage_options` argument to tell Intake how to access data on AWS. In this case we accessed the data as an anonymous user. The `consolidated=True` argument is given to tell [Xarray](https://foundations.projectpythia.org/core/xarray.html) how to load the metadata for this source. Zarr data may contain consolidated metadata. If it does, using it can increase performance significantly.\n",
188+
"Above we used the `storage_options` argument to tell Intake how to access data on AWS. In this case we accessed the data as an anonymous user. The `consolidated=True` argument is given to tell [Xarray](https://foundations.projectpythia.org/core/xarray) how to load the metadata for this source. Zarr data may contain consolidated metadata. If it does, using it can increase performance significantly.\n",
189189
"\n",
190190
"When you use Intake's `open_{driver}` methods, it creates a catalog entry for the source. You can view the yaml using the source's `yaml` method."
191191
]

notebooks/intake_introduction.ipynb

Lines changed: 9 additions & 9 deletions
Original file line numberDiff line numberDiff line change
@@ -41,9 +41,9 @@
4141
"\n",
4242
"| Concepts | Importance | Notes |\n",
4343
"| --- | --- | --- |\n",
44-
"| [Times and Dates in Python](https://foundations.projectpythia.org/core/datetime/datetime.html) | Necessary | |\n",
45-
"| [Intro to Xarray](https://foundations.projectpythia.org/core/xarray/xarray-intro.html) | Necessary | |\n",
46-
"| [Intro to Cartopy](https://foundations.projectpythia.org/core/cartopy/cartopy.html) | Helpful | |\n",
44+
"| [Times and Dates in Python](https://foundations.projectpythia.org/core/datetime/datetime) | Necessary | |\n",
45+
"| [Intro to Xarray](https://foundations.projectpythia.org/core/xarray/xarray-intro) | Necessary | |\n",
46+
"| [Intro to Cartopy](https://foundations.projectpythia.org/core/cartopy/cartopy) | Helpful | |\n",
4747
"| [Understanding of Zarr](https://zarr.readthedocs.io/en/stable/) | Helpful | |\n",
4848
"| [Understanding of Dask](https://www.dask.org/) | Helpful | |\n",
4949
"\n",
@@ -168,7 +168,7 @@
168168
"cell_type": "markdown",
169169
"metadata": {},
170170
"source": [
171-
"From this Python dictionary, there are a few things that we can learn. The `container` key tells us what form the data will be in when we read it. In this case it will be a [Xarray](https://foundations.projectpythia.org/core/xarray.html) `Dataset` The `user_parameters` key has a list containing parameters a user can set to control what data they get. The `metadata` key contains an arbitrary dictionary of information specified by the catalog author. A common things to find in the `metadata` field are plots you can use to get a quick peak at the data."
171+
"From this Python dictionary, there are a few things that we can learn. The `container` key tells us what form the data will be in when we read it. In this case it will be a [Xarray](https://foundations.projectpythia.org/core/xarray) `Dataset` The `user_parameters` key has a list containing parameters a user can set to control what data they get. The `metadata` key contains an arbitrary dictionary of information specified by the catalog author. A common things to find in the `metadata` field are plots you can use to get a quick peak at the data."
172172
]
173173
},
174174
{
@@ -284,7 +284,7 @@
284284
"source": [
285285
"Mesowest provides a [tutorial](https://mesowest.utah.edu/html/hrrr/zarr_documentation/html/xarray_one_day_analysis_example.html) for reading a days worth of surface temperature HRRR data from AWS. Lets see what the same task looks like using Intake.\n",
286286
"\n",
287-
"We will start by setting up our [Cartopy](https://foundations.projectpythia.org/core/cartopy.html) projection according to the information given in the readme source."
287+
"We will start by setting up our [Cartopy](https://foundations.projectpythia.org/core/cartopy) projection according to the information given in the readme source."
288288
]
289289
},
290290
{
@@ -304,7 +304,7 @@
304304
"cell_type": "markdown",
305305
"metadata": {},
306306
"source": [
307-
"Now lets read in the data with Intake. To do this will create a [datetime](https://foundations.projectpythia.org/core/datetime.html) object with the date August 9, 2019. Then we will use list comprehension and `timedelta` objects to create a [datetime](https://foundations.projectpythia.org/core/datetime.html) object for each hour that day. Again, using list comprehension, we will create a list of datasets using Intake. In order to concatenate our list of datasets using [Xarray](https://foundations.projectpythia.org/core/xarray.html), we need a dimension to concatenate accross. Each dataset in our list contains a time variable with an array of just one timestamp. We can promote that variable to a coordinate using the `set_coords` method. This may take a few minutes to run."
307+
"Now lets read in the data with Intake. To do this will create a [datetime](https://foundations.projectpythia.org/core/datetime) object with the date August 9, 2019. Then we will use list comprehension and `timedelta` objects to create a [datetime](https://foundations.projectpythia.org/core/datetime) object for each hour that day. Again, using list comprehension, we will create a list of datasets using Intake. In order to concatenate our list of datasets using [Xarray](https://foundations.projectpythia.org/core/xarray), we need a dimension to concatenate accross. Each dataset in our list contains a time variable with an array of just one timestamp. We can promote that variable to a coordinate using the `set_coords` method. This may take a few minutes to run."
308308
]
309309
},
310310
{
@@ -325,7 +325,7 @@
325325
"cell_type": "markdown",
326326
"metadata": {},
327327
"source": [
328-
"Now our data is ready to be analyzed in the normal way using [Xarray](https://foundations.projectpythia.org/core/xarray.html)."
328+
"Now our data is ready to be analyzed in the normal way using [Xarray](https://foundations.projectpythia.org/core/xarray)."
329329
]
330330
},
331331
{
@@ -371,7 +371,7 @@
371371
"cell_type": "markdown",
372372
"metadata": {},
373373
"source": [
374-
"As you can see [Xarray](https://foundations.projectpythia.org/core/xarray.html) uses Dask arrays instead of [NumPy](https://foundations.projectpythia.org/core/numpy.html) arrays to hold the data when the `to_dask` method is used."
374+
"As you can see [Xarray](https://foundations.projectpythia.org/core/xarray) uses Dask arrays instead of [NumPy](https://foundations.projectpythia.org/core/numpy) arrays to hold the data when the `to_dask` method is used."
375375
]
376376
},
377377
{
@@ -391,7 +391,7 @@
391391
"- Intake can load data into Dask for use in parallel computing. \n",
392392
"\n",
393393
"### What's next?\n",
394-
"In the next notebook we will look at writing a Intake catalog and making it available on [Github](https://foundations.projectpythia.org/foundations/getting-started-github.html)."
394+
"In the next notebook we will look at writing a Intake catalog and making it available on [Github](https://foundations.projectpythia.org/foundations/getting-started-github)."
395395
]
396396
},
397397
{

0 commit comments

Comments
 (0)