\"${e[s]}\" does not resolve`)}}let q,H=!e&&(0,eval)(\"u=>import(u)\");const J=e&&new Promise((e=>{const t=Object.assign(document.createElement(\"script\"),{src:O(\"self._d=u=>import(u)\"),ep:!0});t.setAttribute(\"nonce\",f),t.addEventListener(\"load\",(()=>{if(!(q=!!(H=self._d))){let e;window.addEventListener(\"error\",(t=>e=t)),H=(t,r)=>new Promise(((n,i)=>{const s=Object.assign(document.createElement(\"script\"),{type:\"module\",src:O(`import*as m from'${t}';self._esmsi=m`)});function a(a){document.head.removeChild(s),self._esmsi?(n(self._esmsi,E),self._esmsi=void 0):(i(!(a instanceof Event)&&a||e&&e.error||new Error(`Error loading ${r&&r.errUrl||t} (${s.src}).`)),e=void 0)}e=void 0,s.ep=!0,f&&s.setAttribute(\"nonce\",f),s.addEventListener(\"error\",a),s.addEventListener(\"load\",a),document.head.appendChild(s)}))}document.head.removeChild(t),delete self._d,e()})),document.head.appendChild(t)}));let D=!1,B=!1;const F=e&&HTMLScriptElement.supports;let K=F&&\"supports\"===F.name&&F(\"importmap\"),z=q,G=!1,Q=!1;const V=[0,97,115,109,1,0,0,0];let X,Y,Z,ee=Promise.resolve(J).then((()=>{if(q)return e?new Promise((e=>{const t=document.createElement(\"iframe\");t.style.display=\"none\",t.setAttribute(\"nonce\",f),window.addEventListener(\"message\",(function r({data:n}){Array.isArray(n)&&\"esms\"===n[0]&&([,K,z,B,D,G,Q]=n,e(),document.head.removeChild(t),window.removeEventListener(\"message\",r,!1))}),!1);const r=`"
],
"text/plain": [
":NdOverlay [Variable]\n",
" :Curve [Time] (value)"
]
},
"execution_count": 6,
"metadata": {
"application/vnd.holoviews_exec.v0+json": {
"id": "p1004"
}
},
"output_type": "execute_result"
}
],
"source": [
"df.hvplot(\n",
" kind=\"line\", x=\"Time\", y=[\"Arctic\", \"Antarctica\"], width=700, height=500\n",
")"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Now we can load a source correctly and also receive a graphic output for opening up the data. We can now display this recipe in the YAML syntax with:"
]
},
{
"cell_type": "code",
"execution_count": 7,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"sources:\n",
" csv:\n",
" args:\n",
" urlpath: https://timeseries.weebly.com/uploads/2/1/0/8/21086414/sea_ice.csv\n",
" description: ''\n",
" driver: intake.source.csv.CSVSource\n",
" metadata: {}\n",
"\n"
]
}
],
"source": [
"print(source.yaml())"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"Finally, we can create a YAML file containing this recipe with an additional description and the tested diagram:"
]
},
{
"cell_type": "code",
"execution_count": 8,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"Overwriting sea.yaml\n"
]
}
],
"source": [
"%%writefile sea.yaml\n",
"sources:\n",
" sea_ice:\n",
" args:\n",
" urlpath: \"https://timeseries.weebly.com/uploads/2/1/0/8/21086414/sea_ice.csv\"\n",
" description: \"Polar sea ice cover\"\n",
" driver: csv\n",
" metadata:\n",
" plots:\n",
" basic:\n",
" kind: line\n",
" x: Time\n",
" y: [Arctic, Antarctica]\n",
" width: 700\n",
" height: 500"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"To check that the YAML file works too, we can reload it and try to work with it:"
]
},
{
"cell_type": "code",
"execution_count": 9,
"metadata": {},
"outputs": [],
"source": [
"cat = intake.open_catalog(\"sea.yaml\")"
]
},
{
"cell_type": "code",
"execution_count": 10,
"metadata": {
"scrolled": true
},
"outputs": [
{
"data": {},
"metadata": {},
"output_type": "display_data"
},
{
"data": {
"application/vnd.holoviews_exec.v0+json": "",
"text/html": [
"\n",
""
],
"text/plain": [
":NdOverlay [Variable]\n",
" :Curve [Time] (value)"
]
},
"execution_count": 10,
"metadata": {
"application/vnd.holoviews_exec.v0+json": {
"id": "p1088"
}
},
"output_type": "execute_result"
}
],
"source": [
"cat.sea_ice.plot.basic()"
]
},
{
"cell_type": "markdown",
"metadata": {},
"source": [
"The catalog appears to be functional and can now be released. The easiest way to share an Intake catalog is to put it in a place where it can be read by your target audience. In this tutorial stored in a Git repo, this can be the url of the file in the repo. All you have to share with your users is the URL of the catalog. You can try this yourself with:"
]
},
{
"cell_type": "code",
"execution_count": 11,
"metadata": {},
"outputs": [],
"source": [
"cat = intake.open_catalog(\n",
" \"https://raw.githubusercontent.com/veit/Python4DataScience/main/docs/data-processing/intake/sea.yaml\"\n",
")"
]
},
{
"cell_type": "code",
"execution_count": 12,
"metadata": {
"scrolled": true
},
"outputs": [
{
"data": {
"text/html": [
"\n",
"\n",
"
\n",
" \n",
" \n",
" | \n",
" Time | \n",
" Arctic | \n",
" Antarctica | \n",
"
\n",
" \n",
" \n",
" \n",
" | 0 | \n",
" 1990M01 | \n",
" 12.72 | \n",
" 3.27 | \n",
"
\n",
" \n",
" | 1 | \n",
" 1990M02 | \n",
" 13.33 | \n",
" 2.15 | \n",
"
\n",
" \n",
" | 2 | \n",
" 1990M03 | \n",
" 13.44 | \n",
" 2.71 | \n",
"
\n",
" \n",
" | 3 | \n",
" 1990M04 | \n",
" 12.16 | \n",
" 5.10 | \n",
"
\n",
" \n",
" | 4 | \n",
" 1990M05 | \n",
" 10.84 | \n",
" 7.37 | \n",
"
\n",
" \n",
"
\n",
"
\n",
"\n",
"**Note:**\n",
"\n",
"This catalog is also a DataSource instance, i.e. you can refer to it from other catalogs and thus build a hierarchy of data sources. For example, you have a master or main catalog that references several other catalogs, each with entries of a certain type and the whole thing can e.g. be searched with [Intake-GUI](gui.ipynb). In this way, the overall data acquisition structure has a structure that makes it easier to navigate to the correct data set. You can even have separate hierarchies that reference the same data.\n",
"
"
]
},
{
"cell_type": "code",
"execution_count": 13,
"metadata": {},
"outputs": [
{
"name": "stdout",
"output_type": "stream",
"text": [
"sources:\n",
" sea:\n",
" args:\n",
" path: https://raw.githubusercontent.com/veit/Python4DataScience/main/docs/data-processing/intake/sea.yaml\n",
" description: ''\n",
" driver: intake.catalog.local.YAMLFileCatalog\n",
" metadata: {}\n",
"\n"
]
}
],
"source": [
"print(cat.yaml())"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3.13 Kernel",
"language": "python",
"name": "python313"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.13.0"
},
"latex_envs": {
"LaTeX_envs_menu_present": true,
"autoclose": false,
"autocomplete": true,
"bibliofile": "biblio.bib",
"cite_by": "apalike",
"current_citInitial": 1,
"eqLabelWithNumbers": true,
"eqNumInitial": 1,
"hotkeys": {
"equation": "Ctrl-E",
"itemize": "Ctrl-I"
},
"labels_anchors": false,
"latex_user_defs": false,
"report_style_numbering": false,
"user_envs_cfg": false
},
"widgets": {
"application/vnd.jupyter.widget-state+json": {
"state": {},
"version_major": 2,
"version_minor": 0
}
}
},
"nbformat": 4,
"nbformat_minor": 4
}