NSAPH Data Platform
Contents
Introduction
What is Data Platform
Data Domains
Health
Climate
What is gridMET?
Using command line gridMET utility
Example
Python modules
CWL pipelines and tools
Downloader of gridMET Data
add_daily_data.cwl
Uploader of the gridMET Data to the database
add_data.cwl
Tool aggregating a NetCDF grid file over shapes
aggregate_daily.cwl
Workflow to aggregate and ingest NetCDF files for one year
aggregate_one_file.cwl
Aggregates data in NetCDF file over given geographies
aggregate_wustl.cwl
Downloader of gridMET Data
download.cwl
Downloader of AirNow Data
get_shapes.cwl
Pipeline to aggregate data from Climatology Lab
Sub-workflow
init_tables
from gridmet.cwl
tmpd5z66z6qgridmet.cwl
gridMET Pipeline
Sub-workflow
process
from gridmet_dwnl_only.cwl
tmp9pmq12ragridmet_dwnl_only.cwl
gridmet_dwnl_only.cwl
gridMET Pipeline
Sub-workflow
process
from gridmet_local_shapes.cwl
tmprm194zk3gridmet_local_shapes.cwl
gridmet_local_shapes.cwl
Workflow to aggregate and ingest one gridMET file in NetCDF format
gridmet_one_file.cwl
gridmet.cwl
Index Builder
index.cwl
Universal uploader of the tabular data to the database
ingest.cwl
Database initializer
initdb.cwl
Pipeline to aggregate data in NetCDF format over given geographies
pm25_yearly_download.cwl
Model YAML Writer
registry.cwl
Generic Table (View/Materialized View) Initializer
reset.cwl
Runs an SQL Test Script, presumably generated by DBT Utility
run_test.cwl
Test harness for gridmet.cwl
test_gridmet.cwl
Test harness for pm25_yearly_download.cwl
test_pm25_yearly_download.cwl
Table tuner tool (running VACUUM)
vacuum.cwl
Pipeline to ingest Pollution downloaded from WashU Box
wustl_consolidate_components.cwl
wustl_consolidate_components.cwl
Expression evaluator to format a file name for pollution files downloaded from WashU
wustl_file_pattern.cwl
Workflow to aggregate and ingest one file in NetCDF format
wustl_one_file.cwl
Workflow to aggregate and ingest NetCDF files for one year
wustl_one_year.cwl
wustl.cwl
Pollution
Demographics
Data Processing Pipelines
Python Packages
Data Platform Internals
Adding more data
Terms and Acronyms
Indices
NSAPH Data Platform
Data Domains
Gridmet Computational Utilities
tmpd5z66z6qgridmet.cwl
View page source
tmpd5z66z6qgridmet.cwl