NSAPH Data Platform

Contents

  • Introduction
  • What is Data Platform
  • Data Domains
  • Data Processing Pipelines
  • Python Packages
    • General purpose utilities
    • Data platform components
    • GIS utilities
    • Health data manipulation tools
    • EPA tools
      • Package Contents
        • EPA Toolkit Usage
        • Python Components
        • CWL Tools and Common Workflows
      • Querying Data
    • gridMET tools
    • Census data manipulation tools
  • Data Platform Internals
  • Adding more data
  • Terms and Acronyms
  • Indices
NSAPH Data Platform
  • Data Domains
  • NSAPH EPA Package Description
  • CWL Tools and Common Workflows
  • View page source

CWL Tools and Common Workflows

  • Full EPA AirNow Processing Pipeline (including downloading shapefiles)
    • Description
    • Inputs
    • Outputs
    • Steps
  • Full AirNowProcessing Pipeline (with shapefiles on local file system)
    • Description
    • Inputs
    • Outputs
    • Steps
  • airnow_local_shapes.cwl
  • airnow.cwl
  • Full EPA AQS Processing Pipeline
    • Description
    • Inputs
    • Outputs
    • Steps
  • aqs.cwl
  • Downloader of AirNow Data
    • Description
    • Inputs
    • Outputs
  • download_airnow.cwl
  • Downloader of AQS Data
    • Description
    • Inputs
    • Outputs
  • download_aqs.cwl
  • Resource Loader
    • Description
    • Inputs
    • Outputs
  • ensure_resource.cwl
  • Downloader of AQS Data
    • Description
    • Inputs
    • Outputs
  • expand_aqs.cwl
  • Downloader of AirNow Data
    • Description
    • Inputs
    • Outputs
  • get_shapes.cwl
  • Index Builder
    • Description
    • Inputs
    • Outputs
  • index.cwl
  • Universal uploader of the tabular data to the database
    • Description
    • Inputs
    • Outputs
  • ingest.cwl
  • Database initializer
    • Description
    • Inputs
    • Outputs
  • initcoredb.cwl
  • Introspector for downloaded data file
    • Description
    • Inputs
    • Outputs
  • introspect.cwl
  • Runs an SQL Test Script, presumably generated by DBT Utility
    • Description
    • Inputs
    • Outputs
  • run_test.cwl
  • Sample arguments to AirNow pipeline
  • Sample arguments to AQS pipeline
    • For annual NO2 (nitrogen) data
    • For daily PM25 (small particles) data
  • Prepare environment for AirNow
    • Description
    • Inputs
    • Outputs
  • setup_airnow.cwl
  • Test harness for airnow.cwl
    • Inputs
    • Outputs
    • Steps
  • test_airnow.cwl
  • Test harness for aqs.cwl
    • Inputs
    • Outputs
    • Steps
  • test_aqs.cwl
  • Table tuner tool (running VACUUM)
    • Description
    • Inputs
    • Outputs
  • vacuum.cwl
Previous Next

© Copyright 2021, Harvard University.

Built with Sphinx using a theme provided by Read the Docs.