Python Core Platform Components
See also
Package nsaph
NSAPH Core Package-wide utilities API to initialize logging and database connections
db Database connections API
fips US State FIPS codes, represented as Python dictionary
pg_keywords PostgreSQL keywords, e.g. type names, etc.
Package nsaph.data_model
APIs for data modelling, loading and manipulations
Domain class Data modeling for a data domain
Inserter API to parallel data loader
utils Miscellaneous data handling API
Package nsaph.loader
Command line utilities to manipulate data
Data Introspector introspects columnar data to infer the types of the columns
The data_loader Module Transfers data from file(s) to the database. Implements parallel loading and handling multiple file formats (CSV, FST, JSON, SAS, FWF)
Project Loader Recursively introspects and loads data directory into the database
Index Builder Builds indices for a table or for all tables in the data domain, reporting the progress
Database Activity Monitor API and command line utility to monitor database activity
Vacuum Executes VACUUM command in the database to tune tables for better query performance
Common Configuration Common configuration options for working with the database
Loader Configurator Configuration options for data loader
Package nsaph.requests
Attempt to tackle User requests API. Incomplete work in progress
HDF5 Export API and utility to export result of quering the database in HDF5 format
Query class API and utility to generate SQL query based on a YAML query specification
Package nsaph.utils
Miscellaneous tools and APIs
CWL Output collector Command line utility to copy outputs from a CWL tool or sub-workflow into the calling workflow
Blocking Executor Pool Blocking executor pool to avoid memory overflow with long queues
Localhost for Airflow Overrides host resolver for Airflow, so it can use localhost
JSON to/from Table converter A command line utility to import/export JSON files as database tables
Resource finder An API to look for resources in Python packages
sas_explorer A tool to print metadata of a SAS SAS7BDAT file
SSA to FIPS Mapping A utility to create in-database mapping table between SSA and FIPS codes
ZIP to FIPS mappings A utility to download ZIP to FIPS mapping from HUD site
See also