Skip to content

Processes to automate

jensenmj edited this page Jun 4, 2020 · 25 revisions

This page is meant to be a grab bag list of processes we would like to automate in the department. Eventually we will organize this list by priority order.

Please add your ideas here!

1. Household survey data cleaning: Going a) smartphone traces b) web survey

  1. Jurisdictional data profiles (Chris will give a nicer moniker) to do, Craig, long-term

  2. Census data reconcilation of different datasets and years (look at IPUMS) to do

  3. Baseyear parcel & building data processing (from county assessor websites) soon

5a. Script-callable geocoding & QC function (utilizing our services and others as helpful, e.g. Bing API) Employment database as an example; permits, household survey 5b. Geocoding services creation (from address datasets) Christy has a repo - geocoding-services

7. Annual covered employment dataset processing - start in Fall 2019, data should be migrated to elmer

  1. Annual all-jobs estimates creation a) non-wage & salary b) exempt corporate officers, presumed wage & salary

  2. LODES adjustment

  3. Annual permit data

  4. Refine block-splitting scripts/methodology - parcelizing housing and pop estimates a) fully automate sections requiring GIS b) develop input data format standards

  5. OFM April 1 published data for trends (population of cities and towns) a) cities and towns b) annexations

  6. Convert GIS shapefiles into ElmerGeo spatial

  7. Reproject EPSG 4326 coordinates to 2285 x,y in Sql Server (CLR function)

  8. Help migrate modeling data (e.g. baseyear) to Elmer, integrated with run input management

Clone this wiki locally