Processes to automate

This page is meant to be a grab bag list of processes we would like to automate in the department. Eventually we will organize this list by priority order.

Please add your ideas here!

1. Household survey data cleaning: Going a) smartphone traces b) web survey

2. Jurisdictional data profiles (Chris will give a nicer moniker) to do, Craig, long-term

3. Census data reconcilation of different datasets and years (look at IPUMS) to do

4. Assessor parcel/building data processing (part of UrbanSim baseyear creation) soon

5a. Script-callable geocoding & QC function (utilizing our services and others as helpful, e.g. Bing API) Employment database as an example; permits, household survey 5b. Geocoding services creation (from address datasets) Christy has a repo - geocoding-services

7. Annual covered employment dataset processing - start in Fall 2019, data should be migrated to elmer

8. Annual all-jobs estimates creation a) non-wage & salary b) exempt corporate officers, presumed wage & salary

9. LODES adjustment

10. Annual permit data

11. Refine block-splitting scripts/methodology - parcelizing housing and pop estimates a) fully automate sections requiring GIS b) develop input data format standards

12. OFM April 1 published data for trends (population of cities and towns) a) cities and towns b) annexations

13. convert GIS shapefiles into GDB