Single Lookup Tool - The Department maintains over 8 different database and data sources (Excel & Access files) containing information about different rental properties. The Department often needs to lookup and attribute different programs to these units. This tool would consider of an unified ETL pipeline and deduplication service that allows staff to lookup properties and see which programs have been used, along with alternate addresses, etc.
Rushmore Cervantes, Laura Guglielmo & Luz Santiago
UCLA Extension - The Coding Bootcamp
File processing demo | Upload demo | Search demo
Grace Benedicto Donya Plazo (Code) Stephen Lew Rollin Nelson Emmanuel Yuen Bryan Kirkness (Code) Franklin Campos Rent Compliance Neighborhood Development
Andrey Orlov Ryan House Matt Whitcomb
Developed backend server that provides a response to a single query of relations of various databases.
Ben Chang Charlotte Anongos Daniel Yeh
Developed frontend sever using react with redux with a clean visual of the query results.
- Single query of multiple data sources to provide all information on a single (and related) property i.e. Property Information Sheet/Snapshot
- Minimize need to search using multiple platforms.
- Ensure non-duplication of data
- Long-term goal: Additional query options. Generate a report that produces results from the search of the multiple data sources based on shared common criteria. Criteria search vs. Property Search. i.e. properties that have a land use covenant, financed new construction that are now in the Rent Escrow Program.
Lookup Tool - a website with an automated ETL process on the data exports and a search and lookup functionality.
To load the data, you'll need a database called hcid-disp running in postgres. You'll also need the data files stored in the data
directory, which is ignored from git in the .gitignore
.
Additionally, you'll need to install csvkit. Run pip install csvkit
to install the package.
Run etl/load.sh
from the project root dir and it should create the data tables and run the join query for the APN master table.
Tested using ZSH on Ubuntu and OSX.
HIMS BIMS CCRIS Rent Preservation Properties - Historical Access Database Land Use Neighborhood Development Homeownership Other Non-City Tax Credits and Financed
We've pulled these togehter into a single SQL Server database backup, called datalake.bak
. The Database name is DataLake.
There are two servers running for this application. *Backend server using node & express in root folder *Frontend server using react in "app" folder
- Install dependencies for root and app folder
npm install
- Install postgreSQL
- Create user for prostgres named "username"
- Start backend & frontend servers for root and app folder
npm start
LA City Geohub Parcel | LA County APN Change File | LA County Parcel Data
Node v6.x Postgres v9.6 Sequelize ORM Babel BlueBird npm Parse-address npm Fast-csv npm Multer npm React React-Redux Google Autocomplete