loader

The loader project contains multiple utilities to load GTFS, OSM and OTP data into various apps and databases. The sub projects are:

1. geocoder, which creates data output for the Pelias geocoder
2. gtfs, which contains routines to cache and compare gtfs feeds.
3. gtfsdb, which loads gtfs files into GTFSDB
4. osm, which downloads OSM .pdb files, and futher can extract .osm data via OSMOSIS
5. otp, which builds graphs (Graph.obj) databases for OpenTripPlanner
6. solr, which has config and scripts for loading SOLR (a depricated geo search tool)
7. sum, shared use mobility ... place to pull in car (Zipcar), bike (BIKETOWN) & e-scooter (LIME, BIRD, SHARED, etc...) data, etc...

install:

1. install python 3.7 (works with py versions >= 2.7), zc.buildout and git
2. git clone https://github.com/OpenTransitTools/loader.git
3. cd loader
4. buildout
5. (note: if buildout fails, keep running ... possibly run scripts/clean*sh between runs of buildout ... you'll eventually get there)
6. git update-index --assume-unchanged .pydevproject
7. NOTE: system packages necessary for things to work may include pre-built Shapely, or else the following system packages:
8. Install these packages
   • yum install protobuf protobuf-devel tokyocabinet tokyocabinet-devel geos geos-devel libxml2 libxslt libxml2-devel libxslt-devel openssl-devel
9. Or Build and install Protobuf and TokyoCabinet from source (MacOSX):
   • git clone https://github.com/google/protobuf
   • wget http://tokyocabinet.sourceforge.net/tokyocabinet-1.4.25.tar.gz

run:

1. bin/test ... this cmd will run loader's unit tests (see: http://docs.zope.org/zope.testrunner/#some-useful-command-line-options-to-get-you-started)
2. see individual project README's above to see different app runs
3. and check out the bin/ generated after buildout is run (those binaries are created via buildout & setup.py)