crate.ly

Crate.ly - All the online music in one place (discontinued)

See the static brach for the static or landing page which you can see on crate.ly

Project's Objective

The idea came about while doing an internship in my 3rd year in DIT. When you find a great track on your work computer either on SoundCloud, YouTube or else, there really no good way to organise those tracks so you can later download them, find more from the artist or DJ.

So the initial goal was to be able to quickly mark songs to "Listen To It Later". Following the domain not being available I thought the act of putting records in a "crate" could mean archiving songs for later.

To quickly mark songs, the first implementation was to done via a browser Bookmarklet.

Technologies

Front-end:

• Knockout.js 2.2 for the JavaScript Framework
• jQuery, jQuery UI
• Bootstrap 2
• Grunt (which requires npm, [node](https:// github.com/joyent/node/wiki/Installing-Node.js-via-package-manager))
• LiveReload Chrome Extension

For the actual music web app:

• SoundManager
• Sammy.js for routes
• jquery.noty
• knockout-sortable
• spin.js

Back-end:

• NGINX for the static page and assets (css, js, fonts, etc)
• Python Flask Web Framework for the REST API and Auth
• Cherrypy WSGI Framework for production
• Mongoengine (ORM for MongoDB)
• MongoDB
• Fabric for simple continuous deployment

Hosting:

I used:

• Virtual Server: Digital Ocean 512MB droplet - Ubuntu 12.04 LTE
• DNS: Cloudflare

Quick start

Configuration

• Save the SoundCloud API KEY in script.js

• Copy development.cfg.default to development.cfg

• Copy production.cfg.default to production.cfg

• Copy listentoitlater/listentoitlater.cfg.default listentoitlater/listentoitlater.cfg

Install the requirements for your development environment

• MongoDB
• Python
• PyMongo
• virtualenv

Start the development environment:

mongod

Open an new terminal:

virtualenv env
. env/bin/activate env
pip install -r requirements.txt
./runserver.py

Open an new terminal to watch files being updated and automagically refresh the browser:

grunt

Open in the browser http://0.0.0.0:8000/

Setup the production server

Yes, i did it so many time, I've written all the steps :)

These are for the Ubuntu 12.04 LTE.

ssh into your server and add a linux user:

adduser crately sudo
visudo

Make all the users not require password to run sudo:

%sudo   ALL=(ALL) NOPASSWD: ALL

Allow the user you created (eg. cartely) ssh access so you can use that rather than root:

nano /etc/ssh/sshd_config

Edit/Add this line:

AllowUsers crately

Transfer your public key to from your dev computer:

scp .ssh/id_rsa.pub crately@SERVERHOST:.ssh/authorized_keys

Go back to the server and change the permission of the ssh authorized_keys:

chmod 600 ~/.ssh/authorized_keys

Make fabric work without password by authorizing your own server key:

ssh-keygen -t dsa -P '' -f ~/.ssh/id_dsa
cat ~/.ssh/id_dsa.pub >> ~/.ssh/authorized_keys

Install zsh (optional):

curl -L https://github.com/robbyrussell/oh-my-zsh/raw/master/tools/install.sh | sh
chsh -s /bin/zsh

Install MongoDB (or follow this):

sudo apt-key adv --keyserver keyserver.ubuntu.com --recv 7F0CEB10
echo 'deb http://downloads-distro.mongodb.org/repo/ubuntu-upstart dist 10gen' | sudo tee /etc/apt/sources.list.d/mongodb.list
sudo apt-get update
sudo apt-get install mongodb-10gen

Install git, python and pip:

sudo apt-get install build-essential python-dev python-pip git

Install virtualenv and Fabric:

sudo pip install virtualenv fabric

Setup the directory for the project and deploy from a remote git:

mkdir crately
mkdir crately.git
cd crately.git
git init --bare
git config core.bare false
git config receive.denycurrentbranch ignore
git config core.worktree ../crately

Setup a post-receive hook to run the fabric script after new changes have been pushed to the repo:

nano hooks/post-receive

Add this:

#!/bin/sh
cd ~/crately/scripts
fab deploy

(see the fabric script)

Get the Python web server ready:

cd ~
virtualenv crately/env

sudo cp ~/crately/scripts/cherrypy-ubuntu /etc/init.d/cherrypy
sudo chmod +x /etc/init.d/cherrypy

(see the cherrypy-ubuntu init.d script)

Add the server's git repo back in the dev computer:

git remote add production crately@SERVERHOST:crately.git

Push the repo to the server:

git push production master

Start the web server!

sudo service cherrypy start

Optional: Set a redirect from port 80 to 443 to allow SSL. To do this you'll need a SSL key for your domain.

Replace your domain in the NGINX config file:

• nginx_config

Add 301 redirect from port 80 to https:// (403):

sudo apt-get install nginx
sudo cp scripts/nginx_config /etc/nginx/sites-available/default

sudo service nginx start

Useful commands

Take a full backup of the files in the current directory (.)

tar -zcvf /tmp/ubuntu-12.04.1-bkp.tar.gz .

Take a full backup of MongoDB. Note this can take substantial load:

mongodump -o /tmp