If you would like to contribute to this project, we recommend following the "fork-and-pull" Git workflow.
- Fork the repo on GitHub
- Clone the project to your own machine
- Commit changes to your own branch
- Push your work back up to your fork
- Submit a Pull request so that we can review your changes
NOTE: Be sure to merge the latest from "upstream" before making a pull request!
1. Clone Repo
git clone https://github.com/georgian-io/LLM-Finetuning-Toolkit.git
cd LLM-Finetuning-Toolkit/
2. Install Dependencies
Install with Docker [Recommended]
docker build -t llm-toolkit .
# CPU
docker run -it llm-toolkit
# GPU
docker run -it --gpus all llm-toolkit
Poetry (recommended)
See poetry documentation page for poetry installation instructions
poetry install
pip
We recommend using a virtual environment like `venv` or `conda` for installationpip install -e .
- Use
ruff check --fix
to check and fix lint errors - Use
ruff format
to apply formatting - Run
pytest
at the top level directory to run unit tests
NOTE: Ruff linting and formatting checks are done when PR is raised via Git Action. Before raising a PR, it is a good practice to check and fix lint errors, as well as apply formatting.
To manually release a PyPI package, please run:
make build-release
Note: Make sure you have a pypi token for this PyPI repo.