Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

feat: Introduce InstructionFinetuningDataRepository #1033

Open
wants to merge 3 commits into
base: main
Choose a base branch
from
Open

feat: Introduce InstructionFinetuningDataRepository #1033

wants to merge 3 commits into from

Commits on Oct 16, 2024

  1. feat: Support for finetuning dataset creation 

    WIP: implement initial interface

WIP: minimal working implementation

WIP: store multiple samples for postgres repo

WIP: poetry lock, linting

WIP: actually running poetry lock

WIP: seperate functions for single and batch storing

WIP: test sample validations

WIP: `InstructionFinetuningDataHandler`

WIP: Support filtering

WIP: linting

feat: `FileInstructionFinetuningDataRepository`

WIP: user-facing functions

poetry install
    @NickyHavoc
    NickyHavoc committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    9463aff View commit details
    Browse the repository at this point in the history

  2. instruction_finetuning_handler_builder for easier handler construction 

    temp commit

bugfix in samples_with_filter

poetry update
    @NickyHavoc
    NickyHavoc committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    c0f2abd View commit details
    Browse the repository at this point in the history

  3. feat: use session pooling & pagination in `PostgresInstructionFinetun… 

    …ingDataRepository`

poetry lock
    @NickyHavoc
    NickyHavoc committed Oct 16, 2024
    Configuration menu
    Copy the full SHA
    61a2457 View commit details
    Browse the repository at this point in the history