custom-medical-llm

Train an LLM to accurately answer questions using data from a selected medical textbook. To be used in a VQA model.

Instructions

Data Ingestion (Optional) To save the user time, data has already been scraped and collected. Current data is gathered using attached textbook scraper from Mandell's "Core Radiology - 10th Edition." To train on a custom textbook, re-run the textbook scraper and select the relevant PDF when prompted.
LLM Creation Run the Custom LLM file. The stored LLM will be used as the VQA model's text modality. Currently using a Bigram LLM model as an proof of concept.
VQA Creation (Work in progress) Run the Custom VQA file.

Name		Name	Last commit message	Last commit date
Latest commit History 13 Commits
book-scrape		book-scrape
Custom Medical LLM Test.ipynb		Custom Medical LLM Test.ipynb
Custom Medical VQA Test.ipynb		Custom Medical VQA Test.ipynb
README.md		README.md
qa_dataset.csv		qa_dataset.csv