Yexiao He - SHED

SHED: Shapley-Based Automated Dataset Refinement for Instruction Fine-Tuning

A pipeline for the automatic selection of high-quality data subsets to fine-tune large language models.

paper: https://arxiv.org/abs/2405.00705

code: https://github.com/Lucidreamer9/SHED-Shapley-Based-Automated-Dataset-Refinement

Google Sites

Report abuse