Skip to content

feat: add run_finetune core agent action example #49

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 10 commits into
base: master
Choose a base branch
from

Conversation

ZILECAO
Copy link

@ZILECAO ZILECAO commented Feb 24, 2025

This PR adds the RunFinetuneAction tool call for the Hyperbolic agent. When prompted to run a fine tuning task with a specific model (eg. unsloth/mistral-7b-v0.3-bnb-4bit), the Hyperbolic agent will sync an example fine tuning folder with all required materials to a remote GPU instance rented from Hyperbolic. It will then try to run an example fine tune task. The main purpose of this integration is to quickly get a fine tuning environment set up for GPU users. It's not in a state where a user can freely fine tune solely by prompting the chat agent interface. After the initial run_finetune tool call, it is advised for a user to track their fine tune progress by SSHing into their remote GPU, and modifying with training data files and fine tuning scripts directly there, although more actions could come soon.

The example folder "finetune_example" contains:

  1. example unsloth fine tune script (finetune.py)
  2. example training data (training_data.jsonl)
  3. example inference call using the newly finetuned model (test_inference.py)
  4. strict pip dependency file (requirements.txt)

A demo video can be found here: https://www.loom.com/share/13dfa667db9f496188df284cb15c392b?sid=397e07f7-fb69-472e-8f93-29abea759ce8

and more quickstart info can be found in the README.md inside the finetune_example folder

@ZILECAO ZILECAO changed the title feat: add run_finetune core agent action. feat: add run_finetune core agent action Feb 24, 2025
@ZILECAO ZILECAO changed the title feat: add run_finetune core agent action feat: add run_finetune core agent action example Feb 24, 2025
@aabdel0181
Copy link
Contributor

tested this out earlier -- works great locally on WSL 2.

@connorch connorch force-pushed the master branch 2 times, most recently from 4781f36 to bbb41c0 Compare March 7, 2025 17:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants