Bump accelerate from 1.7.0 to 1.9.0 in /backend

[dependabot]

Bumps accelerate from 1.7.0 to 1.9.0.

Release notes

Sourced from accelerate's releases.

v1.9.0: Trackio support, Model loading speedup, Minor distributed improvements

Trackio tracker support

We've added support for a trackio, lightweight, 💯 free experiment tracking Python library built on top of 🤗 Datasets and Spaces.

Main features are:

• Local-first design: dashboard runs locally by default. You can also host it on Spaces by specifying a space_id.
• Persists logs locally (or in a private Hugging Face Dataset)
• Visualize experiments with a Gradio dashboard locally (or on Hugging Face Spaces)
• Everything here, including hosting on Hugging Faces, is free!

To use it with accelerate, you need to set log_with and initialize the trackers

accelerator = Accelerator(log_with="trackio")
config={"learning_rate": 0.001, "batch_size": 32}
# init_kwargs in order to host the dashboard on spaces
init_kwargs = {"trackio": {"space_id": "hf_username/space_name"}
accelerator.init_trackers("example_project", config=config, init_kwargs=init_kwargs})

Thanks @​pcuenca for the integration !

• trackio by @​pcuenca in huggingface/accelerate#3669

Model loading speedup when relying set_module_tensor_to_device

Setting tensor while clearing cache is very slow, so we added clear_device option to disable it. Another small optimization is using non_blocking everywhere and syncing just before returning control to the user. This makes the loading slightly faster.

• Speedup model loading by 4-5x in Diffusers ⚡ by @​a-r-r-o-w in huggingface/accelerate#3674

FDSP, Deepspeed, FP8 minor improvements

• Add support for e5e2 and default to hybrid when launcher is used by @​IlyasMoutawwakil in huggingface/accelerate#3640
• Fix FP8 tests, enable FP8 to be used without direct Accelerator() configuring by @​pstjohn in huggingface/accelerate#3677
• Bunch of FSDP improvements by @​S1ro1 in huggingface/accelerate#3671
• Fix: properly error when DDP + Dtensor model by @​S1ro1 in huggingface/accelerate#3629
• Fix fsdp2 example typo by @​shimizust in huggingface/accelerate#3657
• Added a check in no_sync() to avoid errors when using deepspeed zero2/3 by @​xliu0105 in huggingface/accelerate#3656

🚨🚨🚨 Breaking changes 🚨🚨🚨

find_executable_batch_size() will no longer halves the batch after every OOM. Instead, we will multiply the batch size by 0.9. This should help user not waste gpu capacity.

• “Stop Halving My Batch!” · Default back-off 0.5 → 0.9 by @​SunMarc in huggingface/accelerate#3684

What's Changed

• [typo] shards instead of shard by @​SunMarc in huggingface/accelerate#3645
• Docs: Fix typos in gradient accumulation guide by @​kilavvy in huggingface/accelerate#3649
• xpu enablement on left cases by @​yao-matrix in huggingface/accelerate#3654
• unpin datasets in examples requirements by @​SunMarc in huggingface/accelerate#3681
• fix: wandb config not saved in offline mode by @​ved1beta in huggingface/accelerate#3648
• accelerate/data_loader.py: do not yield if the base_dataloader is empty by @​0xnightwind in huggingface/accelerate#3659

... (truncated)

Commits

• 5565412 Release: v1.9.0
• 12f89bb do not call partial state if not initialized
• 348aaba Update Gaudi runner image to latest SynapseAI and enable previously disabled ...
• 3b13453 “Stop Halving My Batch!” · Default back-off 0.5 → 0.9 (#3684)
• 0408ab1 warn for invalid keys (#3613)
• 55e518a accelerate/data_loader.py: do not yield if the base_dataloader is empty (#3659)
• 7e11ac4 fix: wandb config not saved in offline mode (#3648)
• e2cc537 trackio (#3669)
• 847ae58 Fix FP8 tests, enable FP8 to be used without direct Accelerator() configuri...
• 6e104f3 unpin datasets (#3681)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR:

• @dependabot rebase will rebase this PR
• @dependabot recreate will recreate this PR, overwriting any edits that have been made to it
• @dependabot merge will merge this PR after your CI passes on it
• @dependabot squash and merge will squash and merge this PR after your CI passes on it
• @dependabot cancel merge will cancel a previously requested merge and block automerging
• @dependabot reopen will reopen this PR if it is closed
• @dependabot close will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually
• @dependabot show <dependency name> ignore conditions will show all of the ignore conditions of the specified dependency
• @dependabot ignore this major version will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this minor version will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself)
• @dependabot ignore this dependency will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)