Skip to content

Conversation

Sergei-Lebedev
Copy link
Contributor

What

Use nonblocking memory copy for non-inplace allgather

Why ?

Improves performance of allgather ring by running self memory copy operations concurrently with communication

@Sergei-Lebedev Sergei-Lebedev force-pushed the topic/allgather_local_copy_nb branch 4 times, most recently from 2550fd3 to 6d057f7 Compare November 9, 2023 09:36
@Sergei-Lebedev Sergei-Lebedev force-pushed the topic/allgather_local_copy_nb branch from 6d057f7 to 02147dd Compare January 24, 2024 09:53
@swx-jenkins3
Copy link

Can one of the admins verify this patch?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants