Skip to content

Pull requests: microsoft/DeepSpeed

New pull request New
140 Open 2,704 Closed
140 Open 2,704 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix op_builder for CUDA 12.5
#5806 opened Jul 29, 2024 by keshavkowshik Loading…
2
Fix circular import in ds_transformer.py
#5804 opened Jul 28, 2024 by eonsparks Loading…
fix: handle exception when loading cache file in test_inference.py
#5802 opened Jul 26, 2024 by HeyangQin Loading…
2
OptimizedLinear updates
#5791 opened Jul 23, 2024 by jeffra Loading…
2
Non-reentrant checkpointing hook fix
#5781 opened Jul 18, 2024 by ic-synth Loading…
2
Fix CPU Adam JIT compilation
#5780 opened Jul 18, 2024 by lekurile Loading…
4
Long sequence parallelism (Ulysses) integration with HuggingFace enhancement New feature or request
#5774 opened Jul 16, 2024 by samadejacobs Loading…
10
Use accelerator to replace cuda in setup and runner
#5769 opened Jul 15, 2024 by Andy666G Loading…
4
Add DataStates-LLM: Asynchronous Checkpointing Engine Support
#5763 opened Jul 10, 2024 by mauryaavinash95 • Draft
2
Find ROCm on Fedora
#5705 opened Jun 28, 2024 by trixirt Loading…
17
sequence parallel with communication overlap
#5691 opened Jun 21, 2024 by inkcherry Loading…
4
Switch from torch.cuda.amp.custom_fwd to torch.amp.custom_fwd(device=...)
#5684 opened Jun 18, 2024 by loadams • Draft
1
2
Switch what versions of python are supported
#5676 opened Jun 17, 2024 by loadams • Draft
Update xpu-max1100.yml with new config and add some tests
#5668 opened Jun 17, 2024 by Liangliang-Ma Loading…
15
Add and Remove ZeRO 3 Hooks
#5658 opened Jun 13, 2024 by jomayeri Loading…
7
Hybrid Offloading for ZeRO3
#5625 opened Jun 7, 2024 by tohtana • Draft
Add support for Phi-3 small to FastGen
#5614 opened Jun 4, 2024 by adk9 • Draft
Upgrade HPU image to v1.16.2.
#5610 opened Jun 4, 2024 by vshekhawat-hlab Loading…
11
state_dict_factory: llama checkpoint - support SWIGLU
#5601 opened Jun 2, 2024 by nelyahu Loading…
2
FastGen H100 MoE support: Add PyTorch multi-gemm MOE implementation
#5586 opened May 29, 2024 by HeyangQin Loading…
7
Update profiler.py
#5584 opened May 29, 2024 by gameofdimension Loading…
reduce cpu host overhead when using moe
#5578 opened May 29, 2024 by ranzhejiang Loading…
7
Reuse KV cache of prefixes
#5572 opened May 27, 2024 by tohtana • Draft
3
Fix deadlock in PipeEngine._exec_recv_grads
#5518 opened May 10, 2024 by i4never Loading…
6
inference: remove unused _validate_args function
#5505 opened May 8, 2024 by nelyahu Loading…
5
ProTip! Find all pull requests that aren't related to any open issues with -linked:issue.