Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism | Dark Hacker News

Dark Hacker News

new|best|ask|show|jobs

Built with the HackerNews API. Developed by LJT.AI

Note: The HackerNews API provides up to 500 stories per category

Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism(github.com)

4 points by yzh 2 years ago | 2 comments

Speedup Megatron-LM from 10% to 30% with Zero Bubble Pipeline Parallelism | Dark Hacker News

ufotalent 2 years ago |

An interesting playground to understand the scheduler is here https://huggingface.co/spaces/sail/zero-bubble-pipeline-para...

QPHutu 2 years ago | |

Cool!