Unsloth creators fix universal error with gradient accumulation

4 points by ZQ-Dev8 1 year ago | 2 comments

gnabgib 1 year ago |

Article title: Bugs in LLM Training - Gradient Accumulation Fix

ZQ-Dev8 1 year ago |

seems like something pytorch maintainers would want to know about and fix asap...

gnabgib 1 year ago |

Article title: Bugs in LLM Training - Gradient Accumulation Fix

ZQ-Dev8 1 year ago |

seems like something pytorch maintainers would want to know about and fix asap...