LeJEPA: Provable and Scalable Self-Supervised Learning Without the Heuristics

5 points by XTXinverseXTY 299 days ago | 2 comments

rvz 299 days ago |

A breath of fresh air from the over-concentration on LLM research. Something different for once.

XTXinverseXTY 299 days ago |

Seems like this signals Yann Lecun's direction now that he's leaving Meta

The EMA teacher model still seems like black magic to me (present in DINO and JEPA series but gone now)

rvz 299 days ago |

A breath of fresh air from the over-concentration on LLM research. Something different for once.

XTXinverseXTY 299 days ago |

Seems like this signals Yann Lecun's direction now that he's leaving Meta

The EMA teacher model still seems like black magic to me (present in DINO and JEPA series but gone now)