AI agents write Ruby but can't navigate it: a 5-model, 13-codebase benchmark

AI agents write Ruby but can't navigate it: a 5-model, 13-codebase benchmark(github.com)

5 points by luuuc 5 hours ago | 2 comments

jdkoeck 1 hour ago |

This is so obviously written by AI that it’s turning me off the whole thing.

khaledh 1 hour ago |

Mirrors my own experience, especially with Rails codebases: it's hard to navigate and find where something is declared due to the "convention over configuration" model.

jdkoeck 1 hour ago |

This is so obviously written by AI that it’s turning me off the whole thing.

khaledh 1 hour ago |

Mirrors my own experience, especially with Rails codebases: it's hard to navigate and find where something is declared due to the "convention over configuration" model.