The Job Board Is Lying to You(nanomicon.com) |
The Job Board Is Lying to You(nanomicon.com) |
1. How well can they write a requirements spec for an AI? How well can they eliminate and disambiguate points of confusion? How well can they iterate upon the requirements by considering the AI's plan?
2. How well can they review the AI's output against the requirements? Can they identify and communicate what was missed, and translate it into updates to the requirements, fix the code via continued chat, otherwise by hand?
3. Can they avoid both under and over engineering?
The point is that if an interview is not assessing these things, it likely is wasting everyone's time.
after 1 30 minute session I'd had enough, and didn't complete the remaining sessions. the even nastier part is that for the next few weeks I would occasionally receive messages from Mercor thanking me for doing the interview, but saying that the format had been changed and it was necessary for me to go through the process again.
LLM’s love that one weird trick to get hits.