Hiring developers in the age of LLMs.

Anyone have any good experiences with hiring software developers in recent times? Previously I had a somewhat difficult, but work realistic challenge I'd give candidates and then go through their submission on a call. However, in recent times it's become impractical to do this, since people can just feed the challenge to an LLM and get a mostly workable solution. The issue isn't that they used AI for the challenge, but that whereas before I'd get only a handful of candidates who would complete the challenge, now I get 100s and I can't go through them all.

A couple of months ago I tried mixing things up by interviewing whoever I felt was worth interviewing, then hiring them for a month trial period, where they'd work on a single "big" feature I wanted in production by the end of the month and / or a number of smaller ones if they finished it quickly. This was generally a decent approach, but it was too much work for me taking on 6 devs at the same time.

I'm curious to hear about how others have been approaching this hiring devs and if you have any tips or advice that worked well for you?

11 comments