Hire for judgment, not AI skills, or you will clean up the mess
I see many founders rush to hire AI experts and prompt engineers. A resume lists ChatGPT proficiency, agentic workflow architecture or RAG (retrieval-augmented generation) experience. The founder assumes this person is the key to automating the business.
Hiring a junior employee with powerful AI tools often creates more work for the founder, not less. AI lets inexperienced people generate mediocre work at infinite speed. A hire without judgment floods your inbox with hallucinations, bad code and generic copy. They do not only make mistakes: they scale them. And you spend your weekends cleaning up the mess.
Stop hiring for ChatGPT experience. In the AI era, the skill that matters most is operational judgment: the ability to check, correct and connect what a machine produces, and to see what breaks before it breaks. AI cannot fake this skill. Test for it with real work, not with résumé keywords, and write the human's responsibility into the offer letter.
Why AI skills are the wrong hiring signal
AI skills are the wrong signal because the machine now does the creating. The human's value moved to selection: deciding what is true, what fits and what is safe. I call this the shift from an economy of creation to an economy of selection.
Gartner predicts that half of all organizations will introduce AI-free assessments to test independent thinking. I think they are right to do so.
We used to hire a writer for how well they could draft a blog post from scratch. We used to hire a junior developer for their ability to write syntax. Today, the LLM (large language model) drafts the post or writes the function in four seconds. The human's job is now to verify, edit and connect. The operator asks three questions:
- Is this true?
- Does this match our brand voice?
- What happens to our data privacy if we paste this customer log into this window?
The pay data supports this shift. According to PwC's 2025 Global AI Jobs Barometer, jobs that need AI skills paid a 56% wage premium in 2024, up from 25% the year before. The market pays for people who can guide and fix the machine.
Your goal is to hire operators, not task doers. A task doer takes a prompt and gives you the result. An operator asks, "Why are we running this prompt?" and "What breaks if the API fails?" If you want to know why the loudest AI experts are often the wrong people to trust, read why you can't trust AI experts anymore.
Three traits of a high-value operator
If AI experience is a vanity metric, what signals a high-value operator in 2026? From my experience, you must interview for three traits.
| Trait | What it looks like | Why it matters |
|---|---|---|
| Radical skepticism | Treats AI output as guilty until proven innocent | AI has a persistent accuracy problem |
| Cognitive diversity | Thinks differently from the team and from the machine | AI produces the average of the internet |
| Systems thinking | Asks what happens in six months, and when the API fails | Models update and agent behavior drifts |
Radical skepticism. AI has a persistent problem with accuracy. A forensic audit of 50 AI survey papers found a 17% phantom citation rate. A phantom citation is a reference that nobody can trace back to a real source. The most valuable employee treats AI output as guilty until proven innocent. Look for the person who checks the source and verifies the math. That person is the firewall between AI hallucinations and your company's reputation.
Cognitive diversity. Cognitive diversity is the most overlooked competitive advantage in the AI era. In my experience, a team of different thinkers produces more new ideas than a bigger AI budget. The reason: AI is the ultimate normalizer, because it produces the average of the internet. To break out of that average, you need brains that work differently. People with ADHD, for example, often excel at the hyper-focus and pattern recognition you need to debug complex agent workflows.
Systems thinking. Do not hire someone who can only run a prompt. Hire someone who understands the consequences. AI models update constantly, and agent behavior drifts. A good hire expects this. They do not stop at building the automation. They ask, "What happens to this data in six months? What if the API stops working for a day?"
My interview playbook: three tests for operators
I stopped using standard interview questions to find these operators. "Tell me about a time you overcame a challenge" invites a rehearsed script. Instead, I run three tests, in this order.
-
The Hallucination Trap. I give the candidate a short report that I know AI generated. It contains a subtle factual error, such as a hallucinated statistic or a competitor that does not exist. I say, "Here is a research brief from our internal AI. Review it and prepare it for the client. You have 15 minutes." If the candidate fixes the formatting, smooths the grammar and says "It looks good," they fail: they trust the machine too much. I want the candidate who stops and says, "I checked this source and I can't find it. The AI made this up."
-
The Black Box test. Most candidates answer clear questions well. AI answers clear questions well too. To find an operator, give an unclear situation. My task looks like this: "We have a client who wants to automate their lead flow. They use a CRM I won't name, and they get leads via email. Propose a solution." I leave out critical information on purpose: the lead volume, the specific CRM, the budget and the data privacy constraints. The AI expert uses ChatGPT to write a generic proposal. The operator replies with questions: "Is it 10 leads or 10,000? Is the data GDPR sensitive? What is the budget?" AI guesses. Operators verify.
-
The paid shadow day. Anyone can sound smart on a Zoom call, so I test real skills with a paid shadow day. I need to see how the candidate handles friction. I give them a messy, real problem, such as a folder of disorganized invoices, and I watch the workflow. There are three possible outcomes:
- They spend four hours on a complex Python script with ChatGPT that never runs. That is the complexity trap.
- They type everything by hand. That is the inefficiency trap.
- They build a simple, boring automation and check the outliers by hand. That is the operator approach.
The pilot and the plane: put AI responsibility in the offer letter
After you hire an operator, write the rules for working with AI into the contract. I now include an augmentation agreement in my offer letters. An augmentation agreement is a clause that defines how the employee works with AI. It does two things:
- It makes the human 100% responsible for the output. "The AI made a mistake" is not a valid excuse.
- It sets strict data privacy boundaries. No proprietary data goes into public models.
The agreement frames the relationship correctly. You are the pilot, and the AI is the autopilot. If the plane crashes, the pilot is at fault, not the software. Once operators are on the team, they will use AI in ways you do not see yet; your employees are already running your AI R&D explains how to bring that work into the open.
The bottom line
The most valuable skill in 2026 is not coding. It is the ability to look at a perfect-looking AI output and say, "Wait, that doesn't make sense." Hire the skeptics. They will save you a fortune.
Build a calmer business,Yuri
Frequently asked questions
Should I hire people for their ChatGPT or prompt engineering experience?
No. ChatGPT experience is a vanity metric. AI lets an inexperienced employee generate mediocre work at infinite speed, so a junior hire without judgment scales mistakes instead of output. Hire for operational judgment instead: the ability to verify, edit and connect AI output, and to ask what breaks when a system fails.
What traits should I look for when hiring in the AI era?
Look for three traits. Radical skepticism: the person treats AI output as guilty until proven innocent and checks sources. Cognitive diversity: people who think differently break out of the average that AI produces. Systems thinking: the person anticipates model updates, agent drift and API failures before they build an automation.
How can I test a job candidate for AI judgment in an interview?
Use three tests. The Hallucination Trap: give the candidate an AI-written report with a subtle factual error and see if they find it. The Black Box test: give an unclear task and see if they ask questions instead of guessing. The paid shadow day: give a messy real problem, such as a folder of disorganized invoices, and watch the workflow.
What is an augmentation agreement for employees who use AI?
An augmentation agreement is a clause in an offer letter that defines how an employee works with AI. It makes the human 100% responsible for the output, so "the AI made a mistake" is not a valid excuse. It also sets strict data privacy boundaries: no proprietary data goes into public AI models.