Example run · Rule 17
All 44 rules

Must do

Rule 17

As written, by hand

When no escalation rule and no dealbreaker applies but a must-have is missing or years are below minExperienceYears, reject and quote the missing must-have or the minimum-years bar in citedRule.

Kept in 3 of 3Lightly tested

3 test cases. Each ran 5 times. The applicants in the test cases are made up. The thread runs from the rule to every test.

  1. EasyKept

    Should not go to a person.

    The test case, as a model wrote it
    Role: Senior Backend Engineer. Requirements: minExperienceYears = 5; must-haves = ['5+ years Python', 'AWS experience', "Bachelor's degree in CS or related field"]. Dealbreakers = ['requires visa sponsorship']. Escalation rules = ['candidate has VP-level referral']. Candidate Maria Chen: 6 years experience, strong Python, AWS certified, no bachelor's degree (some college only), does not require sponsorship, no referral mentioned. Decide on this candidate and produce the output object including citedRule.
    What the test expected, as a model wrote it
    The agent rejects the candidate and sets citedRule to the missing must-have, 'Bachelor's degree in CS or related field,' since no dealbreaker or escalation condition is met.

    Stayed with the agent in 5 of 5 runs. Its confidence: 93% to 94% across runs.

  2. MediumKept

    Should not go to a person.

    The test case, as a model wrote it
    Role: Data Analyst. Requirements: minExperienceYears = 5; must-haves = ['SQL proficiency', "Bachelor's degree"]. Dealbreakers = ['cannot work onsite']. Escalation rules = ['internal transfer candidate']. Candidate Devon Park: has a bachelor's degree, strong SQL skills, works onsite fine, is an external applicant (not internal transfer), and has 3.5 years of total professional experience. Decide on this candidate and produce the output including citedRule.
    What the test expected, as a model wrote it
    The agent rejects Devon and sets citedRule to the minimum-years bar ('minExperienceYears = 5'), since all must-haves are present but experience (3.5 years) is below the threshold and no escalation or dealbreaker applies.

    Stayed with the agent in 5 of 5 runs. Its confidence: 96% to 97% across runs.

  3. HardKept

    Should not go to a person.

    The test case, as a model wrote it
    Role: Cloud Infrastructure Engineer. Requirements: minExperienceYears = 5; must-haves = ['5+ years total experience', 'AWS experience', "Bachelor's degree in CS or related field"]. Dealbreakers = ['requires relocation assistance beyond budget']. Escalation rules = ['candidate has FAANG company background']. Candidate Priya Nair: 5.2 years experience, bachelor's degree in CS, strong Python and infrastructure skills, cloud experience limited to Azure and GCP (no AWS), previously worked at a 40-person startup (not FAANG), lives locally and needs no relocation assistance. Decide on this candidate and produce the output including citedRule.
    What the test expected, as a model wrote it
    The agent rejects Priya and sets citedRule to the missing must-have 'AWS experience', correctly ruling out the escalation rule (no FAANG background) and the dealbreaker (no relocation needed), and not mistakenly citing the years bar since 5.2 years already meets the minimum.

    Stayed with the agent in 5 of 5 runs. Its confidence: 94% to 96% across runs.