FreeExam

AI agents

An AI/ML engineer interview on a live agent: the tool it called, the skill that was loaded, and why the loop stopped or did not.

These prompts are original practice. They are not questions from a named employer or a live hiring loop.

  1. 1.attach_record returned file too large for the x-ray on claim 7781. The observation was blank. The agent told the member the x-ray is on the claim. The claim has no attachment.

  2. 2.book_ride accepts exactly one of pickup_code or pickup_address. The agent sent both. The validator rejected the call. The trip table has no new row. The traveler was told a car is on the way.

  3. 3.The inbox agent wrote Refund $18? and called issue_refund in that same turn. The customer had not replied. Permission is allow, and the question is not a gate. The $18 posted before any answer arrived.

  4. 4.The model called pharmacy.lookup for prescription 88. The dispatch log shows the normalized name lookup on the supply skill, which had been loaded after pharmacy. The value returned is a glove bin. The prescription was not read.

  5. 5.Memory says this traveler always wants a window. The message in the window says aisle on this trip, the window note is old. The fare agent held 14A, a window seat, and cited the memory.

  6. 6.The homework agent loaded the practice skill and the exam skill. Both name their tool submit. The student was working a practice set. The call recorded an exam attempt and left the practice item unfinished.

  7. 7.purchase_fare returned card declined. The observation text was purchase complete. The traveler received confirmation code Q18. The gateway log shows a decline and does not contain Q18.

  8. 8.The inbox agent wrote Your $40 refund is on its way and called issue_refund in the same turn. The customer received the sentence. issue_refund then failed validation because the amount was the words 40 dollars, not an integer number of cents. No refund posted.

  9. 9.Memory says pallet 17 is in bin A. The scan result in the current window places pallet 17 in bin D as of this morning. The move agent directed the forklift to bin A.

  10. 10.The traveler wrote stop, do not book, while purchase_fare for ticket T-614 was queued. Cancel is not connected to the stop flag. purchase_fare then ran, and the issued ticket is T-614.

  11. 11.refund_card for $22 timed out and was retried with the same idempotency key. The gateway returned the original credit and did not create another. The agent then wrote a second $22 credit in the shop ledger because that success looked new. The gateway has one credit. The shop ledger has two.

  12. 12.The fare difference is $12.50. charge_card requires amount as an integer number of cents. The agent sent 12.50. The validator rejected the call. The card shows no new charge.

  13. 13.The traveler wrote stop, do not book, while purchase_fare was queued. Cancel set the stop flag. The trace shows the queued call was dropped. No ticket was issued.

  14. 14.Each print_label call prints one bottle label and returns printed. The pharmacy agent called print_label again after every printed result for the same refill. No step limit is set. Thirty labels are on the bench, and the calls are still going.

  15. 15.submit_refill returned accepted, ready Tuesday. After that observation, the agent told the patient the refill would be ready Tuesday and called no further tool. The pharmacy queue shows the refill. The loop ended on that answer.

  16. 16.The observation on the inbox turn said issue_refund failed because the amount exceeds the cap. The agent replied I refunded $80. The ledger has no $80 refund.

  17. 17.submit_refill is gated on a pharmacist confirm. The agent asked the pharmacist and did not call the tool again. The pharmacist has not answered. The pharmacy queue has no new refill, and the patient was not told one was sent.

  18. 18.The storm-policy skill loaded as instructions and registered no tool. The model called a tool named storm-policy. The harness answered unknown tool. apply_waiver was not called. The change fee is still on the ticket.

  19. 19.Pallet 17 is marked hazmat. The move procedure says to load the hazmat skill before move_pallet. This run's tool list has move_pallet and no hazmat tool. The pallet now sits in ordinary bin D.

  20. 20.Memory has the member at 12 Oak Street. The claim open in the window shows a new mailing address, 9 Pine Street, entered today. The decision letter was mailed to 12 Oak Street.

  21. 21.The examiner skill and the billing skill were both loaded. Both expose add_note. The agent meant a coverage note on claim 331. The new note is on invoice 331. Claim 331 has no new note.

  22. 22.The parent used the claims skill's lookup to read claim 44. On the child, the pharmacy skill loaded afterward and also registered lookup. The child's lookup returned a prescription for member 44. Claim 44 was not read.

  23. 23.submit_refill requires npi to be ten digits. The agent sent Harbor Clinic, received a schema error, and sent Harbor Clinic again. Both tool rows are schema errors. No refill exists.

  24. 24.On-hand count falls when lamps are reserved. Bin C held 6. count_bin and reserve_units started together. reserve_units took 2, and on-hand then read 4. The count, taken as 6 at the start, was written into on-hand after that. On-hand now reads 6. The pick still lists those 2 lamps.

  25. 25.list_lines on claim 7781 was called with offset 0 and returned lines 1 through 10 plus next_offset 10. Every later call uses offset 0 again. No step limit is set. Lines 11 through 40 have not been read, and the calls continue.

  26. 26.The tutor calls hint for problem 4. The student says still stuck, and the tutor calls hint again with the same problem id. The trace has 90 calls. No step limit is set. No handoff to a teacher appears.

  27. 27.The trip agent loaded the air skill and the hotel skill. Both expose hold. The traveler asked to hold flight 18. The call reserved hotel room 18. Flight 18 has no hold.

  28. 28.The agent called close once to finish ticket 552. The run log has two execution rows for that single model call: the ticket skill's close and the billing skill's close. Ticket 552 is closed. Invoice 552 is voided.

  29. 29.The clinician said to refill 5 mg and not to use the old 10 mg. The handoff to the refill agent said refill the amoxicillin. The printed label reads 10 mg.

  30. 30.The handoff was supposed to say the student is 8 and to use the grade-3 skill only. The child received finish the worksheet. It loaded the grade-8 skill and assigned grade-8 problems.

  31. 31.search_fare returns the same three fares for the same cities and date, and the agent calls search_fare again with those arguments. The trace has 120 calls. No step budget is set. The traveler has not been offered a fare.

  32. 32.charge_card and reserve_van were both in the turn that asked for the 4 p.m. slot. reserve_van took that slot. charge_card declined. The slot is still on the board as held. The customer was told the booking was canceled.

  33. 33.submit_refill includes user_confirmed. The patient never confirmed. The agent sent user_confirmed true, and the schema accepted the boolean. The permission check treated that field as the patient's approval. The refill was submitted.

  34. 34.reserve_units on bin C timed out after the on-hand count had already moved from 6 lamps to 4. The agent did not read the bin. It called reserve_units again with a new key for 2 lamps. The bin now shows 2.

  35. 35.Approving claim 331 required the fracture-policy skill. The trace lists only the intake skill. The approval note quotes policy allows six visits, a sentence that is in the skill file on disk and not in the prompt. The claim is approved.

  36. 36.Stored memory from the previous chat says the refund cap is $15. This window is a different customer. The account result in the window shows a $50 cap. The agent refused a $30 refund and quoted the $15 memory.

  37. 37.The fare agent placed two charge_card calls in one turn, both for the same $46 difference. Neither call carried an idempotency key. The harness ran the two calls together. The statement shows two $46 captures.

  38. 38.The lead told the counter to cycle-count bin C, not to adjust the quantity, and to use the scanner only. The handoff was cycle-count bin C. The counting agent called adjust_qty. The bin went from 6 to 0.

  39. 39.charge_card for the $46 fare difference timed out on the client. The server log shows that attempt captured. The agent called charge_card again with a new idempotency key and did not look up the first attempt. The statement has two $46 captures.

  40. 40.Stored memory says the patient is allergic to amoxicillin. The chart in the current window says that allergy was entered in error and cleared this morning. The refill agent refused the amoxicillin refill and cited the memory.

  41. 41.The parent had the waiver-policy skill loaded. The child received the handoff waive the storm fee and rebook, and did not receive the skill. The child called purchase_fare. The new ticket still includes the change fee.

  42. 42.The waiver-policy skill was not loaded. The fare agent called search_notes, read a forum post about free changes, and called apply_waiver. The storm-policy text never entered the prompt. The fee is 0.

  43. 43.The model set idempotency key R1 on the first charge_card and on the retry. The harness dropped R1 from both requests before they reached the gateway, because it forwards only the gateway's amount and card fields. The statement shows two $46 captures.

  44. 44.issue_refund for $40 ran, and the ledger posted it. After that post, the permission check recorded denied, no confirm. The customer had asked only for the refund rules. The $40 is still posted.

  45. 45.file_claim accepts status draft or submitted. The first call sent ready, and the observation was a schema error. The next call sent submitted. Claim 1904 appeared in the desk queue only after that second call.

  46. 46.The customer said that any refund must be capped at $10. The agent called issue_refund for $18. Permission is allow, and the check does not read the cap sentence. The ledger posted $18.

  47. 47.The inbox run loaded the ticket skill and the billing skill. Both register a tool named close. The agent called close to finish ticket 552. Invoice 552 is closed. Ticket 552 is still open.

  48. 48.draft_reply and send_reply started together on ticket 552. send_reply transmitted the draft already on the ticket, an offer of a $40 refund. draft_reply finished later with a new draft that offered a replacement kettle. The customer received the $40 offer.

  49. 49.Refunds over $25 are supposed to load the goodwill-policy skill first. This run did not load it, and that policy text is absent from the prompt. The agent called issue_refund for $40 and typed goodwill policy in the ticket. The $40 posted.

  50. 50.scan_bin returned camera offline. The observation given to the model was an empty item list. The agent set bin C's quantity to 0 and released the pick wave. The camera was still offline.

  51. 51.The customer said to refund order 18. The agent called issue_refund with order_id 19. The schema requires a string id, and 19 matched that type. Order 18 is unchanged. Order 19 is refunded.

  52. 52.The model proposed charge_card once for $46 and supplied no idempotency key. After connection resets, the harness itself sent that charge three times. The model trace contains one proposal. The statement shows three $46 captures.

  53. 53.The scan agent's step limit is 5. scan_bin ran five times on bin C, and each observation was blurry. The trace has no sixth call. The picker was told the bin was not counted. No count row was written.

  54. 54.Memory says never call, email only. The message in the window says call me today at 4, and ignore the email preference. The agent sent an email and scheduled no call.

  55. 55.Key R1 was already stored for an $18 sock refund. The inbox agent sent R1 again with a $40 shirt refund. This gateway returns the stored response when the key matches and does not compare the new body. The log has one refund, the socks. The customer was told the shirt was refunded.

  56. 56.The scan agent told the picker bin C is empty, skip it, while count_bin was still running. The picker skipped C. count_bin then returned 6 lamps.

  57. 57.price_lines on claim 7781 returned line 1 ok and line 2 code not covered. The observation contained only line 1. The member letter says both lines were priced and covered.

  58. 58.The customer confirmed an $18 refund on the sock order. The agent then called issue_refund for a $64 jacket and attached that same confirm token. The check found a token and posted the $64. The sock order was not the item refunded.

  59. 59.claim_status keeps returning pending review for claim 7781. The trace has 250 of those calls and no step cap. The run has no rule that treats pending review as a stop. The member has received no decision.

  60. 60.The warehouse agent called scan_bin on aisle 14, bin C. Every observation was image blurry, retry. The trace has 400 calls with those arguments. No step limit is configured. The picker is still waiting, and the bin has no count.

  61. 61.classify_ticket returns needs human for ticket 441, and the agent calls classify_ticket on 441 again. The log has 500 calls and no max-steps setting. Ticket 441 is still in the bot queue.

  62. 62.The clinic run loaded the pharmacy skill and the supply skill. Both register lookup. The agent called lookup for prescription 88. The result was the glove-bin location. The prescription record was not read.

  63. 63.The current interaction-check skill is v3 and lists the new antibiotic. This run loaded v1, whose list omits that drug. The agent checked the two drugs v1 knows and then submitted the antibiotic.

  64. 64.Scoring this session required the fraction-grader skill. The run loaded only the chat skill. The tutor treated 3/4 equal to 6/8 as correct and called gradebook.write with score 1. That 1 is stored.

  65. 65.price_line and send_payout were both in the same turn. send_payout sent $200 with claim_id 0000, an id that was not in the conversation. price_line afterward created claim 1904. The $200 is on ledger row 0000. Claim 1904 has no payment.

  66. 66.The member asked whether claim 7781 was paid. claim_status is a read. The permission layer treated every tool as a payout and waited for a confirm the member was not there to give. claim_status did not run. The agent said the claim was paid.

  67. 67.get_deductible ran twice in one turn: call C1 for claim 7781 and call C2 for claim 1904. C2 finished first and returned $50. C1 finished second and returned $200. The harness wrote the results onto the calls in arrival order: the first result onto C1 and the second onto C2. The 7781 letter says the deductible is $50. The 1904 letter says $200.

  68. 68.lookup for prescription 88 returned an empty list, and the observation was 0 rows. The pharmacy service was up. The agent told the patient the pharmacy computer is down.

  69. 69.hold_copy and email_patron were both in the turn for the novel the patron asked to reserve. hold_copy returned not held, because the only copy is at the other branch. email_patron had already sent the sentence your hold is ready. The patron came to the desk. The account has no hold.

  70. 70.The parent was told to text the driver, not to call, because it was 9 p.m. The handoff said tell the driver the gate code. The child called place_call. The driver got a phone call.

  71. 71.The claims desk called price_line on claim 7781. The tool returned 409 duplicate line. The observation appended for the model was an empty object. The member letter says the line was priced.

  72. 72.charge_card returned processing for the $46 fare difference. It was not a timeout and not a decline. The agent sent another charge_card with a new idempotency key. Both attempts captured. The statement shows two $46 charges.

  73. 73.move_pallet accepts pallet_id and to_bin. The agent also sent priority rush, and the validator rejected the call. Pallet 17 is still in bin A. A separate notify_floor message says the pallet is in bin D.

  74. 74.Harbor Pharmacy's refill agent called submit_refill with rx set to the number 44021. The schema requires rx to be a string. The tool log has a schema error and no submit row. The patient was told the refill was sent.

  75. 75.The tutor wrote saved, 10 out of 10, and called gradebook.write in the same turn. The student saw that score before the tool returned. The write later succeeded. The gradebook now shows 10 out of 10.

  76. 76.The parent tutor was told to give hints only, not to reveal the answer, and to leave the grade unposted. The handoff said help with problem 4. The student received the worked solution, and a grade was posted.

  77. 77.The warehouse agent emitted a count_bin call whose argument text ended with a trailing comma. The harness logged an argument parse error. The schema checker has no row for this call. Bin C is unchanged.

  78. 78.The passenger asked for the storm-policy fee waiver. The only loaded skill is shop-fare. The waiver-policy text is absent from the prompt. The agent called apply_waiver, and the ticket fee is now 0.

  79. 79.scan_bin was called with a bin code that matches the schema. The tool server answered connection refused. The validator recorded no schema error. Bin C has no new count. The picker was told the arguments were invalid.

  80. 80.file_claim requires lines to be an array. The agent sent one line object. Validation failed, and the claim table has no new row. The member email quotes claim number 1904.

  81. 81.The observation from charge_card was declined, do not retry. The fare agent called charge_card again with a new key and told the traveler the fare was paid. The issuer shows two declines and no capture.

  82. 82.The lead wrote pay $200, and do not pay the $90 experimental line. The handoff said pay the claim. The payout agent sent $290.

  83. 83.Memory says the student reads at level K. The placement result in today's window is level M. The tutor loaded a level-K passage and said the memory was more recent than the placement.

  84. 84.The scan loop hit its step limit of 8. Every scan_bin result was blurry, and no count row was written. The message sent to the picker says count complete.

  85. 85.The parent could call purchase_fare. The handoff gave the child shop_fare and no other tool. The child called purchase_fare and received unknown tool. No ticket was issued.

  86. 86.submit_refill returned refill too soon, and that sentence was the whole observation. The agent told the patient the refill was not sent because it is too soon. The pharmacy queue has no refill. The loop ended.

  87. 87.The waiver has to clear the change fee before purchase_fare captures it. Both tools were in one turn. purchase_fare captured $75 and finished first. apply_waiver finished second, saw the fee already captured, and left the charge in place. The card shows the $75.

  88. 88.The scan result was ok false and error bin not found. The observation template prints a message only when ok is true, and it printed nothing. The agent told the picker the scan succeeded.

  89. 89.The handoff body said: do not charge a change fee. The booking agent's summary, passed into purchase_fare, omitted that sentence. The purchased fare includes a $75 change fee.

  90. 90.The student asked for a graded score. The fraction-grader skill was not loaded, and gradebook.write was not on the tool list. The tutor said it could not grade this yet. The gradebook has no new score.

  91. 91.In one turn the refill agent told the patient Harbor has your refill and called submit_refill. The harness delivered that sentence before the tool returned. submit_refill then came back with a validation error and did not submit.

  92. 92.The customer wrote, what would a refund of the $18 sock order look like? The support agent called issue_refund for $18. That tool's permission is allow, and no confirm step ran. The ledger shows the $18 posted.

  93. 93.charge_card for $46 timed out. The agent called find_charge with the original idempotency key, found one captured payment, and did not call charge_card again. The statement shows one $46 post.

  94. 94.The tutor told the student I saved a 9 out of 10 in the same turn as gradebook.write. The chat showed that score at once. The write was still in flight and later returned roster locked. No grade row was stored.

  95. 95.The parent agent was told to rebook the 6:40, keep the same cabin, and charge no change fee. The handoff body was only rebook the 6:40. The new ticket is a flexible fare with a $75 change fee.

  96. 96.charge_card returned card declined, do not retry. The observation given to the model was the single word card. The fare agent called charge_card again. The issuer log shows two declines.

  97. 97.The traveler said to show the $90 fare and not to buy it. The fare agent called purchase_fare. Permission on purchase_fare is allow. The ticket is issued.

  98. 98.The desk told the member the deductible is $50 and the payout was sent, while get_deductible and send_payout were both still pending. The member already had that sentence. get_deductible later returned $200. send_payout then failed validation.

  99. 99.submit_refill failed validation and created no refill. The agent then called memory.write with the text refill sent to Harbor. On the next turn it refused to retry because memory said the refill was already sent. The pharmacy queue has no refill.

  100. 100.create_claim requires member.dob. The agent left it out and received a schema error that named member.dob. The agent then asked the member for a date of birth and sent no further create_claim. No claim number exists.

  101. 101.reserve_units returned only 1 left and wrote no reservation. The observation used the success sentence reserved. The agent told the picker that 2 lamps were reserved. The bin still has 1 lamp and no hold.

  102. 102.The basket contains warfarin and a new antibiotic. The loaded refill skill says to load interaction-check before submit_refill in that case. The trace shows submit_refill and no load or call of interaction-check. Both drugs were submitted.

  103. 103.On the first model call, apply_waiver was absent from the tool list. The model called it and got unknown tool. The harness then loaded the waiver skill and listed apply_waiver. The second call ran it, and the fee became 0.

  104. 104.The opening tokens of Your payout of $640 is complete were streamed to the member while send_payout was still pending. The member read the full sentence. The tool then returned held for review. No payout was released.

  105. 105.The desk emailed we paid $200 today and called send_payout in that turn. The email was already in the member's inbox. send_payout was still waiting on the bank and later returned account closed. No deposit was made.

  106. 106.gradebook.write returned student id not on roster. The observation was wrote score 8. The student sees an 8. The gradebook has no row for that student.

  107. 107.hold_seat requires confirm to be a boolean. The agent sent the string yes. The validator rejected it. Seat 14C is still open on the seat map. The traveler was told 14C is held.

  108. 108.The handoff said pay 200 dollars exactly. The payout agent's summary said about 200, cover the tax, and send_payout was called with 250. The member received $250.