Business Operations
Rule-based reviews, transaction processing, and coordination work over records, policies, and ledgers, where decisions must be applied consistently and documented.
Mean Score
68.31
general suite
Score ≥ 0.80
55.19%
R0.8
Full Credit
21.71%
R1
Averaged over all 71 tasks in this category, each evaluated under the 70 general model-harness configurations (7 harnesses × 10 models).
Rule-Based Review
34 tasks
T016
Audit An Expense Reimbursement Packet
T022
Policy Clause Retrieval and Case Rulings
T032
Recover an Interrupted Supplier-Bank Release Gate
T038
Repair a Public Assistance Payment-Validation Sample
T045
Prepare an evidence-based interview shortlist
T046
Triage a mixed e-commerce support queue
T049
Review a batch of platform moderation appeals
T058
Policy Version Conflict Resolution with Evidence Priority
T062
Triage a Mixed DSAR Intake Queue
T124
Recover an Interrupted Contract Closeout Review
T137
Recover calibration-certificate control after a reference-standard recall
T144
Recover an Interrupted Formulary-Substitution Review
T145
Repair Municipal Permit Routing After a Zoning Map Revision
T155
Recover a Fail-Closed Payee Screening Batch
T162
Audit Degree Requirements Across Equivalencies and Prerequisites
T167
Recover Alert State after a Screening Filter Failure
T170
Impact-Urgency Service Case Routing
T203
Recover cold-chain holds after a logger gap
T220
Gate FERPA directory disclosures against opt-out and academic fields
T221
Admit energize orders only when a LOTO tag is present
T222
Apply refill requests against days-used windows and controlled holds
T223
Record usage only inside the licensed ISRC territory window
T224
Admit SLA refunds only when the breach is structured and uncapped by chargeback
T225
Release I-9 cases only with unexpired List A or B+C evidence
T227
Admit 1099 rows only for contractors at or above the reporting threshold
T229
Admit purchase-order acknowledgments only at or below ordered quantity
T230
Record samples only with intact custody and in-range receipt temperature
T231
Apply dataset releases only after embargo, never treating preprint as published
T232
Suppress marketing cookies when GPC is set, even after a banner accept
T236
Admit demand-response curtailment only for dispatched sites that did not opt out
T237
Record RMAs only for in-warranty serials that match a single SKU
T244
Accept load-sheet items only while takeoff weight and CG stay in envelope
T247
Admit STV ballots only when rankings are unique legal candidates
T268
sla credit evidence assessment
Transaction Processing
26 tasks
T039
Cancel a privacy export and purge staged data
T052
Place a safe passport-renewal appointment hold
T105
Reconcile and stage a consent-safe NIH-style data-sharing package
T111
Recover a Late Leave Revision Across a Frozen Payroll Boundary
T113
Recover subscription entitlements from an interrupted webhook replay
T118
Recover Warehouse Reservations After a Worker Crash
T123
Recover a vendor-master renewal after a truncated registry export
T125
Recover an Interrupted Product Recall and Stop-Sale Staging Transaction
T126
Recover an interrupted LMS-to-SIS grade passback
T127
Recover an environmental-laboratory sample accession after a partial commit
T130
Recover an interrupted multi-carrier shipment-claim batch
T136
Recover an interrupted escrow-disbursement closeout
T138
Recover a Partial Prior-Authorization Portal Submission
T140
Recover an Interrupted Pharmacovigilance Case-Intake Projection
T151
Recover a Failed CRM Account Merge Without Losing Consent State
T195
Recover Interrupted OSHA and Workers-Comp Reporting State
T197
Recover a crashed continuation-coverage notice-delivery run
T202
Recover a smart-meter billing correction after an interrupted rebill
T204
Recover an interrupted purchase-order EDI match batch
T206
Recover an approved ECN across a multi-level configuration baseline
T207
Recover an Interrupted Water-Main Isolation Projection
T211
Apply a sliding-window partner quota without resurrecting expired refunds
T235
Apply section enrollments only to remaining seats, never promoting waitlist holds
T269
constrained shopping cart update
T270
idempotent family hotel booking
T271
itemized shared expense requests
Coordination
11 tasks
T011
Prioritize a Cross-Time-Zone Customer Escalation Meeting
T015
Recover a Customer Onboarding State from Fragmented Email
T020
Recover a launch control room after scoped late evidence
T037
Reconcile a vendor rollout after late approvals and owner loss
T047
Build a Recoverable Logistics Exception Handoff
T061
Three-Source Decision Record from Meeting, Email, and Documents
T065
Apply a late regional policy update to an active rollout plan
T132
Recover a reviewed itinerary after a second disruption
T205
Recover an interrupted serialized-equipment field-service batch
T246
Pack mill cut jobs onto capacity-limited machines
T274
collaboration materials reminder close