Business Operations
Rule-based reviews, transaction processing, and coordination work over records, policies, and ledgers, where decisions must be applied consistently and documented.
Mean Score
68.31
general suite
Score ≥ 0.80
55.19%
R0.8
Full Credit
21.71%
R1
Averaged over all 71 tasks in this category, each evaluated under the 70 general model-harness configurations (7 harnesses × 10 models). Open a task to inspect its instruction, package files, and the trajectory of every run.
Rule-Based Review
34 tasks
T016
Audit An Expense Reimbursement Packet
→
T022
Policy Clause Retrieval and Case Rulings
→
T032
Recover an Interrupted Supplier-Bank Release Gate
→
T038
Repair a Public Assistance Payment-Validation Sample
→
T045
Prepare an evidence-based interview shortlist
→
T046
Triage a mixed e-commerce support queue
→
T049
Review a batch of platform moderation appeals
→
T058
Policy Version Conflict Resolution with Evidence Priority
→
T062
Triage a Mixed DSAR Intake Queue
→
T124
Recover an Interrupted Contract Closeout Review
→
T137
Recover calibration-certificate control after a reference-standard recall
→
T144
Recover an Interrupted Formulary-Substitution Review
→
T145
Repair Municipal Permit Routing After a Zoning Map Revision
→
T155
Recover a Fail-Closed Payee Screening Batch
→
T162
Audit Degree Requirements Across Equivalencies and Prerequisites
→
T167
Recover Alert State after a Screening Filter Failure
→
T170
Impact-Urgency Service Case Routing
→
T203
Recover cold-chain holds after a logger gap
→
T220
Gate FERPA directory disclosures against opt-out and academic fields
→
T221
Admit energize orders only when a LOTO tag is present
→
T222
Apply refill requests against days-used windows and controlled holds
→
T223
Record usage only inside the licensed ISRC territory window
→
T224
Admit SLA refunds only when the breach is structured and uncapped by chargeback
→
T225
Release I-9 cases only with unexpired List A or B+C evidence
→
T227
Admit 1099 rows only for contractors at or above the reporting threshold
→
T229
Admit purchase-order acknowledgments only at or below ordered quantity
→
T230
Record samples only with intact custody and in-range receipt temperature
→
T231
Apply dataset releases only after embargo, never treating preprint as published
→
T232
Suppress marketing cookies when GPC is set, even after a banner accept
→
T236
Admit demand-response curtailment only for dispatched sites that did not opt out
→
T237
Record RMAs only for in-warranty serials that match a single SKU
→
T244
Accept load-sheet items only while takeoff weight and CG stay in envelope
→
T247
Admit STV ballots only when rankings are unique legal candidates
→
T268
sla credit evidence assessment
→
Transaction Processing
26 tasks
T039
Cancel a privacy export and purge staged data
→
T052
Place a safe passport-renewal appointment hold
→
T105
Reconcile and stage a consent-safe NIH-style data-sharing package
→
T111
Recover a Late Leave Revision Across a Frozen Payroll Boundary
→
T113
Recover subscription entitlements from an interrupted webhook replay
→
T118
Recover Warehouse Reservations After a Worker Crash
→
T123
Recover a vendor-master renewal after a truncated registry export
→
T125
Recover an Interrupted Product Recall and Stop-Sale Staging Transaction
→
T126
Recover an interrupted LMS-to-SIS grade passback
→
T127
Recover an environmental-laboratory sample accession after a partial commit
→
T130
Recover an interrupted multi-carrier shipment-claim batch
→
T136
Recover an interrupted escrow-disbursement closeout
→
T138
Recover a Partial Prior-Authorization Portal Submission
→
T140
Recover an Interrupted Pharmacovigilance Case-Intake Projection
→
T151
Recover a Failed CRM Account Merge Without Losing Consent State
→
T195
Recover Interrupted OSHA and Workers-Comp Reporting State
→
T197
Recover a crashed continuation-coverage notice-delivery run
→
T202
Recover a smart-meter billing correction after an interrupted rebill
→
T204
Recover an interrupted purchase-order EDI match batch
→
T206
Recover an approved ECN across a multi-level configuration baseline
→
T207
Recover an Interrupted Water-Main Isolation Projection
→
T211
Apply a sliding-window partner quota without resurrecting expired refunds
→
T235
Apply section enrollments only to remaining seats, never promoting waitlist holds
→
T269
constrained shopping cart update
→
T270
idempotent family hotel booking
→
T271
itemized shared expense requests
→
Coordination
11 tasks
T011
Prioritize a Cross-Time-Zone Customer Escalation Meeting
→
T015
Recover a Customer Onboarding State from Fragmented Email
→
T020
Recover a launch control room after scoped late evidence
→
T037
Reconcile a vendor rollout after late approvals and owner loss
→
T047
Build a Recoverable Logistics Exception Handoff
→
T061
Three-Source Decision Record from Meeting, Email, and Documents
→
T065
Apply a late regional policy update to an active rollout plan
→
T132
Recover a reviewed itinerary after a second disruption
→
T205
Recover an interrupted serialized-equipment field-service batch
→
T246
Pack mill cut jobs onto capacity-limited machines
→
T274
collaboration materials reminder close
→