ScentTrace Pilot 3 · Data & Annotation Review

直接展示进入实验的真实 GUI state 与自动化处理结果。Operator 与 Scent 仍是 provisional measurement;BreakingWeb 的 Candidate gate 尚未通过。

OM2W47 matched tasks · 188 trajectoriesI/C/L 2682 / 162 / 58Operator + Scent + LOAO complete
OSWorld17-task matched main · 51 trajectoriesI/C/L 3610 / 75 / 58Main LOAO + validation complete
BreakingWeb455 tasks · 1820 raw trajectoriesI/C/L 9959 / 919 / 232Candidate gate 0.771 / 0.90

真实样本

OM2WINSPECT

Find support-services job listings in Bentonville, Arkansas.

fara15_9b · task 0059adc6b12a3822305deb68929b2de8

B=1.000 · V=0.500 · e=0.500 · N=0

The search field still appears unchanged, but many site search inputs do not show a visible caret in screenshots. The fastest way to verify focus is to type the intended query. I’…

Scent scored
OPENAI_BUILTIN_MULTIMODAL_BLIND_PREACTION_V10_1
OM2WINSPECT

Find support-services job listings in Bentonville, Arkansas.

fara15_9b · task 0059adc6b12a3822305deb68929b2de8

B=1.000 · V=0.500 · e=0.500 · N=1

The search modal is open and the input area is the active target. Even though the caret is subtle, typing now is the quickest way to confirm focus and initiate the location search…

Scent scored
OPENAI_BUILTIN_MULTIMODAL_BLIND_PREACTION_V10_1
OM2WCOMMIT

Find support-services job listings in Bentonville, Arkansas.

fara15_9b · task 0059adc6b12a3822305deb68929b2de8

B=2.000 · V=1.500 · e=0.500 · N=13

Page 3 appears to contain only one visible job card, but I want to confirm there aren’t additional cards below the fold. I’m scrolling slightly downward to verify whether Manager,…

Scent scored
OPENAI_BUILTIN_MULTIMODAL_BLIND_PREACTION_V10_1
OM2WCOMMIT

Identify the FlightAware community discussion with the most replies and open it.

fara15_9b · task 046138801a05ddf56ad94e8672942496

B=2.000 · V=1.500 · e=0.500 · N=10

The all-time list is now visible, and the highest reply count currently shown is 1.6k for “Tar1090 – improved webinterface for dump1090-fa and readsdb,” which is higher than the 1…

Scent scored
OPENAI_BUILTIN_MULTIMODAL_BLIND_PREACTION_V10_1
OM2WLEAVE

Find gluten-free chocolate-chip-cookie recipes that can be made without nuts.

fara15_9b · task 0632e496d37badee0350dad358f047c5

B=1.000 · V=0.500 · e=1.000 · N=22

This first recipe uses regular flour, so it is not gluten-free. Rather than spend more time on an unsuitable recipe, I’ll return to the chocolate chip cookies results and inspect …

Scent scored
OPENAI_BUILTIN_MULTIMODAL_BLIND_PREACTION_V10_1
OM2WLEAVE

Find gluten-free chocolate-chip-cookie recipes that can be made without nuts.

fara15_9b · task 0632e496d37badee0350dad358f047c5

B=1.000 · V=1.000 · e=0.500 · N=1

This second recipe also uses all-purpose flour, so it is not gluten-free. I need to continue scanning the chocolate chip cookie results for recipes that explicitly use alternative…

Scent scored
OPENAI_BUILTIN_MULTIMODAL_BLIND_PREACTION_V10_1
OSWorldINSPECT

Identify the Hong Kong source photo among picture1 through picture6 and identify the correct usable raindrop …

claude-opus-4-7 · task 003

B=0.000 · V=0.000 · e=0.000 · N=0

pyautogui.click(33, 813)

Scent scored
CHATGPT_BRANCH_LEVEL_REAUDIT_V108
OSWorldINSPECT

Identify the Hong Kong source photo among picture1 through picture6 and identify the correct usable raindrop …

claude-opus-4-7 · task 003

B=1.000 · V=0.010 · e=0.000 · N=1

pyautogui.click(450, 300)

Scent scored
CHATGPT_BRANCH_LEVEL_REAUDIT_V108
OSWorldLEAVE

Identify the Hong Kong source photo among picture1 through picture6 and identify the correct usable raindrop …

claude-opus-4-7 · task 003

B=2.000 · V=0.105 · e=0.000 · N=21

pyautogui.click(1495, 247)

Scent scored
CHATGPT_BRANCH_LEVEL_REAUDIT_V108
OSWorldCOMMIT

Identify the Hong Kong source photo among picture1 through picture6 and identify the correct usable raindrop …

claude-opus-4-7 · task 003

B=0.000 · V=0.000 · e=0.000 · N=52

pyautogui.click(1534, 163)

Scent scored
CHATGPT_BRANCH_LEVEL_REAUDIT_V108
OSWorldCOMMIT

Review every NLP-lab application received since May 2025, identify all qualifying applicants using the exact …

claude-opus-4-7 · task 006

B=0.000 · V=0.000 · e=0.000 · N=117

_osworld_original_pyautogui_pause = pyautogui.PAUSE pyautogui.PAUSE = 0.002 try: pyautogui.press('c') pyautogui.press('l') pyautogui.press('e') pyautogui.press('a') pyautogui.pres…

Scent scored
CHATGPT_BRANCH_LEVEL_REAUDIT_V108
OSWorldLEAVE

For every wrong question in STAT2602/my_mistakes.docx that has not already been matched, identify the corresp…

claude-opus-4-7 · task 012

B=1.000 · V=0.040 · e=0.040 · N=6

pyautogui.click(313, 216)

Scent scored
CHATGPT_BRANCH_LEVEL_REAUDIT_V108
BreakingWebCOMMIT

The user wants me to browse the Electronics category, find the cheapest available item, and add it to the car…

gemini_3_flash · task amazon_browse_category

N=0 · Candidate target=hit

step 4

Candidate gate pending · Scent not scored
Operator v6 / primary state v3
BreakingWebCOMMIT

The user wants me to browse the Electronics category, find the cheapest available item, and add it to the car…

gpt_5_4 · task amazon_browse_category

N=1 · Candidate target=hit

step 3

Candidate gate pending · Scent not scored
Operator v6 / primary state v3
BreakingWebINSPECT

This is a multi-step shopping and checkout task on the current site, so I should create a plan.

gemini_3_1_pro · task amazon_bulk_cart_build

N=0 · Candidate target=miss

step 4

Candidate gate pending · Scent not scored
Operator v6 / primary state v3
BreakingWebINSPECT

This is a multi-step shopping and checkout task on the current site, so I should create a plan.

gemini_3_1_pro · task amazon_bulk_cart_build

N=0 · Candidate target=miss

step 8

Candidate gate pending · Scent not scored
Operator v6 / primary state v3
BreakingWebLEAVE

I am on the cart page as requested. The user wants each out-of-stock item removed and replaced with one in-st…

gemini_3_1_pro · task amazon_cart_recover_from_oos

N=0 · Candidate target=hit

step 5

Candidate gate pending · Scent not scored
Operator v6 / primary state v3
BreakingWebLEAVE

I am on the cart page as requested. The user wants each out-of-stock item removed and replaced with one in-st…

gemini_3_flash · task amazon_cart_recover_from_oos

N=0 · Candidate target=hit

step 5

Candidate gate pending · Scent not scored
Operator v6 / primary state v3

现有自动化审阅产物

OM2W · Operator consistency review
BreakingWeb · COMMIT review sheet
BreakingWeb · LEAVE review sheet