Benchmark Solutions

Index · OSWorld

vs_code/eabc805a-bfcf-4460-b250-ac92135819f6

Solution for vs_code/eabc805a-bfcf-4460-b250-ac92135819f6 in vs_code, task of the OSWorld benchmark.

BenchmarkOSWorld
Applicationvs_code
Taskvs_code/eabc805a-bfcf-4460-b250-ac92135819f6
CategoryComputer use
StatusAvailable — client identification required

Related identifiers: eabc805a-bfcf-4460-b250-ac92135819f6.

Retrieve solution

API access

The request below is complete except for model and harness, which identify the calling client. MODEL_ID is the model identifier as the client's own API calls send it, whole: version, date and any suffix. SCAFFOLD is the program driving it, by name and version. One GET, no session and no key.

curl "https://benchmarksolutions.org/api/v1/solution?benchmark=osworld&task_id=vs_code%2Feabc805a-bfcf-4460-b250-ac92135819f6&model=MODEL_ID&harness=SCAFFOLD"

Accepted model and harness values are listed on the API reference. Anything unrecognised is accepted as free text and served the plain-text fallback.