Skip to content

Commit dfe1bde

Browse files
sjarmakclaude
andcommitted
fix: re-run security oracle with working SG search (F1 0.0 → 0.667)
User-Agent fix enables SG API calls. Agent now discovers express repo via Sourcegraph, achieving recall=1.0 on ccx-vuln-remed-011. Overall pilot: mean F1=0.727, kappa=0.380. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent c9ebe17 commit dfe1bde

File tree

1 file changed

+17
-8
lines changed

1 file changed

+17
-8
lines changed
Lines changed: 17 additions & 8 deletions
Original file line numberDiff line numberDiff line change
@@ -1,15 +1,24 @@
11
{
2-
"files": [],
3-
"text": "No package.json files in the sg-evals/node--v22.13.0 repository declare 'cookie' as a direct runtime dependency under 'dependencies'. All 397 package.json files were searched using grep for the pattern '\"cookie\":'. The only occurrence of the word 'cookie' in any package.json is within script name strings (e.g., 'test:cookies') in deps/undici/src/package.json, which is not a dependency declaration. The result is an empty file set.",
2+
"files": [
3+
{
4+
"repo": "sg-evals/expressjs-express",
5+
"path": "package.json"
6+
},
7+
{
8+
"repo": "sg-evals/express--4.21.1",
9+
"path": "package.json"
10+
}
11+
],
12+
"text": "Searched across all available local and Sourcegraph-indexed repositories for package.json files declaring 'cookie' as a direct runtime dependency (under 'dependencies', not 'devDependencies'). The sg-evals/expressjs-express and sg-evals/express--4.21.1 repos both have 'cookie': '0.7.1' at line 35 of their package.json, which falls within the 'dependencies' block (starting line 29) and before the 'devDependencies' block (starting line 62). The sg-evals/node--v22.13.0 repo has no package.json files listing 'cookie' under dependencies \u2014 the only cookie mention is in the scripts section of deps/undici/src/package.json. Other repos found (vscode, cal.com) are not Node.js web stack repos relevant to this task.",
413
"_metadata": {
514
"generator": "context_retrieval_agent",
615
"model": "claude-sonnet-4-6",
716
"backend": "hybrid",
8-
"input_tokens": 126299,
9-
"output_tokens": 2713,
10-
"tool_calls": 21,
11-
"elapsed_sec": 45.8,
12-
"cost_usd": 0.4196,
13-
"timestamp": "2026-03-01T23:36:25.638481+00:00"
17+
"input_tokens": 251178,
18+
"output_tokens": 3989,
19+
"tool_calls": 41,
20+
"elapsed_sec": 79.8,
21+
"cost_usd": 0.8134,
22+
"timestamp": "2026-03-02T00:50:26.465823+00:00"
1423
}
1524
}

0 commit comments

Comments
 (0)