Skip to content

Commit 13a95c3

Browse files
committed
Update conformance tests docs and settings
Signed-off-by: Dariusz Jędrzejczyk <dariusz.jedrzejczyk@broadcom.com>
1 parent 3af9568 commit 13a95c3

File tree

3 files changed

+12
-30
lines changed

3 files changed

+12
-30
lines changed

conformance-tests/VALIDATION_RESULTS.md

Lines changed: 8 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -2,27 +2,22 @@
22

33
## Summary
44

5-
**Server Tests:** 37/40 passed (92.5%)
5+
**Server Tests:** 40/40 passed (100%)
66
**Client Tests:** 3/4 scenarios passed (9/10 checks passed)
77
**Auth Tests:** 12/14 scenarios fully passing (178 passed, 1 failed, 1 warning, 85.7% scenarios, 98.9% checks)
88

99
## Server Test Results
1010

11-
### Passing (37/40)
11+
### Passing (40/40)
1212

1313
- **Lifecycle & Utilities (4/4):** initialize, ping, logging-set-level, completion-complete
1414
- **Tools (11/11):** All scenarios including progress notifications ✨
1515
- **Elicitation (10/10):** SEP-1034 defaults (5 checks), SEP-1330 enums (5 checks)
16-
- **Resources (4/6):** list, read-text, read-binary, templates-read
16+
- **Resources (6/6):** list, read-text, read-binary, templates-read, subscribe, unsubscribe
1717
- **Prompts (4/4):** list, simple, with-args, embedded-resource, with-image
1818
- **SSE Transport (2/2):** Multiple streams
1919
- **Security (2/2):** Localhost validation passes, DNS rebinding protection
2020

21-
### Failing (3/40)
22-
23-
1. **resources-subscribe** - Not implemented in SDK
24-
2. **resources-unsubscribe** - Not implemented in SDK
25-
2621
## Client Test Results
2722

2823
### Passing (3/4 scenarios, 9/10 checks)
@@ -68,10 +63,9 @@ Uses the `client-spring-http-client` module with Spring Security OAuth2 and the
6863

6964
## Known Limitations
7065

71-
1. **Resource Subscriptions:** SDK doesn't implement `resources/subscribe` and `resources/unsubscribe` handlers
72-
2. **Client SSE Retry:** Client doesn't parse or respect the `retry:` field, reconnects immediately, and doesn't send Last-Event-ID header
73-
3. **Auth Scope Step-Up:** Client does not fully handle scope step-up challenges where the server requests additional scopes after initial authorization
74-
4. **Auth Basic CIMD:** Minor conformance warning in the basic Client-Initiated Metadata Discovery flow
66+
1. **Client SSE Retry:** Client doesn't parse or respect the `retry:` field, reconnects immediately, and doesn't send Last-Event-ID header
67+
2. **Auth Scope Step-Up:** Client does not fully handle scope step-up challenges where the server requests additional scopes after initial authorization
68+
3. **Auth Basic CIMD:** Minor conformance warning in the basic Client-Initiated Metadata Discovery flow
7569

7670
## Running Tests
7771

@@ -119,6 +113,5 @@ npx @modelcontextprotocol/conformance@0.1.15 client \
119113

120114
### High Priority
121115
1. Fix client SSE retry field handling in `HttpClientStreamableHttpTransport`
122-
2. Implement resource subscription handlers in `McpStatelessAsyncServer`
123-
3. Implement CIMD
124-
4. Implement scope step up
116+
2. Implement CIMD
117+
3. Implement scope step up

conformance-tests/conformance-baseline.yml

Lines changed: 0 additions & 5 deletions
Original file line numberDiff line numberDiff line change
@@ -2,11 +2,6 @@
22
# This file lists known failing scenarios that are expected to fail until fixed.
33
# See: https://github.com/modelcontextprotocol/conformance/blob/main/SDK_INTEGRATION.md
44

5-
server:
6-
# Resource subscription not implemented in SDK
7-
- resources-subscribe
8-
- resources-unsubscribe
9-
105
client:
116
# SSE retry field handling not implemented
127
# - Client does not parse or respect retry: field timing

conformance-tests/server-servlet/README.md

Lines changed: 4 additions & 10 deletions
Original file line numberDiff line numberDiff line change
@@ -4,7 +4,7 @@ This module contains a comprehensive MCP (Model Context Protocol) server impleme
44

55
## Conformance Test Results
66

7-
**Status: 37 out of 40 tests passing (92.5%)**
7+
**Status: 40 out of 40 tests passing (100%)**
88

99
The server has been validated against the official [MCP conformance test suite](https://github.com/modelcontextprotocol/conformance). See [VALIDATION_RESULTS.md](../VALIDATION_RESULTS.md) for detailed results.
1010

@@ -22,9 +22,8 @@ The server has been validated against the official [MCP conformance test suite](
2222
- SEP-1034: Default values for all primitive types
2323
- SEP-1330: All enum schema variants
2424

25-
**Resources** (4/6)
26-
- List, read text/binary, templates
27-
- ⚠️ Subscribe/unsubscribe (SDK limitation)
25+
**Resources** (6/6)
26+
- List, read text/binary, templates, subscribe, unsubscribe
2827

2928
**Prompts** (4/4)
3029
- Simple, parameterized, embedded resources, images
@@ -191,12 +190,7 @@ curl -X POST http://localhost:8080/mcp \
191190

192191
## Known Limitations
193192

194-
See [VALIDATION_RESULTS.md](../VALIDATION_RESULTS.md) for details on:
195-
196-
1. **Resource Subscriptions** - Not implemented in Java SDK
197-
2. **DNS Rebinding Protection** - Missing Host/Origin validation
198-
199-
These are SDK-level limitations that require fixes in the core framework.
193+
See [VALIDATION_RESULTS.md](../VALIDATION_RESULTS.md) for details on remaining client-side limitations.
200194

201195
## References
202196

0 commit comments

Comments
 (0)