chore: add issue templates, expand CONTRIBUTING.md, and project management setup by nvzhihanj · Pull Request #272 · mlcommons/endpoints

nvzhihanj · 2026-04-07T22:10:27Z

Summary

Add 4 YAML issue form templates (bug report, feature request, performance issue, dataset integration)
Expand CONTRIBUTING.md with development setup, code style, testing, PR process, and issue guidelines (~250 lines)
Add project management design spec and implementation plan

What was done (via API, not in this PR)

The following was configured directly on GitHub via the API as part of this project management setup:

Labels: Created 23 new prefixed labels (type:, priority:, area:, status:), deleted 17 legacy labels
Issues: Relabeled all 57 open issues with new taxonomy, closed 6 duplicates with context preserved
Board Completeness of benchmark_results.json Output #57: Configured 6 status columns, 3 custom fields (Priority, Area, Target Release), added ~48 issues, created 4 views
PR linkages: Linked open PRs to their primary issues

Test plan

Verify issue templates render correctly on GitHub (New Issue page)
Verify CONTRIBUTING.md renders correctly and all links work
Verify board at https://github.com/orgs/mlcommons/projects/57 shows issues in Triage

github-actions · 2026-04-07T22:10:38Z

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

gemini-code-assist

Code Review

This pull request establishes a comprehensive project management infrastructure for the repository. It introduces standardized issue templates for bugs, features, performance, and datasets, alongside a significantly expanded CONTRIBUTING.md that details development setup, code style, and testing procedures. The PR also includes a design specification and a task-based implementation plan for migrating issues and configuring a project board. Review feedback focused on correcting pytest-asyncio marker usage, refining coverage commands, and improving the robustness of shell scripts for GitHub token retrieval.

…, and CONTRIBUTING.md Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…dedup cleanup Priority changes: #217→P2, #178→P2, #179→P2, #173→P2, #268→P1, #232→P0, #9→P1 Added open PR to issue linkage table. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

13-task plan covering labels, board, templates, CONTRIBUTING.md, issue migration, duplicate closure, PR linkages, and board automation setup. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Four YAML-based issue form templates: - 100-bug-report.yml: structured bug reporting - 200-feature-request.yml: feature proposals with motivation - 300-performance.yml: performance regressions with benchmark data - 400-dataset-integration.yml: new dataset/eval requests - config.yml: template chooser with Discussions link Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…ue guidelines Replace minimal 10-line CONTRIBUTING.md with comprehensive guide covering: - Ways to contribute with links to issue templates - Development setup (venv, pip install, pre-commit, echo server) - Code style (ruff, mypy, conventional commits, serialization) - Testing (pytest markers, async mode, coverage, fixtures) - PR process and review expectations - Issue lifecycle and priority levels - MLCommons CLA requirements Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

One-way sync: when priority: or area: labels change on an issue, the corresponding board custom field is automatically updated. Labels are the single source of truth. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

- Remove .cursor/rules/ (migrated to CLAUDE.md/AGENTS.md) - Remove docs/superpowers/ plans and specs (local-only artifacts) - Add .cursor/ and docs/superpowers/ to .gitignore - Overhaul README.md: remove emojis, remove inline contributor list (use git log/ATTRIBUTION instead), align architecture section with AGENTS.md, add badges, streamline to match OSS best practices - Contributors section removed — credit lives in git history and ATTRIBUTION file Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Strict asyncio mode is configured globally in pyproject.toml via asyncio_mode = "strict". The marker does not accept a mode argument — passing it causes errors in recent pytest-asyncio versions. Fixed in: CONTRIBUTING.md, AGENTS.md, docs/DEVELOPMENT.md Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

CLA details are already in CONTRIBUTING.md — no need to duplicate in README. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Make it explicit that pre-commit must run before every commit, no exceptions. Hooks may modify files — stage changes and commit once. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Remove Discussions link from issue template config.yml and CONTRIBUTING.md since GitHub Discussions is not enabled on this repo. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

…ign with AGENTS.md - Fix repo URL: mlperf/inference-endpoint → mlcommons/endpoints - Add proper fork workflow (fork → clone → add upstream → branch → PR) - Update project structure to match current codebase (add evaluation, sglang, plugins, async_utils; fix entry point main.py not cli.py) - Remove emoji headers for consistency - Fix test example: add required markers, correct asyncio usage - Remove "skip hooks" advice (contradicts project policy) - Remove verbose docstring example (contradicts minimal-comments policy) - Remove Discussions references (feature not enabled) - Add YAML config templates section - Add performance considerations aligned with AGENTS.md - Add key test fixtures section Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

Signed-off-by: Rashid Kaleem <230885705+arekay-nv@users.noreply.github.com>

nvzhihanj requested a review from a team April 7, 2026 22:10

github-actions bot requested a review from arekay-nv April 7, 2026 22:10

gemini-code-assist bot reviewed Apr 7, 2026

View reviewed changes

Comment thread CONTRIBUTING.md Outdated

Comment thread CONTRIBUTING.md

Comment thread docs/superpowers/plans/2026-04-07-project-management.md Outdated

nvzhihanj commented Apr 8, 2026

View reviewed changes

Comment thread AGENTS.md

arekay-nv force-pushed the chore/project-management-setup branch from 2f2b15b to fc391d7 Compare April 9, 2026 21:05

arekay-nv approved these changes Apr 10, 2026

View reviewed changes

Comment thread .github/ISSUE_TEMPLATE/config.yml Outdated

nvzhihanj and others added 12 commits April 13, 2026 15:38

docs: add project management design spec for labels, board, templates…

060e9f6

…, and CONTRIBUTING.md Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

docs: add project management implementation plan

cdf2ed3

13-task plan covering labels, board, templates, CONTRIBUTING.md, issue migration, duplicate closure, PR linkages, and board automation setup. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

style: apply prettier formatting to README and CONTRIBUTING

b1ab1c7

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

docs: remove CLA line from README Contributing section

cc3af95

CLA details are already in CONTRIBUTING.md — no need to duplicate in README. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

docs: strengthen pre-commit requirement in AGENTS.md

22c646e

Make it explicit that pre-commit must run before every commit, no exceptions. Hooks may modify files — stage changes and commit once. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

fix: remove Discussions references (feature not enabled)

d75f3c6

Remove Discussions link from issue template config.yml and CONTRIBUTING.md since GitHub Discussions is not enabled on this repo. Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>

nvzhihanj force-pushed the chore/project-management-setup branch from 8d9a66f to d75f3c6 Compare April 13, 2026 22:38

nvzhihanj and others added 2 commits April 13, 2026 15:42

Update dependencies

149cce0

Signed-off-by: Rashid Kaleem <230885705+arekay-nv@users.noreply.github.com>

arekay-nv merged commit 9e1041d into main Apr 14, 2026
7 checks passed

arekay-nv deleted the chore/project-management-setup branch April 14, 2026 13:36

github-actions bot locked and limited conversation to collaborators Apr 14, 2026

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

chore: add issue templates, expand CONTRIBUTING.md, and project management setup#272

chore: add issue templates, expand CONTRIBUTING.md, and project management setup#272
arekay-nv merged 14 commits intomainfrom
chore/project-management-setup

nvzhihanj commented Apr 7, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Apr 7, 2026 •

edited

Loading

Uh oh!

gemini-code-assist bot left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

Conversation

nvzhihanj commented Apr 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Summary

What was done (via API, not in this PR)

Test plan

Uh oh!

github-actions bot commented Apr 7, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

gemini-code-assist bot left a comment

Choose a reason for hiding this comment

Code Review

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

nvzhihanj commented Apr 7, 2026 •

edited

Loading

github-actions bot commented Apr 7, 2026 •

edited

Loading