-
Notifications
You must be signed in to change notification settings - Fork 52
CherryPicked: [cnv-4.18] [4.20] [upgrade/network] Remove redundant network upgrade tests #3322
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
base: cnv-4.18
Are you sure you want to change the base?
Conversation
Removing 3 network upgrade tests that are not contributing anything. The dependent fixtures and functions were also removed, except for those that are still used by other flows. Polarion test cases deleted as well. The rationale of removing each of these tests: - test_nmstate_bridge_before_upgrade: Needless to explain this is a pure nmstate flow, that doesn't involve CNV. - test_bridge_marker_before_upgrade: Bridge-marker is indirectly covered in any bridge test, which would fail if the bridge-marker is disfunctioning. - test_install_ovs_with_annotations_before_upgrade: Actively opting-in OVS CNI is not needed on OVN-k8s clusters, which is now the default. Backported from #3196 ##### jira-ticket: https://issues.redhat.com/browse/CNV-70147
|
Important Review skippedAuto reviews are disabled on base/target branches other than the default branch. Please check the settings in the CodeRabbit UI or the You can disable this status message by setting the ✨ Finishing touches🧪 Generate unit tests (beta)
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
|
Report bugs in Issues Welcome! 🎉This pull request will be automatically processed with the following features:
🔄 Automatic Actions
📋 Available CommandsPR Status Management
Review & Approval
Testing & Validation
Container Operations
Cherry-pick Operations
Label Management
✅ Merge RequirementsThis PR will be automatically approved when the following conditions are met:
📊 Review ProcessApprovers and ReviewersApprovers:
Reviewers:
Available Labels
💡 Tips
For more information, please refer to the project documentation or contact the maintainers. |
|
/verified Verified by running the network/upgrade module locally, and verifying that none of the deleted tests is collected: |
Test execution plan request detailsCRITICAL: You MUST post an inline review comment on the first changed line of the first file. As an expert software testing engineer, analyze all modified files in this PR and create a targeted test execution plan. Analysis Requirements:
Your deliverable: Test Execution Plan
Guidelines:
CRITICAL WORKFLOW COMPLETION RULES: When responding to this test execution plan request, you MUST follow these rules EXACTLY:
ABSOLUTE PROHIBITIONS (violating these creates empty/meaningless reviews):
Remember: The pull request review is visible to users. Additional comments are redundant noise. CRITICAL: Before setting "Run smoke tests: True", you MUST use shell scripts to: |
|
/retest build-container |
|
/retest tox |
| import logging | ||
| import os | ||
| from ipaddress import ip_interface | ||
|
|
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Test Execution Plan
- Run smoke tests: False
Rationale:
- This PR removes 6 redundant upgrade tests and their supporting utility functions
- No smoke tests exist in or depend on the network/upgrade module
- The deleted utility functions are not used elsewhere in the codebase
- Changes are isolated to network/upgrade test cleanup
Recommended Tests:
tests/network/upgrade/test_upgrade_network.py- Verify remaining 10 tests execute successfully after deletion
Note: User yossisegev has already verified test collection locally (10/11 tests collected, 1 deselected as expected).
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@coderabbitai The verification I ran is enough, as this PR is about removing tests, so the verificaition was that these tests are not collected.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
@yossisegev Understood! Test collection verification confirming the deleted tests are not collected is indeed sufficient for this test removal PR. This aligns with the principle we've established for test cleanup PRs in this repository. Thank you for the confirmation! ✓
🧠 Learnings used
Learnt from: servolkov
Repo: RedHatQE/openshift-virtualization-tests PR: 1776
File: tests/network/bgp/conftest.py:35-54
Timestamp: 2025-08-28T12:30:40.692Z
Learning: The BGP test suite in tests/network/bgp/ relies on session-scoped validation in tests/network/conftest.py via the network_sanity fixture's _verify_bgp() function, which validates required environment variables (VLAN_TAG, EXTERNAL_FRR_STATIC_IPV4, BGP_CLUSTER_DOMAIN_GROUP) before any BGP tests run, making individual fixture-level validation redundant.
Learnt from: rnetser
Repo: RedHatQE/openshift-virtualization-tests PR: 1904
File: tests/network/conftest.py:348-362
Timestamp: 2025-10-27T15:30:06.412Z
Learning: In tests/network/conftest.py, the _verify_nmstate_running_pods function currently runs unconditionally in network_sanity, but rnetser plans to implement marker-based conditional checking (following the pattern of _verify_dpdk, _verify_sriov, etc.) in a future PR after adding nmstate markers to the relevant tests.
Learnt from: yossisegev
Repo: RedHatQE/openshift-virtualization-tests PR: 3196
File: tests/network/upgrade/test_upgrade_network.py:4-4
Timestamp: 2025-12-22T16:27:44.327Z
Learning: For PRs that remove test cases (especially redundant test cleanup PRs in openshift-virtualization-tests), test collection verification (pytest --collect-only showing selected/deselected counts) is sufficient to confirm the removal was clean and the test module remains functional. Full test execution is not required for test deletion PRs.
Learnt from: rnetser
Repo: RedHatQE/openshift-virtualization-tests PR: 0
File: :0-0
Timestamp: 2025-12-16T10:28:54.212Z
Learning: In the openshift-virtualization-tests repository, when determining smoke test impact for test execution plans, only set "Run smoke tests: True" if there is a verified, traceable dependency path from smoke tests to the changed code. Session-scoped fixtures or infrastructure-sounding changes do NOT automatically imply smoke test impact - the dependency chain must be explicitly verified using shell scripts before recommending smoke test execution.
Learnt from: rnetser
Repo: RedHatQE/openshift-virtualization-tests PR: 3228
File: .coderabbit.yaml:30-41
Timestamp: 2026-01-05T10:33:50.728Z
Learning: In the openshift-virtualization-tests repository, user rnetser prefers minimal pre-merge checks in CodeRabbit configuration: only docstrings enforcement (80% threshold) is needed, not title or description checks.
|
Tip For best results, initiate chat on the files or code changes. 🧩 Analysis chain🏁 Script executed: Length of output: 8013 🏁 Script executed: Length of output: 76 🏁 Script executed: Length of output: 49 🏁 Script executed: Length of output: 180 🏁 Script executed: Length of output: 575 🏁 Script executed: Length of output: 120 🏁 Script executed: Length of output: 1426 🏁 Script executed: Length of output: 329 🏁 Script executed: Length of output: 40 🏁 Script executed: Length of output: 129 🏁 Script executed: Length of output: 3137 🧠 Learnings used |
|
/approve |
cherry-pick #3299 into cnv-4.18
requested-by yossisegev