Skip to content

Extend the timeout duration waiting for MachineConfigPools #69

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
xiaojiey wants to merge 1 commit into
base: main
Choose a base branch
from
Open

Extend the timeout duration waiting for MachineConfigPools #69

Changes from all commits
Commits
Show all changes
1 commit
Select commit
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
6 changes: 4 additions & 2 deletions helpers/utilities.go
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -1474,7 +1474,9 @@ func WaitForMachineConfigPoolsUpdated(tc *testConfig.TestConfig, c dynclient.Cli
log.Printf("Waiting for %d MachineConfigPools to be fully updated", len(mcpList.Items))

// Wait for all MCPs to be updated
bo := backoff.WithMaxRetries(backoff.NewConstantBackOff(tc.APIPollInterval), 720) // 60 minutes max
// Increased from 720 (60 minutes) to 1440 (120 minutes) to handle namespace exhaustion
// issues when applying large numbers of node remediations
bo := backoff.WithMaxRetries(backoff.NewConstantBackOff(tc.APIPollInterval), 1440) // 120 minutes max
err = backoff.RetryNotify(func() error {
pendingPools := []string{}

Expand Down Expand Up @@ -1505,7 +1507,7 @@ func WaitForMachineConfigPoolsUpdated(tc *testConfig.TestConfig, c dynclient.Cli
})
if err != nil {
// On timeout, provide detailed information about pending pools
log.Printf("Timeout reached after 60 minutes waiting for MachineConfigPools")
log.Printf("Timeout reached after 120 minutes waiting for MachineConfigPools")

pendingPools := []string{}
for i := range mcpList.Items {
Expand Down