Skip to content

Add IndexNow sitemap notification to deployment#1125

Open
BenjaminMichaelis wants to merge 3 commits into
mainfrom
benjaminmichaelis/effective-robot
Open

Add IndexNow sitemap notification to deployment#1125
BenjaminMichaelis wants to merge 3 commits into
mainfrom
benjaminmichaelis/effective-robot

Conversation

@BenjaminMichaelis
Copy link
Copy Markdown
Member

Overview

Implement automatic search engine notification via IndexNow when deploying to production. This notifies Bing, Yandex, Naver, and other search engines that the sitemap has been updated, enabling faster content discovery.

Approach

Added a single workflow step to the production deployment job that:

  • Submits the sitemap URL to the IndexNow API endpoint
  • Uses a GitHub Secret (INDEXNOW_API_KEY) for authentication
  • Continues on error to prevent deployment failures if the notification fails
  • Runs after the smoke test confirms the deployment succeeded

Implementation Details

  • Endpoint: https://api.indexnow.org/indexnow (global IndexNow endpoint)
  • Timing: After successful smoke test, before cleanup
  • Payload: Submits https://essentialcsharp.com/sitemap.xml as the URL to be crawled
  • Error Handling: Uses continue-on-error: true to ensure IndexNow issues don't block deployments
  • No App Changes: Zero modifications to application code; purely infrastructure/workflow

Next Steps

  1. Create GitHub Secret INDEXNOW_API_KEY with value: 5c32619215ebebad6b6ea0658237fd52
    • Path: Settings → Secrets and variables → Actions → New repository secret
  2. Next deployment will automatically notify search engines
  3. Verify in Bing Search Console → Crawler → IndexNow submissions

Fixes #401

- Submit sitemap.xml to IndexNow API after successful production deployment
- Notifies search engines (Bing, Yandex, Naver, etc.) of content updates
- Uses GitHub Secret INDEXNOW_API_KEY for authentication
- Continues on error to prevent deployment failures

Addresses: #401
Copilot AI review requested due to automatic review settings May 17, 2026 14:36
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Adds a post-deploy workflow step to the production deployment job that pings the IndexNow API with the site's sitemap URL so search engines (Bing, Yandex, Naver, etc.) are notified of content updates. The step runs only after the smoke test succeeds and is configured with continue-on-error: true so notification failures don't fail deployments. Closes #401.

Changes:

  • Adds a Notify IndexNow of Sitemap Update step to the prod deploy job in Build-Test-And-Deploy.yml.
  • Uses secrets.INDEXNOW_API_KEY to authenticate the POST to https://api.indexnow.org/indexnow.
  • Submits https://essentialcsharp.com/sitemap.xml in the urlList payload.

Comment thread .github/workflows/Build-Test-And-Deploy.yml Outdated
Comment thread .github/workflows/Build-Test-And-Deploy.yml Outdated
Comment thread .github/workflows/Build-Test-And-Deploy.yml Outdated
- Add detailed comments to workflow explaining key file hosting requirement and verification
- Document IndexNow setup procedure in README with step-by-step instructions for key file deployment
- Clarify that sitemap submission is valid (though urlList should ideally contain individual URLs)
- Confirm no literal keys are exposed in code or commits; use generic examples in documentation

Resolves review comments on PR #1125.
… file

- Add wwwroot/6b397fbb613bfbacb059e4972cf3ec15.txt for IndexNow domain ownership
  verification (served as static asset at https://essentialcsharp.com/{key}.txt)
- Fix workflow step: fetch live sitemap after smoke test, extract all <loc> URLs,
  POST correct JSON array to api.indexnow.org (per spec; not a sitemap URL)
- Add graceful warning if sitemap fetch fails; log HTTP response code
- Move key to env var to avoid inline secret interpolation
- Update README with accurate setup instructions and how-it-works explanation
Copilot AI review requested due to automatic review settings May 18, 2026 00:07
Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Copilot reviewed 3 out of 3 changed files in this pull request and generated no new comments.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Check and investigate Ping Google with new sitemap not working

2 participants