Skip to content

[docs] indexing improvements#14229

Merged
valentijnscholten merged 3 commits intoDefectDojo:bugfixfrom
paulOsinski:robotstxt
Feb 4, 2026
Merged

[docs] indexing improvements#14229
valentijnscholten merged 3 commits intoDefectDojo:bugfixfrom
paulOsinski:robotstxt

Conversation

@paulOsinski
Copy link
Contributor

@paulOsinski paulOsinski commented Feb 2, 2026

  1. robots.txt was blocking the /admin/ directory from search crawling, this overrides this behavior. (/admin/ is a documentation folder, not anything sensitive)
  2. I want our search indexer Algolia to know the "audience" of a page for improved search UX, this adds a tag that pulls that from the front matter
  3. latest release version was caching at build time and not refreshing - this sets a Hugo variable to call the API again every hour to get the latest DD version (for the header)

@paulOsinski paulOsinski changed the title [docs] update robots.txt for indexing [docs] override robots.txt Feb 2, 2026
@paulOsinski paulOsinski changed the title [docs] override robots.txt [docs] indexing improvements Feb 2, 2026
@github-actions github-actions bot added the docs label Feb 2, 2026
Copy link
Contributor

@mtesauro mtesauro left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Approved

@valentijnscholten valentijnscholten merged commit 014d737 into DefectDojo:bugfix Feb 4, 2026
149 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

5 participants