Skip to content

bugfix - max content not applied for robots.txt when redirecting#2004

Merged
jnioche merged 1 commit into
mainfrom
robotsRedirNoTrim
Jul 19, 2026
Merged

bugfix - max content not applied for robots.txt when redirecting#2004
jnioche merged 1 commit into
mainfrom
robotsRedirNoTrim

Conversation

@jnioche

@jnioche jnioche commented Jul 18, 2026

Copy link
Copy Markdown
Contributor

Trivial fix

http.robots.content.limit is used on the original fetch attempt but not on redirects

Signed-off-by: Julien Nioche <julien@digitalpebble.com>
@jnioche jnioche added this to the 3.7.0 milestone Jul 18, 2026

@sigee sigee left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jnioche
jnioche merged commit 3664644 into main Jul 19, 2026
2 checks passed
@dpol1
dpol1 deleted the robotsRedirNoTrim branch July 20, 2026 12:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants