Repository navigation
fix: add Amazonbot and MistralAI-Training to the AI training opt-out - #352
Merged
Merged
Conversation
Contributor
🤖 MERGED
GitHub merged this pull request. No material findings were recorded. 411fd30e-cbff-499c-a07c-29291b76e5e3 |
commit: |
|
| Module | Client gzip | Server raw |
|---|---|---|
| @nuxtjs/robots | 608 B | 173 kB |
Package files (6)
Rows overlap and include unused code. These totals do not measure deployed output or npm downloads.
Excludes dependency files, types, source maps, and other non-code files.
| Package files | Summed gzip | Raw | Δ gzip |
|---|---|---|---|
| @nuxtjs/robots · export . | 7.1 kB | 27 kB | — |
| @nuxtjs/robots · export ./content | 292 B | 503 B | — |
| @nuxtjs/robots · export ./util | 467 B | 784 B | — |
| @nuxtjs/robots · built code files | 44 kB | 142 kB | 🔴 +156 B (+0.4%) |
| @nuxtjs/robots · app source files | 3.3 kB | 7.2 kB | — |
| @nuxtjs/robots · server source files | 9.8 kB | 24 kB | — |
Dependencies (8)
Declared dependencies. Their installed size does not show runtime cost.
| Package | Dependency | Requested |
|---|---|---|
| @nuxtjs/robots | @fingerprintjs/botd | catalog: |
| @nuxtjs/robots | @nuxt/kit | catalog: |
| @nuxtjs/robots | @vueuse/core | catalog: |
| @nuxtjs/robots | consola | catalog: |
| @nuxtjs/robots | defu | catalog: |
| @nuxtjs/robots | nuxt-site-config | catalog: |
| @nuxtjs/robots | nuxtseo-shared | catalog: |
| @nuxtjs/robots | ufo | catalog: |
How this is measured
- Compare the same app with and without the module.
- Client: all emitted JS/CSS, summed per-file gzip. This includes lazy chunks.
- Server: deployed files, including external dependencies. Source maps are excluded.
- Default module settings, Node server preset. Memory and request speed are outside this report.
Base: main @ fab5a9e · 2026-10-12 · differences below 16 B are ignored
Contributor
Published @nuxtjs/robots@7.0.1. |
Contributor
|
Good catch, thanks :) |
6 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
🔗 Linked issue
Follow-up to #347 and #349.
❓ Type of change
📚 Description
Thanks for shipping
blockAiBots: 'training'so quickly! ComparingAiTrainingBotswith the operators' docs, two documented training crawlers are missing:AiBotstoo, so neithertruenor'training'blocked it.MistralAI-IndexandMistralAI-Userare already listed and stay out of the training list.Amzn-SearchBotandAmzn-User, are separate and, per the same page, not used for generative AI training, so they stay unblocked.Changes:
src/const.ts: adds both tokens toAiTrainingBotswith their operator sources, andMistralAI-TrainingtoAiBots.test/unit/const.test.ts:AiTrainingBotsmust be a subset ofAiBots, sotruealways blocks everything'training'blocks. Also checks the two tokens and that the Amazon and Mistral search/user agents stay out.test/e2e/ai-training.test.tsand theblockAiBotsdocs list the two new tokens.