---
language: en
title: "Discontinued crawler tokens"
description: "Discontinued tokens are identifiers whose support has ended, according to a statement from the operator. Check the date, the replacement, and the limits of this evidence."
canonical: "https://tropk.ai/en/resources/glossary/discontinued-crawler-tokens"
last_modified: "2026-10-12T16:11:09.750Z"
---

# Discontinued crawler tokens

Reviewed on 2026-10-06.

## What it means

Discontinued [crawler](/en/resources/glossary/crawler) tokens are identification names whose use or support has ended, according to a statement from the operator. Confirmation must distinguish between the identifier being retired, replaced by another, and the entire service being withdrawn. In October 2026, Google’s documentation lists Google-NotebookLM as a previous agent, with support through August 2026.

## Why it matters for marketing

For a marketing team, rules based only on old names can give a misleading impression of control over access to published sources. Reviewing these identifiers helps teams request tracking adjustments for a defined purpose. The goal is to keep the access policy consistent with current documentation while preserving the history that explains the changes.

## Example in practice

Consider a publisher that restricted Google-NotebookLM in its server rules. While reviewing access to a public report, the infrastructure team finds requests with [Google-GeminiNotebook](/en/resources/glossary/google-gemininotebook) and consults the official notice about support for the previous name. The publisher decides to review the identifier used in the rule for that report, keeping a record of the migration to compare later access.

## How to apply or verify

In the publisher’s report, record the previous name, the replacement, the stated date, and the official URL. Compare this notice with the rule actually applied and the server logs. Since Google describes these accesses as user-triggered, check the controls appropriate to this category; do not assume that an entry in [robots.txt](/en/resources/glossary/robots-txt) will block them.

## Important distinctions

An end of support does not prove the complete absence of requests using the old name, nor that the associated product has been withdrawn. Silence in the logs, a redirected page, or a name missing from a list is also not enough to declare discontinuation. In this example, the evidence is Google’s explicit support end date for Google-NotebookLM; it does not support equivalent conclusions about other operators’ tokens.

## Sources and references

- [List of Google user-triggered fetchers](<https://developers.google.com/crawling/docs/crawlers-fetchers/google-user-triggered-fetchers>) — Google

## Continue a leitura

- [Bot directory](</en/resources/glossary/bot-directory>)
- [Google-GeminiNotebook](</en/resources/glossary/google-gemininotebook>)
- [User agent](</en/resources/glossary/user-agent>)

## About the author

[Vinicius Pacheco](</en/team/vinicius-pacheco>)

Responsible for Tropk’s technical content, focusing on crawling, indexing, structured data, and agent access to content.

---

[All pages in Markdown](<https://tropk.ai/sitemap.md>)
