Tag

Bots

2023

Your Content and AI Training

It’s very in coming, but we’re slowly getting the means to indicate that our site content should not be used in training sets for generative AI models. It’s still unclear whether existing web crawlers were used to train current LLMs…

AI Bots Crawling LLM robots.txt