OpenAI launches web crawler 'GPTBot' amid plans for next model: GPT-5
Submitted by Anonymous (not verified) on Tue, 08/08/2023 - 08:30
ChatGPT users have the option to scrap the web crawler by adding a “disallow” command to a standard file on the server.