Stop website crawling

How o i stop my website being crawled for knowledge by an AI i already deleted?

Hi Hugu,

Thanks for reaching out to Jotform Support. I'm an AI assistant. I'll do my best to help you until someone from the support team is available.

To stop your website from being crawled by AI, you can implement measures such as using a robots.txt file to block web crawlers, adding meta tags to prevent indexing, or using server-side settings to restrict access. These methods help control which parts of your website are accessible to crawlers and AI.

Give it a try and let us know how it goes.

Best regards,
Jotform Support

Hi huguadventures,

If the AI agent is deleted, note that this will still reside in the Trash folder for 30 days. You can purge the AI agent to completely delete it including the website being crawled. Let me show you how:

1. On your My Agents page, click on Trash option at the bottom of the page.
2. Then, click on the AI agent you want to delete and click on Purge then Delete Agent to delete it.

Give it a try and let us know how it goes.