Website recrawl

  • lucgvalade
    Asked on April 24, 2025 at 11:50 AM

    Hello...

    Thanks for continuing to improve your product. I have initiated the website crawl. It will pick up all the links in the inital crawl, you can select up to 10. Why the limit? We have to go back in and recrawl and select another 10. Can your server crawling limit be increased to at least 100?

    In my case, it crawled the whole site and allowed me to choose up to 10.

    These are the results.

    Website recrawl Image 1 Screenshot 30


    Website recrawl Image 2 Screenshot 41

    I tried to recrawl more and it will not do it or give me some error. This is another project I am testing out.

    HELP...Luc

  • Shaira JotForm Support
    Replied on April 24, 2025 at 1:32 PM

    Hi Luc,

    Thanks for reaching out to Jotform Support. Keep in mind that when crawling pages, you can only select up to 10 pages at a time. If you need to crawl additional pages beyond that limit, you can simply create a separate link and continue the process with the remaining sites. This allows you to cover all your desired pages while staying within the selection limit.

    About extending the limit from 10 to 100, we've gone ahead and escalated your request to our developers. Exactly when or if it's developed depends on their workload, how viable it is, and how many other users also request it. If there are any updates, we’ll circle back to this thread and let you know.

    Reach out again if you need any more help.

  • lucgvalade
    Replied on May 2, 2025 at 6:16 PM

    Hello...

    Thanks for sending it up the ladder.


    Luc

Your Answer