Screaming Frog Seo Spider 12.6 ((free))

Solution: Increase the "Custom JS Wait Time" in Config > Rendering > Custom JavaScript > Timeout . For heavy infinite scrolls, set it to 5000ms (5 seconds).

Improved ability to crawl millions of URLs by saving data to disk rather than just RAM, preventing crashes on lower-spec machines.

If you are evaluating it against other desktop tools, you can find detailed comparisons on sites like SiteAnalyzer . For technical identification, the software also uses specific user agents that can be verified on WhatIsMyBrowser.com .