This feature is only available to licensed users and we ask everyone to use this responsibly. We also have a custom user-agent feature which allows you to specify your own user agent. ![]() User Agent Switcher – The SEO spider now have a user-agent switcher with inbuilt preset user agents for Googlebot, Bingbot, Yahoo! Slurp, various browsers and more.It narrows the default search by only crawling the URLs that match the REGEX which is particularly useful for larger sites, or sites with less intuitive URL structures. Include (REGEX Crawling) – This new feature allows you to control URLs the spider crawls using REGEX.So lets get straight to it, what new features are there in version 1.70 of the tool? I am excited to announce another update to the Screaming Frog SEO spider, to version 1.70.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |