So in the first step, change the data storage method: Configuration -> System -> Storage -> Mode: Database Storage Screaming Frog must be restarted for the settings to take effect. From now on, each performed crawl will be saved automatically on the disk, and access to it will be possible by entering the "Crawls" tab: File -> Crawls Remember: remove unused unnecessary crawls, as auto-saving will fill up your disk. . Tab configuration Another convenience, thanks to which we can quickly sort and select the data that is important to us. Just right-click on the selected tab and remove it from the view.
Configuring exclusions Using the standard settings, we got a huge database that we didn't necessarily need. What if we could choose only what is important to us, while saving space? And Mexico WhatsApp Number List the Screaming Frog crew came up with this solution. Thanks to the update, we can exclude crawling of images, css, js files, as well as page elements such as title, keywords, headers and many others. You can find the configuration in: Configuration -> Spider -> Crawl and Extraction tab Why use website crawling tools? The above text should answer this question and encourage you to use the facilities offered by Screaming Frog.
We use the paid version of this tool extensively ourselves, so feel free to ask questions in the comments. Similar entries What affects positioning prices? Schema.org what it is, how to implement and impact on SEO Have you fallen for pseudo-scientists in SEO too? About correlations Quo vadis links in SEO? When and what will the "mobile first index" change in SEO?o you own a small local business and would like to appear on the first page of Google search results? Do you think that a company like yours has no chance of winning with large enterprises in the area? Nothing could be more wrong! This article will show you how to plan an SEO strategy for your local business.