Post by muntahaislam222 on Feb 28, 2024 5:00:31 GMT -6
If you have not used Screaming Frog much , you will not have noticed the very interesting functionalities that this tool offers. So that it is not an exaggeratedly long post, we are going to get to the point, listing and explaining how to get a little more out of this magnificent software. 1. Crawl and analyze a site in a test environment If we have a test site, or a pre-production environment where we can check changes before they are online, we can check that website with Screaming Frog. A priori, if it is only a permission per IP, the tool will track normally, as long as you make it work under that IP. Now, these environments, for security reasons, are usually protected with a username and password, so we will only have to do the following: From the Screaming Frog menu, choose “Settings” – “Spider” Click on the “Advanced” tab Check the “request authentication” option And once we have configured the rest of the options for our analysis or crawling, add the url and click "Start" configuracion screaming frog And once Screaming starts to fuel, a window will appear to enter a username and password that will allow us to carry out the tracking. Remember that sometimes these test or pre-production sites are blocked by robots.
txt, so you will probably have to use the "ignore robots.txt" that comes in the "Basic" tab login screaming frog 2. Know the organic traffic that your accessible urls receive We can use a recent Screaming update to know at a glance what organic traffic (or from the channel we want) has to the urls that are potentially crawlable and indexable. We simulate a tracking with the Googlebot user agent and connect to the Google Analytics API so that it gives us the channel traffic data, dates and Europe Mobile Number List metrics that we want: Settings >> User Agent >> Googlebot Regular Configuración >> Spider >> Advanced >> Respect Noindex y Respect Canonical Configuración >> Api Access >> Google Analytics Point 3 requires that we link our Google Analytics account, expressly authorizing Screaming Frog. Once done, when connecting, it gives us the choice of View and then the entire data, metrics and date ranges part. vincular analytics screaming frog The tracking will be performed while making calls to the Analytics API to collect the requested data, combined with the Screaming tracking data.
What do we do with this, you might ask? We have the urls that Google can reach We have optimization elements (tags, internal links...) We have organic traffic data that they receive in a given period And we also have those that have NOT received even a measly visit. Well, several ideas come to mind, since the analysis is only done for blog urls: Those that have had a lot of traffic can give you clues such as topics to write about more frequently. Those that have average traffic, perhaps you can review how to optimize them Those that do not receive any traffic, obviously we must differentiate whether they are content associated with temporality (events or things that have become obsolete). In any case, we have in the right panel, an option called "Overview" and if we get to the Analytics option, my tracking has concluded with 37% of urls without traffic data, so I should start analyzing those urls before than none. ga not matched screaming In line with this, there is also a Report option called GA Not Matched, which offers you the opposite of No GA Data, that is, it gives you a list of urls that Google Analytics does report with traffic, but that the crawler has not been able to reach them.