Verve
Blog
Home > Blog > 2018 > Mar
@

How to Crawl An Entire Industry Faster Than Most Crawl A Single Site

We've previously talked about running Screaming Frog's Crawler on Google's Compute Cloud. Now, I want to share how we took this to the next level - how you can use this to automatically crawl as many websites as you want simultaneously. Running Screaming Frog In the Cloud As a quick reminder, the... More

@

Fixing Google’s Keyword Search Volume Aggregation

If you ask Google Keyword Planner the search volume for 'cheap windows laptop' in the US, it'll tell you that it's 100-1k - thanks for the help Google! If, instead, you turn to the tools providers you'll get answers somewhere in the range of 1.5k (Searchmetrics) to 2.9k (SEOMonitor). Yet, what... More

@

Running Screaming Frog on Google’s Own Servers

Screaming Frog is the industry standard SEO crawler, but it can slow down your computer and monopolise your internet connection. By running it, instead, on Google's Compute Cloud it can run significantly faster and you're free to get on with other jobs whilst it runs. Moreover, if you can runĀ one... More