Web Dev Pro – Client Scraper

Web Dev Pro – Client Scraper

Before you start using our Client Scraper you will need Google Maps API key.  In case you don’t know how to generate your own API key watch this video:

https://console.cloud.google.com/getting-started – API
https://developers.google.com/places/supported_types#table1 – Google Places Types

ENABLE:

  • Places API
  • Geocoding API – this is new!


Radius is in meters – 50000 is maximum

SCRAPER TESTED: 9/11/2021

FAQ

Yes, it is possible to scrape in any other country. The process is the same as for the USA and I do recommend scraping per cities, not the whole country. It’s more narrow and you will get the better results. In the input place, you can type let’s say Berlin, London, or Moscow. Whatever you like and need.

In that case, you can type the country name too. This is the example I used to show to the customer how it works:

  • Sydney, Australia
  • Sydney, Nova Scotia, Canada


And you will get the results for Sydney Australia and Sydney Canada.

Yes of course, if you are offering SEO services you may use Client Scraper to find your potential clients on Google.

By default, the Places API sorts results by prominence within the supplied radius. A Nearby Search request can return up to 60 results, split across three pages. If a place ranks 22nd in prominence, it will appear on the second page of results which you can access through paging. If a place ranks greater than 60th in prominence it will not be included in the search result, even if it is closer to the center of your search.” – Google FAQ

First of all check if you enabled correctly Places API and Geocoding API. If that’s okay, check the billing settings and see if you have a problem there. 

Leverage Browser Caching

  ExpiresActive On

  # Images
  ExpiresByType image/jpeg "access plus 1 year"
  ExpiresByType image/gif "access plus 1 year"
  ExpiresByType image/png "access plus 1 year"
  ExpiresByType image/webp "access plus 1 year"
  ExpiresByType image/svg+xml "access plus 1 year"
  ExpiresByType image/x-icon "access plus 1 year"

  # Video
  ExpiresByType video/webm "access plus 1 year"
  ExpiresByType video/mp4 "access plus 1 year"
  ExpiresByType video/mpeg "access plus 1 year"

  # Fonts
  ExpiresByType font/ttf "access plus 1 year"
  ExpiresByType font/otf "access plus 1 year"
  ExpiresByType font/woff "access plus 1 year"
  ExpiresByType font/woff2 "access plus 1 year"
  ExpiresByType application/font-woff "access plus 1 year"

  # CSS, JavaScript
  ExpiresByType text/css "access plus 1 month"
  ExpiresByType text/javascript "access plus 1 month"
  ExpiresByType application/javascript "access plus 1 month"

  # Others
  ExpiresByType application/pdf "access plus 1 month"
  ExpiresByType image/vnd.microsoft.icon "access plus 1 year"