Web Dev Pro – Client Scraper
Web Dev Pro – Client Scraper
Before you start using our Client Scraper you will need Google Maps API key. In case you don’t know how to generate your own API key watch this video:
https://console.cloud.google.com/getting-started – API
https://developers.google.com/places/supported_types#table1 – Google Places Types
ENABLE:
- Places API
- Geocoding API – this is new!
Radius is in meters – 50000 is maximum
SCRAPER TESTED: 9/11/2021
FAQ
Yes, it is possible to scrape in any other country. The process is the same as for the USA and I do recommend scraping per cities, not the whole country. It’s more narrow and you will get the better results. In the input place, you can type let’s say Berlin, London, or Moscow. Whatever you like and need.
In that case, you can type the country name too. This is the example I used to show to the customer how it works:
- Sydney, Australia
- Sydney, Nova Scotia, Canada
And you will get the results for Sydney Australia and Sydney Canada.
Yes of course, if you are offering SEO services you may use Client Scraper to find your potential clients on Google.
“By default, the Places API sorts results by prominence within the supplied radius. A Nearby Search request can return up to 60 results, split across three pages. If a place ranks 22nd in prominence, it will appear on the second page of results which you can access through paging. If a place ranks greater than 60th in prominence it will not be included in the search result, even if it is closer to the center of your search.” – Google FAQ
First of all check if you enabled correctly Places API and Geocoding API. If that’s okay, check the billing settings and see if you have a problem there.
Leverage Browser Caching
ExpiresActive On # Images ExpiresByType image/jpeg "access plus 1 year" ExpiresByType image/gif "access plus 1 year" ExpiresByType image/png "access plus 1 year" ExpiresByType image/webp "access plus 1 year" ExpiresByType image/svg+xml "access plus 1 year" ExpiresByType image/x-icon "access plus 1 year" # Video ExpiresByType video/webm "access plus 1 year" ExpiresByType video/mp4 "access plus 1 year" ExpiresByType video/mpeg "access plus 1 year" # Fonts ExpiresByType font/ttf "access plus 1 year" ExpiresByType font/otf "access plus 1 year" ExpiresByType font/woff "access plus 1 year" ExpiresByType font/woff2 "access plus 1 year" ExpiresByType application/font-woff "access plus 1 year" # CSS, JavaScript ExpiresByType text/css "access plus 1 month" ExpiresByType text/javascript "access plus 1 month" ExpiresByType application/javascript "access plus 1 month" # Others ExpiresByType application/pdf "access plus 1 month" ExpiresByType image/vnd.microsoft.icon "access plus 1 year"