Recently, I started a side project where I was working with Facebook Lead Generations Ads. My idea was to get a list of names and email addresses that had a specific interest and then send them an automated email. So first I connected my Facebook ads to a free HubSpot account and then I wanted …
Finally, Google has launched an API for its new Google Analytics 4 properties. In this article I will explain to you what you can do with the new Google Analytics Data API (GA4) and how you can use Python to retrieve data. Please check out my other article if you haven’t upgraded to the latest …
Google Analytics Data API (GA4) with Python [Extensive Guide] Read More »
One of the most difficult pages to scrape is the Google Search Result (SERP) pages. I have tried different modules such as Selenium, Requests, and Urllib, but creating a robust Google Search Result scraper is almost impossible. Therefore, I recommend you to use an API, such as Scale SERP. I have used other APIs such …
How to Scrape Google Search Result Page using Python Read More »
If you are using Google Analytics, you might want to retrieve data programmatically. I have used the Google Analytics API to get data from more than 100 properties. Alternatively, you might have a script that gets your data on a repeated basis and sends an email based on this data. Within this article, I will …
How to use the Google Analytics API Reporting with Python Read More »
One of the more complicated tasks within web scraping and user testing automation is the use of rotating proxies. Within this article, I will explain what proxies are, and how you can set rotating proxies using Selenium with Python. Selenium The Selenium web driver allows you to automate QA processes, as well as create scrapers. …
If you are familiar with BigQuery you already know that it is a really powerful tool for data analysis. However, you might find yourself writing multiple versions of the same queries and having to save them in BigQuery. With Google Colaboratory you can still use your familiar queries written in SQL, while adding a more …
By default, Selenium creates a new Chrome profile each time you load the Selenium web driver. Technically, this means that all persistent data such as cookies, cache, and internal storage are cleaned. Practically, this means a website will consider you a new user each time you visit a page. This can be very annoying if …
In this article, you will learn how to create a simple web scraper using Selenium with Python. Web scraping is the extraction of data from a website. Many different tools exist with specifically that purpose, with the most popular one being Scrapy. However, for this article I will use Selenium, as I think it is …
Before you can run your scripts that include Selenium you have to set up a web driver. You will need to download the correct drivers, and initiate the driver in your code. When I first started working with Selenium automation I was annoyed by the setup of the Selenium Web Driver. Therefore, I have built …
Are you trying to understand How to use implicit wait in Selenium web driver? In this article, I will dive deeper into how you can make sure you wait for certain elements when you are running a Selenium web driver. Whether you are a complete newcomer to the world of Python, or even if you …
How to use implicit/explicit wait in Selenium web driver Read More »