One of the more complicated tasks within web scraping and user testing automation is the use of rotating proxies. Within this article, I will explain what proxies are, and how you can set rotating proxies using Selenium with Python. Selenium The Selenium web driver allows you to automate QA processes, as well as create scrapers. […]
If you are familiar with BigQuery you already know that it is a really powerful tool for data analysis. However, you might find yourself writing multiple versions of the same queries and having to save them in BigQuery. With Google Colaboratory you can still use your familiar queries written in SQL, while adding a more
By default, Selenium creates a new Chrome profile each time you load the Selenium web driver. Technically, this means that all persistent data such as cookies, cache, and internal storage are cleaned. Practically, this means a website will consider you a new user each time you visit a page. This can be very annoying if
In this article, you will learn how to create a simple web scraper using Selenium with Python. Web scraping is the extraction of data from a website. Many different tools exist with specifically that purpose, with the most popular one being Scrapy. However, for this article I will use Selenium, as I think it is
Before you can run your scripts that include Selenium you have to set up a web driver. You will need to download the correct drivers, and initiate the driver in your code. When I first started working with Selenium automation I was annoyed by the setup of the Selenium Web Driver. Therefore, I have built
Are you trying to understand How to use implicit wait in Selenium web driver? In this article, I will dive deeper into how you can make sure you wait for certain elements when you are running a Selenium web driver. Whether you are a complete newcomer to the world of Python, or even if you
How to use implicit/explicit wait in Selenium web driver Read More »
Are you trying to understand how to send HTTP requests using Google App Script? In this article I will dive deeper into how you can use one of the most powerful features of Google Sheet, the Google App Script editor. Whether you are a complete newcomer to the world of coding, or even if you
How to send HTTP requests using Google App Script Read More »