Prerequisites: Python Requests, Implementing Web Scraping in Python with BeautifulSoup Web scraping is a technique to fetch data from websites. While surfing on the web, many websites don’t allow the user to save data for personal use. One way is to manually copy-paste the data, which both tedious and time-consuming. Web Scraping is the automation of the data extraction process from websites. In this article, we will scrape the weather update from google’s search result. Modules Required
- BeautifulSoup: This module is used for iterating, searching, and modifying the parse tree over the HTML or XML parser. To download it type the below command in the terminal.
pip install beautifulsoup4
- Requests: Requests library is one of the integral part of Python for making HTTP requests to a specified URL. To download it type the below command in the terminal.
pip install requests
Below is the implementation.
Python3
import requestsfrom bs4 import BeautifulSoup # Enter the City Namecity = input("Enter the City Name: ")search = "Weather in {}".format(city)# URL url = f"https://www.google.com / search?&q ={search}" # Sending HTTP requestreq = requests.get(url)# Pulling HTTP data from internetsor = BeautifulSoup(req.text, "html.parser") # Finding temperature in Celsiustemp = sor.find("div", class_='BNeawe').textprint(temp) |
Output : 
