web scraping and bot creation
Web scraping is the practice of automatically fetching the content of web pages designed for interaction with human users, parsing them, and extracting some information (possibly navigating links to other pages). It is sometimes necessary if there is no other way to extract the necessary information. Ideally, the application provides a dedicated API for accessing its data programmatically. There are several reasons web scraping should be your last resort:
- It is fragile (the web pages you're scraping might change frequently).
- It might be forbidden (some web apps have policies against scraping).
- It might be slow and expansive (if you need to fetch and wade through a lot of noise).
Anyone who wants to build cool bots capable of automating Facebook , Instagram , or any other website
Static Data Fetching:
Case I : Downloading wikipedia source code
Case II : Downloading images with python requests
Case III : Creating Advance File Downloader
Parsing Data with BeautifulSoup (bs4) :
Case I : Building bot that fetches wikipedia articles
Dynamic Scaping with Selenium:
Storing Stuctured Data :
Final Projects :