Web Scraping Databases with Mechanical Soup and SQlite

Hi Everyone! In this step by step tutorial, we will extract a huge table of data from the internet and store it inside an SQLite database! To keep things simple I've chosen a Wikipedia table, but I highly encourage you to apply the same principles on data that updates a bit more frequently (for example weather forecasts) 😃 If you're curious about my IDE - I'm using Wayscript which is now available for the wide public! you no longer need an invitation, you can simply sign up with the following link: https://app.wayscript.com ⭐clone complete tutorial code⭐ https://app.wayscript.com/lairs/517c9... ⏰ TIMESTAMPS ⏰ *************************************** 00:00 - intro 00:34 - imports and installs 01:42 - web scraping with mechanical soup 02:20 - select HTML table elements 03:47 - extract element attributes 06:11 - find the index value of a list item 07:13 - extract multiple columns of table data 09:44 - organize extracted columns 12:44 - enumerate function 14:02 - dictionary to data frame 14:53 - create SQLite database 15:36 - create SQLite table 16:35 - insert Pandas data frame into SQlite table 17:26 - save data permanently inside database file 18:49 - thanks for watching! 💻 CODE AND IMPORTANT LINKS 💻 *************************************** ⭐ URL used in the tutorial: https://en.wikipedia.org/wiki/Compari... ⭐ complete code repository on Github: https://github.com/MariyaSha/Webscrap... ⭐install SQLite on Linux: sudo apt install sqlite3 ⭐install SQLite on Windows: Download the Precompiled Binaries for Windows zip file from SQLite docs: https://www.sqlite.org/download.html ⭐install SQLite on MAC or Anaconda: no need to install - you already have it! 😁 ⭐ code used in the tutorial: column_names = ["Founder", "Maintainer", "Initial_Release_Year", "Current_Stable_Version", "Security_Updates", "Release_Date", "System_Distribution_Commitment", "Forked_From", "Target_Audience", "Cost", "Status"] 📽️ RELATED TUTORIALS📽️ *************************************** 🌞 Much Better HTML table Web Scraping with Pandas:    • Much Better Web Scraping with Pandas - Aut...   🌞 SQLite Databases for Beginners:    • SQLite Backend for Beginners - Create Quic...   🌞 Web Scraping Images with Mechanical Soup:    • Better Web Scraping with Mechanical Soup -...   🌞 Web Scraping Text with Beautiful Soup:    • Web Scraping with Beautiful Soup - Make Da...