Skip to content

Web scraping on Shopee, Twitter, Tokopedia, Bukalapak, Kompas.com, Tiket.com, Yell.com (Traveloka look like) using API and BeautifulSoup to get all data either text, values, even images. We also automate to send the data to WhatsApp using pywhatkit. Also there is image scraper for computer vision dataset.

Notifications You must be signed in to change notification settings

adeirman46/Web_Scraping_for_Data_Science

Repository files navigation

Web Scraping for Data Science

Web scraping on Shopee, Twitter, Tokopedia, Bukalapak, Kompas.com, Tiket.com, Yell.com (Traveloka look like) using API and BeautifulSoup to get all data either text, values, even images. We also automate to send the data to WhatsApp using pywhatkit.

New Feature

Can scrape all images you needed for computer vision purposes in single-click

Installation

conda create -n image_scraper_env python=3.9
conda activate image_scraper_env
pip install -r requirements.txt

How to Use

python image_scraper_bing.py
OR python image_scraper_fast.py

Script

Result Image

About

Web scraping on Shopee, Twitter, Tokopedia, Bukalapak, Kompas.com, Tiket.com, Yell.com (Traveloka look like) using API and BeautifulSoup to get all data either text, values, even images. We also automate to send the data to WhatsApp using pywhatkit. Also there is image scraper for computer vision dataset.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published
  NODES
COMMUNITY 1
Note 1
Project 3
twitter 4
USERS 1