Skip to content

MSyedJubair/Weidian-Scraper

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

1 Commit
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Weidian Scraper GUI

A Python GUI application for scraping product information from Weidian product pages and exporting the results to Excel.

Features

  • User-friendly GUI: Enter multiple Weidian product links and start scraping with a single click.
  • Automated scraping: Uses Selenium and undetected-chromedriver to extract product name, price, main image, and color variant details.
  • Excel export: Results are saved to product_variants.xlsx for easy access and analysis.
  • Threaded processing: Responsive interface with loading popup during scraping.

Screenshots

GUI Screenshot GUI Screenshot

Installation

  1. Clone the repository or download the source files.

  2. Install dependencies:

    pip install -r requirements.txt

    Required packages:

    • selenium
    • undetected-chromedriver
    • pandas
    • openpyxl
    • tkinter
    • re
    • selenium_stealth
  3. (Optional) Install customtkinter:

    pip install customtkinter

Usage

  1. Run the GUI:

    python GUI.py
  2. Enter Weidian product links (one per line) in the text box.

  3. Click "Submit" to start scraping.

  4. Wait for processing to complete. A popup will notify you when done.

  5. Find your results in product_variants.xlsx in the project directory.

Project Structure

  • GUI.py — Main GUI application.
  • weidian_Scraper.py — Scraper logic and Excel export.
  • requirements.txt — Python dependencies.

Troubleshooting

  • Make sure Chrome is installed and compatible with the version of undetected-chromedriver.
  • If you encounter errors, check that all dependencies are installed and up to date.

Error Handling

The application includes comprehensive error handling for:

  • Invalid URLs
  • Network issues
  • Missing product information
  • Browser automation failures

About

A Python GUI application for scraping product information from Weidian product pages and exporting the results to Excel.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

 
 
 

Contributors

Languages