Logo

dev-resources.site

for different kinds of informations.

Scrape Data from Shopee

Published at
12/30/2024
Categories
brightdatachallenge
devchallenge
webdev
api
Author
bach_lee_89
Author
11 person written this
bach_lee_89
open
Scrape Data from Shopee

This is a submission for the Bright Data Web Scraping Challenge: Scrape Data from Complex, Interactive Websites

What I Built

My idea is to create a small project to help people selling on the Shopee e-commerce platform, especially those who have limited time to check products and messages regularly. This tool will allow them to automatically push their products to increase visibility on Shopee’s search page instead of doing it manually. It will also automatically check for unanswered messages after 5 minutes, enhancing user experience and the shop's credibility.

Additionally, I plan to include some advanced features:

Automatically push reminder messages to a Telegram group and suggest AI-generated replies for customer inquiries.
Automatically send notifications about new orders to a Telegram group.
Automatically optimize keywords for SEO to rank higher on Shopee’s search results.
And much more!

Demo

Github Demo Link
Here are some screenshots:
Image description

Image description

Image description

How I Used Bright Data

I have used selenium.webdriver.chromium.remote_connection with BrightData Scraping Browser running as a service. Currently, I have completed the seller-side features. For the buyer-side processing, I am facing some issues with antibot mechanisms and captchas, and I am investigating solutions to resolve these challenges.
And unfortunately, I have very little time to implement this idea as I joined late and only received the credit from Noah Kalson two days ago.

Does my submission qualify for additional prompts?

Yes, my submission qualifies for additional prompts. Here's why:
Innovation: The project introduces an AI-assisted tool to optimize Shopee sellers' daily operations, such as automatic product pushing, improving visibility, and enhancing user response with AI.
Advanced Features: It includes features like integrating Telegram reminders, suggesting AI-powered replies, and SEO keyword optimization for Shopee search ranking.
Social Impact: By helping small businesses on Shopee, this project has the potential to improve sales and operational efficiency.

Thank you

I would like to sincerely thank the BrightData team for organizing this exciting competition. This challenge not only provides an opportunity to showcase our creativity and technical skills but also motivates developers to tackle real-world problems in innovative ways.

The support and resources from your team have been incredibly valuable, and I truly appreciate the effort you’ve put into making this competition a great experience for all participants.

Thank you for inspiring us to push the boundaries of what’s possible with web scraping technology!

brightdatachallenge Article's
30 articles in total
Favicon
Scrape Data from Shopee
Favicon
Estile: AI-Driven Clothing Recommendations Enhanced by Bright Data Scraping
Favicon
Detoxify: Make your YouTube Feed 100x better
Favicon
Scrape Phone Plans
Favicon
Fascinating and brilliantly done!
Favicon
The Tech News Scraper
Favicon
Scrape Data from Complex, Interactive Websites
Favicon
MyGithub scrap datas from Your Github account with a new format
Favicon
Web Scraping Tutorial: Extract Data from Websites Using Python
Favicon
[Boost]
Favicon
Trading Signal from Sentiment Analysis using Bright Data API
Favicon
Congrats to the Bright Data Web Scraping Challenge Winners!
Favicon
WebCrawlAI: An AI-Powered Web Scraper Built Using Bright Data
Favicon
Compare prices across AliExpress, eBay, & Amazon.
Favicon
Track Amazon Prices in Real-Time and Solve CAPTCHAs Seamlessly with Bright Data
Favicon
Gigs AI: A Conversational Chatbot Powered by Aggregated Data from Freelancer and Upwork
Favicon
SEO Performance Analysis Tool: AI-Powered SEO Insights with Complex Web Scraping
Favicon
Reddit Recap: Audio summaries of subreddits powered by BrightData
Favicon
AI-pipe: Pipeline for generating/storing embeddings from AI models to DB with data scraped from sites using custom scripts
Favicon
JobScout.ai: Smarter Job Search with AI and Bright Data
Favicon
State of the Art Automated Web Scraper using Bright Data
Favicon
Trend Chat
Favicon
PriceTracker Pro: Multi-E-Commerce Price Tracking with Bright Data's Web Scrapers API 🚀
Favicon
Web Scraper API to Solve Business Problems
Favicon
Tech Trend Tracker: AI-Powered News Analysis for Technology Insights
Favicon
Yoda’s EU Grant Finder for Solopreneurs: Powered by Bright Data
Favicon
Scrape Unscrapeable Amazon Dataset with BrightData, React.js and Node.js
Favicon
Scrapping Yahoo Finance with AI Analysis
Favicon
Make Cursor Composer Smarter with Bright Web Scraping Capabilities
Favicon
Bright data Challenge - Industry AI Watchdog

Featured ones: