Job Title: Web Scraping & Integration Developer with Site Monitoring and Discord Webhooks Experience

Please login or register as jobseeker to apply for this job.

TYPE OF WORK

Any

SALARY

10/hr

HOURS PER WEEK

30

DATE POSTED

Feb 3, 2025

JOB OVERVIEW

Job Description: We are seeking a skilled developer based in the Philippines to build and maintain a comprehensive data extraction and monitoring system for our sourcing operations. The ideal candidate will be responsible for extracting data from retailer websites using web scraping, implementing site monitoring for selected retailers (utilizing existing APIs when available), and collaborating closely with our Airtable/Zapier specialist to ensure that all data is organized and seamlessly integrated into our sourcing Airtable. Additionally, you will be responsible for setting up and managing Discord integrations via webhooks to provide real-time notifications and updates.
Responsibilities: Develop and maintain robust web scraping scripts to extract data (pricing, availability, product details, etc.) from targeted retailer websites; determine when to deploy custom site monitoring solutions versus leveraging existing APIs for data retrieval; work collaboratively with our Airtable/Zapier specialist to map, clean, and integrate data into our sourcing system; configure Discord webhooks for real-time alerts and notifications; implement error handling, scheduling, and ensure compliance with legal and ethical guidelines for web scraping.
Required Skills & Qualifications: Proven experience in web scraping using Python (BeautifulSoup, Scrapy, Selenium) or Node.js (Puppeteer, Cheerio); strong knowledge of RESTful APIs and experience integrating data from both custom scrapers and existing API endpoints; experience in setting up site monitoring tools for detecting web content changes; familiarity with Airtable and Zapier automation workflows; hands-on experience with Discord webhook integrations; strong problem-solving skills and ability to write clean, maintainable code; excellent communication skills and ability to work both independently and collaboratively.
Preferred Qualifications: Portfolio or case studies demonstrating previous projects involving web scraping, data integration, and real-time monitoring; experience with scheduling and error handling in automated workflows; familiarity with remote team collaboration and working with international clients.
How to Apply: Please submit your proposal with a brief overview of your approach to building the described system, examples of similar projects you have completed (portfolio, GitHub, etc.), your estimated timeline and expected hourly rate, and any initial thoughts on integrating site monitoring, API usage, and Discord notifications.
If you read through this, tell us about why you are a qualified candidate in one sentence.

SKILL REQUIREMENT
VIEW OTHER JOB POSTS FROM:
SHARE THIS POST
facebook linkedin