We seek an experienced developer to create a daily/on-demand web scraper for a car listing website and automate data import into a WordPress site. This is a long-term project with potential for permanent collaboration.
---
Key Responsibilities 1. Web Scraping - Build a robust scraper to extract: - Listing Data: - Make - Model - Mileage - Colour - Specification (e.g., engine type, transmission, fuel type) - Registration year - Price - Location (city/town) - Seller type (private/dealer) - Contact details (if available) - Vehicle condition (new/used) - Features (e.g., navigation system, heated seats, parking sensors) - Images: High-resolution photos of the vehicle(s)
- Implement daily/on-demand scraping with: - Duplicate detection - Removal of orphaned listings (if source listing is deleted)
2. WordPress Integration - Automatically import scraped data into WordPress: - Assign listings to user/dealer accounts (1:many relationships) - Handle user roles (standard users vs. multi-listing dealers) - Ensure seamless synchronization between source and target sites
3. Maintenance & Optimization - Address anti-scraping measures (e.g., CAPTCHA, IP rotation) - Optimize performance for large datasets
---
Requirements - Expertise in: - Web scraping (Python/Scrapy, BeautifulSoup, or similar) - WordPress development (custom plugins, REST API, user role management) - Database integration (MySQL) - **Proven experience** with: - Handling dynamic/content-heavy websites (e.g., pagination, AJAX) - Automated data synchronization - Familiarity with version control (Git)
---
- **Include in your proposal: 1. Examples of past scraping + WordPress projects 2. Brief outline of your approach for this project 3. Reference **CS26MIL** *(applications without this will be rejected)
---
Why Join Us? - Long-term collaboration with a growing UK tech company - Remote work flexibility (team spans 5 locations)
