We seek an experienced developer to create a daily/on-demand web scraper for a car listing website and automate data import into a WordPress site. This is a long-term project with potential for permanent collaboration.
---
Key Responsibilities
1. Web Scraping
- Build a robust scraper to extract:
- Listing Data:
- Make
- Model
- Mileage
- Colour
- Specification (e.g., engine type, transmission, fuel type)
- Registration year
- Price
- Location (city/town)
- Seller type (private/dealer)
- Contact details (if available)
- Vehicle condition (new/used)
- Features (e.g., navigation system, heated seats, parking sensors)
- Images: High-resolution photos of the vehicle(s)
- Implement daily/on-demand scraping with:
- Duplicate detection
- Removal of orphaned listings (if source listing is deleted)
2. WordPress Integration
- Automatically import scraped data into WordPress:
- Assign listings to user/dealer accounts (1:many relationships)
- Handle user roles (standard users vs. multi-listing dealers)
- Ensure seamless synchronization between source and target sites
3. Maintenance & Optimization
- Address anti-scraping measures (e.g., CAPTCHA, IP rotation)
- Optimize performance for large datasets
---
Requirements
- Expertise in:
- Web scraping (Python/Scrapy, BeautifulSoup, or similar)
- WordPress development (custom plugins, REST API, user role management)
- Database integration (MySQL)
- **Proven experience** with:
- Handling dynamic/content-heavy websites (e.g., pagination, AJAX)
- Automated data synchronization
- Familiarity with version control (Git)
---
- **Include in your proposal:
1. Examples of past scraping + WordPress projects
2. Brief outline of your approach for this project
3. Reference **CS26MIL** *(applications without this will be rejected)
---
Why Join Us?
- Long-term collaboration with a growing UK tech company
- Remote work flexibility (team spans 5 locations) |
