Web Developer - Web Scraping and WordPress Integration Specialist
We are seeking an experienced web developer to create and maintain an automated system for scraping car listings from a third-party website and importing them into our WordPress-based automotive marketplace.
## Key Responsibilities:
- Develop a robust web scraping script to extract car listing data from a specified automotive website - Create an automated process to run the scraping script nightly - Implement logic to identify and remove duplicate listings - Build a WordPress integration to automatically import scraped data into our website - Ensure the entire process runs seamlessly without manual intervention
## Required Skills and Experience:
- Extensive experience with web scraping techniques and tools (e.g., Python with BeautifulSoup or Scrapy) - Strong knowledge of WordPress development, including custom post types and the WordPress REST API - Proficiency in PHP and JavaScript - Familiarity with task scheduling in Linux environments (e.g., cron jobs) - Experience with database management, particularly MySQL - Solid understanding of HTML and CSS for parsing web content - Knowledge of ethical web scraping practices and robots.txt protocols
The ideal candidate will be able to create a seamless, automated workflow that reliably updates our WordPress site with fresh, de-duplicated car listings on a nightly basis. This role requires a blend of technical expertise in web scraping, WordPress development, and system automation.
