Web Developer - Web Scraping and WordPress Integration Specialist
We are seeking an experienced web developer to create and maintain an automated system for scraping car listings from a third-party website and importing them into our WordPress-based automotive marketplace.
## Key Responsibilities:
- Develop a robust web scraping script to extract car listing data from a specified automotive website
- Create an automated process to run the scraping script nightly
- Implement logic to identify and remove duplicate listings
- Build a WordPress integration to automatically import scraped data into our website
- Ensure the entire process runs seamlessly without manual intervention
## Required Skills and Experience:
- Extensive experience with web scraping techniques and tools (e.g., Python with BeautifulSoup or Scrapy)
- Strong knowledge of WordPress development, including custom post types and the WordPress REST API
- Proficiency in PHP and JavaScript
- Familiarity with task scheduling in Linux environments (e.g., cron jobs)
- Experience with database management, particularly MySQL
- Solid understanding of HTML and CSS for parsing web content
- Knowledge of ethical web scraping practices and robots.txt protocols
The ideal candidate will be able to create a seamless, automated workflow that reliably updates our WordPress site with fresh, de-duplicated car listings on a nightly basis. This role requires a blend of technical expertise in web scraping, WordPress development, and system automation. |
