Job Description: We are seeking an experienced freelance developer to scrape data from a car listing website and automatically import this data into a WordPress website. The project involves handling multiple listings from individual users and car dealers, ensuring accurate data extraction and integration into the correct fields on the WordPress site.
Key Responsibilities: Data Scraping:
Extract data from a car listing website, including but not limited to:
Vehicle make
Model
Mileage
Price
Description
Images
Dealer information (if applicable)
This list is not exhaustive; additional relevant details may need to be extracted based on the source website's structure and content.
Handle listings from both individual users and car dealers, who may have multiple listings.
WordPress Integration:
Develop a system to automatically import scraped data into a WordPress website.
Ensure data is correctly mapped to corresponding fields in WordPress, such as custom post types.
Implement a mechanism to handle updates or changes in listings on the source website.
Execution and Scheduling:
Develop the script to be executable on demand via a command-line interface.
Ensure the script can be scheduled to run automatically using tools like cron jobs on Linux systems or similar scheduling tools on other platforms.
Implement logging and error handling to monitor the script's performance and troubleshoot issues.
Technical Requirements:
Proficiency in the latest web scraping technologies, including:
Python with libraries like BeautifulSoup, Scrapy, or Playwright.
Node.js with libraries such as Cheerio, Puppeteer, or Playwright.
Familiarity with JavaScript for handling dynamic content.
Experience with WordPress development, including custom post types and database interactions.
Knowledge of APIs or other integration methods to automate data import.
Familiarity with handling large datasets and optimizing performance.
Availability and Communication: Time Zone and Availability: The successful candidate must be available during UK working hours and occasionally be on call to address urgent issues.
Communication: Must be available for regular voice and video calls to discuss project progress, address questions, and collaborate with our team.
Ideal Candidate: Strong background in web scraping and data integration.
Experience with WordPress development and customization.
Excellent problem-solving skills and attention to detail.
Ability to work independently and manage project timelines effectively.
Strong communication skills for regular progress updates.
Proficiency in the latest web scraping coding languages and tools.
Ongoing Opportunities: This project is the first step in a long-term collaboration. For the right candidate, this freelance engagement will lead to ongoing work and potentially transition into a full-time position. We are looking for someone who can grow with our team and contribute to future projects involving data integration, web scraping, and WordPress development.
Proposal Guidelines: Please provide a detailed proposal outlining your approach to data scraping and WordPress integration.
Include examples of similar projects or relevant experience.
Specify the technologies and tools you plan to use.
Provide a cost estimate and timeline for completion.
Important: To ensure you have read the full job description, please include the reference CLWS25 in your proposal. Generic proposals or those not relevant to the project will be automatically declined.
Why This Project Matters: This project will enhance our ability to provide up-to-date car listings to our users, improving their experience and increasing our competitiveness in the market.
