I am seeking an experienced developer to help automate data collection for my car rental business. The project involves web scraping used car valuations, auction results, and competitor rental pricing, then integrating the data into an Excel dashboard.
Scope of Work: 1. Web Scraping Data Sources: - Used car valuations (Auto Trader, BCA, Manheim, CAP HPI, etc.). - Auction prices and historical trends. - Competitor rental pricing (Enterprise, Hertz, Sixt, etc.). 2. Automation & Data Integration: - Extract and clean data from dynamic websites (some may require Selenium for JavaScript-heavy pages). - Store and update scraped data in an Excel-based dashboard (Power Query, VBA, or Python integration). - Schedule automatic updates (daily/weekly). 3. Optimized Data Storage & Reporting: - Ensure data is structured for easy analysis (e.g., vehicle model, price trends, best resale timing). - Provide recommendations for API integration if relevant.
Requirements: Proven experience in web scraping (BeautifulSoup, Scrapy, Selenium, or similar tools). Strong Excel automation skills (Power Query, VBA, Python-Excel integration). Experience scraping dynamic websites that require interaction (e.g., form inputs, AJAX content loading). Ability to ensure IP rotation and anti-blocking measures where needed.
Bonus Skills (Preferred but not required): API integration experience (CAP HPI, telematics providers). Previous work in automotive data or pricing analytics.
Budget & Timeline: Open to proposals, but ideally completed within 2-4 weeks. Payment structure: Milestone-based (initial scraping setup, integration into Excel, final testing).
If you have relevant experience, please share past projects or examples of similar work. Looking forward to working with the right developer!
