We have a real-time ETL pipeline for **Claude Code conversations** that:
* **Extracts** log data in real time * **Transforms** it into structured events (timestamps, session metadata, tagging) * **Loads** it into **QuestDB** for analytics and monitoring
The current pipeline works but needs an expert to bring **data engineering best practices** — ensuring **reliability, observability, correctness, and performance** for production use.
Install the **AI Agent Host** along with the provided scripts and **Claude Code** under your own subscription. After reviewing the system and checking existing issues, send us a **detailed milestone budget** based on your findings.
* **Python 3** with ETL/data engineering expertise * Experience with **real-time streaming systems** (QuestDB, Kafka, Pulsar, etc.) * Familiarity with **ILP ingestion**, **batching**, **retries**, **data contracts** * Knowledge of **logging, monitoring, and delivery guarantees** * Basic Docker knowledge for local & production environments
---
## **Budget & Timeline**
* **Milestone 1 (Debugging):** * **Milestone 2 (Enterprise Upgrade):** * Budget: **Open to proposals after reviewing the repository**
---
## **How to Apply**
Please include:
1. Real-time ETL/data pipeline projects you’ve built or hardened 2. Your approach for ensuring **data quality, ordering, and reliability** 3. Estimated **timeline & cost** per milestone after installing and reviewing the repository.
