We are looking for a Data Engineer with Mage experience for a long term project. This is all about creating and maintaining ETL pipelines in Mage and handling data transformation.
We extract job vacancy data from APIs, XML files and CSVs, clean it up and convert it into JSON format that can be imported into our 30+ different job boards.
Background
-We develop recruitment websites/job boards. -One of our clients has 30+ job websites built on our platform. -We also build dashboards for them which display job information related to their industry sector in infographics with basic query functions (date filters, job type filters etc.) -We receive job data from a variety of external sources (3rd party data providers). Generally speaking, the 3rd party providers scrape the data from somewhere and then provide it to us via an API or FTP (csv files). -We have to process this data and post the jobs and data to our client's websites and dashboards each day -The data we receive is often inconsistent and often not provided in a format that is compatible with our system so it needs to be transformed. -Once a data pipeline is up and running, we have to monitor and maintain it - keeping an eye on and resolving any issues that arise. -We currently have 19 active pipelines with more to be built
The Task
-We are website developers, not data engineers. So we need someone to handle the growing number of data feeds and create all the necessary logic to process the data and map it all to the website fields and to maintain and monitor it constantly for changes and issues. -The task is to convert the incoming data into the format we need so that it exactly matches the fields in the website databases and can simply be imported with no manipulation required. In short, you need to send us valid job data to be seamlessly imported into the client's websites.
We hired someone with specialist knowledge/experience in this area to take over the data processing entirely. This person implemented Mage pipelines and new data transformation processes for us over the last 7 months and things are running quite smoothly most of the time.
Unfortunately, this person now has a permanent job so we need a new expert to take over both the management of the existing pipelines and the creation of new ones.
Premium Logo Design for Inspection Company Category: Adobe Illustrator, Photoshop, Branding, Creative Design, Graphic Design, Icon Design, Illustration, Logo Design, Vector Design Budget: $30 - $250 USD
17 Mar 2026 23:03 GMT
Manga Anime Mixed Media Adaptation -- 2 Category: 2D Animation, 2D Animation Explainer Video, 2D Drawing, 2D Game Art, 3D Animation, 3D Modelling, After Effects, Animation Budget: $750 - $1500 USD
17 Mar 2026 23:03 GMT
Space Explainer YouTube Producer Category: Adobe Premiere Pro, After Effects, Animation, Commercials, DaVinci Resolve, Final Cut Pro, Motion Graphics, Video Editing, Video Production, Voice Over Budget: £10 - £20 GBP
17 Mar 2026 23:02 GMT
G-code for Windows and doors cnc machine 5$ per design Category: CAD / CAM, CNC, CNC Machine Retrofitting, CNC Programming, Computer Aided Manufacturing, G Code, Manufacturing Design, Manufacturing Engineering, Solidworks Budget: $10 - $30 USD
17 Mar 2026 23:02 GMT
CNC Ready 3D Modeling from PDF Category: 3D CAD, 3D Design, 3D Modelling, AutoCAD, Autodesk Inventor, CAD / CAM, CNC, Solidworks Budget: $10 - $30 USD
17 Mar 2026 22:59 GMT
SEO Optimized HTML Site Conversion Category: Accessibility, CSS, CSS3, HTML, HTML5, JavaScript, SEO, Web Development, Web Design, Website Optimization Budget: $250 - $750 USD
17 Mar 2026 22:58 GMT
Elegant Fashion Landing Page Build Category: CSS, CSS3, HTML, JavaScript, UI / User Interface, UX / User Experience, Web Design Budget: $30 - $250 USD
17 Mar 2026 22:57 GMT
4 address verification in tripoli libiya Category: Customer Service, Data Collection, Geolocation, Logistics, Photo Editing, Photo Restoration, Photo Retouching, Photography, Report Writing, Time Management Budget: $10 - $100 USD
17 Mar 2026 22:56 GMT
Diseñador/Animator 2D en Toon Boom Harmony -- 2 Category: 2D Animation, 2D Animation Explainer Video, 3D Animation, 3D Modelling, Animation, Caricature & Cartoons, Toon Boom Budget: $30 - $250 USD
WhatsApp AI Chatbot Integration Support Category: AI Chatbot Development, AI Development, API Development, Data Analytics, JavaScript, PHP, Software Architecture, WordPress Budget: £20 - £250 GBP
17 Mar 2026 22:51 GMT
Launch Digital Products Store Category: ECommerce, HTML, Payment Processing, PHP, SEO, Shopify, Web Design, WooCommerce Budget: $15 - $25 USD
17 Mar 2026 22:51 GMT
Medical Document Formatting for VA Claim Category: Content Writing, Editing, Medical, Medical Writing, Proofreading, Report Writing, Technical Writing, Typography Budget: $10 - $30 USD
