Data Engineer
Leadersit Services Pty Ltd
SYDNEY 2000 - NSW
•6 hours ago
•No application
About
We are seeking a Data Engineer to design, optimise, and maintain enterprise-grade data pipelines, automation frameworks, and governance processes. The successful candidate will play a key role in enabling marketing data-driven customer engagement by building scalable data solutions, improving data quality, and ensuring compliance across multiple brands. This role requires strong technical expertise, business acumen, and the ability to collaborate with both technical and non-technical stakeholders.
Key Responsibilities:
Marketing Data Engineering & Customer Engagement
Embed within marketing and business teams to align data engineering solutions with campaign and personalisation strategies.
Establish and promote engineering practices, documentation standards, and governance frameworks to drive consistency and knowledge sharing.
Migrate manual marketing processes into automated workflows (e.g., Alteryx Server), reducing manual effort and improving reliability.
Design and implement job control and error management frameworks to ensure consistent, auditable, and recoverable data flows.
Optimise ETL and marketing data pipelines, improving execution speed and enabling faster campaign delivery and targeting.
Build and maintain Data Quality Dashboards (Power BI, SQL) to track consent, completeness, and compliance metrics, enhancing stakeholder trust.
Support predictive modelling and segmentation operationalisation to drive personalised customer journeys.
Enterprise Data Warehouse (EDW) & BAU Operations
Monitor and troubleshoot daily ETL/ELT jobs (IBM DataStage, Control-M) to ensure timely and accurate data delivery.
Provide BAU support across platforms (DTSVCWarehouse, Alteryx, Collibra), maintaining enterprise data integrity and compliance with downstream requirements.
Cloud Platforms, Infrastructure & Governance
Deploy and maintain data services (e.g., Pentaho on AWS EC2), ensuring performance, security, and scalability.
Monitor and maintain platform health (Icinga), manage incidents (Sev1/Sev2), and perform system upgrades to ensure uptime and stability.
Support cloud transformation initiatives with hands-on experience in AWS and developing expertise in GCP.
Lead Information Security Management System (ISMS) processes, preparing audit documentation, supplier reports, and ensuring ISO compliance.
Technical Skills
Programming & Scripting: SQL (SQL Server, PostgreSQL, MySQL), Python (Pandas, NumPy), Bash
Data Engineering & Orchestration: BigQuery, dbt, Databricks, Pentaho, Alteryx, Git, CI/CD (basic), Airflow (conceptual)
Analytics & Visualisation: Power BI, Tableau, Star Schema, Snowflake Schema
Platforms & Tools: Adobe Experience Platform (AEP), CDPs, Jira, Ansible, Ubuntu Linux, VMware, Control-M, Collibra
Cloud Expertise: AWS (Certified Cloud Practitioner), exposure to GCP