Intermediate Data Engineer
Lead the evolution of data infrastructure, mentor talent, and drive innovation in a role where strategy meets engineering excellence.
We are seeking a motivated and detail-oriented Intermediate Data Engineer to join our team. The successful candidate will be focused on optimizing and managing our data pipeline architecture, data warehouse, and ensuring compliance with data governance, security and privacy standards. This role requires a proactive individual who can collaborate effectively with stakeholders and developers to maintain robust data ingestion and extraction processes.
Key Responsibilities
Data Pipelines:
Maintain, improve, and optimise the data pipeline architecture, related ETL/ELT tools and integrations
Follow and improve the process for creating pipelines, troubleshooting, integrating monitoring & alerting and documentation
Work and collaborate with stakeholders and developers to ensure data ingestion and extraction processes are in place and in good order
Data Warehouse:
Manage the data warehouse ensuring data and access is available to the correct users and appropriate systems are integrated
Maintain and assemble large, complex data sets within the data warehouse that meet functional & non-functional business requirements
Recommend ways to improve data reliability, efficiency and quality
Define, document and implement data retention and disaster recovery policies
Data Governance, Security, and Privacy Compliance:
Ensure that all activities are conducted in accordance with applicable legislation, rules, and standards, including relevant Acts, regulations, and industry body requirements.
Ensure appropriate NZME stakeholders are looped in as required before the adoption of any new technologies or processes.
Skills & Qualifications:
Minimum 3 years experience in a Data Engineer role
Solid commercial ETL experience, ideally with Airflow and / or NiFi
Experience in Public Cloud, ideally GCP or AWS
Relevant certifications in Data Engineering or Big Data
Knowledge of data warehousing & data modelling concepts
Scripting experience in Python, MySQL, PowerShell, Bash
Experience in versioning with Git
Comfortable with operating Linux OS
All applicants will be asked about their working rights in New Zealand (e.g., Citizen, Resident, Visa, No Visa).
- Team
- Digital
- Locations
- Auckland Central
About NZME
For more information about NZME and corporate policies, click here.
© Copyright NZME. 2024
Already working at NZME?
Let’s recruit together and find your next colleague.