Data and Analytics Technologist

Role overview

What you will do

• Build and maintain scalable data pipelines and ETL/ELT processes integrating applications, APIs, files, databases, and cloud services for batch and real-time processing.
• Develop data products, transformations, and enrichment processes for self-service analytics and reporting.
• Develop and maintain the enterprise data lakehouse using Microsoft Fabric, Databricks, Azure Data Factory, and Azure Data Lake Storage.
• Build and optimize warehouse, lakehouse, and semantic model solutions.
• Implement data quality controls, validation, and monitoring; investigate and resolve root causes of issues.
• Apply data governance standards for metadata, lineage, classification, retention, security, privacy, and compliance.
• Partner with analytics and business teams to design reporting, dashboard, and advanced analytics datasets and models.
• Monitor pipelines and platform services, troubleshoot incidents, and provide operational support.
• Improve automation, reliability, maintainability, and cost efficiency; maintain documentation, procedures, and engineering standards.

Qualifications and experience

• Bachelor’s degree in Computer Science, Information Technology, Engineering, Data Analytics, or a related discipline.
• 5+ years of data engineering experience focused on enterprise-scale cloud platforms.
• 2+ years architecting and building production data pipelines in Azure Databricks.
• Hands-on Spark architecture and optimization experience, including executors, partitions, transformations, OPTIMIZE, Z-ORDER, and VACUUM.
• High proficiency with Python (PySpark) and SQL.
• Experience with Azure Data Lake Storage Gen2, Azure Key Vault, Azure Data Factory, Git, and Unity Catalog.
• Scala or Java experience is an asset.

Benefits

• Competitive compensation, flexible benefits, tuition assistance, training and mentorship, and charitable donation matching.

About ATCO