Senior Data Engineer

Delivery Management & Prioritization

Design, build, and maintain scalable ETL/ELT pipelines using Azure Data Factory, Databricks, Delta Lake, and related Azure services.

Architect data models and storage patterns optimized for analytics, reporting, and machine learning workloads.

Establish and enforce engineering standards for code quality, version control, CI/CD, testing, and documentation.

Optimize data pipelines for performance, reliability, and cost efficiency across cloud environments.

Platform Partnership & Operational Excellence

Collaborate with cloud platform, security, and infrastructure teams to ensure data solutions meet enterprise standards for security, compliance, and reliability.

Implement monitoring, alerting, and automated recovery processes for critical data pipelines and datasets

Partner with analytics and business teams to understand requirements and translate them into scalable technical solutions.

Provide technical leadership, code reviews, and mentorship to data engineers and contractors.

Education

Bachelor’s degree in Computer Science, Information Systems, Engineering, Data Science, or related field (or equivalent practical experience).

Certification / License

Azure Data Engineer or equivalent cloud certification preferred.

Work Experience

7+ years of experience in data engineering, cloud data platforms, or large‐scale data architecture.

Hands‐on experience designing and delivering data pipelines using Azure and Databricks.

Strong experience with SQL, Python, Spark, Delta Lake, and distributed data processing.

Experience supporting production data systems, including monitoring, troubleshooting, and performance tuning.

Knowledge / Skills / Abilities

Deep understanding of data modeling, ETL/ELT patterns, orchestration, and data quality frameworks.

Strong knowledge of Azure services (ADF, ADLS, Databricks, Azure SQL, Synapse, Key Vault, DevOps).

Ability to translate business requirements into scalable technical designs

Excellent written and verbal communication skills, including the ability to communicate complex topics to non-technical audiences.

Master’s degree in Data Engineering, Computer Science, Analytics, or a related field.

Preferred certifications: Microsoft Certified Azure Data Engineer, Databricks Data Engineer Professional, Agile project management.

Experience leading technical design for large‐scale data engineering initiatives.

Experience implementing Lakehouse architectures and supporting advanced analytics or ML workloads.

Experience with CI/CD pipelines, infrastructure‐as‐code, and DevOps practices.

Vendor and contractor oversight experience.

Strong understanding of data governance, metadata management, and enterprise data cataloging.

Ability to drive adoption of engineering best practices and standardized ways of working across teams.