Senior Data Engineer

Role Summary

Responsibilities

• Develop and optimize enterprise data pipelines and solutions using Microsoft Fabric, Azure, SQL, Python, Spark, and related technologies.
• Build ingestion, transformation, and processing frameworks for batch and near-real-time workloads.
• Maintain Bronze, Silver, and Gold data layers and data modeling patterns including Data Vault 2.0 and dimensional models.
• Develop dbt models, reusable transformation frameworks, documentation, automated tests, and standards.
• Implement CI/CD, source control, automated testing, deployment pipelines, and DevOps practices.
• Build quality controls, reconciliation, monitoring, alerting, lineage, and observability.
• Troubleshoot production failures, performance issues, data defects, and incidents; conduct root-cause analysis and implement fixes.
• Optimize SQL, Spark, storage, and compute for performance, reliability, scalability, and cost efficiency.
• Implement security, access controls, data protection, and governance requirements.
• Support Power BI semantic models, reporting solutions, legacy workload migration, and AI-ready data products.

Requirements

• Bachelor's degree in Computer Science, Engineering, Math, or a related field.
• 5+ years of data engineering, data warehousing, ETL/ELT, or enterprise analytics platform experience.
• Strong SQL skills and Python or PySpark experience for data engineering workloads.
• Experience with Microsoft Fabric, Azure Data Factory, Azure Data Lake Storage, Synapse, Databricks, or comparable cloud data platforms.
• Understanding of data modeling, dimensional modeling, lakehouse patterns, and enterprise data architecture.
• Experience with data quality, monitoring, observability, automated testing, production support, Git, CI/CD, and DevOps.
• Knowledge of Agile methodologies and ability to communicate solutions across management levels.
• Ability to manage multiple projects, meet deadlines, and work effectively with customers under pressure.

Preferred Skills

• Master's degree in a related field is preferred.
• Experience with Microsoft Fabric, OneLake, Fabric Data Engineering, and Fabric Data Factory is preferred.
• Experience with dbt Core and Data Vault 2.0 is preferred.
• Experience with Microsoft Purview, metadata, lineage, governance, and data catalog capabilities is preferred.
• Exposure to AI/ML, generative AI, Microsoft Copilot, or AI-assisted data engineering is preferred.

Benefits

• Benefits include employee discounts, 401(k) matching, growth opportunities, education assistance, health benefits, parental leave, paid time off, daily pay, and free movies.
• Benefits may vary by career category.