Senior Data Engineer (Databricks Focused)

Your opportunity

Data engineering and platform development

• Design, build, and optimize pipelines with Databricks, Delta Lake, and Apache Spark.
• Develop scalable ETL for structured and unstructured data and integrate cloud and on-premises sources using Databricks and Azure Data Lake.
• Automate ingestion, transformation, and validation; monitor and improve pipeline performance and reliability.
• Maintain data quality, security, compliance, and operational excellence.

Client leadership and data application

• Lead client engagements and translate business requirements into scalable data architectures and operational plans.
• Collaborate with cross-functional teams to integrate solutions into production and mentor junior team members.
• Convert business requirements and analytics prototypes into scalable solutions; apply data modeling and transformation for analytics and machine learning.
• Document pipelines and contribute to internal knowledge sharing.

Required qualifications

• Bachelor’s or master’s degree in Computer Science, Data Engineering, Information Systems, or a closely related discipline; foundation in data structures, algorithms, and distributed systems.
• At least 5 years of hands-on data engineering experience, including 3 years with Databricks, Apache Spark, and cloud data platforms.
• Production experience deploying and maintaining large-scale data solutions.
• In-depth Azure knowledge, including Azure Data Lake, Azure Databricks, Azure Synapse, and Azure DevOps.
• Advanced Python and/or Scala skills; CI/CD experience and familiarity with infrastructure as code.
• Strong written and verbal communication and ability to engage stakeholders and explain technical concepts.

Preferred qualifications

• Databricks Certified Data Engineer or Microsoft Azure Data Engineer Associate certification is preferred.
• Data governance, data security, compliance framework, consulting, and client management experience are preferred.

Compensation

• Expected compensation range is $84,000 to $128,000; the posting does not specify a pay cadence.
• BDO describes comprehensive benefits, flexible personal time off, and wellness reimbursement.

Flexibility

• Personnel are expected to spend some time in the office, at client sites, and virtually, unless accommodations or alternative arrangements apply.
• BDO describes its model as blended and flexible to meet the needs of staff, the firm, and clients.

About BDO