ETS Senior Engineer - Azure Databricks & Data Platform Engineer

Responsibilities

• Administer, maintain, and optimize Azure Databricks environments, including workspace configuration, cluster management, and workload monitoring.
• Support Lakehouse solutions and data architecture using Azure Databricks and Azure Data Lake Storage.
• Optimize platform performance through cluster tuning, Delta Lake optimization, and workload analysis.
• Troubleshoot and resolve Databricks platform, data pipeline, and performance issues.
• Implement and support Unity Catalog, access controls, and data governance capabilities.
• Configure and maintain Azure security controls including RBAC, Managed Identities, Private Endpoints, Key Vault, and Azure Policy.
• Monitor platform utilization and identify opportunities for cost optimization and operational efficiency.
• Support enterprise Azure data services including Azure Data Factory, Azure SQL Database, Azure Cosmos DB, Azure Database for PostgreSQL, and Azure Synapse Analytics.
• Monitor platform health, availability, reliability, and performance across Azure data services.
• Investigate incidents and collaborate with infrastructure, networking, security, and engineering teams to resolve operational issues.
• Design, implement, and support ETL/ELT and data integration solutions using Azure Data Factory and Azure Databricks.
• Develop automation and Infrastructure as Code (IaC) solutions using Bicep, Terraform, Azure DevOps, and Git-based CI/CD practices.
• Provide technical support and guidance to application teams onboarding Azure data platform services.
• Participate in on-call rotation to provide support for business applications during business and off‑business hours

Qualifications

• Hands-on experience designing, implementing, and supporting Azure data platforms, including Azure Databricks and services such as ADLS Gen2, Azure SQL, Azure Data Factory, Cosmos DB, and similar technologies.
• Experience administering Azure Databricks, including cluster management, performance optimization, Unity Catalog, and Lakehouse architecture.
• Experience with cloud security, governance, and data management, including access controls, metadata management, cataloging, and data lineage.
• Experience troubleshooting and optimizing cloud platforms, databases, and data processing workloads.
• Experience with Infrastructure as Code (IaC), automation, and DevOps using Bicep, Terraform, Ansible, or similar tools.
• Strong analytical, problem-solving, communication, and collaboration skills with the ability to work across technical and business Desired Qualifications

Desired Qualifications

• Bachelor’s degree in computer science, Information Technology, Engineering, or a related field, or equivalent combination of education and experience.
• Experience with data governance, metadata management, or data catalog solutions such as Microsoft Purview, Alation, Atacaama, Collibra, or similar technologies.
• Exposure to AI/ML platforms, AI Foundry, or modern analytics and data science workloads.
• Experience with cloud cost optimization, FinOps practices, or capacity planning.
• Microsoft Azure certifications such as Azure Data Engineer Associate, Azure Solutions Architect Expert, or related certifications.

Hours

Location

• 820 Follin Lane, Vienna, VA 22180
• 5510 Heritage Oaks Drive, Pensacola, FL 32526
• 141 Security Drive, Winchester, VA 22602

Company