Data Platform Engineer

Main Responsibilities

• Administer and support Databricks workspaces, clusters, jobs, runtimes, compute policies, SQL Warehouses, and platform configurations.
• Troubleshoot and resolve production issues involving cluster instability, failed/slow jobs, performance bottlenecks, connectivity issues, resource constraints, and platform availability.
• Manage Databricks governance and security, including Entra ID/AAD groups, service principals, permissions, secrets, Unity Catalog, and workspace access.
• Perform performance and cost optimization, including cluster sizing, autoscaling, Photon, workload optimization, compute policies, and cloud cost reduction.
• Develop and maintain CI/CD, automation, job orchestration, and Infrastructure-as Code solutions using tools such as Azure DevOps and Terraform.
• Collaborate with Data Engineering, DataOps, Infrastructure, Security, DBA, and vendor teams to resolve production issues and support platform operations.
• Participate in incident management, change/release processes, root cause analysis (RCA), and continuous improvement activities.
• Create and maintain operational runbooks, support documentation, and standard operating procedures.
• Take ownership of production issues and independently drive them through troubleshooting, resolution, and follow-up actions.
• Good to have SQL Server and MongoDB administration/support experience, with the ability to troubleshoot platform issues as needed and collaborate effectively with required teams.
• 5+ years of hands-on experience with Azure Databricks administration and L2/L3 production support.
• Strong hands-on cloud experience, preferably Azure, including networking, storage, identity/access, security, monitoring, and Databricks integration.
• Proven experience troubleshooting complex production issues involving Databricks performance, connectivity, availability, jobs, and resource constraints.
• Strong communication, ownership, and problem-solving skills with the ability to independently drive issues to resolution.
• Good to have: Hands-on experience with SQL Server and MongoDB administration.
• Work Location: Ability to work onsite 4 days per week at the main office in Ann Arbor, MI.
• Benefits: • Paid Holidays and Vacation • Medical, Dental & Vision benefits that start on the first day of employment • No-cost mental health support for employee and dependents • Childcare tuition discounts • No-cost fitness, nutrition, and wellness programs • Fertility benefits • Adoption assistance • 401k matching contributions • 15% off the purchase price of stock • Company bonus
• All your information will be kept confidential according to EEO guidelines.