Sr. Data Engineer, Onboarding

Essential Duties and Responsibilities Include but not limited to the following

• Design, develop, and maintain scalable ETL/ELT pipelines on Databricks using PySpark and Python, following a Bronze/Silver/Gold lakehouse pattern.
• Onboard customer data by ingesting, parsing, and transforming 837I/P/D (Institutional/Professional/Dental) claims, 835 remittance advice, and EMR data, and map it accurately to the MDaudit data model.
• Build and optimize Snowflake data models, SQL transformations, and warehousing processes.
• Convert and migrate data from legacy systems and databases (such as Microsoft SQL Server) to the modern data platform.
• Develop reusable frameworks, tools, and automation in Python, PySpark, and SQL to streamline ETL, reduce manual onboarding effort, and improve data accessibility.
• Implement automated data validation, quality checks, and reconciliation, and resolve discrepancies promptly.
• Monitor, maintain, and troubleshoot customer data feeds and file processing after setup, using processing metrics to identify further automation and performance and cost improvements.
• Integrate and validate EMR data (e.g., Epic, Cerner, Meditech, Athenahealth) with claims data to support comprehensive reporting.
• Collaborate with Implementation, Product, Support, and IT teams to clarify requirements, data mapping, and delivery priorities.
• Resolve onboarding escalations on data ingestion and integration issues quickly, performing root-cause analysis and permanent fixes.
• Keep onboarding work items on track in project management tools (e.g., Monday.com), raise risks early, and provide regular status updates to internal stakeholders.
• Document pipelines, data flows, and runbooks, and transition completed work to Support with the documentation needed to operate it.
• Mentor junior engineers, conduct code reviews, and share technical knowledge across the team.
• Adhere to and support HIPAA and other regulatory requirements and maintain data integrity and security.
• Other duties as needed.

Required Skills

• Strong analytical and problem-solving skills with attention to detail.
• Strong written and verbal communication with technical and non-technical colleagues.
• Collaborative, team-oriented working style.
• Strong understanding of healthcare revenue cycle processes and experience with SaaS applications.
• Comfort working in a fast-paced environment.

Education & Experience

Notice of AI Use in Job Application Review

• As part of our commitment in creating a fair, efficient, and consistent hiring process we may use artificial intelligence (AI) to help our recruiting teams organize, summarize, and analyze information provided by candidates, including resumes, application responses, and other materials submitted during the application process.AI may be used to identify patterns, highlight relevant skills, and experience, and assist in comparing a candidate’s qualifications with the requirement of a specific role. These tools are to improve efficiency and consistency while supporting more informed hiring decisions, which will ultimately be made by the hiring team.

Requirements

• Strong analytical and problem-solving skills with attention to detail.
• Strong written and verbal communication with technical and non-technical colleagues.
• Collaborative, team-oriented working style.
• Strong understanding of healthcare revenue cycle processes and experience with SaaS applications.
• Comfort working in a fast-paced environment.