Sr Data Engineer
Role Overview
As a Senior Data Engineer on the (Input Required) team at Optum Technology, you will lead the design and development of scalable, cloud-native data pipelines and machine learning data architectures on Azure and Databricks.
In this role, you will build data integration routines using PySpark, Delta Lake, and Azure Data Factory, while collaborating with Data Science and AI teams to operationalize ML models, feature stores, and streaming analytics frameworks.
You will leverage enterprise-approved AI tools to automate workflows, establish reusable engineering accelerators, and ensure data quality, security, and responsible AI implementation across high-volume healthcare data ecosystems.
You’ll enjoy the flexibility to telecommute* from anywhere within the U.S. as you take on some tough challenges.
Full Job Posting
Our Company
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives.
The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, and data they need to feel their best.
Here, you will find a culture guided by diversity and inclusion, talented peers, comprehensive benefits, and career development opportunities.
Come make an impact on the communities we serve as you help us advance health equity on a global scale.
Join us to start Caring.
Connecting.
Growing together.
Position Summary
As a Senior Data Engineer on the (Input Required) team at Optum Technology, you will lead the design and development of scalable, cloud-native data pipelines and machine learning data architectures on Azure and Databricks.
In this role, you will build data integration routines using PySpark, Delta Lake, and Azure Data Factory, while collaborating with Data Science and AI teams to operationalize ML models, feature stores, and streaming analytics frameworks.
You will leverage enterprise-approved AI tools to automate workflows, establish reusable engineering accelerators, and ensure data quality, security, and responsible AI implementation across high-volume healthcare data ecosystems.
You’ll enjoy the flexibility to telecommute* from anywhere within the U.S. as you take on some tough challenges.
Primary Responsibilities
- Design and develop scalable ETL/ELT data pipelines using Databricks, Apache Spark, and Python on Azure cloud platforms
- Build cloud-native data solutions leveraging Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), and Delta Lake architecture
- Collaborate with Data Science and AI teams to operationalize machine learning models, feature stores, model input pipelines, and real-time/streaming frameworks
- Design, develop, and deploy AI-powered solutions to address complex business challenges with an emphasis on responsible use of AI
- Build reusable frameworks, engineering accelerators, and automation scripts to improve engineering efficiency and delivery quality
- Ensure data quality, governance, security, and compliance across the complete data lifecycle
- Optimize the performance, scalability, and cost-efficiency of batch and streaming data workflows, including Databricks Delta Live Tables (DLT)
- Participate in Agile development practices (sprint planning, code reviews, CI/CD automation with GitHub Actions or Azure DevOps), and provide production support/on-call coverage to ensure system stability
- Leverage enterprise-approved AI tools to streamline software engineering workflows, automate tasks, and drive continuous operational improvement
- Design, develop, and deploy AI-powered solutions to address complex business challenges with emphasis on responsible use of AI
You’ll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.
Required Qualifications
- 4+ years of experience in Data Engineering developing with Python and PySpark
- 4+ years of experience building scalable ETL/ELT data pipelines using Databricks
- 4+ years of experience working within Agile/Scrum project environments
- 4+ years of hands-on experience with Azure Databricks and Delta Lake architecture
- 4+ years of experience implementing CI/CD pipelines using GitHub Actions or Azure DevOps
- 3+ years of hands-on experience with Azure cloud services, including Azure Data Factory (ADF) or Azure Data Lake Storage (ADLS)
- 2+ years of experience with unit testing, data validation, and pipeline testing frameworks
Preferred Qualifications
- Bachelor's or higher degree in Computer Science, Engineering, Information Technology, or a related field
- Experience building, operationalizing, or deploying machine learning models, feature stores, and AI-powered data pipelines
- Experience with real-time and streaming analytics frameworks (e.g., Spark Structured Streaming, Event Hubs, Kafka)
- Knowledge of enterprise data governance, security masking, access control policies, and data quality frameworks
- Experience building reusable automation frameworks, Docker containers, or Kubernetes orchestration workflows
- Strong self-starter with a proven track record of managing technical deliverables independently and taking end-to-end ownership
- 4+ years of experience writing complex SQL / PL-SQL queries and data transformations
- 2+ years of experience working with Databricks Delta Live Tables (DLT)
*All Telecommuters will be required to adhere to UnitedHealth Group’s Telecommuter Policy.
Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc.
In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements).
No matter where or when you begin a career with us, you’ll find a far-reaching choice of benefits and incentives.
The salary for this role will range from $91,700 to $163,700 annually based on full-time employment.
We comply with all minimum wage laws as applicable.
Pursuant to the San Francisco Fair Chance Ordinance, we will consider for employment qualified applicants with arrest and conviction records.
Application Deadline: This will be posted for a minimum of 2 business days or until a sufficient candidate pool has been collected.
Job posting may come down early due to volume of applicants.
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone.
We believe everyone–of every race, gender, sexuality, age, location, and income–deserves the opportunity to live their healthiest life.
Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups, and those with lower incomes.
We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes — an enterprise priority reflected in our mission.
Diversity creates a healthier atmosphere: UnitedHealth Group is an Equal Employment Opportunity/Affirmative Action employer and all qualified applicants will receive consideration for employment without regard to race, color, religion, sex, age, national origin, protected veteran status, disability status, sexual orientation, gender identity or expression, marital status, genetic information, or any other characteristic protected by law.
UnitedHealth Group is a drug-free workplace.
Candidates are required to pass a drug test before beginning employment.
#RPO, #GREEN
Job Details Job: Data Engineering Primary Location: US-MN-Eden Prairie Organization: UHC Medicare & Retirement Schedule: Full-time Number of Openings: 1
About Optum
Verified company details for this employer are not available yet.
Apply for this job in 1 click
Skip the repetitive application forms
Install the Base Career Chrome Extension and autofill job applications across major job boards with your profile.
Trusted by over 500,000 job seekers on Base Career
More from this employer
More jobs at Optum
Senior Engineering Manager - Stratus Imaging Archive
Richmond, CAN
Optum is seeking a Senior Engineering Manager to lead teams building and operating its Stratus Imaging Archive cloud-native medical imaging platform. The role requires extensive software engineering and management experi
Senior Manager Software Engineering - Remote
Richmond, CAN
Optum is seeking a Senior Manager of Software Engineering to lead teams building scalable, secure applications for pharmacy benefits and healthcare technology. The role requires 10+ years of engineering leadership and fu
Financial Analyst
Eden Prairie, USA
Optum is seeking an early-career Financial Analyst to support its Home & Community Consolidations Finance Team. The role covers consolidations, forecasting, budgeting, reporting, variance analysis, and process improvemen
M & A Analyst - Torrance, CA
Torrance, USA
Optum is seeking an M&A Analyst to evaluate and execute healthcare services acquisitions, partnerships, and strategic investments in the Western United States. The role requires a bachelor's degree in a relevant business
Solutions Support Analyst: Kelsey-Seybold Clinic, Pearland, TX
Pearland, USA
The employer seeks a Solutions Support Analyst to support healthcare IT implementations, Epic applications, and clinical workflows. The role includes onsite troubleshooting, testing, training, and workflow optimization.
Manager - Growth Marketing Enablement
Gurugram, IND
Optum is seeking a manager to create pharmacy sales and growth enablement materials that support commercial opportunities, client retention, and field readiness. The role develops tailored collateral, translates complex
Documentation - Process Development and UAT Analyst
Dallas, USA
Optum seeks an analyst to develop operational documentation and processes and coordinate user acceptance testing for eligibility data changes and implementations. You’ll work with business, operations, implementation, an
Product Manager - Remote
Eden Prairie, USA
Optum is seeking a Product Manager to develop and implement healthcare initiatives across clinical, operations, reporting, legal, compliance, and privacy functions. You’ll shape solutions, align cross-functional stakehol
Senior Engineering Manager - Stratus Imaging Archive
Richmond, CAN
Senior Manager Software Engineering - Remote
Richmond, CAN
Financial Analyst
Eden Prairie, USA
M & A Analyst - Torrance, CA
Torrance, USA
Solutions Support Analyst: Kelsey-Seybold Clinic, Pearland, TX
Pearland, USA
Manager - Growth Marketing Enablement
Gurugram, IND
Documentation - Process Development and UAT Analyst
Dallas, USA
Product Manager - Remote
Eden Prairie, USA