Databricks Lead Data Engineer (FTE) – Hybrid in Minnesota, MN

Optum Tech is a global leader in health care innovation. Our teams develop cutting-edge solutions that help people live healthier lives and help make the health system work better for everyone. From advanced data analytics and AI to cybersecurity, we use innovative approaches to solve some of health care’s most complex challenges. Your contributions here have the potential to change lives. Ready to build the next breakthrough? Join us to start Caring. Connecting. Growing together.
The EL3 Databricks Data Engineer will design, build, and optimize scalable data pipelines supporting Claims Payment Integrity (PI) analytics across Medicare & Retirement, Community & States, and Employer & Individual businesses. The role focuses on developing governed lakehouse based data assets, integrating claims and provider datasets, and ensuring high quality data availability for PI, actuarial, audit, recovery, and financial analytics teams.
This position follows a hybrid schedule with four in-office days per week.
Primary Responsibilities:
Data Engineering & Lakehouse Development:
- Build scalable ETL/ELT pipelines in Databricks using PySpark, Spark SQL, Delta Live Tables, and workflows
- Engineer curated datasets across bronze/silver/gold layers for claims, pricing, provider, RCM, and member data
- Implement Delta Lake best practices including ACID transactions, schema evolution, CDC, and optimized storage formats
- Automate ingestion/transformation of large datasets from claims systems, provider files, call center platforms, and EHR feeds
Data Quality & Governance:
- Perform reconciliation and validation of claim related financial datasets
- Enforce PHI compliant design patterns using Unity Catalog, governance guardrails, and cluster policies
- Implement pipeline monitoring, logging, and Spark performance optimization
Platform & Collaboration:
- Work with Data Analysts, Data Scientists, and PI SMEs to translate analytic requirements into production data assets
- Support cluster optimization, table indexing (Z ORDER), and cost efficient lakehouse operations
- Participate in Agile ceremonies and ensure timely delivery of engineering tasks
You’ll be rewarded and recognized for your performance in an environment that will challenge you and give you clear direction on what it takes to succeed in your role as well as provide development for other roles you may be interested in.
Required Qualifications:
- 12+ years of experience in Data Engineering
- 8+ years of experience in Databricks
- 5+ years of experience PySpark, SQL, Jobs/Workflows
- 5+ years of Spark performance tuning experience
- 4+ years of experience in Delta Lake
- 3+ years of experience in healthcare
- Ability to work a hybrid schedule of four in-office days per week in Minneapolis, MN
Preferred Qualifications:
- Experience with Call center data (member & provider interactions), Provider RCM datasets, and EHR/clinical data
- Experience with DLT, CI/CD, and MLflow integrated pipelines
- Exposure to actuarial or PI forecasting workflows
- Healthcare Claims Payment Integrity | M&R, C&S, E&I Claims
- Actuarial & Forecasting Analytics Exposure is an Added Advantage
- Experience engineering data for claims, provider, and membership domains
- Solid understanding of healthcare data models and adjudication flows
Pay is based on several factors including but not limited to local labor markets, education, work experience, certifications, etc. In addition to your salary, we offer benefits such as, a comprehensive benefits package, incentive and recognition programs, equity stock purchase and 401k contribution (all benefits are subject to eligibility requirements). No matter where or when you begin a career with us, you’ll find a far-reaching choice of benefits and incentives. The salary for this role will range from $112,700 to $193,200 annually based on full-time employment. We comply with all minimum wage laws as applicable.
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes – an enterprise priority reflected in our mission.
UnitedHealth Group is an Equal Employment Opportunity employer under applicable law and qualified applicants will receive consideration for employment without regard to race, national origin, religion, age, color, sex, sexual orientation, gender identity, disability, or protected veteran status, or any other characteristic protected by local, state, or federal laws, rules, or regulations.
UnitedHealth Group is a drug – free workplace. Candidates are required to pass a drug test before beginning employment.
Additional Job Detail Information
Requisition Number 2342902
Business Segment Optum
Employee Status Regular
Job Level Director
Travel No
Country: US
Overtime Status Exempt
Schedule Full-time
Shift Day Job
Telecommuter Position No
Similar Jobs:
Our Hiring Process
We want you to know what our hiring process looks like. Watch the video and find out what to expect along the way.
What It’s Like
Watch the video and hear how our employees describe what it’s like to work here in Customer Service.
Careers at Optum
If you want to use your abilities to help us challenge the status quo and achieve on our ambitious mission, this is the right place for you. We are creating and delivering quality health care solutions that deeply impact the health care system. And this means opportunities for people like you to grow and innovate with us.
Closing the GAP
Our team members help close the gap in health care. Take a closer look and see how Lisa helps members navigate a complex health care system.

