Senior Data Engineering Consultant – ADB and Snowflake
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities:
- Design and implement Apache Spark and Scala/Python programs on Azure Databricks in a dynamic and fast-paced work environment
- Build highly scalable data engineering pipelines leveraging Apache Spark, Snowflake, Scala, and PySpark
- Use GitHub Copilot to accelerate development, improve code quality, and enhance productivity during the development lifecycle
- Build AI agents to assist in data engineering development, automating repetitive tasks, optimizing workflows, and providing intelligent recommendations
- Use Snowflake Cortex( LLM ) for tasks like document summarization and field extraction using Snowflake hosted AI models
- Perform systems analysis, including design, coding, unit testing, and other SDLC activities
- Gather and analyze requirements, convert functional specifications into technical tasks, and provide accurate effort estimates
- Collaborate proactively with global teams to address project requirements, identify risks, and ensure timely delivery of solutions
- Act as a DevOps team member, monitoring and maintaining operational processes while building infrastructure using Terraform scripts
- Investigate and resolve production support issues post-deployment, providing effective solutions as needed
- Identify areas for improvement, optimize performance, and enhance scalability of existing solutions
- Own the applications’ technology stack and deliver modern solutions to complex technical challenges
- Analyze existing application infrastructure and recommend modifications to improve reliability, availability, and scalability
- Work independently in a fast-paced, agile environment, adapting to changing priorities and requirements
- Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
Required Qualifications:
- Undergraduate degree or equivalent experience
- 5+years of experience in ETL or Pipeline Development using tools such as Azure Databricks or Apache Spark and Snowflake with development expertise on batch and real-time data integration
- 5+ years of experience in programming using Scala or Python
- 5+ years of extensive knowledge of ETL and Data Warehousing concepts, strategies, methodologies
- 5+ years of experience working in projects with agile or scrum methodologies
- 3+ years of experience working with Terraform for cloud infrastructure automation and management
- Experience using GitHub Copilot and AI agents
- Experience in building end to end architecture for Data Lakes, Data Warehouses and Data Marts
- Experience to own end-to-end development, including coding, testing, debugging and deployment
- Experience to bring innovative ideas to help continuously improve the application portfolio including the design, build, deploy, test and runtime within cloud ecosystems
- Knowledge of AI frameworks like TensorFlow, PyTorch, or Scikit-learn
- Proven excellent written and verbal communication skills including presentation skills
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes – an enterprise priority reflected in our mission.
Additional Job Detail Information
Requisition Number 2300981
Business Segment Optum
Employee Status Regular
Travel No
Country: IN
Overtime Status Exempt
Schedule Full-time
Shift Evening Job
Telecommuter Position No
Similar Jobs:
Our Hiring Process
We want you to know what our hiring process looks like. Watch the video and find out what to expect along the way.
What It’s Like
Watch the video and hear how our employees describe what it’s like to work here in Customer Service.
Careers at Optum
If you want to use your abilities to help us challenge the status quo and achieve on our ambitious mission, this is the right place for you. We are creating and delivering quality health care solutions that deeply impact the health care system. And this means opportunities for people like you to grow and innovate with us.
Closing the GAP
Our team members help close the gap in health care. Take a closer look and see how Lisa helps members navigate a complex health care system.