Software Engineer - Data Engineer
Optum India
Date: 7 hours ago
City: Hyderabad, Telangana
Contract type: Full time
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities
Primary Responsibilities
- Design and develop ETL/ELT solutions on Azure Databricks, LakeBase and Spark
- Develop, implement, and deploy large scale data pipelines empowering machine learning algorithms, insights generation, business intelligence dashboards, reporting and new data products
- Design, build, optimize, and manage modern large-scale data pipelines ETL/ELT processing to support data integration for analytics, machine learning features and predictive modelling
- Consume data from a variety of sources (RDBMS, APIs, FTPs and other cloud storage) & formats (Excel, CSV, XML, JSON, Parquet, Unstructured)
- Write advanced / complex SQL with performance tuning and optimization
- Build AI based solutions for solving business needs, process automations and improving operational efficiency
- Identify ways to improve data reliability, data integrity, system efficiency and quality
- Participate in architectural evolution of data engineering patterns, frameworks, systems, and platforms including defining best practices and standards for managing data collections and integration
- Mentor other data engineers and provide technical direction by teaching other data engineers how to leverage cloud data platforms
- Comply with all applicable Company policies, procedures, and business directives, changes including those relating to work location, team assignments, work schedules, and flexible work arrangements
- 3+ years of experience in data engineering, data integration, data modeling, data architecture, and ETL/ELT processes to provide quality data and analytics solutions
- 3+ years of experience in Python
- 3+ years of experience with API design and lifecycle management (GraphQL, REST, etc.)
- 2+ years of hands-on experience with Redis-backed state management and event-driven processing
- 2 + years of experience in Apache Spark (PySpark/Spark SQL)
- 2+ years of experience building and deploying Cloud based solutions using - Azure Databricks with UC, Snowflake, Functions, Service Bus
- 2+ years of experience in SQL with designing complex data schemas and query performance optimization
- Experience building LLM integrations for workflow automation/business needs
- Experience with DevOps automation with Terraform
- Experience with CI/CD process and tools - GitHub Actions, GIT, Artifactory, Sonar
How to apply
To apply for this job you need to authorize on our website. If you don't have an account yet, please register.
Post a resumeSimilar jobs
Software Development Engineer in Test (SDET) — AI-Enabled Quality Infrastructure
SS&C Technologies,
Hyderabad, Telangana
11 hours ago
SS&C is a leading provider of mission-critical, AI-powered technology and services empowering financial services and healthcare organizations to work smarter, faster, and securely. Founded in 1986, SS&C is headquartered in Windsor, Connecticut, and has offices worldwide. More than 23,000 financial services and healthcare organizations, from the world's largest companies to small and mid-market firms, rely on SS&C for expertise, scale,...
Software Development Engineer in Test
The Depository Trust & Clearing Corporation (DTCC),
Hyderabad, Telangana
12 hours ago
Are you ready to make an impact at DTCC?Do you want to work on innovative projects, collaborate with a dynamic and supportive team, and receive investment in your professional development? At DTCC, we are at the forefront of innovation in the financial markets. We are committed to helping our employees grow and succeed. We believe that you have the skills...
Associate Director, Statistical Programmer
Merck Healthcare,
Hyderabad, Telangana
2 days ago
Work Your Magic with us!Ready to explore, break barriers, and discover more? We know you’ve got big plans – so do we! Our colleagues across the globe love innovating with science and technology to enrich people’s lives with our solutions in Healthcare, Life Science, and Electronics. Together, we dream big and are passionate about caring for our rich mix of...