1,605 Etl Processes jobs in India

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start **Caring. Connecting. Growing together.**
We are looking for a skilled Data Engineer to design, build, and maintain scalable, secure, and high-performance data solutions. This role spans the full data engineering lifecycle - from research and architecture to deployment and support- within cloud-native environments, with a strong focus on AWS and Kubernetes (EKS).
**Primary Responsibilities:**
+ **Data Engineering Lifecycle:** Lead research, proof of concept, architecture, development, testing, deployment, and ongoing maintenance of data solutions
+ **Data Solutions:** Design and implement modular, flexible, secure, and reliable data systems that scale with business needs
+ **Instrumentation and Monitoring:** Integrate pipeline observability to detect and resolve issues proactively
+ **Troubleshooting and Optimization:** Develop tools and processes to debug, optimize, and maintain production systems
+ **Tech Debt Reduction:** Identify and address legacy inefficiencies to improve performance and maintainability
+ **Debugging and Troubleshooting:** Quickly diagnose and resolve unknown issues across complex systems
+ **Documentation and Governance:** Maintain clear documentation of data models, transformations, and pipelines to ensure security and governance compliance
+ **Cloud Expertise:** Leverage advanced skills in AWS and EKS to build, deploy, and scale cloud-native data platforms
+ **Cross-Functional Support:** Collaborate with analytics, application development, and business teams to enable data-driven solutions
+ **Team Leadership:** Lead and mentor engineering teams to ensure operational efficiency and innovation
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Bachelor's degree in Computer Science or related field
+ 5+ years of experience in data engineering or related roles
+ Proven experience designing and deploying scalable, secure, high-quality data solutions
+ Solid expertise in full Data Engineering lifecycle (research to maintenance)
+ Advanced AWS and EKS knowledge
+ Proficient in CI/CD, IaC, and addressing tech debt
+ Proven skilled in monitoring and instrumentation of data pipelines
+ Proven advanced troubleshooting and performance optimization abilities
+ Proven ownership mindset with ability to manage multiple components
+ Proven effective cross-functional collaborator (DS, SMEs, and external teams).
+ Proven exceptional debugging and problem-solving skills
+ Proven solid individual contributor with a team-first approach
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
_#njp_

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start **Caring. Connecting. Growing together.**
The Data Engineering Analyst, using technical and analytical skills, is responsible for supporting Optum members on, not limiting to, ongoing data refreshes and implementations which are delivered on time and with utmost quality, complete analysis of an issue to its final solution, including creative problem solving and technical decision making.
**Primary Responsibility:**
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Bachelor's degree in Computer Science or any engineering
+ 2+ years of experience in Data analysis and functional QC
+ Basic Knowledge on Cloud (AWS)
+ Basic knowledge in Spark Sql
+ Basic Knowledge in Python
+ Basic US Healthcare knowledge
+ Fair knowledge on Cloud (AWS)
+ Technical aptitude for learning new technologies
+ Solid SQL skills
+ Proven solid analytical and problem-solving skills
+ Proven passion to work with lot of data in a challenging environment
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start **Caring. Connecting. Growing together.**
**Primary Responsibilities:**
+ Ingest data from multiple on-prem and cloud data sources using various tools & capabilities in Azure
+ Design and develop Azure Databricks processes using PySpark/Spark-SQL
+ Design and develop orchestration jobs using ADF, Databricks Workflow
+ Analyzing data engineering processes being developed and act as an SME to troubleshoot performance issues and suggest solutions to improve
+ Building test framework for the Databricks notebook jobs for automated testing before code deployment
+ Design and build POCs to validate new ideas, tools, and architectures in Azure
+ Continuously explore new Azure services and capabilities; assess their applicability to business needs
+ Prepare case studies and technical write-ups to showcase successful implementations and lessons learned
+ Work closely with clients, business stakeholders, and internal teams to gather requirements and translate them into technical solutions using best practices and appropriate architecture
+ Contribute to full lifecycle project implementations, from design and development to deployment and monitoring
+ Ensure solutions adhere to security, compliance, and governance standards
+ Monitor and optimize data pipelines and cloud resources for cost and performance efficiency
+ Identifies solutions to non-standard requests and problems
+ Mentor and support existing on-prem developers for cloud environment
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Undergraduate degree or equivalent experience
+ 7+ years of overall experience in Data & Analytics engineering
+ 5+ years of experience working with Azure, Databricks, and ADF, Data Lake
+ 5+ years of experience working with data platform or product using PySpark and Spark-SQL
+ Solid experience with CICD tools such as Jenkins, GitHub, Github Actions, Maven etc.
+ In-depth understanding of Azure architecture & ability to come up with efficient design & solutions
+ Highly proficient in Python and SQL
+ Proven excellent communication skills
+ **Key Skill:** Azure Data Engineer - Azure Databricks, Azure Data factory, Python/Pyspark, Terraform
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start **Caring. Connecting. Growing together.**
**Primary Responsibilities:**
+ Data Ingestion: Develop, maintain, and optimize data ingestion pipelines from various sources including Adobe 1.4 and 2.0 APIs, NAS file drives, SQL servers, and Adobe datasets
+ Workflow Orchestration: Design and manage data workflows using Airflow to ensure reliable data movement, transformation, and scheduling
+ Database Development: Build and enhance data models in Snowflake using DBT (Data Build Tool) as well as Cosmos database development
+ Business Intelligence: Create, maintain, and improve Power BI dashboards to deliver actionable business insights
+ Pipeline Management: Monitor, troubleshoot, and optimize end-to-end data pipelines to ensure high availability and accuracy of data delivery
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Bachelor's degree in Computer Science, Information Systems, Engineering, or a related technical field (or equivalent experience)
+ 2+ years of hands-on experience in data engineering or analytics roles
+ Hands-on experience with Snowflake and DBT for data transformation and modeling (exposure to Cosmos DB a plus)
+ Solid experience with Apache Airflow for workflow orchestration and scheduling
+ Expertise in building and maintaining ETL/ELT pipelines from diverse data sources
+ Advanced SQL skills for querying, data manipulation, and database management
+ Skilled in developing, managing, and optimizing dashboards using Power BI
+ Skills in Python, Airflow, DBT, GitHub, ETL, Power BI, SQL, Adobe AEP/CJO
+ Proficient in Python for data engineering, automation, and scripting tasks
+ Proficient in version control and code management using GitHub
**Preferred Qualification:**
+ Familiarity or experience with Adobe AEP/CJO (Adobe Experience Platform / Customer Journey Analytics)
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._

Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start **Caring. Connecting. Growing together.**
**Primary Responsibilities:**
+ Lead a team to design, develop, test, deploy, maintain and continuously improve software
+ Support driving modern solutions to complex problems
+ Proactively share information across the team, to the right audience with the appropriate level of detail and timeliness
+ Implement small and large scale implementations of projects with E2E delivery
+ Facilitate technical discussions and design solutions
+ Technically coach the team members and provide real time solutions to complex problems
+ Adherence to code quality standards, development best practices, defect-free code delivery
+ Collaborate and Communicate effectively with other engineers and onshore team
+ Partner with business and enterprise architecture team to understand requirements and design/develop end to end solution
+ Practice agile solution delivery & influence teams towards engineering best practices such as DevOps / CICD / Everything as a code
+ Follow engineering best practices and coding standards for successful delivery of program/project
+ Partner closely with global teams to implement the design
+ Manages and is accountable for professional employees and/or supervisors
+ Understand product architecture, features being built and come up with product improvement ideas and POCs
+ Individual contributor and Technical lead for Data Engineering - Data pipelines, Data modelling and Data warehouse
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Undergraduate degree or equivalent experience
+ 5+ years of Spark/Scala experience
+ 2+ years of hands-on experience in production public cloud (Azure, AWS or GCP)
+ Hands-on experience in working with standard DevOps tools:
+ Build automation tools such as Hudson, Jenkins, Travis CI or equivalent
+ Source control tools such as Git, GitHub, SVN or equivalent
+ Configuration tools such as Chef, Puppet, Terraform, Ansible
+ Hands-on in designing software solutions and architecture
+ Hands-on in using design patterns
+ Hands-on knowledge in trouble shooting, performance tuning, and optimization
+ Solid, hands-on knowledge of Angular/ReactJS
+ Experience working in cross-functional teams - Solution Design, Development, Quality Engineering and DevOps
+ Proven solid analytical, problem solving and decision-making skills
+ Proven excellent verbal, written and interpersonal communication skills
+ Proven ability to work collaboratively in a global team with a positive team spirit
**Preferred Qualifications:**
+ Work experience in Agile/Scrum Methodology
+ Work experience in product engineering
+ Knowledge of US Healthcare domain, in general and data analytics applications/products in particular
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._

**Overview**
Proven leadership in building and mentoring high-performing data engineering teams to deliver scalable, secure, and high-performance data solutions. Experienced in architecting cloud-native data platforms on AWS, leveraging services like EMR, Glue, Redshift, and SageMaker. Skilled in Lakehouse architecture, real-time streaming (Kafka, Kinesis, Flink), orchestration with Apache Airflow, and advanced analytics enablement.
Strong focus on data governance, MDM, and infrastructure automation using GitLab CI/CD, Terraform, and IaC. Adept at designing robust middleware APIs to integrate data pipelines with applications and analytics platforms. Collaborative partner to business, AI/ML, and BI teams-delivering end-to-end data solutions that power insights, innovation, and strategic decision-making.
**Responsibilities**
**Data Engineering Leadership**
+ Lead and mentor a team of data engineers in developing and managing **scalable, secure, and high-performance data pipelines** .
+ Define best practices for **data ingestion, transformation, and processing** in a **Lakehouse architecture** .
+ Drive **automation, performance tuning, and cost optimization** in cloud data solutions.
**Cloud Data Infrastructure & Processing**
+ Architect and manage **AWS-based big data solutions** (EMR, EKS, Glue, Redshift).
+ Design and maintain **Apache Airflow** workflows for data orchestration.
+ Optimize **Spark and distributed data processing frameworks** for large-scale workloads.
+ Implement **streaming solutions** (Kafka, Kinesis, Flink) for real-time data processing.
**AI/ML & Advanced Analytics**
+ Collaborate with **Data Scientists and AI/ML teams** to build and deploy **machine learning models** using **AWS SageMaker** .
+ Support **feature engineering, model training, and inference pipelines** at scale.
+ Enable AI-driven analytics by integrating structured and unstructured data sources.
**Business Intelligence & Visualization**
+ Support **BI and reporting teams** with optimized **data models** for **Amazon QuickSight and other visualization tools** .
+ Ensure efficient **data aggregation and pre-processing** for interactive dashboards and self-service analytics.
+ Design, develop, and maintain **middleware components** that facilitate seamless communication between **data platforms, applications, and analytics layers** .
**Master Data Management (MDM) & Governance**
+ Implement **MDM strategies** to ensure clean, consistent, and deduplicated data.
+ Establish **data governance policies** for security, privacy, and compliance (GDPR, HIPAA, etc.).
+ Ensure adherence to **data quality frameworks** across structured and unstructured datasets.
**Collaboration & Strategy**
+ Partner with **business teams, AI/ML teams, and analysts** to deliver **high-value data products** .
+ Define and maintain **data architecture strategies** aligned with business goals.
+ Enable **real-time and batch processing** for analytics, reporting, and AI-driven insights. **Technical Expertise:**
+ Extensive AWS experience with services such as EMR, EKS, Glue, Redshift, S3, Lambda, and SageMaker.
+ Proficient in big data processing frameworks (e.g., Spark, Hive, Presto) and Lakehouse architectures.
+ Skilled in designing and managing Apache Airflow workflows and other orchestration tools.
+ Solid understanding of Master Data Management (MDM) and data governance best practices.
+ Proficient with SQL & NoSQL databases (e.g., Redshift, DynamoDB, PostgreSQL, Elasticsearch).
+ **Middleware Development** - Proven expertise in **building middleware components** like REST API that integrate data pipelines with applications, analytics platforms, and real-time systems.
+ Hands-on experience with Gitlab CI/CD, Terraform, CFT, and Infrastructure-as-Code (IaC) methodologies.
+ Familiarity with AI/ML pipelines, model deployment, and monitoring using SageMaker.
+ Experience with data visualization tools, particularly AWS QuickSight, for business intelligence.
**Qualifications**
Experience with Lakehouse frameworks (Glue Catalog, Iceberg, Delta Lake).
Expertise in streaming data solutions (Kafka, Kinesis, Flink).
In-depth understanding of security best practices in AWS data architectures.
Demonstrated success in driving AI/ML initiatives from ideation to production.
**Educational Qualification:**
+ **Bachelor's degree or higher (UG+) in Computer Science, Data Engineering, Aerospace Engineering, or a related field.**
+ Advanced degrees (Master's, PhD) in **Data Science or AI/ML** are a plus.
REQ-145778

**Our Purpose**
_Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential._
**Title and Summary**
Director, Data Engineering
Position Overview:
Director, Data Engineer, MyMPA will be part of GBSC's Enterprise Performance Management Systems (EPMS) Team, leading the strategic vision, architecture, and execution of our enterprise data infrastructure. You will oversee a team of high-performing engineers focused on implementing enhancements and periodic refreshes of a platform reporting on Mastercard card data performance.
This role will also work closely with the VP of Sales Excellence, VP of Analytics & Metrics and the Director of FP&A to gather requirements for changes and enhancements to the application and contribute to the technology platform's evolution as it grows to support the rapidly expanding Mastercard business?
The ideal candidate will have hands-on development skills combined with an ability to analyze and understand end user requirements as both are critical success factors within this role. This role requires the skills and desire to work as an individual contributor as well as collaborate cross functionally with various business constituents.
1. Have you ever worked on an enterprise-wide reporting solution that relied heavily on your own knowledge and resources to build and maintain the solution?
2. Are you constantly hungry to learn? Do you have a "growth mindset" as opposed to the "fixed mindset"?
3. Do you love working with people, helping them, and turning their requirements into something that can make a difference?
Role:
- Responsible for designing & implementing solutions, managing team and client services.
- Develop and deploy Essbase solutions with best-in-class coding practices
- Define and drive the long-term data engineering roadmap aligned with business goals.
- Ensure data quality, governance, and security best practices are embedded in all engineering processes.
- Oversee the integration of structured and unstructured data from diverse sources to enable advanced analytics and AI/ML capabilities.
- Lead and mentor a team of senior data engineers and managers, fostering a culture of innovation, accountability, and continuous improvement.
- Liaison with the internal groups in Mastercard Technology to ensure our solutions remain in compliance with MasterCard technical standards. Navigate Mastercard Technology requirements around change management and new development.
All About You:
- Proven track record of building and scaling enterprise-grade data platforms in cloud environments.
- Excellent communication skills, capable of translating complex technical concepts into business values.
- Experience deploying applications across both Windows and Linux environments.
- Solid understanding of Essbase technology - understand how this technology works, for both BSO and ASO cubes.
- Good understanding of SQL Server or Oracle DB.
- Develop BSO and ASO cubes with a strong eye for performance.
- Strong commitment to quality and error testing of code you develop. Strong ability to step in and analyze the code of others on the team.
- Be able to work within an Agile environment that is highly responsive to the business. Our team is part of the Finance organization - you must be comfortable working as part of the business with a strong "roll up your sleeves" mentality.
- A transformation mindset, looking to evolve system solutions to capitalize on new technologies to improve and augment existing solutions.
**Corporate Security Responsibility**
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
+ Abide by Mastercard's security policies and practices;
+ Ensure the confidentiality and integrity of the information being accessed;
+ Report any suspected information security violation or breach, and
+ Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.