36,714 Lead Data Engineer jobs in India

About Chubb

Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb employs approximately 40,000 people worldwide. Additional information can be found at: Chubb India

At Chubb India, we are on an exciting journey of digital transformation driven by a commitment to engineering excellence and analytics. We are proud to share that we have been officially certified as a Great Place to Work® for the third consecutive year, a reflection of the culture at Chubb where we believe in fostering an environment where everyone can thrive, innovate, and grow
With a team of over 2500 talented professionals, we encourage a start-up mindset that promotes collaboration, diverse perspectives, and a solution-driven attitude. We are dedicated to building expertise in engineering, analytics, and automation, empowering our teams to excel in a dynamic digital landscape.

We offer an environment where you will be part of an organization that is dedicated to solving real-world challenges in the insurance industry. Together, we will work to shape the future through innovation and continuous learning.

Position Details
Job Title : Lead Data Engineer-Solution Architecture
Function/Department : Technology
Location : Hyderabad/Bangalore/Bhubaneswar
Employment Type : Full Time

Role Overview

Qualifications:
Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field; Master’s degree preferred
Minimum of 10 years’ experience in data architecture or data engineering roles, with a significant focus in P&C insurance domains preferred.
Proven track record of successful implementation of data architecture within large-scale transformation programs or projects
Comprehensive knowledge of data modelling techniques and methodologies, including data normalization and denormalization practices
Hands on expertise across a wide variety of database (Azure SQL, MongoDB, Cosmos), data transformation (Informatica IICS, Databricks), change data capture and data streaming (Apache Kafka) technologies
Proven Expertise with data warehousing concepts, ETL processes, and data integration tools (e.g., Informatica, Databricks, ADF)
Experience with cloud-based data architectures and platforms (e.g. ADLS, Synapse, Snowflake, Azure SQL Database)
Familiarity with .NET Core and Python FastAPI or similar; hands on experience preferred.
Expertise in ensuring data security patterns (e.g. tokenization, encryption, obfuscation)
Familiarity with authentication and authorization methods and frameworks (e.g. OAuth 2.0).
Knowledge of insurance policy operations, regulations, and compliance frameworks specific to Consumer lines
Understanding of advanced analytics, AI, and machine learning concepts as they pertain to data architecture
Skilled in asynchronous programming patterns.
Familiarity with containerization and microservices frameworks, such as Docker and Kubernetes.
Proficient in utilizing Azure or other cloud services, including AKS, Cosmos NoSQL, Cognitive Search, SQL Database, ADLS, App Insights, and API Management.
Familiar with DevSecOps practices and CI/CD tools, including Git, Azure DevOps, and Jenkins.
Familiar with Kafka or similar messaging technologies.
Familiar with GIS / geospatial systems and terminology preferred.
Strong analytical and problem-solving capabilities.
Experienced in producing technical documentation to support system design.
Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
Familiarity with Agile methodologies and experience working in Agile project environments, including ceremonies and tools like JIRA.

Why Join Us?
Be at the forefront of digital transformation in the insurance industry.
Lead impactful initiatives that simplify claims processing and enhance customer satisfaction.
Work alongside experienced professionals in a collaborative, innovation-driven environment.

Why Chubb?

Join Chubb to be part of a leading global insurance company!

Our constant focus on employee experience along with a start-up-like culture empowers you to achieve impactful results.
Industry leader: Chubb is a world leader in the insurance industry, powered by underwriting and engineering excellence
A Great Place to work: Chubb India has been recognized as a Great Place to Work® for the years , and
Laser focus on excellence : At Chubb we pride ourselves on our culture of greatness where excellence is a mindset and a way of being. We constantly seek new and innovative ways to excel at work and deliver outstanding results
Start-Up Culture : Embracing the spirit of a start-up, our focus on speed and agility enables us to respond swiftly to market requirements, while a culture of ownership empowers employees to drive results that matter
Growth and success : As we continue to grow, we are steadfast in our commitment to provide our employees with the best work experience, enabling them to advance their careers in a conducive environment

Employee Benefits

Our company offers a comprehensive benefits package designed to support our employees’ health, well-being, and professional growth. Employees enjoy flexible work options, generous paid time off, and robust health coverage, including treatment for dental and vision related requirements. We invest in the future of our employees through continuous learning opportunities and career advancement programs, while fostering a supportive and inclusive work environment. Our benefits include:

Savings and Investment plans: We provide specialized benefits like Corporate NPS (National Pension Scheme), Employee Stock Purchase Plan (ESPP), Long-Term Incentive Plan (LTIP), Retiral Benefits and Car Lease that help employees optimally plan their finances
Upskilling and career growth opportunities: With a focus on continuous learning, we offer customized programs that support upskilling like Education Reimbursement Programs, Certification programs and access to global learning programs.
Health and Welfare Benefits: We care about our employees’ well-being in and out of work and have benefits like Hybrid Work Environment, Employee Assistance Program (EAP), Yearly Free Health campaigns and comprehensive Insurance benefits.

Application Process

Our recruitment process is designed to be transparent, and inclusive.
Step 1 : Submit your application via the Chubb Careers Portal / Linkedin.
Step 2 : Engage with our recruitment team for an initial discussion.
Step 3 : Participate in HackerRank assessments/technical/functional interviews and assessments (if applicable).
Step 4 : Final interaction with Chubb leadership.

Join Us
With you Chubb is better. Whether you are solving challenges on a global stage or creating innovative solutions for local markets, your contributions will help shape the future. If you value integrity, innovation, and inclusion , and are ready to make a difference, we invite you to be part of Chubb India’s journey .

Apply Now :

About Chubb Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S& P 500 index. Chubb employs approximately 40,000 people worldwide. Additional information can be found at: . About Chubb India At Chubb India, we are on an exciting journey of digital transformation driven by a commitment to engineering excellence and analytics. We are proud to share that we have been officially certified as a Great Place to Work® for the third consecutive year, a reflection of the culture at Chubb where we believe in fostering an environment where everyone can thrive, innovate, and grow With a team of over 2500 talented professionals, we encourage a start-up mindset that promotes collaboration, diverse perspectives, and a solution-driven attitude. We are dedicated to building expertise in engineering, analytics, and automation, empowering our teams to excel in a dynamic digital landscape. We offer an environment where you will be part of an organization that is dedicated to solving real-world challenges in the insurance industry. Together, we will work to shape the future through innovation and continuous learning. Position Details Job Title : Lead Data Engineer-Solution Architecture Function/Department : Technology Location : Hyderabad/Bangalore/Bhubaneswar Employment Type : Full Time Role Overview Qualifications: Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field; Master’s degree preferred Minimum of 10 years’ experience in data architecture or data engineering roles, with a significant focus in P& C insurance domains preferred. Proven track record of successful implementation of data architecture within large-scale transformation programs or projects Comprehensive knowledge of data modelling techniques and methodologies, including data normalization and denormalization practices Hands on expertise across a wide variety of database (Azure SQL, Mongo DB, Cosmos), data transformation (Informatica IICS, Databricks), change data capture and data streaming (Apache Kafka) technologies Proven Expertise with data warehousing concepts, ETL processes, and data integration tools (e.g., Informatica, Databricks, ADF) Experience with cloud-based data architectures and platforms (e.g. ADLS, Synapse, Snowflake, Azure SQL Database) Familiarity with. NET Core and Python Fast API or similar; hands on experience preferred. Expertise in ensuring data security patterns (e.g. tokenization, encryption, obfuscation) Familiarity with authentication and authorization methods and frameworks (e.g. OAuth 2.0). Knowledge of insurance policy operations, regulations, and compliance frameworks specific to Consumer lines Understanding of advanced analytics, AI, and machine learning concepts as they pertain to data architecture Skilled in asynchronous programming patterns. Familiarity with containerization and microservices frameworks, such as Docker and Kubernetes. Proficient in utilizing Azure or other cloud services, including AKS, Cosmos No SQL, Cognitive Search, SQL Database, ADLS, App Insights, and API Management. Familiar with Dev Sec Ops practices and CI/CD tools, including Git, Azure Dev Ops, and Jenkins. Familiar with Kafka or similar messaging technologies. Familiar with GIS / geospatial systems and terminology preferred. Strong analytical and problem-solving capabilities. Experienced in producing technical documentation to support system design. Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams. Familiarity with Agile methodologies and experience working in Agile project environments, including ceremonies and tools like JIRA. Why Join Us? Be at the forefront of digital transformation in the insurance industry. Lead impactful initiatives that simplify claims processing and enhance customer satisfaction. Work alongside experienced professionals in a collaborative, innovation-driven environment. Why Chubb? Join Chubb to be part of a leading global insurance company! Our constant focus on employee experience along with a start-up-like culture empowers you to achieve impactful results. Industry leader: Chubb is a world leader in the insurance industry, powered by underwriting and engineering excellence A Great Place to work: Chubb India has been recognized as a Great Place to Work® for the years , and Laser focus on excellence : At Chubb we pride ourselves on our culture of greatness where excellence is a mindset and a way of being. We constantly seek new and innovative ways to excel at work and deliver outstanding results Start-Up Culture : Embracing the spirit of a start-up, our focus on speed and agility enables us to respond swiftly to market requirements, while a culture of ownership empowers employees to drive results that matter Growth and success : As we continue to grow, we are steadfast in our commitment to provide our employees with the best work experience, enabling them to advance their careers in a conducive environment Employee Benefits Our company offers a comprehensive benefits package designed to support our employees’ health, well-being, and professional growth. Employees enjoy flexible work options, generous paid time off, and robust health coverage, including treatment for dental and vision related requirements. We invest in the future of our employees through continuous learning opportunities and career advancement programs, while fostering a supportive and inclusive work environment. Our benefits include: Savings and Investment plans: We provide specialized benefits like Corporate NPS (National Pension Scheme), Employee Stock Purchase Plan (ESPP), Long-Term Incentive Plan (LTIP), Retiral Benefits and Car Lease that help employees optimally plan their finances Upskilling and career growth opportunities: With a focus on continuous learning, we offer customized programs that support upskilling like Education Reimbursement Programs, Certification programs and access to global learning programs. Health and Welfare Benefits: We care about our employees’ well-being in and out of work and have benefits like Hybrid Work Environment, Employee Assistance Program (EAP), Yearly Free Health campaigns and comprehensive Insurance benefits. Application Process Our recruitment process is designed to be transparent, and inclusive. Step 1 : Submit your application via the Chubb Careers Portal / Linkedin. Step 2 : Engage with our recruitment team for an initial discussion. Step 3 : Participate in Hacker Rank assessments/technical/functional interviews and assessments (if applicable). Step 4 : Final interaction with Chubb leadership. Join Us With you Chubb is better. Whether you are solving challenges on a global stage or creating innovative solutions for local markets, your contributions will help shape the future. If you value integrity, innovation, and inclusion , and are ready to make a difference, we invite you to be part of Chubb India’s journey . Apply Now :

**About the Role:**
**Grade Level (for internal use):**
11
**The Team:** The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering, and distribution to power our Financial Institution Group business and customer needs. We focus on platform scalability to support business operations by following a common data lifecycle that accelerates business value. Our team provides essential intelligence for the Financial Services, Real Estate, and Insurance industries.
**The Impact:** The Data Engineering team will be responsible for implementing and maintaining services and tools to support existing feed systems. This enables users to consume FIG datasets and makes FIG data available for broader consumption and processing within the company.
**What's in it for you:** Opportunity to work with global stakeholders and engage with the latest tools and technologies.
**Responsibilities:**
+ Build new data acquisition and transformation pipelines using advanced data processing and cloud technologies.
+ Collaborate with the broader technology team, including information architecture and data integration teams, to align pipelines with strategic initiatives.
**What We're Looking For:**
+ Bachelor's degree in computer science or a related field, with at least 8+ years of professional software development experience.
+ Must have: **Programming languages commonly used for data processing,** **Data orchestration and workflow management systems,** **Distributed data processing framework, relational database management systems,** **B** **ig data processing frameworks** Experience with large-scale data processing platforms.
+ Deep understanding of RESTful services, good API design, and object-oriented programming principles.
+ Proficiency in object-oriented or functional scripting languages.
+ Good working knowledge of relational and NoSQL databases.
+ Experience in maintaining and developing software in production environments utilizing cloud-based tools.
+ Strong collaboration and teamwork skills, along with excellent written and verbal communication abilities.
+ Self-starter and motivated individual with the ability to thrive in a fast-paced software development environment.
+ Agile experience is highly desirable.
+ Experience with data warehousing and analytics platforms will be a significant advantage.
**Technical Expertise**
+ Data Engineering Expertise: Strong experience in distributed data processing and optimization using modern frameworks.
+ Cloud Platforms: Proficient in leveraging cloud services for scalable data solutions, including ETL orchestration, containerized deployments, and data storage.
+ Workflow Orchestration: Skilled in designing and managing complex data pipelines and workflows.
+ Programming & Scripting: Proficient in writing clean, modular, and testable code for data processing tasks.
+ Database Management: Solid understanding of both relational and non-relational databases, including data querying and modeling.
+ ETL & Data Architecture: Proven ability to design and implement robust ETL pipelines and optimize data models for performance and scalability.
**Soft Skills**
+ **Excellent communication skills** - able to articulate technical concepts to non-technical stakeholders.
+ **Strong interpersonal skills** - collaborative, empathetic, and team-oriented.
+ Demonstrated ability to work on **challenging projects** and go the **extra mile** to deliver results.
**Preferred Qualifications**
+ Experience with CI/CD pipelines, Github and DevOps practices is must.
+ Familiarity with data lake and data warehouse architectures.
+ Exposure to real-time data processing frameworks, and observability tools like Grafana is added advantage.
**What's In It For** **You?**
**Our Purpose:**
Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world.
Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence®, pinpointing risks and opening possibilities. We Accelerate Progress.
**Our People:**
We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.
From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.
**Our Values:**
**Integrity, Discovery, Partnership**
At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of **integrity** in all we do, bring a spirit of **discovery** to our work, and collaborate in close **partnership** with each other and our customers to achieve shared goals.
**Benefits:**
We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global.
Our benefits include:
+ Health & Wellness: Health care coverage designed for the mind and body.
+ Flexible Downtime: Generous time off helps keep you energized for your time on.
+ Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
+ Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
+ Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
+ Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.
For more information on benefits by country visit: Hiring and Opportunity at S&P Global:**
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
**Recruitment Fraud Alert:**
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, "pre-employment training" or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here ( .
---
**Equal Opportunity Employer**
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to:   and your request will be forwarded to the appropriate person. 
**US Candidates Only:** The EEO is the Law Poster   describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)
**Job ID:**
**Posted On:**
**Location:** Ahmedabad, Gujarat, India

**About the Role:**
**Grade Level (for internal use):**
11
**The Team:** The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering, and distribution to power our Financial Institution Group business and customer needs. We focus on platform scalability to support business operations by following a common data lifecycle that accelerates business value. Our team provides essential intelligence for the Financial Services, Real Estate, and Insurance industries.
**The Impact:** The Data Engineering team will be responsible for implementing and maintaining services and tools to support existing feed systems. This enables users to consume FIG datasets and makes FIG data available for broader consumption and processing within the company.
**What's in it for you:** Opportunity to work with global stakeholders and engage with the latest tools and technologies.
**Responsibilities:**
+ Build new data acquisition and transformation pipelines using advanced data processing and cloud technologies.
+ Collaborate with the broader technology team, including information architecture and data integration teams, to align pipelines with strategic initiatives.
**What We're Looking For:**
+ Bachelor's degree in computer science or a related field, with at least 8+ years of professional software development experience.
+ Must have: **Programming languages commonly used for data processing,** **Data orchestration and workflow management systems,** **Distributed data processing framework, relational database management systems,** **B** **ig data processing frameworks** Experience with large-scale data processing platforms.
+ Deep understanding of RESTful services, good API design, and object-oriented programming principles.
+ Proficiency in object-oriented or functional scripting languages.
+ Good working knowledge of relational and NoSQL databases.
+ Experience in maintaining and developing software in production environments utilizing cloud-based tools.
+ Strong collaboration and teamwork skills, along with excellent written and verbal communication abilities.
+ Self-starter and motivated individual with the ability to thrive in a fast-paced software development environment.
+ Agile experience is highly desirable.
+ Experience with data warehousing and analytics platforms will be a significant advantage.
**Technical Expertise**
+ Data Engineering Expertise: Strong experience in distributed data processing and optimization using modern frameworks.
+ Cloud Platforms: Proficient in leveraging cloud services for scalable data solutions, including ETL orchestration, containerized deployments, and data storage.
+ Workflow Orchestration: Skilled in designing and managing complex data pipelines and workflows.
+ Programming & Scripting: Proficient in writing clean, modular, and testable code for data processing tasks.
+ Database Management: Solid understanding of both relational and non-relational databases, including data querying and modeling.
+ ETL & Data Architecture: Proven ability to design and implement robust ETL pipelines and optimize data models for performance and scalability.
**Soft Skills**
+ **Excellent communication skills** - able to articulate technical concepts to non-technical stakeholders.
+ **Strong interpersonal skills** - collaborative, empathetic, and team-oriented.
+ Demonstrated ability to work on **challenging projects** and go the **extra mile** to deliver results.
**Preferred Qualifications**
+ Experience with CI/CD pipelines, Github and DevOps practices is must.
+ Familiarity with data lake and data warehouse architectures.
+ Exposure to real-time data processing frameworks, and observability tools like Grafana is added advantage.
**What's In It For** **You?**
**Our Purpose:**
Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world.
Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence®, pinpointing risks and opening possibilities. We Accelerate Progress.
**Our People:**
We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.
From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.
**Our Values:**
**Integrity, Discovery, Partnership**
At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of **integrity** in all we do, bring a spirit of **discovery** to our work, and collaborate in close **partnership** with each other and our customers to achieve shared goals.
**Benefits:**
We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global.
Our benefits include:
+ Health & Wellness: Health care coverage designed for the mind and body.
+ Flexible Downtime: Generous time off helps keep you energized for your time on.
+ Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
+ Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
+ Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
+ Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.
For more information on benefits by country visit: Hiring and Opportunity at S&P Global:**
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
**Recruitment Fraud Alert:**
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, "pre-employment training" or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here ( .
---
**Equal Opportunity Employer**
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to:   and your request will be forwarded to the appropriate person. 
**US Candidates Only:** The EEO is the Law Poster   describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)
**Job ID:**
**Posted On:**
**Location:** Ahmedabad, Gujarat, India

**Description**
+ Lead the design, development, and implementation of scalable data pipelines and ELT processes using Databricks, DLT, dbt, Airflow, and other tools.
+ Collaborate with stakeholders to understand data requirements and deliver high-quality data solutions.
+ Optimize and maintain existing data pipelines to ensure data quality, reliability, and performance.
+ Develop and enforce data engineering best practices, including coding standards, testing, and documentation.
+ Mentor junior data engineers, providing technical leadership and fostering a culture of continuous learning and improvement.
+ Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to business operations.
+ Stay up to date with the latest industry trends and technologies, and proactively recommend improvements to our data engineering practices.
**Qualifications**
+ Systems (MIS), Data Science or related field.
+ 15 years of experience in data engineering and/or architecture, with a focus on big data technologies.
+ Extensive production experience with Databricks, Apache Spark, and other related technologies.
+ Familiarity with orchestration and ELT tools like Airflow, dbt, etc.
+ Expert SQL knowledge.
+ Proficiency in programming languages such as Python, Scala, or Java.
+ Strong understanding of data warehousing concepts.
+ Experience with cloud platforms such as Azure, AWS, Google Cloud.
+ Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
+ Strong communication and leadership skills, with the ability to effectively mentor and guide
+ Experience with machine learning and data science workflows
+ Knowledge of data governance and security best practices
+ Certification in Databricks, Azure, Google Cloud or related technologies.
This job posting will remain open a minimum of 72 hours and on an ongoing basis until filled.
**Job** Engineering
**Primary Location** India-Karnataka-Bengaluru
**Schedule:** Full-time
**Travel:** No
**Req ID:**
**Job Hire Type** Experienced Not Applicable #BMI N/A

**Description**
+ Lead the design, development, and implementation of scalable data pipelines and ELT processes using Databricks, DLT, dbt, Airflow, and other tools.
+ Collaborate with stakeholders to understand data requirements and deliver high-quality data solutions.
+ Optimize and maintain existing data pipelines to ensure data quality, reliability, and performance.
+ Develop and enforce data engineering best practices, including coding standards, testing, and documentation.
+ Mentor junior data engineers, providing technical leadership and fostering a culture of continuous learning and improvement.
+ Monitor and troubleshoot data pipeline issues, ensuring timely resolution and minimal disruption to business operations.
+ Stay up to date with the latest industry trends and technologies, and proactively recommend improvements to our data engineering practices.
**Qualifications**
+ Systems (MIS), Data Science or related field.
+ 15 years of experience in data engineering and/or architecture, with a focus on big data technologies.
+ Extensive production experience with Databricks, Apache Spark, and other related technologies.
+ Familiarity with orchestration and ELT tools like Airflow, dbt, etc.
+ Expert SQL knowledge.
+ Proficiency in programming languages such as Python, Scala, or Java.
+ Strong understanding of data warehousing concepts.
+ Experience with cloud platforms such as Azure, AWS, Google Cloud.
+ Excellent problem-solving skills and the ability to work in a fast-paced, collaborative environment.
+ Strong communication and leadership skills, with the ability to effectively mentor and guide
+ Experience with machine learning and data science workflows
+ Knowledge of data governance and security best practices
+ Certification in Databricks, Azure, Google Cloud or related technologies.
This job posting will remain open a minimum of 72 hours and on an ongoing basis until filled.
**Job** Information Technology
**Primary Location** India-Maharashtra-Mumbai
**Schedule:** Full-time
**Travel:** No
**Req ID:**
**Job Hire Type** Experienced Not Applicable #BMI N/A

**Job Description:**
We are looking for a Lead Data Engineer with strong Databricks expertise who can also design and build accelerators for automation. The role requires hands-on development in Databricks (PySpark, Spark SQL, Delta Lake,Autoloader, DLT etc) along with experience in creating frameworks for test data generation, report validation, and backend validation. You will be leading technical work, mentoring team members, and building reusable solutions that speed up project delivery.
**Key Responsibilities:**
·Design, develop, and optimize ETL/ELT pipelines on Databricks using PySpark, Spark SQL,Delta Lake, DLT live.
·Build automation accelerators such as:
Synthetic test data generators for large-scale data sets.
Automated report validation tools to compare dashboards with backend data.
Backend validation frameworks for reconciliation and data quality checks.
·Implement data validation frameworks (Great Expectations, Deequ, or custom solutions).
·Ensure data quality, lineage, and governance using Unity Catalog.
·Collaborate with QA, BI, and business teams to integrate accelerators into workflows.
·Drive best practices in coding, performance tuning, and cost optimization on Databricks.
·Lead and mentor data engineers, review code, and set technical standards.
**Must-Have Skills**
-5-7 years of experience in data engineering, with at least 3-5 years hands-on experience in databricks
·Databricks: PySpark, Spark SQL, Delta Lake, Delta Live Tables (DLT).
·Automation & Accelerators: Experience creating test data generators, validation frameworks, report reconciliation tools.
·Programming language: Strong in Python,PySpark and SQL.
·Validation Tools: open source tools like Great Expectations, Deequ, or equivalent custom frameworks.
·Data Pipelines: Batch and streaming pipeline design.
·Data Governance: Unity Catalog for access, lineage, and compliance.
·DevOps/CI-CD: Git, Azure DevOps, Jenkins, or GitHub Actions for deployment automation.
·Cloud & Storage: Azure (preferred) / AWS / GCP with hands-on in ADLS/S3/GCS.
**Good-to-Have Skills**
·Streaming: Kafka, EventHub, or Kinesis.
·Infra-as-Code: Terraform for Databricks and cloud provisioning.
·Reporting Tools: Power BI, Tableau, or Looker (for validation accelerators).
·Testing: Exposure to pytest or unittest for automation.
**Qualifications:**
-Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
**Labcorp is proud to be an Equal Opportunity Employer:**
Labcorp strives for inclusion and belonging in the workforce and does not tolerate harassment or discrimination of any kind. We make employment decisions based on the needs of our business and the qualifications and merit of the individual. Qualified applicants will receive consideration for employment without regard to race, religion, color, national origin, sex (including pregnancy, childbirth, or related medical conditions), family or parental status, marital, civil union or domestic partnership status, sexual orientation, gender identity, gender expression, personal appearance, age, veteran status, disability, genetic information, or any other legally protected characteristic. Additionally, all qualified applicants with arrest or conviction records will be considered for employment in accordance with applicable law.
**We encourage all to apply**
If you are an individual with a disability who needs assistance using our online tools to search and apply for jobs, or needs an accommodation, please visit our accessibility site ( or contact us at Labcorp Accessibility. ( ) For more information about how we collect and store your personal data, please see our Privacy Statement ( .

**Work Schedule**
Standard (Mon-Fri)
**Environmental Conditions**
Office
**Job Description**
**Position Overview**
As a Lead Data Engineer, your pivotal responsibility involves spearheading data initiatives and integrating top-tier data solutions. This role presents a thrilling chance to contribute to innovative projects and engage with a team of committed experts. Your proficiency is instrumental in elevating our competitiveness and ensuring seamless implementation of our data strategies!
**Key Responsibilities**
+ Lead the build, development, and optimization of scalable, secure, and high-performance data pipelines and architectures.
+ Lead and guide a team of data engineers and analysts, encouraging teamwork and technical excellence.
+ Implement standard methodologies for DataOps across the platform to uphold 99.99%+ availability, reliability, and recovery standards.
+ Build and maintain robust data models and frameworks, ensuring they align with enterprise architecture and governance standards.
+ Collaborate with cross-functional teams, including analytics, product, and business units to deliver high-impact, data-driven solutions.
+ Ensure data quality and validation through automated testing, monitoring, and anomaly detection techniques.
+ Own planning, prioritization, and execution of data engineering projects - delivering on time and within scope.
+ Contribute to platform scalability, performance tuning, and migration initiatives, including support for real-time data flows.
+ Deliver technical documentation and code reviews to uphold engineering standards and maintain knowledge continuity.
+ Support data privacy, security, and compliance requirements in line with global regulatory standards.
**Qualifications**
+ Bachelor's degree or equivalent experience in Computer Science, Data Engineering, Information Systems, or a related field.
+ Proven experience (5+ years) in data engineering with a strong understanding of modern data architecture, pipelines, and operations.
+ Expertise in ETL/ELT tools, data warehousing, and cloud-native platforms such as Databricks, Snowflake, or BigQuery.
+ Strong hands-on experience with SQL, Apache Spark, and Python (experience with Pandas preferred).
+ Proficient in working with large datasets and performance optimization for distributed computing environments.
+ Prior experience with tools like Informatica, Cognos, SQL Server, and Oracle is a strong plus.
+ Deep understanding of data modeling, metadata management, and data governance frameworks.
+ Demonstrated experience in leading engineering teams and managing project lifecycles.
+ Familiarity with DevOps/DataOps practices, version control systems (e.g., GitHub), and CI/CD pipelines.
+ Excellent communication, leadership, and collaborator management skills.
+ Experience working in cloud environments such as AWS, Azure, or GCP.
Why Join Us?
This is your chance to work on exceptionally impactful projects and grow your career in an encouraging and innovative environment!
Thermo Fisher Scientific is an EEO/Affirmative Action Employer and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other legally protected status.