26,643 Lead Data Engineer jobs in India

Honeywell Connected Enterprise (HCE) is the software division of Honeywell with strategic focus on digitization, sustainability, and OT Cybersecurity SaaS offerings and solutions. HCE was established to leverage Honeywell's domain expertise and lead the transition into a cutting-edge industrial software company. Since our inception in 2018, HCE established the category of intelligent operations and built a new platform born out of decades of operational data and insights, uniting real-time data across assets, people, and processes into a system of record for a 360-degree view. This is our flagship offering - Honeywell Forge. We are a global team of thousands of innovators with expertise spanning industrial operations, software engineering, data science, artificial intelligence, and process engineering. We are paving the way for our customers to grow responsibly. We believe the future is what we make it. As a Honeywell Futureshaper, you are a part of something bigger. You can work with highly capable people to make the world a better place and become the best you. After all, we are not imagining the future; we're building it.
As a Lead Data Engineer, you will be part of a team that delivers contemporary analytics solutions for all Honeywell business groups and functions. You will build strong relationships with leadership to effectively deliver contemporary data analytics solutions & contribute directly to business success.
+ You will develop solutions on various Database systems viz. Databricks, Snowflake, Hive, Hadoop, PostgreSQL, etc.
+ You will identify and implement process improvements - and you don't like to the same thing twice so you will automate it if you can.
+ You are always keeping an eye on scalability, optimization, and process. You have worked with Big Data before, IoT data, SAP, SQL, Azure, AWS and a bunch of other acronyms.
+ You will work on a team including scrum masters, product owners, data architects, data engineers/designers, data scientists and DevOps.
+ You and your team collaborate to build products from the idea phase through launch and beyond. The software you write makes it to production in couple of sprints.
+ Your team will be working on creating a new platform using your experience of APIs, microservices, and platform development.
You Must Have
+ Bachelors or Master's degree in Computer Science, Engineering, Applied Mathematics or related field
+ 12+ years of data engineering, data design and/or enterprise data management & analytics experience
+ Should be able to architect large enterprise analytics projects with optimal solutions on the Bigdata platform.
+ Should have designed, developed and deployed complex big data ingestion jobs with contemporary data ingestion tools like Spark, Informatica Power Center & BDM on Databricks/Hadoop/NoSQL/MPP platforms.
+ Experience with dimensional modeling, data warehousing and data miningA Job posting does not exist for this global job code, please work with your HRG to develop one
We Value
+ 4 years of experience in building advanced analytics solutions with data from enterprise systems like ERPs(SAP, Oracle, etc.), RDBMS, CRMs, Marketing & Logistics tools etc.
+ 4 years of hands on experience with Spark, Pig/hive etc. and automation of data flows using Informatica BDM/DEI, NiFi and/or Airflow/Oozie.
Honeywell helps organizations solve the world's most complex challenges in automation, the future of aviation and energy transition. As a trusted partner, we provide actionable solutions and innovation through our Aerospace Technologies, Building Automation, Energy and Sustainability Solutions, and Industrial Automation business segments - powered by our Honeywell Forge software - that help make the world smarter, safer and more sustainable.
Honeywell is an equal opportunity employer. Qualified applicants will be considered without regard to age, race, creed, color, national origin, ancestry, marital status, affectional or sexual orientation, gender identity or expression, disability, nationality, sex, religion, or veteran status.

**Our Purpose**
_Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential._
**Title and Summary**
Lead Data Engineer
Overview
We are the global technology company behind the world's fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.
Our team within Mastercard - Services:
The Services org is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to make multi-million-dollar decisions and grow their businesses. Focused on thinking big and scaling fast around the globe, this agile team is responsible for end-to-end solutions for a diverse global customer base. Centered on data-driven technologies and innovation, these services include payments-focused consulting, loyalty and marketing programs, business Test & Learn experimentation, and data-driven information and risk management services.
Advanced Analytics Program:
Within the Services Technology Team, the Advanced Analytics program is a relatively new program that is comprised of a rich set of products that provide accurate perspectives on Credit Risk, Portfolio Optimization, and Ad Insights. Currently, we are enhancing our customer experience with new user interfaces, moving to API and web application-based data publishing to allow for seamless integration in other Mastercard products and externally, utilizing new data sets and algorithms to further analytic capabilities, and generating scalable big data processes.
We are looking for an innovative lead data engineer who will lead the technical design and development of an Analytic Foundation. The Analytic Foundation is a suite of individually commercialized analytical capabilities that also includes a comprehensive data platform. These services will be offered through a series of APIs that deliver data and insights from various points along a central data store. This individual will partner closely with other areas of the business to build and enhance solutions that drive value for our customers.
Engineers work in small, flexible teams. Every team member contributes to designing, building, and testing features. The range of work you will encounter varies from building intuitive, responsive UIs to designing backend data models, architecting data flows, and beyond. There are no rigid organizational structures, and each team uses processes that work best for its members and projects.
Here are a few examples of products in our space:
- Portfolio Optimizer (PO) is a solution that leverages Mastercard's data assets and analytics to allow issuers to identify and increase revenue opportunities within their credit and debit portfolios.
- Audiences uses anonymized and aggregated transaction insights to offer targeting segments that have high likelihood to make purchases within a category to allow for more effective campaign planning and activation.
- Credit Risk products are a new suite of APIs and tooling to provide lenders real-time access to KPIs and insights serving thousands of clients to make smarter risk decisions using Mastercard data.
Help found a new, fast-growing engineering team!
Position Responsibilities:
As a Lead Data Engineer within Advanced Analytics team, you will:
- Lead collaboration with data scientists to understand the existing modeling pipeline and identify optimization opportunities.
- Oversee the integration and management of data from various sources and storage systems, establishing processes and pipelines to produce cohesive datasets for analysis and modeling.
- Partner with Product Managers and Customer Experience Designers to develop a deep understanding of users and use cases and apply that knowledge to scoping and building new modules and features
- Design and develop data pipelines to automate repetitive tasks within data science and data engineering.
- Demonstrated experience leading cross-functional teams or working across different teams to solve complex problems.
- Identify patterns and innovative solutions in existing spaces, consistently seeking opportunities to simplify, automate tasks, and build reusable components for multiple use cases and teams.
- Create data products that are well-modeled, thoroughly documented, and easy to understand and maintain.
- Comfortable leading projects in environments with undefined or ambiguous requirements.
- Mentor junior data engineers
Ideal Candidate Qualifications:
- High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Impala, Oozie, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
- Extensive experience with Spark Processing engine.
- Proficiency in, at least, one modern programming language such as Python, Java or Scala
- Strong Computer Science fundamentals in object-oriented design, data structures, algorithm design, problem solving, and complexity analysis.
- Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
- Working Knowledge in Software Development engineering Paradigms along with Data Engineering.
- Relational Databases as well as NoSQL experience
- Experience in cloud technologies like Databricks/AWS/Azure
- Basic Shell scripting and knowledge of Linux/Unix systems
- Experience in designing & developing software at scale
- Strong written and verbal English communication skills.
**Corporate Security Responsibility**
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
+ Abide by Mastercard's security policies and practices;
+ Ensure the confidentiality and integrity of the information being accessed;
+ Report any suspected information security violation or breach, and
+ Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.

**Work Schedule**
Standard (Mon-Fri)
**Environmental Conditions**
Office
**Job Description**
**Position Overview**
As a Lead Data Engineer, your pivotal responsibility involves spearheading data initiatives and integrating top-tier data solutions. This role presents a thrilling chance to contribute to innovative projects and engage with a team of committed experts. Your proficiency is instrumental in elevating our competitiveness and ensuring seamless implementation of our data strategies!
**Key Responsibilities**
+ Lead the build, development, and optimization of scalable, secure, and high-performance data pipelines and architectures.
+ Lead and guide a team of data engineers and analysts, encouraging teamwork and technical excellence.
+ Implement standard methodologies for DataOps across the platform to uphold 99.99%+ availability, reliability, and recovery standards.
+ Build and maintain robust data models and frameworks, ensuring they align with enterprise architecture and governance standards.
+ Collaborate with cross-functional teams, including analytics, product, and business units to deliver high-impact, data-driven solutions.
+ Ensure data quality and validation through automated testing, monitoring, and anomaly detection techniques.
+ Own planning, prioritization, and execution of data engineering projects - delivering on time and within scope.
+ Contribute to platform scalability, performance tuning, and migration initiatives, including support for real-time data flows.
+ Deliver technical documentation and code reviews to uphold engineering standards and maintain knowledge continuity.
+ Support data privacy, security, and compliance requirements in line with global regulatory standards.
**Qualifications**
+ Bachelor's degree or equivalent experience in Computer Science, Data Engineering, Information Systems, or a related field.
+ Proven experience (5+ years) in data engineering with a strong understanding of modern data architecture, pipelines, and operations.
+ Expertise in ETL/ELT tools, data warehousing, and cloud-native platforms such as Databricks, Snowflake, or BigQuery.
+ Strong hands-on experience with SQL, Apache Spark, and Python (experience with Pandas preferred).
+ Proficient in working with large datasets and performance optimization for distributed computing environments.
+ Prior experience with tools like Informatica, Cognos, SQL Server, and Oracle is a strong plus.
+ Deep understanding of data modeling, metadata management, and data governance frameworks.
+ Demonstrated experience in leading engineering teams and managing project lifecycles.
+ Familiarity with DevOps/DataOps practices, version control systems (e.g., GitHub), and CI/CD pipelines.
+ Excellent communication, leadership, and collaborator management skills.
+ Experience working in cloud environments such as AWS, Azure, or GCP.
Why Join Us?
This is your chance to work on exceptionally impactful projects and grow your career in an encouraging and innovative environment!
Thermo Fisher Scientific is an EEO/Affirmative Action Employer and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other legally protected status.

Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create sustainable growth, optimize internal processes and deliver better consumer outcomes.
Health systems, hospitals and medical clinics are under immense pressure to improve clinical outcomes and reduce the cost of providing patient care. Investing in new partnerships, clinical services and technology is not enough to create meaningful and substantive change. To succeed long-term, healthcare organizations must empower leaders, clinicians, employees, affiliates and communities to build cultures that foster innovation to achieve the best outcomes for patients.
Joining the Huron team means you'll help our clients evolve and adapt to the rapidly changing healthcare environment and optimize existing business operations, improve clinical outcomes, create a more consumer-centric healthcare experience, and drive physician, patient and employee engagement across the enterprise.
Join our team as the expert you are now and create your future.
As a Lead Data Engineer, you will play a key role in supporting our various business objectives. You will collaborate directly with all members of the Engineering team and key individuals from other business units, lead the requirements discovery process, lead interactive prototyping sessions, build required data models, and prepare the models for release to production. You will utilize several different software tools and architectures to accomplish these objectives. The successful candidate will demonstrate the ability to consistently engineer data-driven models and solutions that solve problems and identify opportunities to drive operational excellence. Responsibilities Include: - Interact with key business unit leaders to elicit requirements and develop prototypes. - Successfully translate business requirements into analytical model specifications. - Identify opportunities to improve business outcomes with new data-driven solutions. - Design and coordinate the development of data-driven processes, analyses, and tools. - Work with the database architect to plan appropriate data structures to support models. - Build frameworks for automating operational models for continual analysis and insight. - Present concise and clear recommendations to business unit and practice leadership, including properly design visualizations, where appropriate. - Design and execute proper experiments to improve operations. - Assist with developing scripts and applications necessary to support data model implementation.
**Duties & Responsibilities:**
You will be responsible to handle the core data aspects of software engineering and data science; use software engineering principles to develop algorithms that automate the data flow process. Also collaborate with data scientists to build machine learning and analytics infrastructure, from testing to deployment.
+ Building and maintaining data infrastructure for the optimal extraction, transformation, and loading of data from a wide variety of sources such as AWS data lakes and data warehouse.
+ Ensuring data accessibility at all times and implementing company data policies with respect to data privacy and confidentiality
+ Cleaning and wrangling data from primary and secondary sources into formats that can be efficiently utilized by data scientists and other data consumers
+ Collaborating with engineering teams, data scientists, and other stakeholders to understand how data can be leveraged to meet business needs
**Job Description:**
+ Bachelor's Degree.
+ 8+ years of experience with 5+ years of strong experience working with data.
+ Strong communication skills: ability to be well-organized, clear, and concise in conversations and written communications with development team members, business analysts, and project management.
+ Experience in Healthcare will be an added advantage.
+ Very strong communication and leadership skills and works well independently
+ Proficiency in Data Engineering best practices.
+ Experience working with Agile development methodologies
+ Good knowledge of SQL and NoSQL databases and are skilled in writing SQL queries to manipulate and retrieve data.
+ Good knowledge and hands-on experience on Python, SQL, Scala, R programing language.
+ Good Data Base knowledge on MySQL and SQL Server, strong emphasis on relational database design, scripting, and stored procedures
+ Proficiency with AWS tools: S3, Athena, Glue, RDS, Redshift, Step Functions, Lake Formation, Cloud Formation, Event Bridge, Lambda
+ Experience working with structured, semi-structured and un-structured data, ETL, data cleansing, and data conversion, data parsing
+ Experience in data modeling complex data warehouse architecture in Redshift/Athena
+ Proficiency in various data cleansing techniques, tools and ETL process.
+ Fimiliar with symantic data modelling techniques using Cube.js or (SSAS/Looker).
+ Able to manage your own time and work well both independently and as part of a team.
**Position Level**
Senior Associate
**Country**
India
At Huron, we're redefining what a consulting organization can be. We go beyond advice to deliver results that last. We inherit our client's challenges as if they were our own. We help them transform for the future. We advocate. We make a difference. And we intelligently, passionately, relentlessly do great work.together.
Are you the kind of person who stands ready to jump in, roll up your sleeves and transform ideas into action? Then come discover Huron.
Whether you have years of experience or come right out of college, we invite you to explore our many opportunities. Find out how you can use your talents and develop your skills to make an impact immediately. Learn about how our culture and values provide you with the kind of environment that invites new ideas and innovation. Come see how we collaborate with each other in a culture of learning, coaching, diversity and inclusion. And hear about our unwavering commitment to make a difference in partnership with our clients, shareholders, communities and colleagues.
Huron Consulting Group offers a competitive compensation and benefits package including medical, dental, and vision coverage to employees and dependents; a 401(k) plan with a generous employer match; an employee stock purchase plan; a generous Paid Time Off policy; and paid parental leave and adoption assistance. Our Wellness Program supports employee total well-being by providing free annual health screenings and coaching,

**About the Role:**
**Grade Level (for internal use):**
11
**The Team:** The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering, and distribution to power our Financial Institution Group business and customer needs. We focus on platform scalability to support business operations by following a common data lifecycle that accelerates business value. Our team provides essential intelligence for the Financial Services, Real Estate, and Insurance industries.
**The Impact:** The Data Engineering team will be responsible for implementing and maintaining services and tools to support existing feed systems. This enables users to consume FIG datasets and makes FIG data available for broader consumption and processing within the company.
**What's in it for you:** Opportunity to work with global stakeholders and engage with the latest tools and technologies.
**Responsibilities:**
+ Build new data acquisition and transformation pipelines using advanced data processing and cloud technologies.
+ Collaborate with the broader technology team, including information architecture and data integration teams, to align pipelines with strategic initiatives.
**What We're Looking For:**
+ Bachelor's degree in computer science or a related field, with at least 8+ years of professional software development experience.
+ Must have: **Programming languages commonly used for data processing,** **Data orchestration and workflow management systems,** **Distributed data processing framework, relational database management systems,** **B** **ig data processing frameworks** Experience with large-scale data processing platforms.
+ Deep understanding of RESTful services, good API design, and object-oriented programming principles.
+ Proficiency in object-oriented or functional scripting languages.
+ Good working knowledge of relational and NoSQL databases.
+ Experience in maintaining and developing software in production environments utilizing cloud-based tools.
+ Strong collaboration and teamwork skills, along with excellent written and verbal communication abilities.
+ Self-starter and motivated individual with the ability to thrive in a fast-paced software development environment.
+ Agile experience is highly desirable.
+ Experience with data warehousing and analytics platforms will be a significant advantage.
**Technical Expertise**
+ Data Engineering Expertise: Strong experience in distributed data processing and optimization using modern frameworks.
+ Cloud Platforms: Proficient in leveraging cloud services for scalable data solutions, including ETL orchestration, containerized deployments, and data storage.
+ Workflow Orchestration: Skilled in designing and managing complex data pipelines and workflows.
+ Programming & Scripting: Proficient in writing clean, modular, and testable code for data processing tasks.
+ Database Management: Solid understanding of both relational and non-relational databases, including data querying and modeling.
+ ETL & Data Architecture: Proven ability to design and implement robust ETL pipelines and optimize data models for performance and scalability.
**Soft Skills**
+ **Excellent communication skills** - able to articulate technical concepts to non-technical stakeholders.
+ **Strong interpersonal skills** - collaborative, empathetic, and team-oriented.
+ Demonstrated ability to work on **challenging projects** and go the **extra mile** to deliver results.
**Preferred Qualifications**
+ Experience with CI/CD pipelines, Github and DevOps practices is must.
+ Familiarity with data lake and data warehouse architectures.
+ Exposure to real-time data processing frameworks, and observability tools like Grafana is added advantage.
**What's In It For** **You?**
**Our Purpose:**
Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world.
Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence®, pinpointing risks and opening possibilities. We Accelerate Progress.
**Our People:**
We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.
From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.
**Our Values:**
**Integrity, Discovery, Partnership**
At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of **integrity** in all we do, bring a spirit of **discovery** to our work, and collaborate in close **partnership** with each other and our customers to achieve shared goals.
**Benefits:**
We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global.
Our benefits include:
+ Health & Wellness: Health care coverage designed for the mind and body.
+ Flexible Downtime: Generous time off helps keep you energized for your time on.
+ Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
+ Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
+ Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
+ Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.
For more information on benefits by country visit: Hiring and Opportunity at S&P Global:**
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
**Recruitment Fraud Alert:**
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, "pre-employment training" or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here ( .
---
**Equal Opportunity Employer**
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to:   and your request will be forwarded to the appropriate person. 
**US Candidates Only:** The EEO is the Law Poster   describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)
**Job ID:**
**Posted On:**
**Location:** Ahmedabad, Gujarat, India

**About the Role:**
**Grade Level (for internal use):**
11
**The Team:** The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering, and distribution to power our Financial Institution Group business and customer needs. We focus on platform scalability to support business operations by following a common data lifecycle that accelerates business value. Our team provides essential intelligence for the Financial Services, Real Estate, and Insurance industries.
**The Impact:** The Data Engineering team will be responsible for implementing and maintaining services and tools to support existing feed systems. This enables users to consume FIG datasets and makes FIG data available for broader consumption and processing within the company.
**What's in it for you:** Opportunity to work with global stakeholders and engage with the latest tools and technologies.
**Responsibilities:**
+ Build new data acquisition and transformation pipelines using advanced data processing and cloud technologies.
+ Collaborate with the broader technology team, including information architecture and data integration teams, to align pipelines with strategic initiatives.
**What We're Looking For:**
+ Bachelor's degree in computer science or a related field, with at least 8+ years of professional software development experience.
+ Must have: **Programming languages commonly used for data processing,** **Data orchestration and workflow management systems,** **Distributed data processing framework, relational database management systems,** **B** **ig data processing frameworks** Experience with large-scale data processing platforms.
+ Deep understanding of RESTful services, good API design, and object-oriented programming principles.
+ Proficiency in object-oriented or functional scripting languages.
+ Good working knowledge of relational and NoSQL databases.
+ Experience in maintaining and developing software in production environments utilizing cloud-based tools.
+ Strong collaboration and teamwork skills, along with excellent written and verbal communication abilities.
+ Self-starter and motivated individual with the ability to thrive in a fast-paced software development environment.
+ Agile experience is highly desirable.
+ Experience with data warehousing and analytics platforms will be a significant advantage.
**Technical Expertise**
+ Data Engineering Expertise: Strong experience in distributed data processing and optimization using modern frameworks.
+ Cloud Platforms: Proficient in leveraging cloud services for scalable data solutions, including ETL orchestration, containerized deployments, and data storage.
+ Workflow Orchestration: Skilled in designing and managing complex data pipelines and workflows.
+ Programming & Scripting: Proficient in writing clean, modular, and testable code for data processing tasks.
+ Database Management: Solid understanding of both relational and non-relational databases, including data querying and modeling.
+ ETL & Data Architecture: Proven ability to design and implement robust ETL pipelines and optimize data models for performance and scalability.
**Soft Skills**
+ **Excellent communication skills** - able to articulate technical concepts to non-technical stakeholders.
+ **Strong interpersonal skills** - collaborative, empathetic, and team-oriented.
+ Demonstrated ability to work on **challenging projects** and go the **extra mile** to deliver results.
**Preferred Qualifications**
+ Experience with CI/CD pipelines, Github and DevOps practices is must.
+ Familiarity with data lake and data warehouse architectures.
+ Exposure to real-time data processing frameworks, and observability tools like Grafana is added advantage.
**What's In It For** **You?**
**Our Purpose:**
Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world.
Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence®, pinpointing risks and opening possibilities. We Accelerate Progress.
**Our People:**
We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.
From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.
**Our Values:**
**Integrity, Discovery, Partnership**
At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of **integrity** in all we do, bring a spirit of **discovery** to our work, and collaborate in close **partnership** with each other and our customers to achieve shared goals.
**Benefits:**
We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global.
Our benefits include:
+ Health & Wellness: Health care coverage designed for the mind and body.
+ Flexible Downtime: Generous time off helps keep you energized for your time on.
+ Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
+ Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
+ Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
+ Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.
For more information on benefits by country visit: Hiring and Opportunity at S&P Global:**
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
**Recruitment Fraud Alert:**
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, "pre-employment training" or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here ( .
---
**Equal Opportunity Employer**
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to:   and your request will be forwarded to the appropriate person. 
**US Candidates Only:** The EEO is the Law Poster   describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)
**Job ID:**
**Posted On:**
**Location:** Ahmedabad, Gujarat, India

Achieving our goals starts with supporting yours. Grow your career, access top-tier health and wellness benefits, build lasting connections with your team and our customers, and travel the world using our extensive route network.
Come join us to create what's next. Let's define tomorrow, together.
**Description**
**Description - External**
United's Digital Technology team designs, develops, and maintains massively scaling technology solutions brought to life with innovative architectures, data analytics, and digital solutions.
Find your future at United! We're reinventing what our industry looks like, and what an airline can be - from the planes we fly to the people who fly them. When you join us, you're joining a global team of 100,000+ connected by a shared passion with a wide spectrum of experience and skills to lead the way forward.
Achieving our ambitions starts with supporting yours. Evolve your career and find your next opportunity. Get the care you need with industry-leading health plans and best-in-class programs to support your emotional, physical, and financial wellness. Expand your horizons with travel across the world's biggest route network. Connect outside your team through employee-led Business Resource Groups.
Create what's next with us. Let's define tomorrow together.
**Job overview and responsibilities**
United Airlines is seeking talented people to join the Data and Machine Learning Engineering team. The organization is responsible for leading data driven insights & innovation to support the Machine Learning needs for commercial and operational projects with a digital focus. This role will frequently collaborate with data scientists and data engineers. This role will design and implement key components of the Machine Learning Platform, business use cases, and establish processes and best practices.
**This position is offered on local terms and conditions. Expatriate assignments and sponsorship for employment visas, even on a time-limited visa status, will not be awarded.**
United Airlines is an equal opportunity employer. United Airlines recruits, employs, trains, compensates, and promotes regardless of race, religion, color, national origin, gender identity, sexual orientation, physical ability, age, veteran status, and other protected status as required by applicable law.
· Build high-performance, cloud-native machine learning infrastructure and AIML services to enable rapid innovation across United. Set up containers and Serverless platform with cloud infrastructure. Design and develop tools and apps to enable AIML automation using AWS ecosystem.
· Build data pipelines to enable AIML models for batch and real-time data. Hands on development expertise of Python, Spark, Flink, FastAPI (similar framework), Kubernetes, ArgoCD, Github.
· Stay aligned with the latest developments in cloud-native and ML ops/engineering and to experiment with and learn new technologies - Agentic AI tools, MCP, Agent Development Kits LLMOps, A2A etc.
. Optimize, Fine-tune, Deploy and Monitor; Scalable and Secure Agents and Services.
**Qualifications - External**
**Required**
· Bachelor's degree in Computer Science, Data Science, Generative AI, Engineering or related discipline or Mathematics experience required
· 6+ years of software engineering experience with languages such as Python, Go, Java, Scala, Kotlin, or C/C++.
· 5+ years of experience in machine learning, deep learning, and natural language processing.
· 3+ years of experience working in cloud environments (AWS preferred) - Kubernetes, Dockers, ECS and EKS.
· 2+ years of experience with Big Data technologies such as Spark, Flink and SQL programming.
· 3+ years of experience with cloud-native DevOps, CI/CD.
· 1+ years of experience with Generative AI/LLMs.
· Strong software engineering experience with Python .
· Familiarity with data science methodologies and frameworks used for building and deploying production grade systems.
· ML pipelines Experience in ML model life cycle development experience and prefer experience to common algorithms
**Qualifications**
**Preferred**
· Master's degree
· Computer Science or related STEM field

**About us:**
Working at Target means helping all families discover the joy of everyday life. We bring that vision to life through our values and culture. Learn more about Target here ( .
**About the Role:**
As a **Lead Data Engineer** , you will serve as the **technical anchor** for the engineering team, responsible for designing and developing **scalable, high-performance data solutions** . You will **own and drive data architecture** that supports both functional and non-functional business needs, ensuring **reliability, efficiency, and scalability** .
Your expertise in **big data technologies, distributed systems, and cloud platforms** will help shape the engineering roadmap and best practices for **data processing, analytics, and real-time data serving** . You will play a key role in **architecting and optimizing data pipelines** using **Hadoop, Spark, Scala/Java, and cloud technologies** to support enterprise-wide data initiatives.
Additionally, **experience with API development for serving low-latency data** and **Customer Data Platforms (CDP)** will be a strong plus.
**Key Responsibilities:**
+ Architect and build **scalable, high-performance data pipelines** and **distributed data processing solutions** using **Hadoop, Spark, Scala/Java, and cloud platforms (AWS/GCP/Azure)** .
+ Design and implement **real-time and batch data processing solutions** , ensuring data is efficiently processed and made available for analytical and operational use.
+ **Develop APIs and data services** to expose **low-latency, high-throughput** data for downstream applications, enabling real-time decision-making.
+ Optimize and enhance **data models, workflows, and processing frameworks** to improve performance, scalability, and cost-efficiency.
+ Drive **data governance, security, and compliance** best practices.
+ Collaborate with **data scientists, product teams, and business stakeholders** to understand requirements and deliver **data-driven solutions** .
+ Lead the **design, implementation, and lifecycle management** of data services and solutions.
+ Stay up to date with **emerging technologies** and drive adoption of best practices in **big data engineering, cloud computing, and API development** .
+ Provide **technical leadership and mentorship** to engineering teams, promoting best practices in **data engineering and API design** .
**About You:**
+ **7+ years of experience in data engineering, software development, or distributed systems.**
+ **Expertise in big data technologies** such as **Hadoop, Spark, and distributed processing frameworks.**
+ **Strong programming skills in Scala and/or Java** (Python is a plus).
+ **Experience with cloud platforms (AWS, GCP, or Azure)** and their **data ecosystem** (e.g., S3, BigQuery, Databricks, EMR, Snowflake, etc.).
+ **Proficiency in API development** using **REST, GraphQL, or gRPC** to serve real-time and batch data.
+ **Experience with real-time and streaming data architectures** (Kafka, Flink, Kinesis, etc.).
+ Strong knowledge of **data modeling, ETL pipeline design, and performance optimization** .
+ Understanding of **data governance, security, and compliance** in large-scale data environments.
+ **Experience with Customer Data Platforms (CDP) or customer-centric data processing** is a strong plus.
+ Strong problem-solving skills and ability to work in **complex, unstructured environments** .
+ Excellent communication and collaboration skills, with experience working in **cross-functional teams** .
**Why Join Us?**
+ Work with cutting-edge **big data, API, and cloud technologies** in a fast-paced, collaborative environment.
+ Influence and shape the **future of data architecture and real-time data services** at Target.
+ Solve **high-impact business problems** using **scalable, low-latency data solutions** .
+ Be part of a culture that values **innovation, learning, and growth** .

**About the Role:**
**Grade Level (for internal use):**
11
**S&P Global Mobility**
**The Role: Lead Data Engineer( AWS Cloud, Python)**
We are seeking a **Senior Data Engineer** with deep expertise in AWS Cloud Development to join our fast-paced data engineering organization. This role is critical to both the development of new data products and the modernization of existing platforms. The ideal candidate is a seasoned data engineer with hands-on experience designing, building, and optimizing large-scale data pipelines and architectures in both on-premises (e.g., Oracle) and cloud environments (especially AWS). This individual will also serve as a **Cloud Development expert** , mentoring and guiding other data engineers as they enhance their cloud skillsets.
**Responsibilities**
+ **Data Engineering & Architecture**
+ Design, build, and maintain scalable data pipelines and data products.
+ Develop and optimize ELT/ETL processes using a variety of data tools and technologies.
+ Support and evolve data models that drive operational and analytical workloads.
+ Modernize legacy Oracle-based systems and migrate workloads to cloud-native platforms.
+ **Cloud Development & DevOps (AWS-Focused)**
+ Build, deploy, and manage cloud-native data solutions using AWS services (e.g., S3, Lambda, Glue, EMR, Redshift, Athena, Step Functions).
+ Implement CI/CD pipelines, IaC (e.g., Terraform or CloudFormation), and monitor cloud infrastructure for performance and cost optimization.
+ Ensure data platform security, scalability, and resilience in the AWS cloud.
+ **Technical Leadership & Mentoring**
+ Act as a subject matter expert on cloud-based data development and DevOps best practices.
+ Mentor data engineers on AWS architecture, infrastructure as code, and cloud-first design patterns.
+ Participate in code and architecture reviews, enforcing best practices and high-quality standards.
+ **Cross-functional Collaboration**
+ Work closely with product managers, data analysts, software engineers, and other stakeholders to understand business needs and deliver end-to-end solutions.
+ Support and evolve the roadmap for data platform modernization and new product delivery.
**What We're looking for:**
**Required Qualifications**
+ **8+ years** of experience in data engineering or equivalent technical role.
+ **5+ years** of hands-on experience with AWS Cloud Development and DevOps.
+ Strong expertise in **SQL** , **data modeling** , and **ETL/ELT pipelines** .
+ Deep experience with **Oracle** (PL/SQL, performance tuning, data extraction).
+ Proficiency in **Python** and/or **Scala** for data processing tasks.
+ Strong knowledge of cloud infrastructure (networking, security, cost optimization).
+ Experience with **infrastructure as code** (Terraform).
+ Familiarity with CI/CD pipelines and DevOps tooling (e.g., Jenkins, GitHub Actions).
**Preferred (Nice to Have)**
+ Experience with **Google Cloud Platform (GCP), Snowflake**
+ Knowledge of containerization and orchestration tools.
+ Experience with modern orchestration tools (e.g., Airflow, dbt).
+ Exposure to data cataloging, governance, and quality tools.
**About Company Statement:**
**S&P Global delivers essential intelligence that powers decision making.** We provide the world's leading organizations with the right data, connected technologies and expertise they need to move ahead. As part of our team, you'll help solve complex challenges that equip businesses, governments and individuals with the knowledge to adapt to a changing economic landscape.
**S&P Global Mobility** turns invaluable insights captured from automotive data to help our clients understand today's market, reach more customers, and shape the future of automotive mobility.
**About S&P Global Mobility**
At S&P Global Mobility, we provide invaluable insights derived from unmatched automotive data, enabling our customers to anticipate change and make decisions with conviction. Our expertise helps them to optimize their businesses, reach the right consumers, and shape the future of mobility. We open the door to automotive innovation, revealing the buying patterns of today and helping customers plan for the emerging technologies of tomorrow.
For more information, visit .
**What's In It For** **You?**
**Our Purpose:**
Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world.
Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence®, pinpointing risks and opening possibilities. We Accelerate Progress.
**Our People:**
We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.
From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.
**Our Values:**
**Integrity, Discovery, Partnership**
At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of **integrity** in all we do, bring a spirit of **discovery** to our work, and collaborate in close **partnership** with each other and our customers to achieve shared goals.
**Benefits:**
We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global.
Our benefits include:
+ Health & Wellness: Health care coverage designed for the mind and body.
+ Flexible Downtime: Generous time off helps keep you energized for your time on.
+ Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
+ Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
+ Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
+ Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.
For more information on benefits by country visit: Hiring and Opportunity at S&P Global:**
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
**Recruitment Fraud Alert:**
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, "pre-employment training" or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here ( .
---
**Equal Opportunity Employer**
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to:   and your request will be forwarded to the appropriate person. 
**US Candidates Only:** The EEO is the Law Poster   describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)
**Job ID:**
**Posted On:**
**Location:** Bangalore, Karnataka, India