32,786 Lead Data Engineer jobs in India
Lead Data Engineer
Mumbai, Maharashtra
TransOrg Analytics
Job Viewed
Job Description
Location : Gurgaon/Mumbai
Job ID : DE2001
Job Type : Full time
Experience : 5-8 years
Why would you like to join us?TransOrg Analytics, an award winning – Big Data and Predictive analytics- company, offers advanced analytics solutions to industry leaders and Fortune 500 companies across India, US, UK, Singapore and the Middle East. Our products – Clonizo’ (customer cloning) have yielded significant incremental benefits to our clients. We have been recognized by the CIO Review magazine as the – Predictive Analytics Company of the Year- and by TiE for excellence in entrepreneurship.
OverviewYou will have to work with data to help the organization make better business decisions. Using techniques from a range of disciplines, including computer programming, mathematics, and statistics to draw conclusions from data to describe, predict, and improve business performance.
Key Responsibilities- Analyzing data using statistical techniques and providing reports.
- Developing and implementing databases and data collection systems.
- Acquiring data from primary and secondary sources and maintain data systems.
- Identifying, analyzing, and interpreting trends or patterns in complex data sets
- Lead the Data Engineering through its next phase of growth.
- Design/Implementation/Consulting experience of large-scale data solutions, including data Ingestion, Data Modelling, Design & Architecture. The projects may include development, deployment, and infrastructure with complexity around technology, cross-functional dependencies, and multiple stakeholders across various divisions and departments?
- Identifying data sources
- Collecting data, Sourcing missing data, Organizing data in to usable formats, Analyzing data to find answers to specific questions, Setting up data infrastructure, Developing, implementing and maintaining databases
- Assessing quality of data and removing or cleaning data
- Generating information and insights from data sets and identifying trends and patterns
- Preparing reports for executive and project teams
- Creating visualizations of data
- A single point contact for all type of data and data related issues. Work closely with vendors, functional, operational, and technical teams across the business to understand their data needs and develop solutions that allow various functions to make data-informed decision.
- Will be responsible for data consistency and accuracy in timely manner pertaining to all data providers/vendors.
- Solid experience leading data teams in developing data fabric platforms.
- Have an eye for Data Quality and understanding of data completeness.
- Understanding different market data used in current business processes and the impact of making changes.
- Ability to build scale and performance as part of development.
- Ability to troubleshoot scale and performance issues, data validation issues
- Expert in implementing security best practices.
- Should know various tolls and techniques to ensure data is accurate and verified.
- Develop, document, maintain and support nimble data solutions that are able to both provide ready access to existing data features and incorporate new features in a timely manner.
- Develop the data roadmap using the most appropriate technologies and manage and expand in- house data teams to support growth.
- Work cross-functionally across multiple locations so communication, collaboration, and organization are key to your success.
- Automation of multi-step repetitive tasks.
- Relational Database and SQL and Oracle Language
- Hands on experience on R or Python–Statistical Programming
- Extraction, Transformation and Loading (ETL) (Microsoft SSIS)
- Analytics / OLAP Cube Development (Microsoft SSAS and MDX)
- Report Development (Microsoft SSRS)
- Big Data, Hadoop and analytics knowledge
- Data Warehouse knowledge
- Problem-solving and troubleshooting.
- Strong knowledge & experience in Relational databases like Sybase, SQL Server and Oracle
- Machine Learning & AI
- Experience working with Visualization tools: Power BI, Tableau, Looker, Qlickview, etc
- Basic domain knowledge of Mutual Funds.
- Good analytical skills
- Excellent communication skills – both written and verbal.
- Bachelor’s degree in Computer Science, Information Systems, or equivalent education or work experience or B.Tech/B.E./MCA
This advertiser has chosen not to accept applicants from your region.
Job No Longer Available
This position is no longer listed on WhatJobs. The employer may be reviewing applications, filled the role, or has removed the listing.
However, we have similar jobs available for you below.
Lead Data Engineer-Solution Architecture
Hyderabad, Andhra Pradesh
Chubb
Posted today
Job Viewed
Job Description
About Chubb
Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb employs approximately 40,000 people worldwide. Additional information can be found at: .
About Chubb India
At Chubb India, we are on an exciting journey of digital transformation driven by a commitment to engineering excellence and analytics. We are proud to share that we have been officially certified as a Great Place to Work® for the third consecutive year, a reflection of the culture at Chubb where we believe in fostering an environment where everyone can thrive, innovate, and grow
With a team of over 2500 talented professionals, we encourage a start-up mindset that promotes collaboration, diverse perspectives, and a solution-driven attitude. We are dedicated to building expertise in engineering, analytics, and automation, empowering our teams to excel in a dynamic digital landscape.
We offer an environment where you will be part of an organization that is dedicated to solving real-world challenges in the insurance industry. Together, we will work to shape the future through innovation and continuous learning.
Position Details
- Job Title : Lead Data Engineer-Solution Architecture
- Function/Department : Technology
- Location : Hyderabad/Bangalore/Bhubaneswar
- Employment Type : Full Time
Role Overview
Qualifications:
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field; Master’s degree preferred
- Minimum of 10 years’ experience in data architecture or data engineering roles, with a significant focus in P&C insurance domains preferred.
- Proven track record of successful implementation of data architecture within large-scale transformation programs or projects
- Comprehensive knowledge of data modelling techniques and methodologies, including data normalization and denormalization practices
- Hands on expertise across a wide variety of database (Azure SQL, MongoDB, Cosmos), data transformation (Informatica IICS, Databricks), change data capture and data streaming (Apache Kafka) technologies
- Proven Expertise with data warehousing concepts, ETL processes, and data integration tools (e.g., Informatica, Databricks, ADF)
- Experience with cloud-based data architectures and platforms (e.g. ADLS, Synapse, Snowflake, Azure SQL Database)
- Familiarity with .NET Core and Python FastAPI or similar; hands on experience preferred.
- Expertise in ensuring data security patterns (e.g. tokenization, encryption, obfuscation)
- Familiarity with authentication and authorization methods and frameworks (e.g. OAuth 2.0).
- Knowledge of insurance policy operations, regulations, and compliance frameworks specific to Consumer lines
- Understanding of advanced analytics, AI, and machine learning concepts as they pertain to data architecture
- Skilled in asynchronous programming patterns.
- Familiarity with containerization and microservices frameworks, such as Docker and Kubernetes.
- Proficient in utilizing Azure or other cloud services, including AKS, Cosmos NoSQL, Cognitive Search, SQL Database, ADLS, App Insights, and API Management.
- Familiar with DevSecOps practices and CI/CD tools, including Git, Azure DevOps, and Jenkins.
- Familiar with Kafka or similar messaging technologies.
- Familiar with GIS / geospatial systems and terminology preferred.
- Strong analytical and problem-solving capabilities.
- Experienced in producing technical documentation to support system design.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
- Familiarity with Agile methodologies and experience working in Agile project environments, including ceremonies and tools like JIRA.
Why Join Us?
- Be at the forefront of digital transformation in the insurance industry.
- Lead impactful initiatives that simplify claims processing and enhance customer satisfaction.
- Work alongside experienced professionals in a collaborative, innovation-driven environment.
Why Chubb?
Join Chubb to be part of a leading global insurance company!
Our constant focus on employee experience along with a start-up-like culture empowers you to achieve impactful results.
- Industry leader: Chubb is a world leader in the insurance industry, powered by underwriting and engineering excellence
- A Great Place to work: Chubb India has been recognized as a Great Place to Work® for the years , and
- Laser focus on excellence : At Chubb we pride ourselves on our culture of greatness where excellence is a mindset and a way of being. We constantly seek new and innovative ways to excel at work and deliver outstanding results
- Start-Up Culture : Embracing the spirit of a start-up, our focus on speed and agility enables us to respond swiftly to market requirements, while a culture of ownership empowers employees to drive results that matter
- Growth and success : As we continue to grow, we are steadfast in our commitment to provide our employees with the best work experience, enabling them to advance their careers in a conducive environment
Employee Benefits
Our company offers a comprehensive benefits package designed to support our employees’ health, well-being, and professional growth. Employees enjoy flexible work options, generous paid time off, and robust health coverage, including treatment for dental and vision related requirements. We invest in the future of our employees through continuous learning opportunities and career advancement programs, while fostering a supportive and inclusive work environment. Our benefits include:
- Savings and Investment plans: We provide specialized benefits like Corporate NPS (National Pension Scheme), Employee Stock Purchase Plan (ESPP), Long-Term Incentive Plan (LTIP), Retiral Benefits and Car Lease that help employees optimally plan their finances
- Upskilling and career growth opportunities: With a focus on continuous learning, we offer customized programs that support upskilling like Education Reimbursement Programs, Certification programs and access to global learning programs.
- Health and Welfare Benefits: We care about our employees’ well-being in and out of work and have benefits like Hybrid Work Environment, Employee Assistance Program (EAP), Yearly Free Health campaigns and comprehensive Insurance benefits.
Application Process
Our recruitment process is designed to be transparent, and inclusive.
- Step 1 : Submit your application via the Chubb Careers Portal / Linkedin.
- Step 2 : Engage with our recruitment team for an initial discussion.
- Step 3 : Participate in HackerRank assessments/technical/functional interviews and assessments (if applicable).
- Step 4 : Final interaction with Chubb leadership.
Join Us
With you Chubb is better. Whether you are solving challenges on a global stage or creating innovative solutions for local markets, your contributions will help shape the future. If you value integrity, innovation, and inclusion , and are ready to make a difference, we invite you to be part of Chubb India’s journey .
Apply Now :
This advertiser has chosen not to accept applicants from your region.
0
Lead Data Engineer-Solution Architecture
Hyderabad, Andhra Pradesh
Chubb
Posted today
Job Viewed
Job Description
About Chubb
Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb employs approximately 40,000 people worldwide. Additional information can be found at:
About Chubb India
At Chubb India, we are on an exciting journey of digital transformation driven by a commitment to engineering excellence and analytics. We are proud to share that we have been officially certified as a Great Place to Work for the third consecutive year, a reflection of the culture at Chubb where we believe in fostering an environment where everyone can thrive, innovate, and grow
With a team of over 2500 talented professionals, we encourage a start-up mindset that promotes collaboration, diverse perspectives, and a solution-driven attitude. We are dedicated to building expertise in engineering, analytics, and automation, empowering our teams to excel in a dynamic digital landscape.
We offer an environment where you will be part of an organization that is dedicated to solving real-world challenges in the insurance industry. Together, we will work to shape the future through innovation and continuous learning.
Position Details
- Job Title: Lead Data Engineer-Solution Architecture
- Function/Department: Technology
- Location: Hyderabad/Bangalore/Bhubaneswar
- Employment Type: Full Time
Role Overview
Qualifications:
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field; Master’s degree preferred
- Minimum of 10 years’ experience in data architecture or data engineering roles, with a significant focus in P&C insurance domains preferred.
- Proven track record of successful implementation of data architecture within large-scale transformation programs or projects
- Comprehensive knowledge of data modelling techniques and methodologies, including data normalization and denormalization practices
- Hands on expertise across a wide variety of database (Azure SQL, MongoDB, Cosmos), data transformation (Informatica IICS, Databricks), change data capture and data streaming (Apache Kafka) technologies
- Proven Expertise with data warehousing concepts, ETL processes, and data integration tools (e.g., Informatica, Databricks, ADF)
- Experience with cloud-based data architectures and platforms (e.g. ADLS, Synapse, Snowflake, Azure SQL Database)
- Familiarity with .NET Core and Python FastAPI or similar; hands on experience preferred.
- Expertise in ensuring data security patterns (e.g. tokenization, encryption, obfuscation)
- Familiarity with authentication and authorization methods and frameworks (e.g. OAuth 2.0).
- Knowledge of insurance policy operations, regulations, and compliance frameworks specific to Consumer lines
- Understanding of advanced analytics, AI, and machine learning concepts as they pertain to data architecture
- Skilled in asynchronous programming patterns.
- Familiarity with containerization and microservices frameworks, such as Docker and Kubernetes.
- Proficient in utilizing Azure or other cloud services, including AKS, Cosmos NoSQL, Cognitive Search, SQL Database, ADLS, App Insights, and API Management.
- Familiar with DevSecOps practices and CI/CD tools, including Git, Azure DevOps, and Jenkins.
- Familiar with Kafka or similar messaging technologies.
- Familiar with GIS / geospatial systems and terminology preferred.
- Strong analytical and problem-solving capabilities.
- Experienced in producing technical documentation to support system design.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
- Familiarity with Agile methodologies and experience working in Agile project environments, including ceremonies and tools like JIRA.
Why Join Us?
- Be at the forefront of digital transformation in the insurance industry.
- Lead impactful initiatives that simplify claims processing and enhance customer satisfaction.
- Work alongside experienced professionals in a collaborative, innovation-driven environment.
Why Chubb?
Join Chubb to be part of a leading global insurance company!
Our constant focus on employee experience along with a start-up-like culture empowers you to achieve impactful results.
- Industry leader: Chubb is a world leader in the insurance industry, powered by underwriting and engineering excellence
- A Great Place to work: Chubb India has been recognized as a Great Place to Work for the years , and
- Laser focus on excellence: At Chubb we pride ourselves on our culture of greatness where excellence is a mindset and a way of being. We constantly seek new and innovative ways to excel at work and deliver outstanding results
- Start-Up Culture: Embracing the spirit of a start-up, our focus on speed and agility enables us to respond swiftly to market requirements, while a culture of ownership empowers employees to drive results that matter
- Growth and success: As we continue to grow, we are steadfast in our commitment to provide our employees with the best work experience, enabling them to advance their careers in a conducive environment
Employee Benefits
Our company offers a comprehensive benefits package designed to support our employees’ health, well-being, and professional growth. Employees enjoy flexible work options, generous paid time off, and robust health coverage, including treatment for dental and vision related requirements. We invest in the future of our employees through continuous learning opportunities and career advancement programs, while fostering a supportive and inclusive work environment. Our benefits include:
- Savings and Investment plans: We provide specialized benefits like Corporate NPS (National Pension Scheme), Employee Stock Purchase Plan (ESPP), Long-Term Incentive Plan (LTIP), Retiral Benefits and Car Lease that help employees optimally plan their finances
- Upskilling and career growth opportunities: With a focus on continuous learning, we offer customized programs that support upskilling like Education Reimbursement Programs, Certification programs and access to global learning programs.
- Health and Welfare Benefits: We care about our employees’ well-being in and out of work and have benefits like Hybrid Work Environment, Employee Assistance Program (EAP), Yearly Free Health campaigns and comprehensive Insurance benefits.
Application Process
Our recruitment process is designed to be transparent, and inclusive.
- Step 1: Submit your application via the Chubb Careers Portal / Linkedin.
- Step 2: Engage with our recruitment team for an initial discussion.
- Step 3: Participate in HackerRank assessments/technical/functional interviews and assessments (if applicable).
- Step 4: Final interaction with Chubb leadership.
Join Us
With you Chubb is better. Whether you are solving challenges on a global stage or creating innovative solutions for local markets, your contributions will help shape the future. If you value integrity, innovation, and inclusion, and are ready to make a difference, we invite you to be part of Chubb India’s journey.
Apply Now:
This advertiser has chosen not to accept applicants from your region.
1
Lead Data Engineer-Solution Architecture
Hyderabad, Andhra Pradesh
Chubb
Posted today
Job Viewed
Job Description
About Chubb
Chubb is a world leader in insurance. With operations in 54 countries and territories, Chubb provides commercial and personal property and casualty insurance, personal accident and supplemental health insurance, reinsurance and life insurance to a diverse group of clients. The company is defined by its extensive product and service offerings, broad distribution capabilities, exceptional financial strength and local operations globally. Parent company Chubb Limited is listed on the New York Stock Exchange (NYSE: CB) and is a component of the S&P 500 index. Chubb employs approximately 40,000 people worldwide. Additional information can be found at:
About Chubb India
At Chubb India, we are on an exciting journey of digital transformation driven by a commitment to engineering excellence and analytics. We are proud to share that we have been officially certified as a Great Place to Work® for the third consecutive year, a reflection of the culture at Chubb where we believe in fostering an environment where everyone can thrive, innovate, and grow
With a team of over 2500 talented professionals, we encourage a start-up mindset that promotes collaboration, diverse perspectives, and a solution-driven attitude. We are dedicated to building expertise in engineering, analytics, and automation, empowering our teams to excel in a dynamic digital landscape.
We offer an environment where you will be part of an organization that is dedicated to solving real-world challenges in the insurance industry. Together, we will work to shape the future through innovation and continuous learning.
Position Details
- Job Title : Lead Data Engineer-Solution Architecture
- Function/Department : Technology
- Location : Hyderabad/Bangalore/Bhubaneswar
- Employment Type : Full Time
Role Overview
Qualifications:
- Bachelor’s degree in Computer Science, Information Systems, Data Engineering, or a related field; Master’s degree preferred
- Minimum of 10 years’ experience in data architecture or data engineering roles, with a significant focus in P&C insurance domains preferred.
- Proven track record of successful implementation of data architecture within large-scale transformation programs or projects
- Comprehensive knowledge of data modelling techniques and methodologies, including data normalization and denormalization practices
- Hands on expertise across a wide variety of database (Azure SQL, MongoDB, Cosmos), data transformation (Informatica IICS, Databricks), change data capture and data streaming (Apache Kafka) technologies
- Proven Expertise with data warehousing concepts, ETL processes, and data integration tools (e.g., Informatica, Databricks, ADF)
- Experience with cloud-based data architectures and platforms (e.g. ADLS, Synapse, Snowflake, Azure SQL Database)
- Familiarity with .NET Core and Python FastAPI or similar; hands on experience preferred.
- Expertise in ensuring data security patterns (e.g. tokenization, encryption, obfuscation)
- Familiarity with authentication and authorization methods and frameworks (e.g. OAuth 2.0).
- Knowledge of insurance policy operations, regulations, and compliance frameworks specific to Consumer lines
- Understanding of advanced analytics, AI, and machine learning concepts as they pertain to data architecture
- Skilled in asynchronous programming patterns.
- Familiarity with containerization and microservices frameworks, such as Docker and Kubernetes.
- Proficient in utilizing Azure or other cloud services, including AKS, Cosmos NoSQL, Cognitive Search, SQL Database, ADLS, App Insights, and API Management.
- Familiar with DevSecOps practices and CI/CD tools, including Git, Azure DevOps, and Jenkins.
- Familiar with Kafka or similar messaging technologies.
- Familiar with GIS / geospatial systems and terminology preferred.
- Strong analytical and problem-solving capabilities.
- Experienced in producing technical documentation to support system design.
- Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
- Familiarity with Agile methodologies and experience working in Agile project environments, including ceremonies and tools like JIRA.
Why Join Us?
- Be at the forefront of digital transformation in the insurance industry.
- Lead impactful initiatives that simplify claims processing and enhance customer satisfaction.
- Work alongside experienced professionals in a collaborative, innovation-driven environment.
Why Chubb?
Join Chubb to be part of a leading global insurance company!
Our constant focus on employee experience along with a start-up-like culture empowers you to achieve impactful results.
- Industry leader: Chubb is a world leader in the insurance industry, powered by underwriting and engineering excellence
- A Great Place to work: Chubb India has been recognized as a Great Place to Work® for the years , and
- Laser focus on excellence : At Chubb we pride ourselves on our culture of greatness where excellence is a mindset and a way of being. We constantly seek new and innovative ways to excel at work and deliver outstanding results
- Start-Up Culture : Embracing the spirit of a start-up, our focus on speed and agility enables us to respond swiftly to market requirements, while a culture of ownership empowers employees to drive results that matter
- Growth and success : As we continue to grow, we are steadfast in our commitment to provide our employees with the best work experience, enabling them to advance their careers in a conducive environment
Employee Benefits
Our company offers a comprehensive benefits package designed to support our employees’ health, well-being, and professional growth. Employees enjoy flexible work options, generous paid time off, and robust health coverage, including treatment for dental and vision related requirements. We invest in the future of our employees through continuous learning opportunities and career advancement programs, while fostering a supportive and inclusive work environment. Our benefits include:
- Savings and Investment plans: We provide specialized benefits like Corporate NPS (National Pension Scheme), Employee Stock Purchase Plan (ESPP), Long-Term Incentive Plan (LTIP), Retiral Benefits and Car Lease that help employees optimally plan their finances
- Upskilling and career growth opportunities: With a focus on continuous learning, we offer customized programs that support upskilling like Education Reimbursement Programs, Certification programs and access to global learning programs.
- Health and Welfare Benefits: We care about our employees’ well-being in and out of work and have benefits like Hybrid Work Environment, Employee Assistance Program (EAP), Yearly Free Health campaigns and comprehensive Insurance benefits.
Application Process
Our recruitment process is designed to be transparent, and inclusive.
- Step 1 : Submit your application via the Chubb Careers Portal / Linkedin.
- Step 2 : Engage with our recruitment team for an initial discussion.
- Step 3 : Participate in HackerRank assessments/technical/functional interviews and assessments (if applicable).
- Step 4 : Final interaction with Chubb leadership.
Join Us
With you Chubb is better. Whether you are solving challenges on a global stage or creating innovative solutions for local markets, your contributions will help shape the future. If you value integrity, innovation, and inclusion , and are ready to make a difference, we invite you to be part of Chubb India’s journey .
Apply Now :
This advertiser has chosen not to accept applicants from your region.
2
Lead Data Engineer
Pune, Maharashtra
Mastercard
Posted 2 days ago
Job Viewed
Job Description
**Our Purpose**
_Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential._
**Title and Summary**
Lead Data Engineer
Overview
This position is for Lead Data Engineer in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. You will be hands on and work closely to guide a team of Data Engineers in the associated data maintenance, integrations, enhancements, loads and transformation processes for the organization. This key individual will work closely with Data Architects to design and implement solutions and insure successful implementations.
Role
- Leads initiatives to build and maintain database technologies, environments, and applications, seeking opportunities for improvements and efficiencies
- Architects internal data solutions as part of the full stack to include data modelling, integration with file based as well as event driven upstream systems
- Writes SQL statement procedures to optimize SQL execution and query development
- Effectively utilizes various tools such as Spark (Scala, Python), Nifi, Spark streaming, Informatica for data ETL,
- Manages the deployment of data solutions that are optimally standardized and database updates to meet project deliverables
- Leads database security posture, which includes proactively identifying security risks and implementing both risk mitigation plans and control functions
- Oversees the resolution of chronic complex problems to prevent future data performance issues
- Supports process improvement efforts to identify and test opportunities for automation and/or reduction in time to deployment
- Responsible for complex design (in conjunction with Data Architects), development, and performance and system testing, and provides functional guidance, advice to experienced engineers
- Mentors junior staff by providing training to develop technical skills and capabilities across the team
All about you
- Experience developing a specialization in a particular functional area (e.g., modeling, data loads, transformations, replication, performance tuning, logical and physical database design, performance and troubleshooting, data replication, backup and recovery, and data security) leveraging Apache Spark, Nifi, Databricks, Snowflake, Informatica, streaming solutions.
- Experience leading a major work stream or multiple smaller work streams for a large domain initiative, often providing technical guidance and advice to project team members
- Experience creating deliverables within the global database technology domains and sub-domains, supporting cross-functional leaders in the technical community to derive new solutions
- Experience supporting automation and/or cloud delivery effort; may perform financial and cost analysis
- Experience in database architecture or other relevant IT experience
- Experience in leading business system application and database architecture design, influencing technology direction in range of breadth of IT areas
**Corporate Security Responsibility**
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
+ Abide by Mastercard's security policies and practices;
+ Ensure the confidentiality and integrity of the information being accessed;
+ Report any suspected information security violation or breach, and
+ Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
_Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential._
**Title and Summary**
Lead Data Engineer
Overview
This position is for Lead Data Engineer in the Commercial Data as a Service group. In this position you will enjoy being responsible for helping define and maintain the data systems key to delivering successful outcomes for our customers. You will be hands on and work closely to guide a team of Data Engineers in the associated data maintenance, integrations, enhancements, loads and transformation processes for the organization. This key individual will work closely with Data Architects to design and implement solutions and insure successful implementations.
Role
- Leads initiatives to build and maintain database technologies, environments, and applications, seeking opportunities for improvements and efficiencies
- Architects internal data solutions as part of the full stack to include data modelling, integration with file based as well as event driven upstream systems
- Writes SQL statement procedures to optimize SQL execution and query development
- Effectively utilizes various tools such as Spark (Scala, Python), Nifi, Spark streaming, Informatica for data ETL,
- Manages the deployment of data solutions that are optimally standardized and database updates to meet project deliverables
- Leads database security posture, which includes proactively identifying security risks and implementing both risk mitigation plans and control functions
- Oversees the resolution of chronic complex problems to prevent future data performance issues
- Supports process improvement efforts to identify and test opportunities for automation and/or reduction in time to deployment
- Responsible for complex design (in conjunction with Data Architects), development, and performance and system testing, and provides functional guidance, advice to experienced engineers
- Mentors junior staff by providing training to develop technical skills and capabilities across the team
All about you
- Experience developing a specialization in a particular functional area (e.g., modeling, data loads, transformations, replication, performance tuning, logical and physical database design, performance and troubleshooting, data replication, backup and recovery, and data security) leveraging Apache Spark, Nifi, Databricks, Snowflake, Informatica, streaming solutions.
- Experience leading a major work stream or multiple smaller work streams for a large domain initiative, often providing technical guidance and advice to project team members
- Experience creating deliverables within the global database technology domains and sub-domains, supporting cross-functional leaders in the technical community to derive new solutions
- Experience supporting automation and/or cloud delivery effort; may perform financial and cost analysis
- Experience in database architecture or other relevant IT experience
- Experience in leading business system application and database architecture design, influencing technology direction in range of breadth of IT areas
**Corporate Security Responsibility**
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
+ Abide by Mastercard's security policies and practices;
+ Ensure the confidentiality and integrity of the information being accessed;
+ Report any suspected information security violation or breach, and
+ Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
This advertiser has chosen not to accept applicants from your region.
3
Lead Data Engineer
Bangalore, Karnataka
Honeywell
Posted 3 days ago
Job Viewed
Job Description
Honeywell Connected Enterprise (HCE) is the software division of Honeywell with strategic focus on digitization, sustainability, and OT Cybersecurity SaaS offerings and solutions. HCE was established to leverage Honeywell's domain expertise and lead the transition into a cutting-edge industrial software company. Since our inception in 2018, HCE established the category of intelligent operations and built a new platform born out of decades of operational data and insights, uniting real-time data across assets, people, and processes into a system of record for a 360-degree view. This is our flagship offering - Honeywell Forge. We are a global team of thousands of innovators with expertise spanning industrial operations, software engineering, data science, artificial intelligence, and process engineering. We are paving the way for our customers to grow responsibly. We believe the future is what we make it. As a Honeywell Futureshaper, you are a part of something bigger. You can work with highly capable people to make the world a better place and become the best you. After all, we are not imagining the future; we're building it.
As a Lead Data Engineer, you will be part of a team that delivers contemporary analytics solutions for all Honeywell business groups and functions. You will build strong relationships with leadership to effectively deliver contemporary data analytics solutions & contribute directly to business success.
+ You will develop solutions on various Database systems viz. Databricks, Snowflake, Hive, Hadoop, PostgreSQL, etc.
+ You will identify and implement process improvements - and you don't like to the same thing twice so you will automate it if you can.
+ You are always keeping an eye on scalability, optimization, and process. You have worked with Big Data before, IoT data, SAP, SQL, Azure, AWS and a bunch of other acronyms.
+ You will work on a team including scrum masters, product owners, data architects, data engineers/designers, data scientists and DevOps.
+ You and your team collaborate to build products from the idea phase through launch and beyond. The software you write makes it to production in couple of sprints.
+ Your team will be working on creating a new platform using your experience of APIs, microservices, and platform development.
You Must Have
+ Bachelors or Master's degree in Computer Science, Engineering, Applied Mathematics or related field
+ 12+ years of data engineering, data design and/or enterprise data management & analytics experience
+ Should be able to architect large enterprise analytics projects with optimal solutions on the Bigdata platform.
+ Should have designed, developed and deployed complex big data ingestion jobs with contemporary data ingestion tools like Spark, Informatica Power Center & BDM on Databricks/Hadoop/NoSQL/MPP platforms.
+ Experience with dimensional modeling, data warehousing and data miningA Job posting does not exist for this global job code, please work with your HRG to develop one
We Value
+ 4 years of experience in building advanced analytics solutions with data from enterprise systems like ERPs(SAP, Oracle, etc.), RDBMS, CRMs, Marketing & Logistics tools etc.
+ 4 years of hands on experience with Spark, Pig/hive etc. and automation of data flows using Informatica BDM/DEI, NiFi and/or Airflow/Oozie.
Honeywell helps organizations solve the world's most complex challenges in automation, the future of aviation and energy transition. As a trusted partner, we provide actionable solutions and innovation through our Aerospace Technologies, Building Automation, Energy and Sustainability Solutions, and Industrial Automation business segments - powered by our Honeywell Forge software - that help make the world smarter, safer and more sustainable.
Honeywell is an equal opportunity employer. Qualified applicants will be considered without regard to age, race, creed, color, national origin, ancestry, marital status, affectional or sexual orientation, gender identity or expression, disability, nationality, sex, religion, or veteran status.
As a Lead Data Engineer, you will be part of a team that delivers contemporary analytics solutions for all Honeywell business groups and functions. You will build strong relationships with leadership to effectively deliver contemporary data analytics solutions & contribute directly to business success.
+ You will develop solutions on various Database systems viz. Databricks, Snowflake, Hive, Hadoop, PostgreSQL, etc.
+ You will identify and implement process improvements - and you don't like to the same thing twice so you will automate it if you can.
+ You are always keeping an eye on scalability, optimization, and process. You have worked with Big Data before, IoT data, SAP, SQL, Azure, AWS and a bunch of other acronyms.
+ You will work on a team including scrum masters, product owners, data architects, data engineers/designers, data scientists and DevOps.
+ You and your team collaborate to build products from the idea phase through launch and beyond. The software you write makes it to production in couple of sprints.
+ Your team will be working on creating a new platform using your experience of APIs, microservices, and platform development.
You Must Have
+ Bachelors or Master's degree in Computer Science, Engineering, Applied Mathematics or related field
+ 12+ years of data engineering, data design and/or enterprise data management & analytics experience
+ Should be able to architect large enterprise analytics projects with optimal solutions on the Bigdata platform.
+ Should have designed, developed and deployed complex big data ingestion jobs with contemporary data ingestion tools like Spark, Informatica Power Center & BDM on Databricks/Hadoop/NoSQL/MPP platforms.
+ Experience with dimensional modeling, data warehousing and data miningA Job posting does not exist for this global job code, please work with your HRG to develop one
We Value
+ 4 years of experience in building advanced analytics solutions with data from enterprise systems like ERPs(SAP, Oracle, etc.), RDBMS, CRMs, Marketing & Logistics tools etc.
+ 4 years of hands on experience with Spark, Pig/hive etc. and automation of data flows using Informatica BDM/DEI, NiFi and/or Airflow/Oozie.
Honeywell helps organizations solve the world's most complex challenges in automation, the future of aviation and energy transition. As a trusted partner, we provide actionable solutions and innovation through our Aerospace Technologies, Building Automation, Energy and Sustainability Solutions, and Industrial Automation business segments - powered by our Honeywell Forge software - that help make the world smarter, safer and more sustainable.
Honeywell is an equal opportunity employer. Qualified applicants will be considered without regard to age, race, creed, color, national origin, ancestry, marital status, affectional or sexual orientation, gender identity or expression, disability, nationality, sex, religion, or veteran status.
This advertiser has chosen not to accept applicants from your region.
4
Lead Data Engineer
Bengaluru, Karnataka
Honeywell
Posted 3 days ago
Job Viewed
Job Description
Honeywell Connected Enterprise (HCE) is the software division of Honeywell with strategic focus on digitization, sustainability, and OT Cybersecurity SaaS offerings and solutions. HCE was established to leverage Honeywell's domain expertise and lead the transition into a cutting-edge industrial software company. Since our inception in 2018, HCE established the category of intelligent operations and built a new platform born out of decades of operational data and insights, uniting real-time data across assets, people, and processes into a system of record for a 360-degree view. This is our flagship offering - Honeywell Forge. We are a global team of thousands of innovators with expertise spanning industrial operations, software engineering, data science, artificial intelligence, and process engineering. We are paving the way for our customers to grow responsibly. We believe the future is what we make it. As a Honeywell Futureshaper, you are a part of something bigger. You can work with highly capable people to make the world a better place and become the best you. After all, we are not imagining the future; we're building it.
As a Lead Data Engineer, you will be part of a team that delivers contemporary analytics solutions for all Honeywell business groups and functions. You will build strong relationships with leadership to effectively deliver contemporary data analytics solutions & contribute directly to business success.
+ You will develop solutions on various Database systems viz. Databricks, Snowflake, Hive, Hadoop, PostgreSQL, etc.
+ You will identify and implement process improvements - and you don't like to the same thing twice so you will automate it if you can.
+ You are always keeping an eye on scalability, optimization, and process. You have worked with Big Data before, IoT data, SAP, SQL, Azure, AWS and a bunch of other acronyms.
+ You will work on a team including scrum masters, product owners, data architects, data engineers/designers, data scientists and DevOps.
+ You and your team collaborate to build products from the idea phase through launch and beyond. The software you write makes it to production in couple of sprints.
+ Your team will be working on creating a new platform using your experience of APIs, microservices, and platform development.
You Must Have
+ Bachelors or Master's degree in Computer Science, Engineering, Applied Mathematics or related field
+ 12+ years of data engineering, data design and/or enterprise data management & analytics experience
+ Should be able to architect large enterprise analytics projects with optimal solutions on the Bigdata platform.
+ Should have designed, developed and deployed complex big data ingestion jobs with contemporary data ingestion tools like Spark, Informatica Power Center & BDM on Databricks/Hadoop/NoSQL/MPP platforms.
+ Experience with dimensional modeling, data warehousing and data miningA Job posting does not exist for this global job code, please work with your HRG to develop one
We Value
+ 4 years of experience in building advanced analytics solutions with data from enterprise systems like ERPs(SAP, Oracle, etc.), RDBMS, CRMs, Marketing & Logistics tools etc.
+ 4 years of hands on experience with Spark, Pig/hive etc. and automation of data flows using Informatica BDM/DEI, NiFi and/or Airflow/Oozie.
Honeywell helps organizations solve the world's most complex challenges in automation, the future of aviation and energy transition. As a trusted partner, we provide actionable solutions and innovation through our Aerospace Technologies, Building Automation, Energy and Sustainability Solutions, and Industrial Automation business segments - powered by our Honeywell Forge software - that help make the world smarter, safer and more sustainable.
Honeywell is an equal opportunity employer. Qualified applicants will be considered without regard to age, race, creed, color, national origin, ancestry, marital status, affectional or sexual orientation, gender identity or expression, disability, nationality, sex, religion, or veteran status.
As a Lead Data Engineer, you will be part of a team that delivers contemporary analytics solutions for all Honeywell business groups and functions. You will build strong relationships with leadership to effectively deliver contemporary data analytics solutions & contribute directly to business success.
+ You will develop solutions on various Database systems viz. Databricks, Snowflake, Hive, Hadoop, PostgreSQL, etc.
+ You will identify and implement process improvements - and you don't like to the same thing twice so you will automate it if you can.
+ You are always keeping an eye on scalability, optimization, and process. You have worked with Big Data before, IoT data, SAP, SQL, Azure, AWS and a bunch of other acronyms.
+ You will work on a team including scrum masters, product owners, data architects, data engineers/designers, data scientists and DevOps.
+ You and your team collaborate to build products from the idea phase through launch and beyond. The software you write makes it to production in couple of sprints.
+ Your team will be working on creating a new platform using your experience of APIs, microservices, and platform development.
You Must Have
+ Bachelors or Master's degree in Computer Science, Engineering, Applied Mathematics or related field
+ 12+ years of data engineering, data design and/or enterprise data management & analytics experience
+ Should be able to architect large enterprise analytics projects with optimal solutions on the Bigdata platform.
+ Should have designed, developed and deployed complex big data ingestion jobs with contemporary data ingestion tools like Spark, Informatica Power Center & BDM on Databricks/Hadoop/NoSQL/MPP platforms.
+ Experience with dimensional modeling, data warehousing and data miningA Job posting does not exist for this global job code, please work with your HRG to develop one
We Value
+ 4 years of experience in building advanced analytics solutions with data from enterprise systems like ERPs(SAP, Oracle, etc.), RDBMS, CRMs, Marketing & Logistics tools etc.
+ 4 years of hands on experience with Spark, Pig/hive etc. and automation of data flows using Informatica BDM/DEI, NiFi and/or Airflow/Oozie.
Honeywell helps organizations solve the world's most complex challenges in automation, the future of aviation and energy transition. As a trusted partner, we provide actionable solutions and innovation through our Aerospace Technologies, Building Automation, Energy and Sustainability Solutions, and Industrial Automation business segments - powered by our Honeywell Forge software - that help make the world smarter, safer and more sustainable.
Honeywell is an equal opportunity employer. Qualified applicants will be considered without regard to age, race, creed, color, national origin, ancestry, marital status, affectional or sexual orientation, gender identity or expression, disability, nationality, sex, religion, or veteran status.
This advertiser has chosen not to accept applicants from your region.
5
Lead Data Engineer
Pune, Maharashtra
Mastercard
Posted 4 days ago
Job Viewed
Job Description
**Our Purpose**
_Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential._
**Title and Summary**
Lead Data Engineer
Overview
We are the global technology company behind the world's fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.
Our team within Mastercard - Services:
The Services org is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to make multi-million-dollar decisions and grow their businesses. Focused on thinking big and scaling fast around the globe, this agile team is responsible for end-to-end solutions for a diverse global customer base. Centered on data-driven technologies and innovation, these services include payments-focused consulting, loyalty and marketing programs, business Test & Learn experimentation, and data-driven information and risk management services.
Advanced Analytics Program:
Within the Services Technology Team, the Advanced Analytics program is a relatively new program that is comprised of a rich set of products that provide accurate perspectives on Credit Risk, Portfolio Optimization, and Ad Insights. Currently, we are enhancing our customer experience with new user interfaces, moving to API and web application-based data publishing to allow for seamless integration in other Mastercard products and externally, utilizing new data sets and algorithms to further analytic capabilities, and generating scalable big data processes.
We are looking for an innovative lead data engineer who will lead the technical design and development of an Analytic Foundation. The Analytic Foundation is a suite of individually commercialized analytical capabilities that also includes a comprehensive data platform. These services will be offered through a series of APIs that deliver data and insights from various points along a central data store. This individual will partner closely with other areas of the business to build and enhance solutions that drive value for our customers.
Engineers work in small, flexible teams. Every team member contributes to designing, building, and testing features. The range of work you will encounter varies from building intuitive, responsive UIs to designing backend data models, architecting data flows, and beyond. There are no rigid organizational structures, and each team uses processes that work best for its members and projects.
Here are a few examples of products in our space:
- Portfolio Optimizer (PO) is a solution that leverages Mastercard's data assets and analytics to allow issuers to identify and increase revenue opportunities within their credit and debit portfolios.
- Audiences uses anonymized and aggregated transaction insights to offer targeting segments that have high likelihood to make purchases within a category to allow for more effective campaign planning and activation.
- Credit Risk products are a new suite of APIs and tooling to provide lenders real-time access to KPIs and insights serving thousands of clients to make smarter risk decisions using Mastercard data.
Help found a new, fast-growing engineering team!
Position Responsibilities:
As a Lead Data Engineer within Advanced Analytics team, you will:
- Lead collaboration with data scientists to understand the existing modeling pipeline and identify optimization opportunities.
- Oversee the integration and management of data from various sources and storage systems, establishing processes and pipelines to produce cohesive datasets for analysis and modeling.
- Partner with Product Managers and Customer Experience Designers to develop a deep understanding of users and use cases and apply that knowledge to scoping and building new modules and features
- Design and develop data pipelines to automate repetitive tasks within data science and data engineering.
- Demonstrated experience leading cross-functional teams or working across different teams to solve complex problems.
- Identify patterns and innovative solutions in existing spaces, consistently seeking opportunities to simplify, automate tasks, and build reusable components for multiple use cases and teams.
- Create data products that are well-modeled, thoroughly documented, and easy to understand and maintain.
- Comfortable leading projects in environments with undefined or ambiguous requirements.
- Mentor junior data engineers
Ideal Candidate Qualifications:
- High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Impala, Oozie, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
- Extensive experience with Spark Processing engine.
- Proficiency in, at least, one modern programming language such as Python, Java or Scala
- Strong Computer Science fundamentals in object-oriented design, data structures, algorithm design, problem solving, and complexity analysis.
- Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
- Working Knowledge in Software Development engineering Paradigms along with Data Engineering.
- Relational Databases as well as NoSQL experience
- Experience in cloud technologies like Databricks/AWS/Azure
- Basic Shell scripting and knowledge of Linux/Unix systems
- Experience in designing & developing software at scale
- Strong written and verbal English communication skills.
**Corporate Security Responsibility**
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
+ Abide by Mastercard's security policies and practices;
+ Ensure the confidentiality and integrity of the information being accessed;
+ Report any suspected information security violation or breach, and
+ Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
_Mastercard powers economies and empowers people in 200+ countries and territories worldwide. Together with our customers, we're helping build a sustainable economy where everyone can prosper. We support a wide range of digital payments choices, making transactions secure, simple, smart and accessible. Our technology and innovation, partnerships and networks combine to deliver a unique set of products and services that help people, businesses and governments realize their greatest potential._
**Title and Summary**
Lead Data Engineer
Overview
We are the global technology company behind the world's fastest payments processing network. We are a vehicle for commerce, a connection to financial systems for the previously excluded, a technology innovation lab, and the home of Priceless®. We ensure every employee has the opportunity to be a part of something bigger and to change lives. We believe as our company grows, so should you. We believe in connecting everyone to endless, priceless possibilities.
Our team within Mastercard - Services:
The Services org is a key differentiator for Mastercard, providing the cutting-edge services that are used by some of the world's largest organizations to make multi-million-dollar decisions and grow their businesses. Focused on thinking big and scaling fast around the globe, this agile team is responsible for end-to-end solutions for a diverse global customer base. Centered on data-driven technologies and innovation, these services include payments-focused consulting, loyalty and marketing programs, business Test & Learn experimentation, and data-driven information and risk management services.
Advanced Analytics Program:
Within the Services Technology Team, the Advanced Analytics program is a relatively new program that is comprised of a rich set of products that provide accurate perspectives on Credit Risk, Portfolio Optimization, and Ad Insights. Currently, we are enhancing our customer experience with new user interfaces, moving to API and web application-based data publishing to allow for seamless integration in other Mastercard products and externally, utilizing new data sets and algorithms to further analytic capabilities, and generating scalable big data processes.
We are looking for an innovative lead data engineer who will lead the technical design and development of an Analytic Foundation. The Analytic Foundation is a suite of individually commercialized analytical capabilities that also includes a comprehensive data platform. These services will be offered through a series of APIs that deliver data and insights from various points along a central data store. This individual will partner closely with other areas of the business to build and enhance solutions that drive value for our customers.
Engineers work in small, flexible teams. Every team member contributes to designing, building, and testing features. The range of work you will encounter varies from building intuitive, responsive UIs to designing backend data models, architecting data flows, and beyond. There are no rigid organizational structures, and each team uses processes that work best for its members and projects.
Here are a few examples of products in our space:
- Portfolio Optimizer (PO) is a solution that leverages Mastercard's data assets and analytics to allow issuers to identify and increase revenue opportunities within their credit and debit portfolios.
- Audiences uses anonymized and aggregated transaction insights to offer targeting segments that have high likelihood to make purchases within a category to allow for more effective campaign planning and activation.
- Credit Risk products are a new suite of APIs and tooling to provide lenders real-time access to KPIs and insights serving thousands of clients to make smarter risk decisions using Mastercard data.
Help found a new, fast-growing engineering team!
Position Responsibilities:
As a Lead Data Engineer within Advanced Analytics team, you will:
- Lead collaboration with data scientists to understand the existing modeling pipeline and identify optimization opportunities.
- Oversee the integration and management of data from various sources and storage systems, establishing processes and pipelines to produce cohesive datasets for analysis and modeling.
- Partner with Product Managers and Customer Experience Designers to develop a deep understanding of users and use cases and apply that knowledge to scoping and building new modules and features
- Design and develop data pipelines to automate repetitive tasks within data science and data engineering.
- Demonstrated experience leading cross-functional teams or working across different teams to solve complex problems.
- Identify patterns and innovative solutions in existing spaces, consistently seeking opportunities to simplify, automate tasks, and build reusable components for multiple use cases and teams.
- Create data products that are well-modeled, thoroughly documented, and easy to understand and maintain.
- Comfortable leading projects in environments with undefined or ambiguous requirements.
- Mentor junior data engineers
Ideal Candidate Qualifications:
- High proficiency in using Python or Scala, Spark, Hadoop platforms & tools (Hive, Impala, Oozie, Airflow, NiFi, Scoop), SQL to build Big Data products & platforms
- Extensive experience with Spark Processing engine.
- Proficiency in, at least, one modern programming language such as Python, Java or Scala
- Strong Computer Science fundamentals in object-oriented design, data structures, algorithm design, problem solving, and complexity analysis.
- Ability to easily move between business, data management, and technical teams; ability to quickly intuit the business use case and identify technical solutions to enable it
- Working Knowledge in Software Development engineering Paradigms along with Data Engineering.
- Relational Databases as well as NoSQL experience
- Experience in cloud technologies like Databricks/AWS/Azure
- Basic Shell scripting and knowledge of Linux/Unix systems
- Experience in designing & developing software at scale
- Strong written and verbal English communication skills.
**Corporate Security Responsibility**
All activities involving access to Mastercard assets, information, and networks comes with an inherent risk to the organization and, therefore, it is expected that every person working for, or on behalf of, Mastercard is responsible for information security and must:
+ Abide by Mastercard's security policies and practices;
+ Ensure the confidentiality and integrity of the information being accessed;
+ Report any suspected information security violation or breach, and
+ Complete all periodic mandatory security trainings in accordance with Mastercard's guidelines.
This advertiser has chosen not to accept applicants from your region.
Be The First To Know
About the latest Lead data engineer Jobs in India !
6
Lead Data Engineer
Hyderabad, Andhra Pradesh
ThermoFisher Scientific
Posted 7 days ago
Job Viewed
Job Description
**Work Schedule**
Standard (Mon-Fri)
**Environmental Conditions**
Office
**Job Description**
**Position Overview**
As a Lead Data Engineer, your pivotal responsibility involves spearheading data initiatives and integrating top-tier data solutions. This role presents a thrilling chance to contribute to innovative projects and engage with a team of committed experts. Your proficiency is instrumental in elevating our competitiveness and ensuring seamless implementation of our data strategies!
**Key Responsibilities**
+ Lead the build, development, and optimization of scalable, secure, and high-performance data pipelines and architectures.
+ Lead and guide a team of data engineers and analysts, encouraging teamwork and technical excellence.
+ Implement standard methodologies for DataOps across the platform to uphold 99.99%+ availability, reliability, and recovery standards.
+ Build and maintain robust data models and frameworks, ensuring they align with enterprise architecture and governance standards.
+ Collaborate with cross-functional teams, including analytics, product, and business units to deliver high-impact, data-driven solutions.
+ Ensure data quality and validation through automated testing, monitoring, and anomaly detection techniques.
+ Own planning, prioritization, and execution of data engineering projects - delivering on time and within scope.
+ Contribute to platform scalability, performance tuning, and migration initiatives, including support for real-time data flows.
+ Deliver technical documentation and code reviews to uphold engineering standards and maintain knowledge continuity.
+ Support data privacy, security, and compliance requirements in line with global regulatory standards.
**Qualifications**
+ Bachelor's degree or equivalent experience in Computer Science, Data Engineering, Information Systems, or a related field.
+ Proven experience (5+ years) in data engineering with a strong understanding of modern data architecture, pipelines, and operations.
+ Expertise in ETL/ELT tools, data warehousing, and cloud-native platforms such as Databricks, Snowflake, or BigQuery.
+ Strong hands-on experience with SQL, Apache Spark, and Python (experience with Pandas preferred).
+ Proficient in working with large datasets and performance optimization for distributed computing environments.
+ Prior experience with tools like Informatica, Cognos, SQL Server, and Oracle is a strong plus.
+ Deep understanding of data modeling, metadata management, and data governance frameworks.
+ Demonstrated experience in leading engineering teams and managing project lifecycles.
+ Familiarity with DevOps/DataOps practices, version control systems (e.g., GitHub), and CI/CD pipelines.
+ Excellent communication, leadership, and collaborator management skills.
+ Experience working in cloud environments such as AWS, Azure, or GCP.
Why Join Us?
This is your chance to work on exceptionally impactful projects and grow your career in an encouraging and innovative environment!
Thermo Fisher Scientific is an EEO/Affirmative Action Employer and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other legally protected status.
Standard (Mon-Fri)
**Environmental Conditions**
Office
**Job Description**
**Position Overview**
As a Lead Data Engineer, your pivotal responsibility involves spearheading data initiatives and integrating top-tier data solutions. This role presents a thrilling chance to contribute to innovative projects and engage with a team of committed experts. Your proficiency is instrumental in elevating our competitiveness and ensuring seamless implementation of our data strategies!
**Key Responsibilities**
+ Lead the build, development, and optimization of scalable, secure, and high-performance data pipelines and architectures.
+ Lead and guide a team of data engineers and analysts, encouraging teamwork and technical excellence.
+ Implement standard methodologies for DataOps across the platform to uphold 99.99%+ availability, reliability, and recovery standards.
+ Build and maintain robust data models and frameworks, ensuring they align with enterprise architecture and governance standards.
+ Collaborate with cross-functional teams, including analytics, product, and business units to deliver high-impact, data-driven solutions.
+ Ensure data quality and validation through automated testing, monitoring, and anomaly detection techniques.
+ Own planning, prioritization, and execution of data engineering projects - delivering on time and within scope.
+ Contribute to platform scalability, performance tuning, and migration initiatives, including support for real-time data flows.
+ Deliver technical documentation and code reviews to uphold engineering standards and maintain knowledge continuity.
+ Support data privacy, security, and compliance requirements in line with global regulatory standards.
**Qualifications**
+ Bachelor's degree or equivalent experience in Computer Science, Data Engineering, Information Systems, or a related field.
+ Proven experience (5+ years) in data engineering with a strong understanding of modern data architecture, pipelines, and operations.
+ Expertise in ETL/ELT tools, data warehousing, and cloud-native platforms such as Databricks, Snowflake, or BigQuery.
+ Strong hands-on experience with SQL, Apache Spark, and Python (experience with Pandas preferred).
+ Proficient in working with large datasets and performance optimization for distributed computing environments.
+ Prior experience with tools like Informatica, Cognos, SQL Server, and Oracle is a strong plus.
+ Deep understanding of data modeling, metadata management, and data governance frameworks.
+ Demonstrated experience in leading engineering teams and managing project lifecycles.
+ Familiarity with DevOps/DataOps practices, version control systems (e.g., GitHub), and CI/CD pipelines.
+ Excellent communication, leadership, and collaborator management skills.
+ Experience working in cloud environments such as AWS, Azure, or GCP.
Why Join Us?
This is your chance to work on exceptionally impactful projects and grow your career in an encouraging and innovative environment!
Thermo Fisher Scientific is an EEO/Affirmative Action Employer and does not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability or any other legally protected status.
This advertiser has chosen not to accept applicants from your region.
7
Lead Data Engineer
Hyderabad, Andhra Pradesh
S&P Global
Posted 12 days ago
Job Viewed
Job Description
**About the Role:**
**Grade Level (for internal use):**
11
**The Team:** The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering, and distribution to power our Financial Institution Group business and customer needs. We focus on platform scalability to support business operations by following a common data lifecycle that accelerates business value. Our team provides essential intelligence for the Financial Services, Real Estate, and Insurance industries.
**The Impact:** The Data Engineering team will be responsible for implementing and maintaining services and tools to support existing feed systems. This enables users to consume FIG datasets and makes FIG data available for broader consumption and processing within the company.
**What's in it for you:** Opportunity to work with global stakeholders and engage with the latest tools and technologies.
**Responsibilities:**
+ Build new data acquisition and transformation pipelines using advanced data processing and cloud technologies.
+ Collaborate with the broader technology team, including information architecture and data integration teams, to align pipelines with strategic initiatives.
**What We're Looking For:**
+ Bachelor's degree in computer science or a related field, with at least 8+ years of professional software development experience.
+ Must have: **Programming languages commonly used for data processing,** **Data orchestration and workflow management systems,** **Distributed data processing framework, relational database management systems,** **B** **ig data processing frameworks** Experience with large-scale data processing platforms.
+ Deep understanding of RESTful services, good API design, and object-oriented programming principles.
+ Proficiency in object-oriented or functional scripting languages.
+ Good working knowledge of relational and NoSQL databases.
+ Experience in maintaining and developing software in production environments utilizing cloud-based tools.
+ Strong collaboration and teamwork skills, along with excellent written and verbal communication abilities.
+ Self-starter and motivated individual with the ability to thrive in a fast-paced software development environment.
+ Agile experience is highly desirable.
+ Experience with data warehousing and analytics platforms will be a significant advantage.
**Technical Expertise**
+ Data Engineering Expertise: Strong experience in distributed data processing and optimization using modern frameworks.
+ Cloud Platforms: Proficient in leveraging cloud services for scalable data solutions, including ETL orchestration, containerized deployments, and data storage.
+ Workflow Orchestration: Skilled in designing and managing complex data pipelines and workflows.
+ Programming & Scripting: Proficient in writing clean, modular, and testable code for data processing tasks.
+ Database Management: Solid understanding of both relational and non-relational databases, including data querying and modeling.
+ ETL & Data Architecture: Proven ability to design and implement robust ETL pipelines and optimize data models for performance and scalability.
**Soft Skills**
+ **Excellent communication skills** - able to articulate technical concepts to non-technical stakeholders.
+ **Strong interpersonal skills** - collaborative, empathetic, and team-oriented.
+ Demonstrated ability to work on **challenging projects** and go the **extra mile** to deliver results.
**Preferred Qualifications**
+ Experience with CI/CD pipelines, Github and DevOps practices is must.
+ Familiarity with data lake and data warehouse architectures.
+ Exposure to real-time data processing frameworks, and observability tools like Grafana is added advantage.
**What's In It For** **You?**
**Our Purpose:**
Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world.
Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence®, pinpointing risks and opening possibilities. We Accelerate Progress.
**Our People:**
We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.
From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.
**Our Values:**
**Integrity, Discovery, Partnership**
At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of **integrity** in all we do, bring a spirit of **discovery** to our work, and collaborate in close **partnership** with each other and our customers to achieve shared goals.
**Benefits:**
We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global.
Our benefits include:
+ Health & Wellness: Health care coverage designed for the mind and body.
+ Flexible Downtime: Generous time off helps keep you energized for your time on.
+ Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
+ Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
+ Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
+ Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.
For more information on benefits by country visit: Hiring and Opportunity at S&P Global:**
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
**Recruitment Fraud Alert:**
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, "pre-employment training" or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here ( .
---
**Equal Opportunity Employer**
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to: and your request will be forwarded to the appropriate person.
**US Candidates Only:** The EEO is the Law Poster describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)
**Job ID:**
**Posted On:**
**Location:** Ahmedabad, Gujarat, India
**Grade Level (for internal use):**
11
**The Team:** The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering, and distribution to power our Financial Institution Group business and customer needs. We focus on platform scalability to support business operations by following a common data lifecycle that accelerates business value. Our team provides essential intelligence for the Financial Services, Real Estate, and Insurance industries.
**The Impact:** The Data Engineering team will be responsible for implementing and maintaining services and tools to support existing feed systems. This enables users to consume FIG datasets and makes FIG data available for broader consumption and processing within the company.
**What's in it for you:** Opportunity to work with global stakeholders and engage with the latest tools and technologies.
**Responsibilities:**
+ Build new data acquisition and transformation pipelines using advanced data processing and cloud technologies.
+ Collaborate with the broader technology team, including information architecture and data integration teams, to align pipelines with strategic initiatives.
**What We're Looking For:**
+ Bachelor's degree in computer science or a related field, with at least 8+ years of professional software development experience.
+ Must have: **Programming languages commonly used for data processing,** **Data orchestration and workflow management systems,** **Distributed data processing framework, relational database management systems,** **B** **ig data processing frameworks** Experience with large-scale data processing platforms.
+ Deep understanding of RESTful services, good API design, and object-oriented programming principles.
+ Proficiency in object-oriented or functional scripting languages.
+ Good working knowledge of relational and NoSQL databases.
+ Experience in maintaining and developing software in production environments utilizing cloud-based tools.
+ Strong collaboration and teamwork skills, along with excellent written and verbal communication abilities.
+ Self-starter and motivated individual with the ability to thrive in a fast-paced software development environment.
+ Agile experience is highly desirable.
+ Experience with data warehousing and analytics platforms will be a significant advantage.
**Technical Expertise**
+ Data Engineering Expertise: Strong experience in distributed data processing and optimization using modern frameworks.
+ Cloud Platforms: Proficient in leveraging cloud services for scalable data solutions, including ETL orchestration, containerized deployments, and data storage.
+ Workflow Orchestration: Skilled in designing and managing complex data pipelines and workflows.
+ Programming & Scripting: Proficient in writing clean, modular, and testable code for data processing tasks.
+ Database Management: Solid understanding of both relational and non-relational databases, including data querying and modeling.
+ ETL & Data Architecture: Proven ability to design and implement robust ETL pipelines and optimize data models for performance and scalability.
**Soft Skills**
+ **Excellent communication skills** - able to articulate technical concepts to non-technical stakeholders.
+ **Strong interpersonal skills** - collaborative, empathetic, and team-oriented.
+ Demonstrated ability to work on **challenging projects** and go the **extra mile** to deliver results.
**Preferred Qualifications**
+ Experience with CI/CD pipelines, Github and DevOps practices is must.
+ Familiarity with data lake and data warehouse architectures.
+ Exposure to real-time data processing frameworks, and observability tools like Grafana is added advantage.
**What's In It For** **You?**
**Our Purpose:**
Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world.
Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence®, pinpointing risks and opening possibilities. We Accelerate Progress.
**Our People:**
We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.
From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.
**Our Values:**
**Integrity, Discovery, Partnership**
At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of **integrity** in all we do, bring a spirit of **discovery** to our work, and collaborate in close **partnership** with each other and our customers to achieve shared goals.
**Benefits:**
We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global.
Our benefits include:
+ Health & Wellness: Health care coverage designed for the mind and body.
+ Flexible Downtime: Generous time off helps keep you energized for your time on.
+ Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
+ Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
+ Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
+ Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.
For more information on benefits by country visit: Hiring and Opportunity at S&P Global:**
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
**Recruitment Fraud Alert:**
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, "pre-employment training" or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here ( .
---
**Equal Opportunity Employer**
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to: and your request will be forwarded to the appropriate person.
**US Candidates Only:** The EEO is the Law Poster describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)
**Job ID:**
**Posted On:**
**Location:** Ahmedabad, Gujarat, India
This advertiser has chosen not to accept applicants from your region.
8
Lead Data Engineer
Ahmedabad, Gujarat
S&P Global
Posted 12 days ago
Job Viewed
Job Description
**About the Role:**
**Grade Level (for internal use):**
11
**The Team:** The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering, and distribution to power our Financial Institution Group business and customer needs. We focus on platform scalability to support business operations by following a common data lifecycle that accelerates business value. Our team provides essential intelligence for the Financial Services, Real Estate, and Insurance industries.
**The Impact:** The Data Engineering team will be responsible for implementing and maintaining services and tools to support existing feed systems. This enables users to consume FIG datasets and makes FIG data available for broader consumption and processing within the company.
**What's in it for you:** Opportunity to work with global stakeholders and engage with the latest tools and technologies.
**Responsibilities:**
+ Build new data acquisition and transformation pipelines using advanced data processing and cloud technologies.
+ Collaborate with the broader technology team, including information architecture and data integration teams, to align pipelines with strategic initiatives.
**What We're Looking For:**
+ Bachelor's degree in computer science or a related field, with at least 8+ years of professional software development experience.
+ Must have: **Programming languages commonly used for data processing,** **Data orchestration and workflow management systems,** **Distributed data processing framework, relational database management systems,** **B** **ig data processing frameworks** Experience with large-scale data processing platforms.
+ Deep understanding of RESTful services, good API design, and object-oriented programming principles.
+ Proficiency in object-oriented or functional scripting languages.
+ Good working knowledge of relational and NoSQL databases.
+ Experience in maintaining and developing software in production environments utilizing cloud-based tools.
+ Strong collaboration and teamwork skills, along with excellent written and verbal communication abilities.
+ Self-starter and motivated individual with the ability to thrive in a fast-paced software development environment.
+ Agile experience is highly desirable.
+ Experience with data warehousing and analytics platforms will be a significant advantage.
**Technical Expertise**
+ Data Engineering Expertise: Strong experience in distributed data processing and optimization using modern frameworks.
+ Cloud Platforms: Proficient in leveraging cloud services for scalable data solutions, including ETL orchestration, containerized deployments, and data storage.
+ Workflow Orchestration: Skilled in designing and managing complex data pipelines and workflows.
+ Programming & Scripting: Proficient in writing clean, modular, and testable code for data processing tasks.
+ Database Management: Solid understanding of both relational and non-relational databases, including data querying and modeling.
+ ETL & Data Architecture: Proven ability to design and implement robust ETL pipelines and optimize data models for performance and scalability.
**Soft Skills**
+ **Excellent communication skills** - able to articulate technical concepts to non-technical stakeholders.
+ **Strong interpersonal skills** - collaborative, empathetic, and team-oriented.
+ Demonstrated ability to work on **challenging projects** and go the **extra mile** to deliver results.
**Preferred Qualifications**
+ Experience with CI/CD pipelines, Github and DevOps practices is must.
+ Familiarity with data lake and data warehouse architectures.
+ Exposure to real-time data processing frameworks, and observability tools like Grafana is added advantage.
**What's In It For** **You?**
**Our Purpose:**
Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world.
Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence®, pinpointing risks and opening possibilities. We Accelerate Progress.
**Our People:**
We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.
From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.
**Our Values:**
**Integrity, Discovery, Partnership**
At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of **integrity** in all we do, bring a spirit of **discovery** to our work, and collaborate in close **partnership** with each other and our customers to achieve shared goals.
**Benefits:**
We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global.
Our benefits include:
+ Health & Wellness: Health care coverage designed for the mind and body.
+ Flexible Downtime: Generous time off helps keep you energized for your time on.
+ Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
+ Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
+ Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
+ Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.
For more information on benefits by country visit: Hiring and Opportunity at S&P Global:**
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
**Recruitment Fraud Alert:**
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, "pre-employment training" or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here ( .
---
**Equal Opportunity Employer**
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to: and your request will be forwarded to the appropriate person.
**US Candidates Only:** The EEO is the Law Poster describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)
**Job ID:**
**Posted On:**
**Location:** Ahmedabad, Gujarat, India
**Grade Level (for internal use):**
11
**The Team:** The Market Intelligence Industry Data Solutions business line provides data technology and services supporting acquisition, ingestion, content management, mastering, and distribution to power our Financial Institution Group business and customer needs. We focus on platform scalability to support business operations by following a common data lifecycle that accelerates business value. Our team provides essential intelligence for the Financial Services, Real Estate, and Insurance industries.
**The Impact:** The Data Engineering team will be responsible for implementing and maintaining services and tools to support existing feed systems. This enables users to consume FIG datasets and makes FIG data available for broader consumption and processing within the company.
**What's in it for you:** Opportunity to work with global stakeholders and engage with the latest tools and technologies.
**Responsibilities:**
+ Build new data acquisition and transformation pipelines using advanced data processing and cloud technologies.
+ Collaborate with the broader technology team, including information architecture and data integration teams, to align pipelines with strategic initiatives.
**What We're Looking For:**
+ Bachelor's degree in computer science or a related field, with at least 8+ years of professional software development experience.
+ Must have: **Programming languages commonly used for data processing,** **Data orchestration and workflow management systems,** **Distributed data processing framework, relational database management systems,** **B** **ig data processing frameworks** Experience with large-scale data processing platforms.
+ Deep understanding of RESTful services, good API design, and object-oriented programming principles.
+ Proficiency in object-oriented or functional scripting languages.
+ Good working knowledge of relational and NoSQL databases.
+ Experience in maintaining and developing software in production environments utilizing cloud-based tools.
+ Strong collaboration and teamwork skills, along with excellent written and verbal communication abilities.
+ Self-starter and motivated individual with the ability to thrive in a fast-paced software development environment.
+ Agile experience is highly desirable.
+ Experience with data warehousing and analytics platforms will be a significant advantage.
**Technical Expertise**
+ Data Engineering Expertise: Strong experience in distributed data processing and optimization using modern frameworks.
+ Cloud Platforms: Proficient in leveraging cloud services for scalable data solutions, including ETL orchestration, containerized deployments, and data storage.
+ Workflow Orchestration: Skilled in designing and managing complex data pipelines and workflows.
+ Programming & Scripting: Proficient in writing clean, modular, and testable code for data processing tasks.
+ Database Management: Solid understanding of both relational and non-relational databases, including data querying and modeling.
+ ETL & Data Architecture: Proven ability to design and implement robust ETL pipelines and optimize data models for performance and scalability.
**Soft Skills**
+ **Excellent communication skills** - able to articulate technical concepts to non-technical stakeholders.
+ **Strong interpersonal skills** - collaborative, empathetic, and team-oriented.
+ Demonstrated ability to work on **challenging projects** and go the **extra mile** to deliver results.
**Preferred Qualifications**
+ Experience with CI/CD pipelines, Github and DevOps practices is must.
+ Familiarity with data lake and data warehouse architectures.
+ Exposure to real-time data processing frameworks, and observability tools like Grafana is added advantage.
**What's In It For** **You?**
**Our Purpose:**
Progress is not a self-starter. It requires a catalyst to be set in motion. Information, imagination, people, technology-the right combination can unlock possibility and change the world.
Our world is in transition and getting more complex by the day. We push past expected observations and seek out new levels of understanding so that we can help companies, governments and individuals make an impact on tomorrow. At S&P Global we transform data into Essential Intelligence®, pinpointing risks and opening possibilities. We Accelerate Progress.
**Our People:**
We're more than 35,000 strong worldwide-so we're able to understand nuances while having a broad perspective. Our team is driven by curiosity and a shared belief that Essential Intelligence can help build a more prosperous future for us all.
From finding new ways to measure sustainability to analyzing energy transition across the supply chain to building workflow solutions that make it easy to tap into insight and apply it. We are changing the way people see things and empowering them to make an impact on the world we live in. We're committed to a more equitable future and to helping our customers find new, sustainable ways of doing business. We're constantly seeking new solutions that have progress in mind. Join us and help create the critical insights that truly make a difference.
**Our Values:**
**Integrity, Discovery, Partnership**
At S&P Global, we focus on Powering Global Markets. Throughout our history, the world's leading organizations have relied on us for the Essential Intelligence they need to make confident decisions about the road ahead. We start with a foundation of **integrity** in all we do, bring a spirit of **discovery** to our work, and collaborate in close **partnership** with each other and our customers to achieve shared goals.
**Benefits:**
We take care of you, so you can take care of business. We care about our people. That's why we provide everything you-and your career-need to thrive at S&P Global.
Our benefits include:
+ Health & Wellness: Health care coverage designed for the mind and body.
+ Flexible Downtime: Generous time off helps keep you energized for your time on.
+ Continuous Learning: Access a wealth of resources to grow your career and learn valuable new skills.
+ Invest in Your Future: Secure your financial future through competitive pay, retirement planning, a continuing education program with a company-matched student loan contribution, and financial wellness programs.
+ Family Friendly Perks: It's not just about you. S&P Global has perks for your partners and little ones, too, with some best-in class benefits for families.
+ Beyond the Basics: From retail discounts to referral incentive awards-small perks can make a big difference.
For more information on benefits by country visit: Hiring and Opportunity at S&P Global:**
At S&P Global, we are committed to fostering a connected and engaged workplace where all individuals have access to opportunities based on their skills, experience, and contributions. Our hiring practices emphasize fairness, transparency, and merit, ensuring that we attract and retain top talent. By valuing different perspectives and promoting a culture of respect and collaboration, we drive innovation and power global markets.
**Recruitment Fraud Alert:**
If you receive an email from a spglobalind.com domain or any other regionally based domains, it is a scam and should be reported to . S&P Global never requires any candidate to pay money for job applications, interviews, offer letters, "pre-employment training" or for equipment/delivery of equipment. Stay informed and protect yourself from recruitment fraud by reviewing our guidelines, fraudulent domains, and how to report suspicious activity here ( .
---
**Equal Opportunity Employer**
S&P Global is an equal opportunity employer and all qualified candidates will receive consideration for employment without regard to race/ethnicity, color, religion, sex, sexual orientation, gender identity, national origin, age, disability, marital status, military veteran status, unemployment status, or any other status protected by law. Only electronic job submissions will be considered for employment.
If you need an accommodation during the application process due to a disability, please send an email to: and your request will be forwarded to the appropriate person.
**US Candidates Only:** The EEO is the Law Poster describes discrimination protections under federal law. Pay Transparency Nondiscrimination Provision - - Professional (EEO-2 Job Categories-United States of America), IFTECH202.2 - Middle Professional Tier II (EEO Job Group), SWP Priority - Ratings - (Strategic Workforce Planning)
**Job ID:**
**Posted On:**
**Location:** Ahmedabad, Gujarat, India
This advertiser has chosen not to accept applicants from your region.
9