182 Data Pipeline jobs in India

Relocation Assistance Offered Within Country
Job Number # - Mumbai, Maharashtra, India
**Who We Are**
Colgate-Palmolive Company is a global consumer products company operating in over 200 countries specialising in Oral Care, Personal Care, Home Care, Skin Care, and Pet Nutrition. Our products are trusted in more households than any other brand in the world, making us a household name!
Join Colgate-Palmolive, a caring, innovative growth company reimagining a healthier future for people, their pets, and our planet. Guided by our core values-Caring, Inclusive, and Courageous-we foster a culture that inspires our people to achieve common goals. Together, let's build a brighter, healthier future for all.
**Title: Sr. Analyst, Data Architecture**
**Brief introduction - Role Summary/Purpose :**
+ The candidate will collaborate with Colgate Business teams and CBS Analytics to identify and develop high-impact use cases utilizing Prompt Engineering.
+ This position requires a strong foundation in Artificial Intelligence, Machine Learning, and Generative AI.
+ The ideal candidate is an analytical problem solver skilled at working with large data sets, demonstrates a collaborative and customer-centric approach (proactive and responsive to business needs), and possesses strong written and verbal communication abilities. Additionally, the candidate should have a passion for continuous learning and driving innovation to unlock new business opportunities.
**Responsibilities :**
+ Design, develop and refine AI-generated text prompts for various applications
+ Collaborate with content creators, product teams and data scientists to ensure prompt alignment with company goals and user needs
+ Monitor and analyze prompt performance to identify areas for improvement
+ Optimize AI prompt generation process to enhance overall system performance
+ Stay up-to-date on the latest advancements in AI, natural language processing and machine learning
+ Provide support to teams in understanding prompt engineering best practices
**Required Qualifications :**
+ Bachelor's or Master's degree in Computer Science, Data Science, Engineering, or a related field
+ 1 Year of Experience with prompt engineering for large language models (LLMs) including Gemini, GPT, Llama, and Claude is preferred
+ Comprehensive understanding of Artificial Intelligence, Machine Learning, and generative AI platforms
+ Knowledge of Data Transformation tools - R/Python/ SQL/DBT/Cloud solutions ( GCP/Snowflake )
+ Working knowledge of visualization tools like SIgma,Tableau, DOMO, Data studio,
+ Ability to Read , Analyze and Visualize data
+ Effective Verbal & Written Communication for Business engagement
**Preferred Qualifications:**
+ Excellent problem-solving and analytical skills
+ Ability to collaborate effectively with cross-functional teams
+ Working knowledge of consumer packaged goods industry
+ Understanding of Colgate's processes, and tools supporting analytics (for internal candidates)
+ Willingness and ability to experiment with new tools and techniques
+ Good facilitation and project management skills
**Our Commitment to Inclusion**
Our journey begins with our people-developing strong talent with diverse backgrounds and perspectives to best serve our consumers around the world and fostering an inclusive environment where everyone feels a true sense of belonging. We are dedicated to ensuring that each individual can be their authentic self, is treated with respect, and is empowered by leadership to contribute meaningfully to our business.
**Equal Opportunity Employer**
Colgate is an equal opportunity employer and all qualified applicants will receive consideration for employment without regard to race, colour, religion, gender, gender identity, sexual orientation, national origin, ethnicity, age, disability, marital status, veteran status (United States positions), or any other characteristic protected by law.
Reasonable accommodation during the application process is available for persons with disabilities. Please complete this request form ( should you require accommodation.
#LI-Hybrid

ABOUT AMGEN
Amgen harnesses the best of biology and technology to fight the world's toughest diseases, and make people's lives easier, fuller and longer. We discover, develop, manufacture and deliver innovative medicines to help millions of patients. Amgen helped establish the biotechnology industry more than 40 years ago and remains on the cutting-edge of innovation, using technology and human genetic data to push beyond what's known today.
ABOUT THE ROLE
Role Description:
We are seeking a seasoned and passionate Principal Architect (Enterprise Architect - Data Platform Engineering) in our Data Architecture & Engineering group to drive the architecture, development and implementation of our strategy spanning across Data Fabric, Data Management, and Data Analytics Platform stack. The ideal candidate possesses a deep technical expertise and understanding of data and analytics landscape, current tools and technology trends, and data engineering principles, coupled with strong leadership and data-driven problem-solving skills. As a Principal Architect, you will play a crucial role in building the strategy and driving the implementation of best practices across data and analytics platforms.
Roles & Responsibilities:
+ Must be passionate about Data, Content and AI technologies - with ability to evaluate and assess new technology and trends in the market quickly - with enterprise architecture in mind
+ Drive the strategy and implementation ofenterprise data platform and technical roadmapsthat align with the Amgen Data strategy 
+ Maintain the pulse of current market trends in data & AI space and be able to quickly perform hands-on experimentation and evaluations
+ Provide expert guidance and influence the management and peers from functional groups with Enterprise mindset and goals
+ Responsible for design, develop, optimize, delivery and support of Enterprise Data platform on AWS and Databricks architecture 
+ Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions.
+ Advice and support Application teams (product managers, architects, business analysts, and developers) on tools, technology, and methodology related to the design and development of applications that have large data volume and variety of data types 
+ Collaborate and align withEARB, Cloud Infrastructure, Securityand other technology leaders on Enterprise Data Architecture changes
+ Ensure scalability, reliability, and performance of data platforms by implementing best practices for architecture, cloud resource optimization, and system tuning.
+ Collaboration with RunOps engineers to continuously increase our ability to push changes into production with as little manual overhead and as much speed as possible.
Basic Qualifications and Experience:
+ Master's degree with 8 - 10 years of experience in Computer Science, IT or related field OR
+ Bachelor's degree with 10 - 14 years of experience in Computer Science, IT or related field
Functional Skills:
**Must-Have Skills:**
+ 8+ years of experience in data architecture and engineering or related roles with hands-on experience building enterprise data platforms in a cloud environment (AWS, Azure, GCP).
+ 5+ years of experience in leading enterprise scale data platforms and solutions
+ Expert-level proficiency with Databricks and experience in optimizing data pipelines and workflows in Databricks environments.
+ Deep understanding of distributed computing, data architecture, and performance optimization in cloud-based environments.
+ Experience with Enterprise mindset / certifications like TOGAF etc. are a plus.
+ Highlypreferred to have Big Tech or Big Consulting experience.
+ Solid knowledge of data security, governance, and compliance practices in cloud environments.
+ Must have exceptional communication to engage and influence architects and leaders in the organization
**Good-to-Have Skills:**
+ Experience with Gen AI tools in databricks
+ Experience with unstructured data architecture and pipelines
+ Experience working with agile development methodologies such as Scaled Agile.
Professional Certifications
+ AWS Certified Data Engineer preferred
+ Databricks Certificate preferred
Soft Skills:
+ Excellent analytical and troubleshooting skills.
+ Strong verbal and written communication skills
+ Ability to work effectively with global, virtual teams
+ High degree of initiative and self-motivation.
+ Ability to manage multiple priorities successfully.
+ Team-oriented, with a focus on achieving team goals
+ Strong presentation and public speaking skills.
EQUAL OPPORTUNITY STATEMENT
Amgen is an Equal Opportunity employer and will consider you without regard to your race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, or disability status.
We will ensure that individuals with disabilities are provided with reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request an accommodation.

At Microsoft, our core mission is empowering every person and every organization on the planet to achieve more. Industry Solutions (IS) is a global organization of over 16,000 strategic sellers, industry experts, elite engineers, architects and consultants, who along with delivery experts are working together to bring Microsoft's mission of empowerment - and cutting-edge technology - to life for the world's most influential customers. We are on the front lines of innovation, working side-by-side with customers to drive value across the entirety of their digital transformation journey. Our team prides itself on embracing a growth mindset, inspiring excellence, and encouraging everyone to share their unique viewpoints and be their authentic selves.
**Responsibilities**
**Pre-Sales Support**
+ Collaborates in the pre-sale process with internal stakeholders (e.g., Solution Architect, Pursuit Lead, Consulting Account Executive) by providing technical guidance, translating business requirements, or identifying possible existing or new solution offerings to help shape the deal and influence budgetary estimates. Contributes to Solution Review Meeting (SRM). Develops proposals or statement of work (SOW). Directly engages customers and internal teams to influence closing the deal. Actively involves themselves in Technical Quality Assurance (TQA) process.
+ Provides input on staffing and skill requirements for delivery to Resource Deployment, Technical Delivery Managers (TDMs), and/or Project Managers.
**Technical Delivery**
+ Follows the capacity process outlined by Resource, Insights, Capacity, and Capability (RICC) team. Maintains tools with up-to-date skills and availability.
+ Leads meetings with customers/partners to identify business needs and create a vision. Uses business, industry, and technology strategies to map customer/partner requirements to the adoption and optimization of Microsoft technology solutions. Engages others appropriately to understand and define customer requirements.
+ Participates in project planning in projects by collaborating with other subject matter experts in identifying the current and future business value of planned solutions. Assesses technical and business risks in programs and develops mitigations. Manages their schedule and communicates with project leads. Generates and delivers Work Breakdown Structure (WBS). 
+ Provides oversight and leadership on work streams or a partner team to implement solutions. Follows Industry Solutions processes in the implementation process and aligns solutions with the intent of the architecture and meeting customer/partner business goals. 
+ Manages complex escalations, analyzes situations, and coordinates appropriate resources to resolve issues by following delivery practices, considering cost implications, and engaging in conversations with internal and external stakeholders (e.g., Customer Service and Support, Project Manager, Solution Architect, Product Group) as needed.
+ Proactively manages executive-level customer/partner/stakeholder relationships to identify and contribute to the drivers of satisfaction and dissatisfaction, determine the root cause, and establish recovery actions to improve the experience. Works with account team to ensure One Microsoft approach. Shares lessons learned with workgroup and consultant community.
**Intellectual Property Management**
+ Acts as an ambassador in the consumption of intellectual property (IP) by identifying new intellectual property that needs to be developed or refreshed. Updates new versions of the content, reviews IP to be considered for harvest and curation and ensures it is logged for consumption. Contributes to driving a consistent approach of using and managing resources. Improves Industry Solutions offerings quality and collaborates with portfolio and solution teams by providing feedback.
**Business Development**
+ Drives opportunities to expand or accelerate the adoption and consumption of cloud and Microsoft technologies. Collaborates, as appropriate, with peers and other teams (e.g., Sales, account-aligned team) to scale the business with existing high-stake or strategic customers, by articulating/developing value propositions of strategic Microsoft products and services. Drives innovation and digital transformation. Ensures the use of the existing intellectual property (IP).
**Readiness**
+ Learns new technologies or services based on business demands and industry trends. Obtains relevant accreditations and certification(s) as advised by domain leadership team. Identifies certifications and readiness plans in partnership with Worldwide Learning. Leads or participates in relevant technical communities and conducts training sessions to evangelize technology and/or offerings based on availability. Mentors team members and acts as a technical advisor for stakeholders by providing thought leadership, articulation of solutions value, and outcomes of business strategies.  
**Operational Excellence**
+ Completes operational tasks and readiness and ensures timeliness and accuracy. Follows Microsoft policies, compliance, and procedures (e.g., Enterprise Services Authorization Policy, Standards of Business Conduct, labor logging, expenses, travel guidelines). Leads by example and guides team members on operational tasks, readiness, and compliance.
**Knowledge, Skills, Abilities**
+ · Architecture Design· Artificial Intelligence (AI)· Business Analysis· Business Knowledge· Challenger Mindset· Cloud Platform· Cloud Security· Commercial Technology Acumen· Competitive Analysis· Consultative Selling· Creativity· Data Analysis· Data Architecture· Databases· Decision Making· DevOps· Driving Insight-Led Conversations· Engineering Awareness· English Language Proficiency· Enterprise Security· Executive Presence· Formal Presentations· Governance Methodology and Practices· Innovation & Capability Growth· Interpersonal Flexibility· Machine Learning· Microsoft Products· Migration Planning· Network Architecture· Networking· Open Source Platforms· Operational Excellence· Oral Communication· Problem Solving· Project Management · Relationship Management· Software Architecture· Software Engineering Practices· Stakeholder Management· Storytelling· Strategic Technical Planning· Team Orchestration· Technical Architecture· Technical Communication· Technical Solutions· Technology Industry Knowledge· Trusted Technical Advisor· Written Communications **Technology Areas**
+ Strong understanding of complex business problems to ensure projects are leveraging the appropriate technology and the technical design. 
+ Enterprise-scale technical experience with cloud and hybrid infrastructures, architecture designs, database migrations, and technology management.
+ Experience in moving data from on-premises data platforms to cloud and designing cloud native data warehouse platform.
+ Experience working with transactional, temporal, time series, and structured and unstructured data. 
+ Big Data and Data Warehouses including Azure Synapse Analytics (formerly Azure SQL DW), Snowflake, GCP's Big Query, AWS Redshift, Azure Data Lake, Azure Data Explorer
+ Advanced Analytics including Azure Synapse Analytics, Azure Data Bricks, data visualization tools (i.e. PowerBI, Tableau)
+ Data Science and Machine Learning (i.e. Azure ML, ML Server, TensorFlow, or other similar frameworks) 
+ Experience with cloud infrastructure, storage optimization and query optimizations.
+ Experience in delivering/managing lifecycle of software/services using DevOps/MLOps. **Other**
+ Embody our culture and values
**Qualifications**
Required/Minimum Qualifications
+ Bachelor's Degree in Computer Science, Information Technology, Engineering, or related field AND 8+ years experience in technology solutions, practice development, architecture, consulting, and/or technology domain (e.g., Security)
+ OR Master's Degree in Computer Science, Information Technology, Engineering, or related field AND 6+ years experience in technology solutions, practice development, architecture, consulting, and/or technology domain (e.g., Security)
+ OR equivalent experience.
Additional or Preferred Qualifications
+ Bachelor's Degree in Computer Science, Information Technology, Engineering, or related field AND 12+ years experience in technology solutions, practice development, architecture, consulting, and/or technology domain
+ OR Master's Degree in Computer Science, Information Technology, Engineering, or related field AND 8+ years experience in technology solutions, practice development, architecture, consulting, and/or technology domain
+ OR equivalent experience.
+ 6+ years technical sales experience.
+ 6+ years project management experience.
+ Technical or Professional Certification in Domain
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations ( .

With more than 45,000 employees and partners worldwide, the Customer Experience and Success (CE&S) organization is on a mission to empower customers to accelerate business value through differentiated customer experiences that leverage Microsoft's products and services, ignited by our people and culture. We drive cross-company alignment and execution, ensuring that we consistently exceed customers' expectations in every interaction, whether in-product, digital, or human-centered. CE&S is responsible for all up services across the company, including consulting, customer success, and support across Microsoft's portfolio of solutions and products. Join CE&S and help us accelerate AI transformation for our customers and the world.
The Global Customer Success (GCS) organization, an organization within CE&S, is leading the effort to enable customer success on the Microsoft Cloud by harnessing leading, AI-powered capabilities and human expertise to deliver innovation solutions that accelerate business value, drive operational excellence and nurture long term loyalty.
Are you looking for a role where you can interact directly with large enterprise customers to improve their Azure Data and SQL related technologies? If so, we are looking for you!
We are seeking a Cloud Solution Architect in the CSA Global Delivery organization with deep expertise in Azure Data and SQL. As a key technical resource for the customer, you will be primarily focused on delivering proactive services such as education workshops, delivering assessments, and providing tailored guidance. Troubleshooting skills are essential as this role will include working with Microsoft Support to expedite incident resolution.
The CSA Global Delivery team is a centralized group consisting of both full-time employees (FTEs) and Vendor CSAs dedicated to enhancing the customer's experience with Microsoft as they transition to hybrid/public cloud solutions.
Microsoft's mission is to empower every person and every organization on the planet to achieve more.
This role is flexible in that you can work up to 50% from home.
Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
**Responsibilities**
You will be planning and delivering proactive and reactive support including onsite presence as needed
· You will Identify and manage customer goals and SfMC opportunities to improve the quality, consumption, and health of the customer's solution.
· You will drive and participate in proactive delivery management: spot performance issues, analyze problems, and drive activities focused on stabilizing and optimizing your customer's solution.
· You will work with internal Microsoft support teams, account teams, product engineering and service engineering teams and other stakeholders to ensure a streamlined and efficient customer support experience.
· You will apply and share lessons learned for continuous process and delivery improvement for the customer and peers.
· You will engage in meetings with your customers and account teams to review Support for Mission Critical services, customer support issues, and articulate your Customer Success Plans.
· You will share and gain knowledge through technical communities.
Technical Leadership
· Demonstrate the capability to act as CSA Pod Lead with ability to drive planning and delivery of Pod team by engaging CSAM and ATU, manage customer relationship by conducting monthly engagement reviews and assuring quality and be accountable for capacity planning, hiring, skilling and utilization of Pod members.
· Proactively develops technical and professional learning and development plan in alignment with and support from their manager. Role models effective technical readiness. Acts as a mentor and role model to less experienced colleagues to educate them on technical and non-technical concepts. Participates in development opportunities (e.g., Ready, Build, Ignite).
· Shares ideas, insights, and strategic technical input with technical teams, internal communities across the field, and the larger virtual team across Microsoft using a thorough knowledge of specific Microsoft products and their context in the competitive landscape. Participates in external technical community events (e.g., conferences, seminars, technical meetups, Webcasts, blogs, hackathons) and shares learnings with the internal team.
· Generates new ideas for changes and improvements to existing intellectual property (IP), technologies, and processes for designated customers/partners. Drives opportunities for IP reuse, best practice sharing, and consumption acceleration. Proactively identifies gaps through delivery and communicating those gaps to others (e.g., Leadership, managed intellectual property (MIP), Design, and Governance). Applies subject matter expertise to develop new IP that fills identified gaps
Important key criteria:
- Should have potential to scale as CSA Pod Lead with ability to lead planning and delivery of vendor Pod team by engaging account team
- Manage customer relationship by conducting monthly engagement reviews and assuring quality and be accountable for capacity planning, hiring, skilling and utilization of Pod members.
Additional details
**Qualifications**
Bachelor's Degree in Computer Science, Information Technology, Engineering, Business, Liberal Arts, or related field AND 4+ years experience in cloud/infrastructure technologies, information technology (IT) consulting/support, systems administration, network operations, software development/support, technology solutions, practice development, architecture, and/or consulting OR equivalent experience.
- 10+ years of Data & AI related experience with at least three of the following technologies: SQL Server 2012 or later on-premises, SQL Server 2012 or later running on Azure VMs, Azure SQL Database, Azure SQL Managed Instance, Azure SQL Hyper-Scale, SQL AAG Clusters, Azure Integration Services
- Strong knowledge of SQL Server Internals
- Practical experience designing / building large OLTP DB systems
- Knowledge of other SQL technologies on Azure (PostgreSQL, MySQL, MariaDB)
- Data & AI Certifications in Microsoft and competing Cloud Technologies.
- Outstanding customer service skills with excellent oral and written communication skills as well as experience providing training to peers or customers.
- Strong interpersonal and leadership skills while working with diverse audiences including highly technical IT professionals, engineers, developers, and architects as well as executives and management professionals in both customer and Microsoft teams.
- Experience leading and driving projects as well as motivating others.
- Self-motivated, resourceful, and able to handle multiple responsibilities as a Microsoft Cloud Solution Architect
- Ability to develop strong strategic customer relationships that gain the trust and respect of customers.
- Ability to handle critical technical issues and work in difficult support situations.
- Ability to handle difficult or sensitive situations with customers.
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations ( .

We’re seeking a skilled Data Integration Engineer with 10+ years of experience to design, develop, and maintain robust data pipelines and integration solutions. The ideal candidate will have hands-on experience with Informatica, ETL processes, and cloud data Platforms.

Key Responsibilities:

·    Develop and maintain ETL workflows using Informatica.

·    Design and implement data pipelines for ingestion, transformation, and loading.

·    Work with SQL and Python to manipulate and analyse data.

·    Integrate data across various systems and platforms, including GCP and BigQuery.

·    Ensure data quality, consistency, and security across all integrations.

·    Collaborate with data architects, analysts, and business stakeholders.

Required Skills:

·    Strong experience with Informatica and ETL development.

·    Proficiency in Python and SQL.

·    Hands-on experience with Google Cloud Platform (GCP) and Big Query.

·    Solid understanding of data integration best practices and performance optimization.

This is a remote position.

Duration: 6 months Location: Remote Timings: Full Time (As per company timings) Notice Period: (Immediate Joiner - Only) Experience: 6-9 Years JD: We seek a Senior Data Integration Developer with deep expertise in SAP Data Intelligence to support a large-scale enterprise data program. You will be responsible for designing, building, and optimizing SAP DI pipelines for data ingestion, transformation, and integration across multiple systems. Key Responsibilities Design, develop, and deploy data integration pipelines in SAP Data Intelligence. Integrate SAP and non-SAP data sources, ensuring scalability and performance. Implement data quality checks, metadata management, and monitoring. Collaborate with MDM teams, functional consultants, and business analysts to meet integration requirements. Troubleshoot issues and optimize workflows for efficiency. Prepare technical documentation and handover materials.    6+ years of data integration experience, with at least 3 years in SAP Data Intelligence. Strong skills in SAP DI Graphs, Operators, and connectivity with SAP HANA, S/4HANA, and cloud platforms. Experience with data transformation, cleansing, and enrichment processes. Proficiency in Python, SQL, and integration protocols (REST, OData, JDBC). Strong problem-solving and debugging skills.

The Global Power Market is amidst a fundamental transition from a central (Predictable, vertically integrated, one way) to a distributed (Intermittent, horizontally networked, bidirectional) model with increasing penetration of Renewables playing a key role in this transition.

RILs newly created Distributed Renewables (RE) business intends to accelerate this transition by providing safe, reliable, affordable, and accessible distributed green energy solutions to Indias population thereby improving quality of life.

Digital is the key enabler for the business to scale-up through the 3 pillars of agility, delightful customer experience and data driven decision making.

Work Location : Navi Mumbai

Department: Digital, Distributed Renewable Energy

Reporting to: Head, Digital Initiatives, Distributed Renewables

Job Overview:

We are seeking a highly skilled and experienced Data and Integration Architect to join our team. This role is crucial for designing and implementing robust data and integration architectures that support our company's strategic goals. The ideal candidate will possess a deep understanding of data architecture, data modeling, integration patterns, and the latest technologies in data integration and management. This position requires a strategic thinker who can collaborate with various stakeholders to ensure our data and integration frameworks are scalable, secure, and aligned with business needs.

Key Responsibilities:

1.   Data Architecture Design : Develop and maintain an enterprise data architecture strategy that supports business objectives and aligns with the companys technology roadmap.

2.   Integration Architecture Development: Design and implement integration solutions that seamlessly connect disparate systems both internally and with external partners, ensuring data consistency and accessibility.

3.   Data Governance and Compliance: Establish and enforce data governance policies and procedures to ensure data integrity, quality, security, and compliance with relevant regulations.

4.   System Evaluation and Selection: Evaluate and recommend technologies and platforms for data integration, management, and analytics, ensuring they meet the organizations needs.

5.   Collaboration with IT and Business Teams: Work closely with IT teams, business analysts, and external partners to understand data and integration requirements and translate them into architectural solutions.

6.   Performance and Scalability: Ensure the data and integration architecture supports high performance and scalability, addressing future growth and technology evolution.

7.   Best Practices and Standards: Advocate for and implement industry best practices and standards in data management, integration, and architecture design.

8.   Troubleshooting and Optimization: Identify and address data and integration bottlenecks, performing regular system audits and optimizations to improve performance and efficiency.

9.   Documentation and Training: Develop comprehensive documentation for the data and integration architectures. Provide training and mentorship to IT staff and stakeholders on best practices.

Qualifications:

1.   Bachelors or Masters degree in Computer Science, Information Technology, Data Science, or a related field.

2.   Minimum of 7 years of experience in data architecture, integration, or a related field, with a proven track record of designing and implementing large-scale data and integration solutions.

3.   Expert knowledge of data modeling, data warehousing, ETL processes, and integration patterns (APIs, microservices, messaging).

4.   Experience with cloud-based data and integration platforms (e.g., AWS, Azure, Google Cloud Platform) and understanding of SaaS, PaaS, and IaaS models.

5.   Strong understanding of data governance, data quality management, and compliance regulations (e.g., GDPR, HIPAA).

6.   Proficient in SQL and NoSQL databases, data integration tools (e.g., Informatica, Talend, MuleSoft), and data visualization tools (e.g., Tableau, Power BI).

7.   Excellent analytical, problem-solving, and project management skills.

8.   Outstanding communication and interpersonal abilities, with the skill to articulate complex technical concepts to non-technical stakeholders.

What We Offer:

1.   Opportunities for professional growth and advancement.

2.   A dynamic and innovative work environment with a strong focus on collaboration and continuous learning.

3.   The chance to work on cutting-edge projects, making a significant impact on the companys data strategy and operations.

This position offers an exciting opportunity for a seasoned Data and Integration Architect to play a key role in shaping the future of our data and integration strategies. If you are passionate about leveraging data to drive business success and thrive in a dynamic and collaborative environment, we encourage you to apply.

**Introduction**
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
**Your role and responsibilities**
As Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing.
Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets.
In this role, your responsibilities may include:
* Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques
* Designing and implementing various enterprise seach applications such as Elasticsearch and Splunk for client requirements
* Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviors.
* Build teams or writing programs to cleanse and integrate data in an efficient and reusable manner, developing predictive or prescriptive models, and evaluating modeling results
Your primary responsibilities include:
* Develop & maintain data pipelines for batch & stream processing using informatica power centre or cloud ETL/ELT tools.
* Liaise with business team and technical leads, gather requirements, identify data sources, identify data quality issues, design target data structures, develop pipelines and data processing routines, perform unit testing and support UAT.
* Work with data scientist and business analytics team to assist in data ingestion and data-related technical issues.
**Required technical and professional expertise**
* Expertise in Data warehousing/ information Management/ Data Integration/Business Intelligence using ETL tool Informatica PowerCenter
* Knowledge of Cloud, Power BI, Data migration on cloud skills.
* Experience in Unix shell scripting and python
* Experience with relational SQL, Big Data etc
**Preferred technical and professional experience**
* Knowledge of MS-Azure Cloud
* Experience in Informatica PowerCenter
* Experience in Unix shell scripting and python
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.