17,372 Data Engineer jobs in India

Data Engineer-Data Modeling

Pune, Maharashtra IBM

Posted today

Job Viewed

Tap Again To Close

Job Description

**Introduction**
In this role, you'll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of new technology.
**Your role and responsibilities**
As an Data Engineer at IBM you will harness the power of data to unveil captivating stories and intricate patterns. You'll contribute to data gathering, storage, and both batch and real-time processing.
* Collaborating closely with diverse teams, you'll play an important role in deciding the most suitable data management systems and identifying the crucial data required for insightful analysis. As a Data Engineer, you'll tackle obstacles related to database integration and untangle complex, unstructured data sets.
* In this role, your responsibilities may include:
* Implementing and validating predictive models as well as creating and maintain statistical models with a focus on big data, incorporating a variety of statistical and machine learning techniques
* Designing and implementing various enterprise search applications such as Elasticsearch and Splunk for client requirements
* Work in an Agile, collaborative environment, partnering with other scientists, engineers, consultants and database administrators of all backgrounds and disciplines to bring analytical rigor and statistical methods to the challenges of predicting behaviours.
* Build teams or writing programs to cleanse and integrate data in an efficient and reusable manner, developing predictive or prescriptive models, and evaluating modelling results
**Required technical and professional expertise**
* 4+ years of experience in data modelling, data architecture.
* Proficiency in data modelling tools Erwin, IBM Infosphere Data Architect and database management systems
* Familiarity with different data models like relational, dimensional and NoSQL databases.
* Understanding of business processes and how data supports business decision making.
* Strong understanding of database design principles, data warehousing concepts, and data governance practices
**Preferred technical and professional experience**
* Excellent analytical and problem-solving skills with a keen attention to detail.
* Ability to work collaboratively in a team environment and manage multiple projects simultaneously.
* Knowledge of programming languages such as SQL
IBM is committed to creating a diverse environment and is proud to be an equal-opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, gender, gender identity or expression, sexual orientation, national origin, caste, genetics, pregnancy, disability, neurodivergence, age, veteran status, or other characteristics. IBM is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer, Data Modeling

Hyderabad, Andhra Pradesh data.ai

Posted today

Job Viewed

Tap Again To Close

Job Description

What can you tell your friends

when they ask you what you do?

We’re looking for an experienced Big Data Engineer who can create innovative new products in the analytics and data space. You will participate in the development that creates the world's #1 mobile app analytics service. Together with the team, you will build out new product features and applications using agile methodologies and open-source technologies. You will work directly with Data Scientists, Data Engineers, Product Managers, and Software Architects, and will be on the front lines of coding new and exciting analytics and data mining products. You should be passionate about what you do and excited to join an entrepreneurial start-­up.

To ensure we execute on our values we are looking for someone who has a passion for:

As a Big Data Engineer, we will need you to be in charge of model implementation and maintenance, and to build a clean, robust, and maintainable data processing program that can support these projects on huge amounts of data, this includes

  • Able to design and implement complex data product components based on requirements with possible technical solutions.
  • Write data programs using Python (e.g., pyspark) with a commitment to maintaining high-quality work while being confident in dealing with data mining challenges.
  • Discover any feasible new technologies lying in the Big Data ecosystem, for example, the Hadoop ecosystem, and share them with to team with your professional perspectives.
  • Get up to speed in the data science and machine learning domain, implementing analysis components in a distributed computing environment (e.g., MapReduce implementation) with instruction from Data Scientists.
  • Be comfortable conducting detailed discussions with Data Scientists regarding specific questions related to specific data models.
  • You should be a strong problem solver with proven experience in big data.
  • You should recognize yourself in the following…

  • Hands-on experience and deep knowledge of the Hadoop ecosystem.
  • Must: PySpark, MapReduce, HDFS.
  • Plus: Storm, Kafka.
  • Must have 2+ years of Linux environment development experience.
  • Proficient with programming in Python & Scala, experience in Pandas, Sklearn or Other data science and data analysis toolset is a big plus.
  • Experience in data pipeline design & automation.
  • Having a background in data mining, analytics & data science components implementation, and machine learning domain, familiarity with common algorithms and libs is a plus.
  • Passion for cloud computing (AWS in particular) and distributed systems.
  • You must be a great problem solver with the ability to dive deeply into complex problems and emerge with clear and pragmatic solutions.
  • Good communication, and cooperation globally.
  • Major in Math or Computer Science.
  • You are driven by passion for innovation that pushes us closer to our vision in everything we do. Centering around our purpose and our hunger for new innovations is the foundation that allows us to grow and unlock the potential in AI.
  • You are an Ideal Team Player: You are hungry and no, we are not talking about food here. You are humble, yet love to succeed, especially as a team! You are smart, and not just book smart, you have a great read on people.
  • This position is located in Hyderabad, India.

    We are hiring for our engineering team at our data.ai India subsidiary entity, which is in the process of getting established . As we are awaiting approval from the Indian government, they shall be interim employees at Innova Solutions who is our Global Employer of Record.

    This advertiser has chosen not to accept applicants from your region.

    Data Engineer- Lead Data Engineer

    Bengaluru, Karnataka Paytm

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Role Overview



    We are seeking an experienced Lead Data Engineer to join our Data Engineering team at Paytm, India's leading digital payments and financial services platform. This is a critical role responsible for designing, building, and maintaining large-scale, real-time data streams that process billions of transactions and user interactions daily. Data accuracy and stream reliability are essential to our operations, as data quality issues can result in financial losses and impact customer trust.

    As a Lead Data Engineer at Paytm, you will be responsible for building robust data systems that support India's largest digital payments ecosystem. You'll architect and implement reliable, real-time data streaming solutions where precision and data correctness are fundamental requirements . Your work will directly support millions of users across merchant payments, peer-to-peer transfers, bill payments, and financial services, where data accuracy is crucial for maintaining customer confidence and operational excellence.


    This role requires expertise in designing fault-tolerant, scalable data architectures that maintain high uptime standards while processing peak transaction loads during festivals and high-traffic events. We place the highest priority on data quality and system reliability, as our customers depend on accurate, timely information for their financial decisions. You'll collaborate with cross-functional teams including data scientists, product managers, and risk engineers to deliver data solutions that enable real-time fraud detection, personalized recommendations, credit scoring, and regulatory compliance reporting.


    Key technical challenges include maintaining data consistency across distributed systems with demanding performance requirements, implementing comprehensive data quality frameworks with real-time validation, optimizing query performance on large datasets, and ensuring complete data lineage and governance across multiple business domains. At Paytm, reliable data streams are fundamental to our operations and our commitment to protecting customers' financial security and maintaining India's digital payments infrastructure.


    Key Responsibilities


    Data Stream Architecture & Development Design and implement reliable, scalable data streams handling high-volume transaction data with strong data integrity controlsBuild real-time processing systems using modern data engineering frameworks (Java/Python stack) with excellent performance characteristicsDevelop robust data ingestion systems from multiple sources with built-in redundancy and monitoring capabilitiesImplement comprehensive data quality frameworks, ensuring the 4 C's: Completeness, Consistency, Conformity, and Correctness - ensuring data reliability that supports sound business decisionsDesign automated data validation, profiling, and quality monitoring systems with proactive alerting capabilities Infrastructure & Platform Management Manage and optimize distributed data processing platforms with high availability requirements to ensure consistent service deliveryDesign data lake and data warehouse architectures with appropriate partitioning and indexing strategies for optimal query performanceImplement CI/CD processes for data engineering workflows with comprehensive testing and reliable deployment proceduresEnsure high availability and disaster recovery for critical data systems to maintain business continuity


    Performance & Optimization Monitor and optimize streaming performance with focus on latency reduction and operational efficiencyImplement efficient data storage strategies including compression, partitioning, and lifecycle management with cost considerationsTroubleshoot and resolve complex data streaming issues in production environments with effective response protocolsConduct proactive capacity planning and performance tuning to support business growth and data volume increases


    Collaboration & Leadership Work closely with data scientists, analysts, and product teams to understand important data requirements and service level expectationsMentor junior data engineers with emphasis on data quality best practices and customer-focused approachParticipate in architectural reviews and help establish data engineering standards that prioritize reliability and accuracyDocument technical designs, processes, and operational procedures with focus on maintainability and knowledge sharing


    Required Qualifications


    Experience & Education Bachelor's or Master's degree in Computer Science, Engineering, or related technical field

    7+ years (Senior) of hands-on data engineering experience

    Proven experience with large-scale data processing systems (preferably in fintech/payments domain)

    Experience building and maintaining production data streams processing TB/PB scale data with strong performance and reliability standards


    Technical Skills & RequirementsProgramming Languages:

    Expert-level proficiency in both Python and Java; experience with Scala preferred


    Big Data Technologies: Apache Spark (PySpark, Spark SQL, Spark with Java), Apache Kafka, Apache Airflow

    Cloud Platforms: AWS (EMR, Glue, Redshift, S3, Lambda) or equivalent Azure/GCP services

    Databases: Strong SQL skills, experience with both relational (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Cassandra, Redis)

    Data Quality Management: Deep understanding of the 4 C's framework - Completeness, Consistency, Conformity, and Correctness

    Data Governance: Experience with data lineage tracking, metadata management, and data cataloging

    Data Formats & Protocols: Parquet, Avro, JSON, REST APIs, GraphQL Containerization & DevOps: Docker, Kubernetes, Git, GitLab/GitHub with CI/CD pipeline experience

    Monitoring & Observability: Experience with Prometheus, Grafana, or similar monitoring tools

    Data Modeling: Dimensional modeling, data vault, or similar methodologies

    Streaming Technologies: Apache Flink, Kinesis, or Pulsar experience is a plus

    Infrastructure as Code: Terraform, CloudFormation (preferred)

    Java-specific: Spring Boot, Maven/Gradle, JUnit for building robust data services


    Preferred Qualifications


    Domain Expertise

    Previous experience in fintech, payments, or banking industry with solid understanding of regulatory compliance and financial data requirementsUnderstanding of financial data standards, PCI DSS compliance, and data privacy regulations where compliance is essential for business operationsExperience with real-time fraud detection or risk management systems where data accuracy is crucial for customer protection


    Advanced Technical Skills (Preferred)


    Experience building automated data quality frameworks covering all 4 C's dimensionsKnowledge of machine learning stream orchestration (MLflow, Kubeflow)Familiarity with data mesh or federated data architecture patternsExperience with change data capture (CDC) tools and techniques


    Leadership & Soft Skills Strong problem-solving abilities with experience debugging complex distributed systems in production environmentsExcellent communication skills with ability to explain technical concepts to diverse stakeholders while highlighting business valueExperience mentoring team members and leading technical initiatives with focus on building a quality-oriented cultureProven track record of delivering projects successfully in dynamic, fast-paced financial technology environments


    What We Offer


    Opportunity to work with cutting-edge technology at scaleCompetitive salary and equity compensation

    Comprehensive health and wellness benefits

    Professional development opportunities and conference attendanceFlexible working arrangements

    Chance to impact millions of users across India's digital payments ecosystem


    Application Process


    Interested candidates should submit:

    Updated resume highlighting relevant data engineering experience with emphasis on real-time systems and data quality

    Portfolio or GitHub profile showcasing data engineering projects, particularly those involving high-throughput streaming systems

    Cover letter explaining interest in fintech/payments domain and understanding of data criticality in financial services

    References from previous technical managers or senior colleagues who can attest to your data quality standards






    PI1255d80c7d

    This advertiser has chosen not to accept applicants from your region.

    Senior Data Engineer / Data Engineer

    Kochi, Kerala Invokhr

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    LOOKING FOR IMMEDIATE JOINERS OR 15 DAYS NOTICE PERIODS AND THIS IS WORK FROM HOME OPPORTUNITY

    Position: Senior Data Engineer / Data Engineer

    Desired Experience: 3-8 years

    Salary: Best-in-industry

    You will act as a key member of the Data consulting team, working directly with the partners and senior

    stakeholders of the clients designing and implementing big data and analytics solutions. Communication

    and organisation skills are keys for this position, along with a problem-solution attitude.

    What is in it for you:

    Opportunity to work with a world class team of business consultants and engineers solving some of

    the most complex business problems by applying data and analytics techniques

    Fast track career growth in a highly entrepreneurial work environment

    Best-in-industry renumeration package

    Essential Technical Skills:

    Technical expertise with emerging Big Data technologies, such as: Python, Spark, Hadoop, Clojure,

    Git, SQL and Databricks; and visualization tools: Tableau and PowerBI

    Experience with cloud, container and micro service infrastructures

    Experience working with divergent data sets that meet the requirements of the Data Science and

    Data Analytics teams

    Hands-on experience with data modelling, query techniques and complexity analysis

    Desirable Skills:

    Experience/Knowledge of working in an agile environment and experience with agile

    methodologies such as Scrum

    Experience of working with development teams and product owners to understand their

    requirement

    Certifications on any of the above areas will be preferred.

    Your duties will include:

    Develop data solutions within a Big Data Azure and/or other cloud environments

    Working with divergent data sets that meet the requirements of the Data Science and Data Analytics

    teams

    Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse

    Liaising with CTO, Product Owners and other Operations teams to deliver engineering roadmaps

    showing key items such as upgrades, technical refreshes and new versions

    Perform data mapping activities to describe source data, target data and the high-level or

    detailed transformations that need to occur;

    Assist Data Analyst team in developing KPIs and reporting in tools viz. Power BI, Tableau

    Data Integration, Transformation, Modelling

    Maintaining all relevant documentation and knowledge bases

    Research and suggest new database products, services and protocols

    Essential Personal Traits:

    You should be able to work independently and communicate effectively with remote teams.

    Timely communication/escalation of issues/dependencies to higher management.

    Curiosity to learn and apply emerging technologies to solve business problems

    This advertiser has chosen not to accept applicants from your region.

    Senior Data Engineer / Data Engineer

    Gurugram, Uttar Pradesh Invokhr

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Desired Experience: 3-8 years

    Salary: Best-in-industry

    Location: Gurgaon ( 5 days onsite)


    Overview:

    You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for this position, along with a problem-solution attitude.

    What is in it for you:

    Opportunity to work with a world class team of business consultants and engineers solving some of the most complex business problems by applying data and analytics techniques

    Fast track career growth in a highly entrepreneurial work environment

    Best-in-industry renumeration package

    Essential Technical Skills:

    Technical expertise with emerging Big Data technologies, such as: Python, Spark, Hadoop, Clojure, Git, SQL and Databricks; and visualization tools: Tableau and PowerBI

    Experience with cloud, container and micro service infrastructures

    Experience working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams

    Hands-on experience with data modelling, query techniques and complexity analysis

    Desirable Skills:

    Experience/Knowledge of working in an agile environment and experience with agile methodologies such as Scrum

    Experience of working with development teams and product owners to understand their requirement

    Certifications on any of the above areas will be preferred.

    Your duties will include:

    Develop data solutions within a Big Data Azure and/or other cloud environments

    Working with divergent data sets that meet the requirements of the Data Science and Data Analytics teams

    Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse

    Liaising with CTO, Product Owners and other Operations teams to deliver engineering roadmaps showing key items such as upgrades, technical refreshes and new versions

    Perform data mapping activities to describe source data, target data and the high-level or detailed transformations that need to occur;

    Assist Data Analyst team in developing KPIs and reporting in tools viz. Power BI, Tableau

    Data Integration, Transformation, Modelling

    Maintaining all relevant documentation and knowledge bases

    Research and suggest new database products, services and protocols

    Essential Personal Traits:

    You should be able to work independently and communicate effectively with remote teams.

    Timely communication/escalation of issues/dependencies to higher management.

    Curiosity to learn and apply emerging technologies to solve business problems


    ** Interested candidate please send thier resume on - and **

    This advertiser has chosen not to accept applicants from your region.

    Data Engineer- Lead Data Engineer

    Bengaluru, Karnataka Paytm

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Role Overview We are seeking an experienced Lead Data Engineer to join our Data Engineering team at Paytm, India's leading digital payments and financial services platform. This is a critical role responsible for designing, building, and maintaining large-scale, real-time data streams that process billions of transactions and user interactions daily. Data accuracy and stream reliability are essential to our operations, as data quality issues can result in financial losses and impact customer a Lead Data Engineer at Paytm, you will be responsible for building robust data systems that support India's largest digital payments ecosystem. You'll architect and implement reliable, real-time data streaming solutions where precision and data correctness are fundamental requirements . Your work will directly support millions of users across merchant payments, peer-to-peer transfers, bill payments, and financial services, where data accuracy is crucial for maintaining customer confidence and operational excellence.This role requires expertise in designing fault-tolerant, scalable data architectures that maintain high uptime standards while processing peak transaction loads during festivals and high-traffic events. We place the highest priority on data quality and system reliability, as our customers depend on accurate, timely information for their financial decisions. You'll collaborate with cross-functional teams including data scientists, product managers, and risk engineers to deliver data solutions that enable real-time fraud detection, personalized recommendations, credit scoring, and regulatory compliance reporting.Key technical challenges include maintaining data consistency across distributed systems with demanding performance requirements, implementing comprehensive data quality frameworks with real-time validation, optimizing query performance on large datasets, and ensuring complete data lineage and governance across multiple business domains. At Paytm, reliable data streams are fundamental to our operations and our commitment to protecting customers' financial security and maintaining India's digital payments ResponsibilitiesData Stream Architecture & Development Design and implement reliable, scalable data streams handling high-volume transaction data with strong data integrity controlsBuild real-time processing systems using modern data engineering frameworks (Java/Python stack) with excellent performance characteristicsDevelop robust data ingestion systems from multiple sources with built-in redundancy and monitoring capabilitiesImplement comprehensive data quality frameworks, ensuring the 4 C's: Completeness, Consistency, Conformity, and Correctness - ensuring data reliability that supports sound business decisionsDesign automated data validation, profiling, and quality monitoring systems with proactive alerting capabilitiesInfrastructure & Platform Management Manage and optimize distributed data processing platforms with high availability requirements to ensure consistent service deliveryDesign data lake and data warehouse architectures with appropriate partitioning and indexing strategies for optimal query performanceImplement CI/CD processes for data engineering workflows with comprehensive testing and reliable deployment proceduresEnsure high availability and disaster recovery for critical data systems to maintain business continuityPerformance & Optimization Monitor and optimize streaming performance with focus on latency reduction and operational efficiencyImplement efficient data storage strategies including compression, partitioning, and lifecycle management with cost considerationsTroubleshoot and resolve complex data streaming issues in production environments with effective response protocolsConduct proactive capacity planning and performance tuning to support business growth and data volume increasesCollaboration & Leadership Work closely with data scientists, analysts, and product teams to understand important data requirements and service level expectationsMentor junior data engineers with emphasis on data quality best practices and customer-focused approachParticipate in architectural reviews and help establish data engineering standards that prioritize reliability and accuracyDocument technical designs, processes, and operational procedures with focus on maintainability and knowledge sharingRequired QualificationsExperience & Education Bachelor's or Master's degree in Computer Science, Engineering, or related technical field7+ years (Senior) of hands-on data engineering experienceProven experience with large-scale data processing systems (preferably in fintech/payments domain)Experience building and maintaining production data streams processing TB/PB scale data with strong performance and reliability standardsTechnical Skills & RequirementsProgramming Languages: Expert-level proficiency in both Python and Java; experience with Scala preferredBig Data Technologies: Apache Spark (PySpark, Spark SQL, Spark with Java), Apache Kafka, Apache AirflowCloud Platforms: AWS (EMR, Glue, Redshift, S3, Lambda) or equivalent Azure/GCP servicesDatabases: Strong SQL skills, experience with both relational (PostgreSQL, MySQL) and NoSQL databases (MongoDB, Cassandra, Redis)Data Quality Management: Deep understanding of the 4 C's framework - Completeness, Consistency, Conformity, and CorrectnessData Governance: Experience with data lineage tracking, metadata management, and data catalogingData Formats & Protocols: Parquet, Avro, JSON, REST APIs, GraphQLContainerization & DevOps: Docker, Kubernetes, Git, GitLab/GitHub with CI/CD pipeline experienceMonitoring & Observability: Experience with Prometheus, Grafana, or similar monitoring toolsData Modeling: Dimensional modeling, data vault, or similar methodologiesStreaming Technologies: Apache Flink, Kinesis, or Pulsar experience is a plusInfrastructure as Code: Terraform, CloudFormation (preferred)Java-specific: Spring Boot, Maven/Gradle, JUnit for building robust data servicesPreferred QualificationsDomain Expertise Previous experience in fintech, payments, or banking industry with solid understanding of regulatory compliance and financial data requirementsUnderstanding of financial data standards, PCI DSS compliance, and data privacy regulations where compliance is essential for business operationsExperience with real-time fraud detection or risk management systems where data accuracy is crucial for customer protectionAdvanced Technical Skills (Preferred) Experience building automated data quality frameworks covering all 4 C's dimensionsKnowledge of machine learning stream orchestration (MLflow, Kubeflow)Familiarity with data mesh or federated data architecture patternsExperience with change data capture (CDC) tools and techniquesLeadership & Soft Skills Strong problem-solving abilities with experience debugging complex distributed systems in production environmentsExcellent communication skills with ability to explain technical concepts to diverse stakeholders while highlighting business valueExperience mentoring team members and leading technical initiatives with focus on building a quality-oriented cultureProven track record of delivering projects successfully in dynamic, fast-paced financial technology environmentsWhat We Offer Opportunity to work with cutting-edge technology at scaleCompetitive salary and equity compensationComprehensive health and wellness benefitsProfessional development opportunities and conference attendanceFlexible working arrangementsChance to impact millions of users across India's digital payments ecosystemApplication Process Interested candidates should submit:Updated resume highlighting relevant data engineering experience with emphasis on real-time systems and data qualityPortfolio or GitHub profile showcasing data engineering projects, particularly those involving high-throughput streaming systemsCover letter explaining interest in fintech/payments domain and understanding of data criticality in financial servicesReferences from previous technical managers or senior colleagues who can attest to your data quality standards
    This advertiser has chosen not to accept applicants from your region.

    Data Engineer

    Pune, Maharashtra Citigroup

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    The Role
    We are looking for a hands-on Data Engineer who is passionate about solving
    business problems through innovation and engineering practices.
    As a Data
    Engineer, you will leverage your deep technical knowledge to drive the creation of
    high-quality software products. You will also be expected to share your technical
    expertise and promote a culture of technical excellence within the team. The Data
    Engineer will work with a Team Lead and will be a code-contributing member of the
    team that will deliver solutions against the sprint-level commitments.
    Responsibilities
    -
    Code contributing member of an Agile team, working to deliver sprint goals.
    -
    Demonstrating technical knowledge and expertise in software development,
    including programming languages, frameworks, and best practices.
    -
    Actively contributes to the implementation of features and technical
    solutions. Write clean, efficient, and maintainable code that meets the
    highest standards of quality.
    -
    Collaborate with other Engineers to define and evolve the overall system
    architecture and design.
    -
    Provide guidance on scalable, robust, and efficient solutions that align with
    business requirements and industry best practices.
    -
    Offer expert engineering guidance and support to multiple teams, helping
    them overcome technical challenges, make informed decisions, and deliver
    high-quality software solutions. Foster a culture of technical excellence and
    continuous improvement.
    -
    Stay up to date with emerging technologies, tools, and industry trends.
    Evaluate their potential impact on the organization and provide
    recommendations for technology adoption and innovation.
    Required Qualifications
    -
    0-2+ years' experience of implementing data-intensive solutions using agile
    methodologies.
    -
    Proficient in one or more programming languages commonly used in data
    engineering such as
    Python, Java, or Scala.
    -
    Multiple years of experience with software engineering best practices (unit
    testing, automation, design patterns, peer review, etc.)
    -
    Strong proficiency in working with relational databases and using SQL for
    data querying, transformation, and manipulation.
    -
    Clear understanding of Data Structures and Object Oriented Principles.
    -
    Experience of modelling data for analytical consumers
    -
    Ability to automate and streamline the build, test and deployment of data
    pipelines.
    -
    Proven experience of providing technical vision and guidance to a data team.
    -
    Thrives in a dynamic environment, capable of managing multiple tasks
    simultaneously while maintaining a high standard of work.
    -
    BA/BS degree or equivalent work experience.
    Preferred Qualifications
    -
    Experience with
    Hadoop
    for data storage and processing is valuable, as is
    exposure to modern data platforms such as
    Snowflake
    and
    Databricks
    .
    -
    Multiple years of experience architecting and building horizontally scalable,
    highly available, highly resilient, and low latency applications
    -
    Multiple years of experience with Cloud-native development and Container
    Orchestration tools (Serverless, Docker, Kubernetes, OpenShift, etc.).
    -
    Familiarity with open-source data engineering tools and frameworks (e.g.
    Spark
    , Kafka, Beam, Flink, Trino, Airflow, DBT) is a valuable asset
    -
    Exposure to a range of table and file formats including Iceberg, Hive, Avro,
    Parquet and JSON
    -
    Experience in cloud native technologies and patterns (AWS, Google Cloud)
    -
    Exposure to Infrastructure as Code tools (i.e., Terraform, Cloudformation,
    etc.)
    -
    Experience of driving and/or influencing the data strategy of your team or
    organization
    Show all files ( Family Group:**
    Technology
    ---
    **Job Family:**
    Digital Software Engineering
    ---
    **Time Type:**
    Full time
    ---
    **Most Relevant Skills**
    Please see the requirements listed above.
    ---
    **Other Relevant Skills**
    For complementary skills, please see above and/or contact the recruiter.
    ---
    _Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
    _If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
    _View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
    Citi is an equal opportunity and affirmative action employer.
    Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
    This advertiser has chosen not to accept applicants from your region.
    Be The First To Know

    About the latest Data engineer Jobs in India !

    Data Engineer

    Hyderabad, Andhra Pradesh Amgen

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    **Join Amgen's Mission of Serving Patients**
    At Amgen, if you feel like you're part of something bigger, it's because you are. Our shared mission-to serve patients living with serious illnesses-drives all that we do.
    Since 1980, we've helped pioneer the world of biotech in our fight against the world's toughest diseases. With our focus on four therapeutic areas -Oncology, Inflammation, General Medicine, and Rare Disease- we reach millions of patients each year. As a member of the Amgen team, you'll help make a lasting impact on the lives of patients as we research, manufacture, and deliver innovative medicines to help people live longer, fuller happier lives.
    Our award-winning culture is collaborative, innovative, and science based. If you have a passion for challenges and the opportunities that lay within them, you'll thrive as part of the Amgen team. Join us and transform the lives of patients while transforming your career.
    Data Engineer
    **What you will do**
    Let's do this. Let's change the world. In this vital role you will be responsible for designing, building, maintaining, analyzing, and interpreting data to deliver actionable insights that drive business decisions.
    This role involves working with large datasets, developing reports, supporting and performing data governance initiatives and, visualizing data to ensure data is accessible, reliable, and efficiently managed. The ideal candidate has deep technical skills, experience with big data technologies, and a deep understanding of data architecture and ETL processes.
    **Roles & Responsibilities:**
    + Design, develop, and maintain data solutions for data generation, collection, and processing
    + Be a crucial team member that assists in design and development of the data pipeline
    + Build data pipelines and ensure data quality by implementing ETL processes to migrate and deploy data across systems
    + Contribute to the design, development, and implementation of data pipelines, ETL/ELT processes, and data integration solutions
    + Take ownership of data pipeline projects from inception to deployment, manage scope, timelines, and risks
    + Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs
    + Develop and maintain data models, data dictionaries, and other documentation to ensure data accuracy and consistency
    + Implement data security and privacy measures to protect sensitive data
    + Leverage cloud platforms (AWS preferred) to build scalable and efficient data solutions
    + Collaborate and communicate effectively with product teams
    + Collaborate with Data Architects, Business SMEs, and Data Scientists to design and develop end-to-end data pipelines to meet fast-paced business needs across geographic regions
    + Identify and resolve complex data-related challenges
    + Adhere to best practices for coding, testing, and designing reusable code/component
    + Explore new tools and technologies that will help to improve ETL platform performance
    + Participate in sprint planning meetings and provide estimations on technical implementation
    **Basic Qualifications:**
    **What we expect of you**
    We are all different, yet we all use our unique contributions to serve patients. The (vital attribute) professional we seek is a (type of person) with these qualifications.
    **Basic Qualifications:**
    Master's degree / Bachelor's degree and 5 to 9 years
    **Preferred Qualifications:**
    **Must-Have Skills:**
    + Hands-on experience with big data technologies and platforms, such as Databricks, Apache Spark (PySpark, SparkSQL), workflow orchestration, performance tuning on big data processing
    + Proficiency in data analysis tools (eg. SQL) and experience with data visualization tools
    + Excellent problem-solving skills and the ability to work with large, complex datasets
    + Solid understanding of data governance frameworks, tools, and best practices.
    + Knowledge of data protection regulations and compliance requirements
    **Good-to-Have Skills:**
    + Experience with ETL tools such as Apache Spark, and various Python packages related to data processing, machine learning model development
    + Good understanding of data modeling, data warehousing, and data integration concepts
    + Knowledge of Python/R, Databricks, SageMaker, cloud data platforms
    **Professional Certifications**
    + Certified Data Engineer / Data Analyst (preferred on Databricks or cloud environments)
    **What you can expect of us**
    As we work to develop treatments that take care of others, we also work to care for your professional and personal growth and well-being. From our competitive benefits to our collaborative culture, we'll support your journey every step of the way.
    In addition to the base salary, Amgen offers competitive and comprehensive Total Rewards Plans that are aligned with local industry standards.
    **Apply now and make a lasting impact with the Amgen team.**
    **careers.amgen.com**
    As an organization dedicated to improving the quality of life for people around the world, Amgen fosters an inclusive environment of diverse, ethical, committed and highly accomplished people who respect each other and live the Amgen values to continue advancing science to serve patients. Together, we compete in the fight against serious disease.
    Amgen is an Equal Opportunity employer and will consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability status, or any other basis protected by applicable law.
    We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
    This advertiser has chosen not to accept applicants from your region.

    Data Engineer

    Bangalore, Karnataka Kyndryl

    Posted 1 day ago

    Job Viewed

    Tap Again To Close

    Job Description

    **Who We Are**
    At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.
    **The Role**
    Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl? As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role? Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips.
    As a Data Engineer at Kyndryl, you'll be at the forefront of the data revolution, crafting and shaping data platforms that power our organization's success. This role is not just about code and databases; it's about transforming raw data into actionable insights that drive strategic decisions and innovation.
    In this role, you'll be engineering the backbone of our data infrastructure, ensuring the availability of pristine, refined data sets. With a well-defined methodology, critical thinking, and a rich blend of domain expertise, consulting finesse, and software engineering prowess, you'll be the mastermind of data transformation.
    Your journey begins by understanding project objectives and requirements from a business perspective, converting this knowledge into a data puzzle. You'll be delving into the depths of information to uncover quality issues and initial insights, setting the stage for data excellence. But it doesn't stop there. You'll be the architect of data pipelines, using your expertise to cleanse, normalize, and transform raw data into the final dataset-a true data alchemist.
    Armed with a keen eye for detail, you'll scrutinize data solutions, ensuring they align with business and technical requirements. Your work isn't just a means to an end; it's the foundation upon which data-driven decisions are made - and your lifecycle management expertise will ensure our data remains fresh and impactful.
    So, if you're a technical enthusiast with a passion for data, we invite you to join us in the exhilarating world of data engineering at Kyndryl. Let's transform data into a compelling story of innovation and growth.
    Your Future at Kyndryl
    Every position at Kyndryl offers a way forward to grow your career. We have opportunities that you won't find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector, you can find your opportunity here.
    **Who You Are**
    You're good at what you do and possess the required experience to prove it. However, equally as important - you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused - someone who prioritizes customer success in their work. And finally, you're open and borderless - naturally inclusive in how you work with others.
    Required Technical and Professional Expertise
    + 4-5 years of experience working as a Data Engineer or in Azure cloud modernization
    + Good experience in Power BI for data visualization and dashboard development
    + Strong experience in developing data pipelines and using tools such as AWS Glue, Azure Databricks, Synapse, or Google Dataproc
    + Proficient in working with both relational and NoSQL databases, including PostgreSQL, DB2, and MongoDB
    + Excellent problem-solving, analytical, and critical thinking skills
    + Ability to manage multiple projects simultaneously while maintaining a high level of attention to detail
    + Expertise in data mining, data storage, and Extract-Transform-Load (ETL) processes
    Preferred Technical and Professional Experience
    + Experience in Data Modelling, to create conceptual model of how data is connected and how it will be used in business processes
    + Professional certification, e.g., Open Certified Technical Specialist with Data Engineering Specialization
    + Cloud platform certification, e.g., AWS Certified Data Analytics - Specialty, Elastic Certified Engineer, Google Cloud Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate
    + Understanding of social coding and Integrated Development Environments, e.g., GitHub and Visual Studio
    + Degree in a scientific discipline, such as Computer Science, Software Engineering, or Information Technology
    **Being You**
    Diversity is a whole lot more than what we look like or where we come from, it's how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we're not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you - and everyone next to you - the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That's the Kyndryl Way.
    **What You Can Expect**
    With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter - wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.
    **Get Referred!**
    If you know someone that works at Kyndryl, when asked 'How Did You Hear About Us' during the application process, select 'Employee Referral' and enter your contact's Kyndryl email address.
    Kyndryl is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. Kyndryl is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
    This advertiser has chosen not to accept applicants from your region.

    Data Engineer

    Hyderabad, Andhra Pradesh Kyndryl

    Posted 1 day ago

    Job Viewed

    Tap Again To Close

    Job Description

    **Who We Are**
    At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities.
    **The Role**
    Are you ready to dive headfirst into the captivating world of data engineering at Kyndryl? As a Data Engineer, you'll be the visionary behind our data platforms, crafting them into powerful tools for decision-makers. Your role? Ensuring a treasure trove of pristine, harmonized data is at everyone's fingertips.
    As a Data Engineer at Kyndryl, you'll be at the forefront of the data revolution, crafting and shaping data platforms that power our organization's success. This role is not just about code and databases; it's about transforming raw data into actionable insights that drive strategic decisions and innovation.
    In this role, you'll be engineering the backbone of our data infrastructure, ensuring the availability of pristine, refined data sets. With a well-defined methodology, critical thinking, and a rich blend of domain expertise, consulting finesse, and software engineering prowess, you'll be the mastermind of data transformation.
    Your journey begins by understanding project objectives and requirements from a business perspective, converting this knowledge into a data puzzle. You'll be delving into the depths of information to uncover quality issues and initial insights, setting the stage for data excellence. But it doesn't stop there. You'll be the architect of data pipelines, using your expertise to cleanse, normalize, and transform raw data into the final dataset-a true data alchemist.
    Armed with a keen eye for detail, you'll scrutinize data solutions, ensuring they align with business and technical requirements. Your work isn't just a means to an end; it's the foundation upon which data-driven decisions are made - and your lifecycle management expertise will ensure our data remains fresh and impactful.
    So, if you're a technical enthusiast with a passion for data, we invite you to join us in the exhilarating world of data engineering at Kyndryl. Let's transform data into a compelling story of innovation and growth.
    Your Future at Kyndryl
    Every position at Kyndryl offers a way forward to grow your career. We have opportunities that you won't find anywhere else, including hands-on experience, learning opportunities, and the chance to certify in all four major platforms. Whether you want to broaden your knowledge base or narrow your scope and specialize in a specific sector, you can find your opportunity here.
    **Who You Are**
    You're good at what you do and possess the required experience to prove it. However, equally as important - you have a growth mindset; keen to drive your own personal and professional development. You are customer-focused - someone who prioritizes customer success in their work. And finally, you're open and borderless - naturally inclusive in how you work with others.
    Required Technical and Professional Expertise
    + 4-5 years of experience working as a Data Engineer or in Azure cloud modernization
    + Good experience in Power BI for data visualization and dashboard development
    + Strong experience in developing data pipelines and using tools such as AWS Glue, Azure Databricks, Synapse, or Google Dataproc
    + Proficient in working with both relational and NoSQL databases, including PostgreSQL, DB2, and MongoDB
    + Excellent problem-solving, analytical, and critical thinking skills
    + Ability to manage multiple projects simultaneously while maintaining a high level of attention to detail
    + Expertise in data mining, data storage, and Extract-Transform-Load (ETL) processes
    Preferred Technical and Professional Experience
    + Experience in Data Modelling, to create conceptual model of how data is connected and how it will be used in business processes
    + Professional certification, e.g., Open Certified Technical Specialist with Data Engineering Specialization
    + Cloud platform certification, e.g., AWS Certified Data Analytics - Specialty, Elastic Certified Engineer, Google Cloud Professional Data Engineer, or Microsoft Certified: Azure Data Engineer Associate
    + Understanding of social coding and Integrated Development Environments, e.g., GitHub and Visual Studio
    + Degree in a scientific discipline, such as Computer Science, Software Engineering, or Information Technology
    **Being You**
    Diversity is a whole lot more than what we look like or where we come from, it's how we think and who we are. We welcome people of all cultures, backgrounds, and experiences. But we're not doing it single-handily: Our Kyndryl Inclusion Networks are only one of many ways we create a workplace where all Kyndryls can find and provide support and advice. This dedication to welcoming everyone into our company means that Kyndryl gives you - and everyone next to you - the ability to bring your whole self to work, individually and collectively, and support the activation of our equitable culture. That's the Kyndryl Way.
    **What You Can Expect**
    With state-of-the-art resources and Fortune 100 clients, every day is an opportunity to innovate, build new capabilities, new relationships, new processes, and new value. Kyndryl cares about your well-being and prides itself on offering benefits that give you choice, reflect the diversity of our employees and support you and your family through the moments that matter - wherever you are in your life journey. Our employee learning programs give you access to the best learning in the industry to receive certifications, including Microsoft, Google, Amazon, Skillsoft, and many more. Through our company-wide volunteering and giving platform, you can donate, start fundraisers, volunteer, and search over 2 million non-profit organizations. At Kyndryl, we invest heavily in you, we want you to succeed so that together, we will all succeed.
    **Get Referred!**
    If you know someone that works at Kyndryl, when asked 'How Did You Hear About Us' during the application process, select 'Employee Referral' and enter your contact's Kyndryl email address.
    Kyndryl is committed to creating a diverse environment and is proud to be an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, gender, gender identity or expression, sexual orientation, national origin, genetics, pregnancy, disability, age, veteran status, or other characteristics. Kyndryl is also committed to compliance with all fair employment practices regarding citizenship and immigration status.
    This advertiser has chosen not to accept applicants from your region.
     

    Nearby Locations

    Other Jobs Near Me

    Industry

    1. request_quote Accounting
    2. work Administrative
    3. eco Agriculture Forestry
    4. smart_toy AI & Emerging Technologies
    5. school Apprenticeships & Trainee
    6. apartment Architecture
    7. palette Arts & Entertainment
    8. directions_car Automotive
    9. flight_takeoff Aviation
    10. account_balance Banking & Finance
    11. local_florist Beauty & Wellness
    12. restaurant Catering
    13. volunteer_activism Charity & Voluntary
    14. science Chemical Engineering
    15. child_friendly Childcare
    16. foundation Civil Engineering
    17. clean_hands Cleaning & Sanitation
    18. diversity_3 Community & Social Care
    19. construction Construction
    20. brush Creative & Digital
    21. currency_bitcoin Crypto & Blockchain
    22. support_agent Customer Service & Helpdesk
    23. medical_services Dental
    24. medical_services Driving & Transport
    25. medical_services E Commerce & Social Media
    26. school Education & Teaching
    27. electrical_services Electrical Engineering
    28. bolt Energy
    29. local_mall Fmcg
    30. gavel Government & Non Profit
    31. emoji_events Graduate
    32. health_and_safety Healthcare
    33. beach_access Hospitality & Tourism
    34. groups Human Resources
    35. precision_manufacturing Industrial Engineering
    36. security Information Security
    37. handyman Installation & Maintenance
    38. policy Insurance
    39. code IT & Software
    40. gavel Legal
    41. sports_soccer Leisure & Sports
    42. inventory_2 Logistics & Warehousing
    43. supervisor_account Management
    44. supervisor_account Management Consultancy
    45. supervisor_account Manufacturing & Production
    46. campaign Marketing
    47. build Mechanical Engineering
    48. perm_media Media & PR
    49. local_hospital Medical
    50. local_hospital Military & Public Safety
    51. local_hospital Mining
    52. medical_services Nursing
    53. local_gas_station Oil & Gas
    54. biotech Pharmaceutical
    55. checklist_rtl Project Management
    56. shopping_bag Purchasing
    57. home_work Real Estate
    58. person_search Recruitment Consultancy
    59. store Retail
    60. point_of_sale Sales
    61. science Scientific Research & Development
    62. wifi Telecoms
    63. psychology Therapy
    64. pets Veterinary
    View All Data Engineer Jobs