737 Data Engineer jobs in Chennai

We’re Hiring: Data Engineer

Position: Data Engineer

Experience Required: 3+ Years

Notice Period: Immediate Joiner (or within 15 days)

Location: Chennai (Remote)

Shift: Includes Night Shifts (US Shift)

Preferred Candidates: From Chennai

Skills We’re Looking For:

• SQL, Python, ETL
• Apache Airflow
• Data Pipeline Optimization & Tuning
• Data Modelling
• Hadoop Infra / Cloud Platforms

Roles & Responsibilities

• Lead and mentor a team of data engineers by providing guidance, support, and feedback.
• Design and maintain scalable, robust data architectures and pipelines.
• Develop and optimize ETL workflows to improve efficiency and reduce costs.
• Stay up-to-date with industry trends and integrate relevant technologies.
• Plan, coordinate, and deliver data engineering projects on time.
• Set clear goals, define scopes, and allocate tasks to team members.
• Conduct regular performance reviews and support career development.
• Foster a positive and collaborative team culture .
• Act as a liaison between the team and upper management.
• Ensure stakeholders’ expectations are met with accurate communication.
• Maintain comprehensive project documentation .
• Encourage innovation, process improvements, and best practices.

How to Apply

Send your resume and a cover letter to

with the subject line:

"Data Engineer Application - (Your Name)"

Also include the following details in your email:

• Current Location
• Total Experience
• Relevant Experience (SQL, Python, ETL, Airflow, Cloud, etc.)
• Current CTC
• Expected CTC
• Notice Period

Dear Candidate,

Greetings from TCS !

TCS is hiring for Azure Data Engineer, please find the below JD.

Experience range – 6 to 10 years

Location - Chennai

Skills Required - Azure Databricks, Azure data factory, Azure synapse, Pyspark

Required Competencies:

1) Strong design and data solutioning skills

2) Pyspark hands-on experience with complex transformations and large dataset handling experience

3) Good command and hands-on experience in Python. Experience working with following concepts, packages, and tools,

a. Object oriented and functional programming

b. NumPy, Pandas, Matplotlib, requests, pytest

c. Jupyter, PyCharm and IDLE

d. Conda and Virtual Environment

4) Working experience must with Hive, HBase or similar

5) Azure Skills

a. Must have working experience in Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Databases

b. Azure DevOps

c. Azure AD Integration, Service Principal, Pass-thru login etc.

d. Networking – vnet, private links, service connections, etc.

e. Integrations – Event grid, Service Bus etc.

6) Database skills

a. Oracle, Postgres, SQL Server – any one database experience

b. Oracle PL/SQL or T-SQL experience

Data modelling

Job Responsibilities

• Collaborate with project stakeholders (client) to identify product and technical requirements.
• Develop, implement, and tune large-scale distributed systems and pipelines that process large volume of data
• Write clean, maintainable, and testable code for data workflows.
• Troubleshoot data issues and perform root cause analysis

Must have:

• 3+ years of Hands-on coding experience in PySpark & SQL .
• Excellent verbal and business communication skills.
• Worked on complex SQL Query and has work on query performance optimization

Good to have:

• Experience working on large-scale data warehouse projects; Teradata experience is a plus.
• Experience with ETL tools.
• Experience working with workflow scheduler tools; experience with Apache Airflow is a plus.
• Working experience with Kubernetes , Unix, github

Dear Candidate,

Thanks for Applying with TCS for skill GCP Data Engineering.

Responsibilities

• Experience on Tableau, Power BI, ETL processes and data engineering.
• SQL and experience with Looker/Look ML.
• Big Query, Dataflow, Compose.
• Python or scripting for automation.
• Good communication and customer handling skills.
• Monitoring and Logging and database administration.

Qualifications

• Years of Experience: 3 to 10 yrs.
• Location: Chennai, Gandhinagar, Bangalore.

Required Skills

• Experience with Tableau and Power BI.
• Proficiency in Python.

Preferred Skills

• Experience with ETL processes.
• Knowledge of database administration.

If you are looking for an opportunity, kindly share your CV / Resume to this mail id

``

JOB OBJECTIVE

We are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines that enable to collect, store, process, and analyze large volumes of data. This role will play a crucial part in ensuring data availability, quality, and accessibility for data-driven decision-making.

KEY ACCOUNTABILITIES

• Data Pipeline Development: o Design, develop, and maintain data pipelines to ingest, process, and transform data from various sources into usable formats. o Implement data integration solutions that connect disparate data systems, including databases, APIs, and third-party data sources.

• Data Storage and Warehousing:

Create and manage data storage solutions, such as data lakes, data warehouses, and NoSQL databases.

Optimize data storage for performance, scalability, and cost-efficiency.

Data Quality and Governance: o Establish data quality standards and implement data validation and cleansing processes.

o Collaborate with data analysts and data scientists to ensure data consistency and accuracy.

ETL (Extract, Transform, Load):

o Develop ETL processes to transform raw data into a structured and usable format.

o Monitor and troubleshoot ETL jobs to ensure data flows smoothly.

Performance Tuning:

o Optimize data pipelines and queries for improved performance and efficiency.

o Identify and resolve bottlenecks in data processing.

• Data Documentation:

o Maintain comprehensive documentation for data pipelines, schemas, and data dictionaries.

o Create and update data lineage and metadata documentation.

Scalability and Reliability:

o Design data infrastructure to scale with growing data volumes and business requirements.

o Implement data recovery and backup strategies to ensure data availability and resilience.

• Collaboration:

o Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver data solutions.

o Provide technical support and guidance to data users.

• Continuous Learning:

o Stay updated on emerging technologies, tools, and best practices in data engineering.

o Implement new technologies to enhance data processing capabilities.

QUALIFICATIONS, EXPERIENCE, & COMPETENCIES

• 9+ years of experience in similar role

• Bachelor's or master’s degree in computer science, Information Technology, or a related field.

• Proven experience in data engineering, ETL development, and data integration.

• Proficiency in data pipeline orchestration tools (e.g., Apache NiFi, Apache Airflow).

• Strong knowledge of databases (SQL and NoSQL), data warehousing, and data modeling concepts.

• Familiarity with data processing frameworks (e.g., Hadoop, Spark) and cloud-based data services (e.g., AWS, Azure, GCP).

• Experience with version control systems (e.g., Git) and data versioning.

• Excellent programming skills in languages such as Python, SQL, Java, Scala, R, and/or Go.

• Knowledge of data security and compliance standards.

• Strong problem-solving and troubleshooting skills.

• Effective communication and teamwork abilities.

Interviews in Chennai –

Positions : Python /java /data engineer/ fronted developer

Interview Dates : (20th September Saturday)

Years of experience - 4-12 Years

Preferences – previous experience in BFSI, NBFC, MFI or in fintech organization.

Venue : will be informed shortly (Chennai)

Eligibility Criteria: BE/ B. Tech only.

sahiba

About Position:

We are conducting an in-person hiring drive for the position of Data Engineer (Pyspark, Power BI) Engineer in Chennai on 6th Sep 2025. Interview Location is mentioned below:

Chennai: Olympia Pinnacle, #1, S. No. 69/2A1, S. No. 67/1-2A, New S. No. 67/4, Old Mahabalipuram Road, Okkiam Thuraipakkam Village, Thuraipakkam, Chennai, Tamilnadu

We are seeking a highly skilled and motivated individual to join our team as a Data Analyst. The successful candidate will be responsible for managing and analyzing large datasets using PySpark, SQL, and PowerBI.

• Role: Data Engineer
• Job Location: Chennai
• Experience: 6+ Years
• Job Type: Full Time Employment

What You'll Do:

• They will also be responsible for designing and maintaining data warehousing systems and using data analytics to help drive business decisions.
• This role requires a deep understanding of data structures and algorithms, as well as the ability to communicate complex information to non-technical stakeholders.
• Use PySpark and SQL to process, analyze, and manage large datasets.
• Develop interactive reports and dashboards using Power BI.
• Implement data warehousing solutions to store and retrieve data efficiently.
• Conduct data analytics to derive insights and support business decision-making.

Expertise You'll Bring:

• Proficiency in PySpark for processing large amounts of data.
• Strong knowledge of SQL for managing and manipulating databases.
• Experience with Power BI for creating interactive visualizations and business intelligence reports.
• A Bachelor’s degree in Computer Science, Information Systems, Mathematics, Statistics or a related field is required.
• Familiarity with other data visualization tools like Tableau or QlikView.

Benefits:

• Competitive salary and benefits package
• Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
• Opportunity to work with cutting-edge technologies
• Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
• Annual health check-ups
• Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Values-Driven, People-Centric & Inclusive Work Environment:

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

• We support hybrid work and flexible hours to fit diverse lifestyles.
• Our office is accessibility-friendly, with ergonomic setups and assistive technologies to support employees with physical disabilities.
• If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment

Let’s unleash your full potential at Persistent - persistent.com/careers

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

Skills: Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark;

Good to have : GCP/any cloud

Roles/Responsibilities:

• Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.
• Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization.
• Implements processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
• Writes unit/integration tests, contributes to engineering wiki, and documents work.
• Performs data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
• Works closely with a team of frontend and backend engineers, product managers, and analysts.
• Defines company data assets (data models), spark, sparkSQL, and hiveSQL jobs to populate data models.
• Designs data integrations and data quality framework.

Position: Permanent

Role: Data Engineer

Experience: 5 Years

Location: Chennai / Bangalore /

Work Mode: Hybrid

Key Responsibilities

Data Management

• Develop data mapping specifications and transformation rules

• Perform data cleansing, validation, and reconciliation activities

• Create and execute data conversion scripts and processes

• Document data models, mappings, and migration procedures System Integration

• Configure integrations between Workday and third-party applications

• Develop integration specifications and technical designs

• Troubleshoot integration issues and implement solutions

• Monitor integration performance and implement optimizations Technical Configuration & Development

• Design and implement Snowflake data models optimized for HR analytics

• Create and maintain Snowflake objects (tables, views, stored procedures)

• Develop SQL transformations within Snowflake for reporting requirements

• Configure Workday modules according to design specifications

• Build and maintain business processes, security configurations, and reports

• Develop custom calculations, rules, and business logic

• Create and maintain configuration workbooks and technical documentation

• Participate in system testing, including unit, integration, and regression testing Reporting & Analytics

• Develop reporting solutions using Snowflake as the data source

• Create data visualization dashboards connected to Snowflake

• Build self-service reporting capabilities for HR and business users

• Design and implement metrics and KPIs for HR analytics

• Support data analysis needs throughout the implementation lifecycle

Required Experience & Skills

• 3+ years of experience in HRIS implementation, data management, or system integration

• 2+ years of hands-on experience with Workday/Greenhouse data conversion, integration, or reporting

• Experience with Snowflake or similar cloud data warehouse platforms

• Experience with architecting or working with ELT technologies (such as DBT) and data architectures

• Strong SQL skills and experience with data transformation tools

• Experience with ETL processes and data validation techniques

• Understanding of HR data structures and relationships

• Excellent analytical and problem-solving abilities

• Knowledge of programming languages (Python etc.)

• Experience with data visualization tools

• Understanding of API integration patterns and technologies

• Experience with agile development methodologies

We are hiring for AWS Data Engineer

Experience - 5 to 7 Years

Location : Chennai

Notice period - immediate to 30 days

Job Summary

Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions

4 years of experience in GCP BQ Dataflow Airflow and Python Should have hands on experience in data transformation and data ingestion

Job Description

Develop and maintain data engineering solutions leveraging AWS IoT services Utilize Python programming to build optimize and automate data pipelines Work with largescale IoT data ingestion processing and storage architectures Collaborate with crossfunctional teams to integrate IoT data with analytics and monitoring platforms Ensure data quality reliability and security in IoT data workflows Stay updated with the latest AWS IoT and data engineering technologies and best practices

Roles and Responsibilities

Design develop and deploy scalable IoT data pipelines using AWS services Write efficient reusable and maintainable Python code for data processing tasks Monitor and troubleshoot data ingestion and processing issues to maintain system reliability Optimize data workflows for performance and cost efficiency Collaborate with data scientists analysts and other stakeholders to understand data requirements Implement security best practices for IoT data handling and storage Document solutions and contribute to knowledge sharing within the team

If Interested , Kindly share me your updated CV with below details -

Candidate Name -

Candidate Email ID -

Candidate Mobile Number -

Date of Birth(As per Aadhar)-

Current/ Preferred Location-

Total Years of IT experience -

Relevant Years of Experience -

Current Company-

Current CTC -

Expected CTC -

Any Offers in hand or Pipeline -

Notice Period (If serving then LWD) -