Explore exciting Data Engineer job opportunities in 83 Data Engineer jobs in Chennai
Big Data Engineer
Posted 1 day ago
Job Viewed
Job Description
**Responsibilities:**
+ Design, development of BigData applications/ pipelines using Spark, Scala, SQL, Pyspark, Python, Java
+ Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
**Qualifications:**
+ 4-8 years of experience in software development, building large scale distributed data processing systems or large-scale applications
+ Designing & developing Big Data solutions with at least one end to end implementation.
+ Strong Hands-on experience in following technical skills: Apache Spark, Scala/ Java, XML/ JSON/ Parquet/ Avro, SQL, Linux, Hadoop Ecosystem (HDFS, Spark, Impala, HIVE, HBASE etc.), Kafka.
+ Performance analysis, troubleshooting and issue resolution and Exposure to latest Cloudera offerings like Ozone, Iceberg.
+ Intermediate level experience in Applications Development role
+ Consistently demonstrates clear and concise written and verbal communication
+ Demonstrated problem-solving and decision-making skills
+ Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Data engineer - Big data technologies
Posted 1 day ago
Job Viewed
Job Description
**Responsibilities:**
+ Perform system and application monitoring, capacity planning and systems tests to ensure products meet performance requirements
+ Evaluate technologies, develop prototypes, contribute to design issues, and implement solutions
+ Work with various internal and external teams to identify and resolve problems
+ Consult with end users and clients to identify and correct systems problems or propose solutions
+ Assist in the development of software and systems tools used by integration teams to create end user packages
+ Provide support for operating systems and in-house applications, including third party applications, as needed
+ Perform coding, analysis, testing or other appropriate functions in order to identify problems and propose solutions
+ Adhere to Citi technology standards, audit requirements and corporate compliance issues and requirements
+ Apply knowledge of engineering procedures and concepts and basic knowledge of other technical areas to day to day activities
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
**Qualifications:**
+ 2-4 years of relevant experience in an Engineering role
+ Experience working in Financial Services or a large complex and/or global environment
+ Project Management experience
+ Consistently demonstrates clear and concise written and verbal communication
+ Comprehensive knowledge of design metrics, analytics tools, benchmarking activities and related reporting to identify best practices
+ Demonstrated analytic/diagnostic skills
+ Ability to work in a matrix environment and partner with virtual teams
+ Ability to work independently, multi-task, and take ownership of various parts of a project or initiative
+ Ability to work under pressure and manage to tight deadlines or unexpected changes in expectations or requirements
+ Proven track record of operational process change and improvement
+ Deep understanding of retail banking products and functions (Deposits, Savings and Checking, Money market funds, Certificate of Deposits) Payments, Fund Transfers etc)
+ Deep understanding of Card products, associated processes and life cycle.
+ Understanding of Private banking and wealth management
+ Experience in Hadoop technologies, Data warehousing technologies
+ Comfortable in SQL
+ Excellent written and verbal communication skills, with the ability to present complex financial information clearly and concisely to both technical and non-technical audiences.
+ Ability to work effectively both independently and as part of a team. Strong collaboration and relationship-building skills are crucial for success in this role.
+ A self-starter who takes initiative and is driven to achieve results
+ Possesses a strong analytical mindset and meticulous attention to detail to ensure accuracy and completeness in all tasks
Able to adapt quickly to changing priorities and work effectively in a dynamic environment.
+ Snowflake experience
+ Experience in Data lineage identification, DQ rules implementation
+ Risk and Finance Regulatory reports exposure
**Education:**
+ Bachelor's degree/University degree or equivalent experience
---
**Job Family Group:**
Technology
---
**Job Family:**
Systems & Engineering
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Officer- Data Engineer (Big Data, PySpark)
Posted 1 day ago
Job Viewed
Job Description
**Shape your Career with Citi**
We're currently looking for a high caliber professional to join our team as ** ** **Officer,** **Data Engineer -C11- Hybrid** based in Chennai, India. Being part of our team means that we'll provide you with the resources to meet your unique needs, empower you to make healthy decision and manage your financial well-being to help plan for your future.
**The Data Engineer** is accountable for developing high quality data products to support the Bank's regulatory requirements and data driven decision making. A Data Engineer will serve as an example to other team members, work closely with customers, and remove or escalate roadblocks. By applying their knowledge of data architecture standards, data warehousing, data structures, and business intelligence they will contribute to business outcomes on an agile team.
**Responsibilities** & **Qualifications:**
+ 5-8 years of relevant experience in **Big Data** : Experience of 'big data' platforms such as Hadoop, Hive or Snowflake for data storage and processing.
+ Experience in **Big Data, PySpark .**
+ Demonstrated problem-solving and decision-making skills
+ Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
**Education:**
+ Bachelor's degree/University degree or equivalent experience
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Officer- Big Data Engineer ( Hadoop, Hive, Python, Pyspark)
Posted 1 day ago
Job Viewed
Job Description
**Shape your Career with Citi**
We're currently looking for a high caliber professional to join our team as ** ** **Officer, Big** **Data Engineer -C10- Hybrid** based in Chennai, India. Being part of our team means that we'll provide you with the resources to meet your unique needs, empower you to make healthy decision and manage your financial well-being to help plan for your future. For instance:
+ We provide programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more. Coverage varies by country.
**Responsibilities &** **Qualifications:**
+ 2 - 5 years of relevant experience in **Big data** **platforms such as Hadoop, Hive**
+ **Languages** : Proficient in one or more programming languages commonly used in data engineering such as **Python, PySpark.**
+ **Database Management** : **SQL**
+ Working knowledge of program languages
+ Consistently demonstrates clear and concise written and verbal communication
**Education:**
+ Bachelor's degree/University degree or equivalent experience
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Officer- Big Data Engineer ( Hadoop, Hive, Python, Pyspark)
Posted 1 day ago
Job Viewed
Job Description
**Shape your Career with Citi**
We're currently looking for a high caliber professional to join our team as ** ** **Officer, Big** **Data Engineer -C10- Hybrid** based in Chennai, India. Being part of our team means that we'll provide you with the resources to meet your unique needs, empower you to make healthy decision and manage your financial well-being to help plan for your future. For instance:
+ We provide programs and services for your physical and mental well-being including access to telehealth options, health advocates, confidential counseling and more. Coverage varies by country.
**Responsibilities &** **Qualifications:**
+ 2 - 5 years of relevant experience in **Big data** **platforms such as Hadoop, Hive**
+ **Languages** : Proficient in one or more programming languages commonly used in data engineering such as **Python, PySpark.**
+ **Database Management** : **SQL**
+ Working knowledge of program languages
+ Consistently demonstrates clear and concise written and verbal communication
**Education:**
+ Bachelor's degree/University degree or equivalent experience
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Data Engineer
Posted 3 days ago
Job Viewed
Job Description
Dear (Recipient Name),
I would like to share a data engineering opportunity that may align with your professional background.
About the Company
We are seeking a Data Engineer with 4-7 years of experience to join our team in Chennai or Coimbatore. NO relocation , only Chennai locals apply
About the Role
The ideal candidate will possess strong expertise in Azure Data Factory and SQL, complemented by proficiency in NoSQL databases.
Responsibilities
- Building efficient orchestration solutions using Azure Data Factory.
- Designing modular, reusable workflows.
- Creating dynamic expressions.
- Developing parameterized pipelines.
- Implementing custom activities and triggers.
Qualifications
- 4-7 years of experience in data engineering.
Required Skills
- Strong expertise in Azure Data Factory.
- only Azure required no AWS please
- Proficiency in SQL.
- Experience with NoSQL databases.
Preferred Skills
- Experience in building orchestration solutions.
Pay range and compensation package
Please let me know if you are interested in this role or if you can recommend a suitable candidate.
Equal Opportunity Statement
We are committed to diversity and inclusivity.
``
Data Engineer
Posted 3 days ago
Job Viewed
Job Description
Greetings from HCLTECH!
We are hiring for the role Data Engineer, interested candidates please share the resume to
Mode of Interview: In Person Interview (No Virtual Interviews)
Date: 11th October 2025
Location: Sholinganallur, Chennai
Work Location: Chennai, Bangalore, Hyderabad
Role: Azure/ AWS Data Engineer
Experience: 6 Years to 13 Years
Job Description:
- Pyspark – 4/5
- Advanced SQL – 4/5
- DWH experience – 4/5
- Data modelling – 3/5
- Azure or AWS – 3/5
- Synapse or Redshift or Databricks – 3/5
- ADF or Glue – 3 /5
- Oracle or SQL Server – 4/5
- Airflow – 2 /5
Interested candidates, please share the resume to along with the below details
Candidate Name
Number
Total Experience
Relevant Experience
Notice Period
Company
Current Location
Pref Location
Current CTC
Expected CTC
Be The First To Know
About the latest Data engineer Jobs in Chennai !
Data Engineer
Posted 3 days ago
Job Viewed
Job Description
Key Responsibilities
· Data Pipeline Development: Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs.
· Data Integration: Integrate data from multiple sources and ensure data quality and consistency.
· Data Modelling: Build and optimize data models using Spark to support complex data transformations and analysis.
· SQL Development: Write efficient SQL queries to extract, transform, and load data into data warehouses and other storage solutions.
· Big Data Processing: Utilize big data technologies, especially Apache Spark, to process and analyze large datasets.
· Cloud Services: Implement and manage data solutions on cloud platforms such as Azure, AWS, or GCP.
· Problem Solving: Analyze and resolve data-related issues, ensuring data accuracy and reliability.
· Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Required Skills and Qualifications
· Education: Bachelor’s degree in Computer Science, Information Technology, or a related field.
· Experience: 3 to 5 years of experience in data engineering or a related role.
· Programming: Proficient in Python, with experience in data manipulation and automation scripts.
· Big Data: Strong knowledge of big data technologies, especially Apache Spark.
· SQL: Excellent skills in writing and optimizing SQL queries.
· Data Modelling: Experience in data modelling and data architecture, particularly using Spark.
· Cloud Platforms: Hands-on experience with at least one cloud platform (Azure, AWS, GCP).
· Data Analytics Concepts: Solid understanding of data engineering and analytics concepts.
· Problem Solving: Strong problem-solving skills with the ability to troubleshoot data issues effectively.
· Communication: Good communication skills, with the ability to work collaboratively in a team environment.
Preferred Qualifications
· Databricks: Experience with Databricks tool is a plus but not mandatory.
· Certifications: Certifications in Databricks or Azure (or any relevant certifications) are highly
Data Engineer
Posted 3 days ago
Job Viewed
Job Description
DATA ENGINEER
Who We Are?
Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering. The company deploys a leading team that spun out of the largest solar power producer in the world. This team operates within a sophisticated suite of software to support projects from land origination, through to commercial operation.
Location
Chennai
What We Offer
- Opportunity to join a top-notch, collaborative team of professionals
- Fantastic team environment and collaborative culture
- Professional development opportunities to grow into an industry leader
- Medical Insurance for the employee and family
- Spot Recognition bonus for exceptional performance
- Long Term Incentive policy
- Regular team outings, events, and activities to foster a positive work environment
Our Commitment to Diversity
At CIR, we are dedicated to nurturing a diverse and equitable workforce that truly reflects our community. We deeply value each person’s unique perspective, skills, and experiences. CIR embraces all individuals, regardless of race, religion, sexual orientation, gender identity, age, or nationality. We are steadfast in our commitment to fostering a just and inclusive world through intentional policies and actions. Your individuality enriches our collective strength, and we strive to ensure everyone feels respected, valued, and empowered.
Position Summary
As a Data Engineer, you would be required to take ownership of data infrastructure, pipeline development, and data curation for regulatory, zoning, renewable energy, and geospatial data applications. This role involves handling large-scale datasets related to zoning laws, permitting, environmental regulations, and spatial data, ensuring data quality, and enabling seamless integration with AI/ML models. The ideal candidate will be responsible for designing end-to-end data pipelines, supporting data-driven decision-making, and building and leading a data engineering team as they scale their operations.
Core Responsibilities
Data Engineering & Pipeline Development:
- Design and develop ETL pipelines to collect, clean, and transform regulatory and geospatial datasets.
- Build data ingestion pipelines for integrating zoning laws, permitting data, renewable energy regulations, GIS data, and environmental impact assessments.
- Work with PostGIS, PostgreSQL, and cloud-based storage solutions to manage structured and unstructured data.
- Develop automated data workflows to support AI/ML applications and real-time analytics.
- Ensure scalability, security, and performance of data architecture to handle large and diverse datasets.
Data Curation & Quality Assurance:
- Collect and preprocess zoning regulations, permitting documents, renewable energy policies, environmental impact assessments, and spatial data for AI applications.
- Implement data validation techniques to ensure accuracy and consistency.
- Maintain metadata, lineage tracking, and documentation for all datasets.
- Optimize regulatory and geospatial data storage, indexing, and querying for real-time performance.
Collaboration & Leadership:
- Work closely with AI/ML Engineers to align data structures with machine learning models.
- Collaborate with stakeholders to define data needs, storage strategies, and reporting workflows.
- Take the lead in hiring, training, and managing a data engineering team to scale operations effectively.
- Stay updated with emerging data engineering best practices and implement innovative solutions.
Education Requirements
Master’s or Ph.D. in Computer Science, Data Engineering, GIS, or related fields.
Technical Skills and Experience
Software Proficiency:
- Programming: Python (Pandas, NumPy, SQLAlchemy), SQL.
- Database & Storage: PostgreSQL, PostGIS, NoSQL, Cloud Data Warehouses (BigQuery, Snowflake, Redshift).
- Data Processing: Apache Airflow, Apache Spark, ETL frameworks, data lakes.
- Regulatory & GIS Data Management: Experience with QGIS, GDAL, GeoPandas, Google Earth Engine, and handling zoning/permitting datasets.
- Cloud & Infrastructure: AWS/GCP/Azure (S3, RDS, Lambda, EC2), Docker, Kubernetes.
- Big Data Processing: Experience with distributed computing, real-time data streaming, and indexing techniques.
- Communication: Strong ability to translate complex data requirements into business value.
Project Management:
- Design experience in projects from conception to implementation.
- Ability to coordinate with other engineers and stakeholders.
Renewable Energy Systems:
- Understanding of solar energy systems and their integration into existing infrastructure
Experience
- 2-4 years of experience
- Experience with automating regulatory data processing and AI-driven decision support systems.
- Strong understanding of vector databases, spatial indexing, and knowledge graphs.
- Hands-on experience building data architectures supporting ML/AI applications.
Psychosocial Skills /Human Skills/Behavioural Skills
- Strong analytical, organizational, and problem-solving skills.
- Management experience a plus.
- Must be a go-getter with an enterprising attitude
- A self-starter, able to demonstrate high levels of initiative and motivation
- Entrepreneurial mindset with the ability to take ideas and run with them from concept to conclusion.
- Technical understanding of clean energy business processes
- Exceptional verbal and writing communication skills with superiors, peers, partners, and other stakeholders.
- Excellent interpersonal skills while managing multiple priorities in a fast-paced and ever-changing environment.
Physical Demands
The physical demands described here are representative of those that must be met by an employee to successfully perform the essential functions of this job. The physical demands of this job require an individual to be able to work at a computer for most of the day, be able to participate in conference calls and travel to team retreats on a time-to-time basis. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Work Conditions
The work environment is usually quiet (normal city traffic noises are common), a blend of artificial and natural light, temperate and generally supports a collaborative work environment. Reasonable accommodations may be made to enable individuals with disabilities to perform the essential functions.
Equal Opportunity Employer
At Cleantech Industry Resources, we embrace diversity and uphold a strong dedication to establishing an all-encompassing atmosphere for both our staff and associates. Our choices in employment are free from any bias related to race, creed, nationality, ethnicity, gender, sexual orientation, gender identity, gender expression, age, physical limitations, veteran status, or any other legally safeguarded attributes.
Being an integral part of Cleantech Industry Resources means you can expect to be immersed in a realm of professional possibilities within a culture that nurtures teamwork, adaptability, and the embracing of all.
Data Engineer
Posted 3 days ago
Job Viewed
Job Description
Dear Candidate,
Greetings from TCS !
TCS is hiring for GCP data engineer, please find the below JD.
Experience range – 6 to 8 years
Location - Bengaluru/Chennai/Gurgaon
Skills Required - GCP BigQuery, Python
Role& Responsibilities –
- Excellent communication (both oral and written ) and documentation
- Hands-on experience in the complete eco-system of any one/more of the various Hadoop distributions such as MapR (preferred ) and/or Hortonworks and/or Cloudera and/or Apache Hadoop , with specialization in tools such as Spark (Core and SQL) , Hive and NoSql Databases such as HBase and/or Cassandra and/or MongoDB
- Hands-on experience in the various services of Google Cloud Platform (GCP ) cloud such as CloudStorage, DataFlow, DataProc, CI/CD, BigQuery , Spanner, BigTable, Composer, Pub/Sub, Hyper-drive, etc…
- Broader responsibilities include but not limited to analysis, design, development and testing as needed
- Should be a self-starter, team player, collaborative and should be thorough focusing on the quality of the deliverable and time to market