873 Senior Data Engineer jobs in Chennai
Big Data Engineer
Posted 4 days ago
Job Viewed
Job Description
**Responsibilities:**
+ Design, development of BigData applications/ pipelines using Spark, Scala, SQL, Pyspark, Python, Java
+ Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
**Qualifications:**
+ 4-8 years of experience in software development, building large scale distributed data processing systems or large-scale applications
+ Designing & developing Big Data solutions with at least one end to end implementation.
+ Strong Hands-on experience in following technical skills: Apache Spark, Scala/ Java, XML/ JSON/ Parquet/ Avro, SQL, Linux, Hadoop Ecosystem (HDFS, Spark, Impala, HIVE, HBASE etc.), Kafka.
+ Performance analysis, troubleshooting and issue resolution and Exposure to latest Cloudera offerings like Ozone, Iceberg.
+ Intermediate level experience in Applications Development role
+ Consistently demonstrates clear and concise written and verbal communication
+ Demonstrated problem-solving and decision-making skills
+ Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Big Data Engineer
Posted today
Job Viewed
Job Description
The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
Responsibilities:
- Design, development of BigData applications/ pipelines using Spark, Scala, SQL, Pyspark, Python, Java
- Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
- Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
Qualifications:
- 4-8 years of experience in software development, building large scale distributed data processing systems or large-scale applications
- Designing & developing Big Data solutions with at least one end to end implementation.
- Strong Hands-on experience in following technical skills: Apache Spark, Scala/ Java, XML/ JSON/ Parquet/ Avro, SQL, Linux, Hadoop Ecosystem (HDFS, Spark, Impala, HIVE, HBASE etc.), Kafka.
- Performance analysis, troubleshooting and issue resolution and Exposure to latest Cloudera offerings like Ozone, Iceberg.
- Intermediate level experience in Applications Development role
- Consistently demonstrates clear and concise written and verbal communication
- Demonstrated problem-solving and decision-making skills
- Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
Education:
- Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
-
Job Family Group:
Technology
-
Job Family:
Applications Development
-
Time Type:
Full time
-
Most Relevant Skills
Please see the requirements listed above.
-
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.
-
Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.
If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi .
View Citi's EEO Policy Statement and the Know Your Rights poster.
Big Data Engineer
Posted today
Job Viewed
Job Description
Description
Primary Tech skills – AZURE ,Databricks ,Pyspark,SQL Secondary Tech skills – ADF, Synapse Roles:•Experience in Pyspark, SQL, Cloud data warehouse like Azure Synapse, databricks•Experience working with structured and unstructured data•Extensive knowledge of Data Warehousing concepts, strategies, methodologies•Experience in ETL/Pipeline Development using tools such as Azure Databricks and Azure Data Factory with development expertise on batch and real-time data integration•Experience in data ingestion, preparation, integration, and operationalization techniques in optimally addressing the data requirements•Experience in relational data processing technology like MS SQL, Delta Lake, Spark SQL, SQL Server•Experience with Orchestration tools, Azure DevOps, and GitHub•Must be team oriented with strong communication, collaboration, prioritization, and adaptability skillBig Data Engineer
Posted today
Job Viewed
Job Description
Hiring for Big Data:
LOCATION: Chennai, Bengaluru, Hyderabad.
EXPERIENCE: 7-10
Notice Period : Immediate Joiner or 30 Day
Key Skills
- Hands-on experience on technologies like Python, SQL, Snowflake, HDFS , Hive, Scala, Spark, AWS, HBase and Cassandra.
- Good knowledge in Data Warehousing concepts.
- Proficient in Hadoop distributions such as Cloudera, Hortonworks.
- Good working experience on technologies like Python , Scala, SQL & PL/SQL
- Developers design and build the foundational architecture to manage massive-scale data storage, processing, and analysis using distributed, cloud-based systems and platforms.
- Coding Big Data Pipelines.
- Managing Big Data Infrastructure and Pipelines.
Big Data Engineer
Posted today
Job Viewed
Job Description
The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
Responsibilities:
Qualifications:
Education:
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
Job Family Group:
Technology---
Job Family:
Applications Development---
Time Type:
Full time---
Most Relevant Skills
Please see the requirements listed above.---
Other Relevant Skills
For complementary skills, please see above and/or contact the recruiter.---
Big Data Engineer
Posted today
Job Viewed
Job Description
Description
:Senior Big Data Engineer
Posted today
Job Viewed
Job Description
We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .
ResponsibilitiesChoosing the right technologies for our use cases, deploy and operate.
Setting up Data stores structured, semi structured and non-structured.
Secure data at rest via encryption
Implement tool to access securely multiple data sources
Implement solutions to run real-time analytics
Use container technologies
SkillsMust have
6+ years of relevant technology experience
Programming Skills:
Strong proficiency in Java or Scala.
Solid understanding of SQL and experience working with structured, semi-structured, and unstructured data.
Big Data & Data Engineering:
Deep experience with Big Data frameworks such as Apache Spark, Hadoop, and Kafka.
Hands-on experience in designing and managing data pipelines, ETL workflows, and real-time streaming applications.
Familiarity with data warehousing solutions (e.g., Hive, Trino, BigQuery, Redshift, Snowflake).
Architecture & Infrastructure:
Background in microservices-based architectures and API integrations.
Hands-on expertise with Kubernetes and Docker for containerization and orchestration.
Cloud & DevOps:
Experience with cloud platforms like AWS, Google Cloud Platform (GCP), or Azure, including services such as EMR, Dataproc, or BigQuery.
Understanding of data security best practices, including encryption and secure access controls.
Development Practices:
Knowledge of Agile/Scrum methodologies.
Soft Skills:
Team-oriented, respectful, and able to collaborate effectively in cross-functional teams.
Strong problem-solving skills and a growth mindset with a willingness to learn and adapt.
Nice to have
Exposure to data visualization and exploration tools such as Apache Superset is a plus.
Experience with workflow orchestration tools such as Apache Airflow is an advantage.
Familiarity with Unix/Linux environments is beneficial.
Experience with CI/CD pipelines and modern DevOps tools is a plus.
OtherLanguages
English: C2 Proficient
Seniority
Senior
Chennai, India
Req. VR-
BigData Development
BCM Industry
04/09/2025
Req. VR-
Be The First To Know
About the latest Senior data engineer Jobs in Chennai !
Sr. Big Data Engineer
Posted today
Job Viewed
Job Description
•Superior oral, and written communication skills, as well as the willingness to collaborate across teams of internal and external technical staff, business analysts, software support, and operations staff.
•Ability to write abstracted, reusable code components
•Hands-on experience in writing shell scripts, complex SQL queries, Hadoop commands, and Git
•Minimum 5 years experience working with and developing solutions using Python/R
•Experience in developing Hive, Sqoop, Spark, Kafka, HBase on Hadoop
•Familiar with Hortonworks, Zookeeper, and Oozie is a plus
•Willingness to learn new technologies quickly
•Strong business acumen, Critical Thinking, and Creativity
•Performance tuning experience
•Bachelor's degree in a quantitative field (such as Engineering, Computer Science, Statistics, Econometrics) and a minimum of 10 years of experience
•Minimum 5 years of SAS experience (configuration & development experience)
Talend Big Data Engineer
Posted today
Job Viewed
Job Description
• This solution enables our Data Scientists and Data Analysts to actively detect trends, patterns, and relationships in data sets.
•engage in the enhancement and maintenance support of data movement solutions to meet client business objectives and will have an opportunity to work with a cross-disciplinary team.
•Contribute to the data movement project enhancement and bug fixes for applications that move data from multiple sources to a concentrated common EDL Layer.
Design and build pipelines to ingest data from source systems and data transformation using Azure Data Factory into Azure Data Lake.
Candidate should have :
•Experience in Talend and Big data is mandatory, ADF is good to know
Experience in Talend Big Data ETL tool and RDBMS
Experience in Azure Data Factory and Azure Components
Experience in Hadoop Hive and RDBMS
Working knowledge of SQL, NoSQL, data warehousing
Design, Implement and deploy ETL using Talend Big Data Components
Experience in Enhancements and Fixes and Troubleshooting production issues
Hands-on experience in HiveQL and ability to write MapReduce jobs.
Knowledge in Datasets, Linked services, Copy Data Activity
Hadoop Big data engineer
Posted today
Job Viewed
Job Description
• As individual contributor code and test modules.
• Interact and collaborate directly with software developers, product managers, and business analysts to ensure proper development and quality of service applications and products.
• Ability to do development in an Agile environment.
• Work closely with Leads and Architects to understand the requirements and translate that into code.
• Mentor junior engineers if required.