What Jobs are available for Data Engineers in India?
Showing 1134 Data Engineers jobs in India
Senior Data Engineers
Posted 1 day ago
Job Viewed
Job Description
#hiring #Hiring #HiringNow #hyderabad #hyderabadjob #HyderabadJobs #immediatejoiner #opportunity #CareerOpportunity #Senior #TechJobs #TechCareers #dataengineer #DataEngineering #DataArchitect #DataEngineeringJobs #HealthcareData #HealthcareAnalytics #ImmediateJoiner #HybridJobs
#CloudComputing #BigData #DataAnalytics #PlatformEngineering #Terraform #Kubernetes #SQL #Python #Scala #apachespark #pyspark #ETLpipeline #PySpark #ApacheSpark #Kafka #apache #RealTimeData #DataPipelines #DataProcessing #Analytics #AnalyticalProcessing #CloudArchitect #DeltaLake #ETL #PySpark #AWS #SeniorDataEngineer #LeadDataEngineer #AWSJobs #PythonJobs #SQLJobs #BigDataCareers #CloudDataEngineering #PlatformEngineering #AnalyticsJobs #KafkaJobs #CI_CD #SparkJobs #Databricks
Were Hiring: Sr. Data Engineers (Python/Scala, Spark/Databricks, SQL, AWS) | Hyderabad
Role Details
- Position : Senior Data Engineer / Lead Data Engineer
- Experience : 6–12 years
- Location : Hyderabad
- Work Mode : Hybrid (3 days/week in-office)
- Join : Immediate
Is this job a match or a miss?
Big Data Engineer
Posted 5 days ago
Job Viewed
Job Description
**Responsibilities:**
+ Utilize knowledge of applications development procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements
+ Identify and analyze issues, make recommendations, and implement solutions
+ Utilize knowledge of business processes, system processes, and industry standards to solve complex issues
+ Analyze information and make evaluative judgements to recommend solutions and improvements
+ Conduct testing and debugging, utilize script tools, and write basic code for design specifications
+ Assess applicability of similar experiences and evaluate options under circumstances not covered by procedures
+ Develop working knowledge of Citi's information systems, procedures, standards, client server application development, network operations, database administration, systems administration, data center operations, and PC-based applications
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
**Qualifications:**
+ 3 to 5 years of relevant experience
+ Experience in programming/debugging used in business applications
+ Working knowledge of industry practice and standards
+ Comprehensive knowledge of specific business area for application development
+ Working knowledge of program languages
+ Consistently demonstrates clear and concise written and verbal communication
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
Additional Job Description
We are looking for a Big Data Engineer that will work on the collecting, storing, processing, and analyzing of huge sets of data. The primary focus will be on choosing optimal solutions to use for these purposes, then maintaining, implementing, and monitoring them. You will also be responsible for integrating them with the architecture used across the company.
Responsibilities
- Selecting and integrating any Big Data tools and frameworks required to provide requested capabilities
- Implementing data wrangling, scarping, cleaning using both Java or Python
Strong experience on data structure.
Skills and Qualifications
- Proficient understanding of distributed computing principles
- Proficient in Java or Python and some part of machine learning
- Proficiency with Hadoop v2, MapReduce, HDFS, Pyspark, Spark
- Experience with building stream-processing systems, using solutions such as Storm or Spark-Streaming
- Good knowledge of Big Data querying tools, such as Pig, Hive, and Impala
- Experience with Spark
- Experience with integration of data from multiple data sources
- Experience with NoSQL databases, such as HBase, Cassandra, MongoDB
- Knowledge of various ETL techniques and frameworks, such as Flume
- Experience with various messaging systems, such as Kafka or RabbitMQ
- Experience with Big Data ML toolkits, such as Mahout, SparkML, or H2O
- Good understanding of Lambda Architecture, along with its advantages and drawbacks
- Experience with Cloudera/MapR/Hortonworks
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Is this job a match or a miss?
Big Data Engineer
Posted 5 days ago
Job Viewed
Job Description
**Responsibilities:**
+ Design, development of BigData applications/ pipelines using Spark, Scala, SQL, Pyspark, Python, Java
+ Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
**Qualifications:**
+ 4-8 years of experience in software development, building large scale distributed data processing systems or large-scale applications
+ Designing & developing Big Data solutions with at least one end to end implementation.
+ Strong Hands-on experience in following technical skills: Apache Spark, Scala/ Java, XML/ JSON/ Parquet/ Avro, SQL, Linux, Hadoop Ecosystem (HDFS, Spark, Impala, HIVE, HBASE etc.), Kafka.
+ Performance analysis, troubleshooting and issue resolution and Exposure to latest Cloudera offerings like Ozone, Iceberg.
+ Intermediate level experience in Applications Development role
+ Consistently demonstrates clear and concise written and verbal communication
+ Demonstrated problem-solving and decision-making skills
+ Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Is this job a match or a miss?
Big Data Engineer
Posted 5 days ago
Job Viewed
Job Description
Greetings from TCS!
We are hiring for Bigdata Developer
Job location: Chennai, Bangalore, Hyderabad, Mumbai, Kolkata, Pune, Indore, Ahmedabad, Kochi, Gurgaon
Desired experience: 5 to 10 years
Required Technical Skill Set: HDFS, Hive, Spark, Sqoop, Flume, Oozie, Unix Script, Autosys
Must-Have:
- Hands-on experience in Big data, Hadoop
- Hands-on experience in Hive, Sqoop, Spark, Hive
- Hands on experience with Data Transformations, data structures, Metadata, SQL, workload management
- Coding experience in SQL
- Good communication skills and team skills
- Effective communication and independently
Responsibilities:
- As a Developer, must be able to do Requirements gathering and data analysis for the multiple business processes involved
- Development of Data ingestion framework using Spark, Hive, Sqoop tech stack
- Good analytical ability
- Good communication skills
- Good understanding of ETL and BI concepts
Regards
Bodhisatwa Ray
Is this job a match or a miss?
Big Data Engineer
Posted 9 days ago
Job Viewed
Job Description
Coforge Ltd is Hiring for Big Data Engineer – AWS, Spark & Scala.
Must Have Skills:- AWS, Spark & Scala.
Experience Required: 3 to 6 Years
Job Locations: Pune, Hyderabad, Greater Noida Only.
Send your CV to:
For queries, contact via WhatsApp:
Key Responsibilities:-
• Design, develop, and optimize Big Data architectures leveraging AWS services for large-scale, complex data processing.
• Build and maintain data pipelines using Spark (Scala) for both structured and unstructured datasets.
• Architect and operationalize data engineering and analytics platforms (AWS preferred; Hortonworks, Cloudera, or MapR experience a plus).
• Implement and manage AWS services including EMR, Glue, Kinesis, DynamoDB, Athena, CloudFormation, API Gateway, and S3.
• Work on real-time streaming solutions using Kafka and AWS Kinesis.
• Support ML model operationalization on AWS (deployment, scheduling, and monitoring).
• Analyze source system data and data flows to ensure high-quality, reliable data delivery for business needs.
• Write highly efficient SQL queries and support data warehouse initiatives using Apache NiFi, Airflow, and Kylo.
• Collaborate with cross-functional teams to provide technical leadership, mentor team members, and strengthen the data engineering capability.
• Troubleshoot and resolve complex technical issues, ensuring scalability, performance, and security of data solutions.
Mandatory Skills & Qualifications:-
• Solid hands-on experience in Big Data Technologies (AWS, Scala, Hadoop, and Spark Mandatory)
• Proven expertise in Spark with Scala
• Hands-on experience with: AWS services (EMR, Glue, Lambda, S3, CloudFormation, API Gateway, Athena, Lake Formation)
Is this job a match or a miss?
Big Data Engineer
Posted 9 days ago
Job Viewed
Job Description
Job Title :- Data Engineer - Pyspark
Experience: 5 to 8 Years
Location: Pune/Hyderabad
Job Description
Required Skills:
5+ years of experience in Big data and pyspark
Must-Have
Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL
Good-to-Have
Good Spark, Pyspark,Big Data experience
Spark UI/Optimization/debugging techniques
Good python scripting skills
Intermediate SQL exposure – Subquery, Joins, CTE’s
Database technologies
AWS EMR, S3, IAM, Lambda, SNS, SQS
Good work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQL
Experience working on Data Engineering projects
Good Understanding of SQL
Good understanding of Unix and HDFS commands
Communication
Experience working on Data Analytics and Pyspark
Thanks & Regards ,
Manasi Prava Natha
Is this job a match or a miss?
Big Data Engineer
Posted 322 days ago
Job Viewed
Job Description
At Thoucentric, we work on various problem statements.
The most popular ones are -Building capabilities that address a market need, basis our ongoing research effortsSolving a specific use case for a current or potential client based on challenges on-groundDeveloping new systems that help be a better employer and a better partner to clientsAll of these need the best of minds to work on them day-to-day; and we do exactly that! Your contribution to organization development is as important as outward facing consulting. We are invested in both, employee growth and client success!As a Data Engineer, you will play a pivotal role in designing, implementing, and maintaining our data infrastructure. You will work with a wide variety of data sources, process and transform data, and orchestrate workflows to support data-driven decision-making. Your expertise in Delta Lake, Apache Spark, and Apache Airflow will be crucial in ensuring the reliability and performance of our data systems.
Key Responsibilities:
Data Ingestion and Integration: Develop and maintain data pipelines to ingest data from diverse sources.Implement data integration solutions to harmonize data from various platforms. Data Transformation: Use Delta Lake to process and transform data efficiently.Build and optimize data processing workflows using Apache Spark. Data Orchestration: Create, schedule, and manage data pipelines with Apache Airflow.Monitor and troubleshoot workflow execution, ensuring data quality. Data Modeling and Optimization: Design and maintain data models to support efficient querying and reporting.Implement performance tuning and optimization strategies for Spark and Delta Lake. Data Governance: Establish data security and access controls to protect sensitive information.Ensure compliance with data governance policies and best practices. Collaboration: Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and provide data support.RequirementsQualifications:
Bachelor's degree in Computer Science, Information Technology, or a related field.3+ years of experience in data engineering, focusing on Delta Lake, Apache Spark, and Apache Airflow.Strong proficiency in Delta Lake concepts and best practices.Proven expertise in Apache Spark for large-scale data processing.Experience with Apache Airflow for workflow orchestration.Strong SQL and NoSQL database knowledge.Familiarity with data warehousing and data modeling.Excellent problem-solving and troubleshooting skills.Strong communication and teamwork skills.Preferred Qualifications:
Experience with cloud-based data platforms (e.g., AWS, Azure, Google Cloud).Knowledge of containerization and orchestration tools (e.g., Docker, Kubernetes).Familiarity with data visualization tools (e.g., Tableau, Power BI).Certification in Delta Lake, Apache Spark, or Apache Airflow.Benefits What is in it for You: Be part of the exciting Growth Story of Thoucentric!Work on projects that help you stay ahead of the curve. Not just exciting projects, if you are a self-starter, you will also get multiple opportunities to design, drive and contribute to the organizational and practice initiatives.Challenge yourself in an environment with higher expectations ensuring constant learning curve and steep growth opportunitiesBe part of One Extended Family. We bond beyond work - sports, get-togethers, common interests etc. Work in a very enriching environment with Open Culture, Flat Organization and Excellent Peer Group.Is this job a match or a miss?
Be The First To Know
About the latest Data engineers Jobs in India !
Big Data Developer
Posted 3 days ago
Job Viewed
Job Description
Role: Lead/Architect
Required Technical Skill Set: Bigdata, Hadoop or Data Warehousing Tools and Cloud Computing
Desired Experience Range: 4 to10 Years
Location: Chennai and Bengaluru
Must-Have:
- Working experience of Hadoop, Hive SQL’s, Spark, Bigdata Eco System Tools.
- Should be able to tweak queries and work on performance enhancement.
- The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production after testing.
- The candidate should have strong functional and technical knowledge to deliver what is required and he/she should be well acquainted with Banking terminologies.
- Occasionally, the candidate may have to be responsible as a primary contact and/or driver for small to medium size projects.
- The candidate should have strong DevOps and Agile Development Framework knowledge.
Good-to-Have:
- Preferable to have good technical knowledge on Cloud computing, AWS or Azure Cloud Services.
- Strong conceptual and creative problem-solving skills, ability to work with considerable ambiguity, ability to learn new and complex concepts quickly.
- Experience in working with teams in a complex organization involving multiple reporting lines · Knowledge in BI tools like MSTR, Tableau is an added advantage.
Is this job a match or a miss?
Big Data Developer
Posted 6 days ago
Job Viewed
Job Description
Dear Candidates,
Greetings from Tata Consultancy Services!
TCS has been a great pioneer in feeding the fire of young techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together.
Kindly attach your updated resumes
What we are looking for?
- Role: Big Data Developer
- Experience: 4 to 10 years (Appropriate)
- Location: Bangalore Preferably
- Notice Period: 0 to 90 days
Skills required:
- Hands-on experience of Hadoop, Python, PySpark, Hive, Big Data Eco System Tools .
- Should be able to develop, tweak queries and work on performance enhancement.
- Solid understanding of object-oriented programming and HDFS concepts
- The candidate will be responsible for delivering code, setting up environment, connectivity, deploying the code in production after testing.
- Preferable to have good DWH/ Data Lake knowledge.
- Conceptual and creative problem-solving skills, ability to work with considerable ambiguity, ability to learn new and complex concepts quickly.
- Experience in working with teams in a complex organization involving multiple reporting lines
- The candidate should have good DevOps and Agile Development Framework knowledge.
Thanks & Regards
Malleswari M
BFSI TAG Team
Is this job a match or a miss?
Big Data Developer
Posted 9 days ago
Job Viewed
Job Description
We are seeking a highly skilled and experienced Senior Big Data Engineer with strong expertise in Streaming Data and Big Data Technologies , AWS & Scala Mandatory . The ideal candidate will have hands-on experience in architecting and implementing scalable data solutions using modern cloud-native tools and frameworks.
Key Responsibilities:
- Architect and implement scalable data pipelines for real-time, batch, structured, and unstructured data .
- Design and develop solutions using AWS services such as EMR, Kinesis, Glue, Athena, S3, CloudFormation, API Gateway .
- Work extensively with streaming platforms like Kafka, Flink, Spark Streaming .
- Develop and optimize data ingestion workflows using Apache NiFi, Airflow, Sqoop, Oozie .
- Build and maintain data lakes and analytics platforms using AWS Lake Formation .
- Hands-on development using Scala with Spark for distributed data processing.
- Work with NoSQL databases including DynamoDB, HBase , and Hadoop ecosystem tools like MapReduce, Hive, HDFS .
- Collaborate with cross-functional teams to deliver high-performance data solutions.
Technical Skills Required:
- Mandatory: Spark, Scala, AWS, Hadoop
- Big Data Tools: EMR, Glue, Hive, HDFS, HBase, MapReduce
- Streaming & Messaging: Kafka, Kinesis, Flink, Spark Streaming
- Data Ingestion: Apache NiFi, Airflow, Sqoop, Oozie
- Cloud Platforms: AWS (preferred), Hortonworks, Cloudera, MapR
- Programming: Scala (with Spark), Python (optional)
- Databases: DynamoDB, NoSQL, HBase
- Others: AWS Athena, Lake Formation, CloudFormation
Is this job a match or a miss?