18,730 Spark Developer jobs in India

Candidate should be able to:
Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc.
open to receiving feedback and constructive criticism.
Proficiency working with large data stores
understanding of Test Driven Development (TDD) or Pair Programming
Candidate should have:
Deep understanding of all aspects of database technologies - schema design, optimization, scalability, etc.
Excellent communication skills
passion for resolving user pain points through great design.
Track record of contributions to open-source software projects.
Experience in SDLC, especially testing and deployment.
Professional ETL experience using Spark (Python or Scala)
Experience in Software version control (e.g. git working knowledge or greater)
Experience in Unix-like operating system environment (proficient)
3+ years of CI/CD experience (Jenkins, Terraform, Cloud Formation, etc.)
4+ years of experience designing technical solutions using object-oriented design concepts.
3+ years of AWS solution engineering and architecture experience

Develop, test, and deploy data processing applications using Apache Spark and Scala. 

Optimize and tune Spark applications for better performance on large-scale data sets. 

Work with the Cloudera Hadoop ecosystem (., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. 

Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. 

Design and implement high-performance data processing and analytics solutions. 

Ensure data integrity, accuracy, and security across all processing tasks. 

Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. 

Implement version control and CI/CD pipelines for Spark applications. 

Required Skills & Experience:  

Minimum 8 years of experience in application development. 

Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing. 

Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop. 

Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi. 

Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data. 

Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL. 

Knowledge of data warehousing concepts, dimensional modeling, and data lakes. 

Ability to troubleshoot and optimize Spark and Cloudera platform performance. 

Familiarity with version control tools like Git and CI/CD tools (., Jenkins, GitLab). 

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming testing activities. Integrates in-depth specialty area knowledge with a solid understanding of industry standards and practices. Good understanding of how the team and area integrate with others in accomplishing the objectives of the subfunction/ job family. Applies analytical thinking and knowledge of data analysis tools and methodologies. Quality and timeliness of service provided will affect the effectiveness of own team and other closely related teams.
**Responsibilities:**
+ Utilize knowledge of applications development testing procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
+ Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
+ Apply fundamental knowledge of programming languages for design specifications.
+ Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
+ Serve as advisor or coach to new or lower level analysts
+ Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
+ Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
+ Has the ability to operate with a limited level of direct supervision.
+ Can exercise independence of judgement and autonomy.
+ Acts as SME to senior stakeholders and /or other team members.
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
+ Conducts initiatives related to User Acceptance Testing (UAT) process and product rollout into production. Testing specialists who work with technology project managers, UAT professionals and users to design and implement appropriate scripts/plans for an application testing strategy/approach. Responsibilities may also include software quality assurance testing.Conducts a variety of tests and analyses to ensure that systems and or applications meet or exceed specified standards and end-user requirements.Works closely with key stakeholders to understand business and functional requirements to develop test plans, test cases and scripts.Works complex testing assignments.
**Qualifications:**
+ Design, code, test, document and implement application release projects as part of development team.
+ Minimum 4 years of proven project experience
+ **Should be hands-on with Spark 2.0 and above, Java 8 and above.**
+ **Should be good with Hive / Oracle, Unix Shell Scripting**
+ Should have experience on Spring Boot and Rest API
+ Good to have knowledge on Agile methodologies
+ Work with BA and understand all functional and technical requirements of the project.
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming testing activities. Integrates in-depth specialty area knowledge with a solid understanding of industry standards and practices. Good understanding of how the team and area integrate with others in accomplishing the objectives of the subfunction/ job family. Applies analytical thinking and knowledge of data analysis tools and methodologies. Quality and timeliness of service provided will affect the effectiveness of own team and other closely related teams.

Responsibilities:

Utilize knowledge of applications development testing procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code

Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems

Apply fundamental knowledge of programming languages for design specifications.

Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging

Serve as advisor or coach to new or lower level analysts

Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions

Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents

Has the ability to operate with a limited level of direct supervision.

Can exercise independence of judgement and autonomy.

Acts as SME to senior stakeholders and /or other team members.

Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Conducts initiatives related to User Acceptance Testing (UAT) process and product rollout into production. Testing specialists who work with technology project managers, UAT professionals and users to design and implement appropriate scripts/plans for an application testing strategy/approach. Responsibilities may also include software quality assurance testing.
Conducts a variety of tests and analyses to ensure that systems and or applications meet or exceed specified standards and end-user requirements.
Works closely with key stakeholders to understand business and functional requirements to develop test plans, test cases and scripts.
Works complex testing assignments.

Qualifications:

Design, code, test, document and implement application release projects as part of development team.

Minimum 4 years of proven project experience

Should be hands-on with Spark and above, Java 8 and above.

Should be good with Hive / Oracle, Unix Shell Scripting

Should have experience on Spring Boot and Rest API

Good to have knowledge on Agile methodologies

Work with BA and understand all functional and technical requirements of the project.

Education:

Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

---

Job Family Group:

Technology

---

Job Family:

Applications Development

---

Time Type:

Full time

---

Most Relevant Skills

Please see the requirements listed above.

---

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

---

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
**Responsibilities:**
+ Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
+ Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
+ Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
+ Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
+ Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
+ Ensure essential procedures are followed and help define operating standards and processes
+ Serve as advisor or coach to new or lower level analysts
+ Has the ability to operate with a limited level of direct supervision.
+ Can exercise independence of judgement and autonomy.
+ Acts as SME to senior stakeholders and /or other team members.
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
**Qualifications:**
+ - 7 to 12 years of Application development experience - The primary area of Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns. - The candidate should be commendable in Data Structures and Algorithms. He should have worked on Core Application Development of complex size encompassing all areas of Java/J2EE.- She/He should Thorough knowledge and hands on experience in following technologies Hadoop, Map Reduce Framework, Spark, YARN, Sqoop, Pig , Hue, Unix, Java, Sqoop, Impala, Cassandra on Mesos. Cloudera certification (CCDH) is an added advantage. - She/He should have implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications.- Exposure to ETL and BI tools will be good.- Work in an agile environment following through the best practices of agile Scrum.- Expertise in designing and optimizing the software solutions for performance and stability.- Expertise in troubleshooting and problem solving.- Expertise in Test driven development.
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.
**Responsibilities:**
+ Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas
+ Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users
+ Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement
+ Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality
+ Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems
+ Ensure essential procedures are followed and help define operating standards and processes
+ Serve as advisor or coach to new or lower level analysts
+ Has the ability to operate with a limited level of direct supervision.
+ Can exercise independence of judgement and autonomy.
+ Acts as SME to senior stakeholders and /or other team members.
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
**Qualifications:**
+ 5-8 years of relevant experience
+ Experience in systems analysis and programming of software applications
+ Experience in managing and implementing successful projects
+ Working knowledge of consulting/project management techniques/methods
+ Ability to work under pressure and manage deadlines or unexpected changes in expectations or requirements
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
As an Assistant Vice President (AVP), you will act as a hands-on tech lead, delivering robust solutions while guiding junior developers and ensuring best practices.
***Responsibilities***
+ Develop backend services using Spring Boot, Spring WebFlux, MyBatis, and JPA
+ Work with Spark and Python to extend and enhance cloud-based data pipelines
+ Support data and infrastructure migration efforts from legacy DBs to Snowflake and S3
+ Implement caching strategies with Redis, ehcache or Hazlecast
+ Build Angular components with reusable architecture and performance optimizations.
+ Maintain strong test coverage with TDD and enforce coding standards via Sonar
+ Mentor junior developers and participate in daily standups, code reviews, and CI/CD delivery pipelines
***Required Skills***
+ **6-10 years of experience** in backend/full-stack engineering using modern Java-based platforms
+ **Programming Languages** : Proficient in Java, Python, JavaScript/TypeScript
+ **Frameworks** : Spring Boot/WebFlux, Angular 12+, Node.js
+ **Databases** : Oracle, MongoDB, Redis, HDFS, Strong SQL skills.
+ **Cloud Technologies** : (ECS, S3, Lambda, RDS), Kubernetes.
+ **Data Technologies** : Apache Spark with Python, Snowflake, data migration tools.
+ **Development Practices** : TDD, CI/CD pipelines, Git workflows.
+ **Quality Tools** : SonarQube, automated testing frameworks.
+ Strong mentoring, conflict resolution, and cross-team communication skills
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.

We are looking for a seasoned Developer who is passionate in writing clean and efficient code, building scalable systems, driving engineering excellence in a fast-paced, Agile environment.
This role is ideal for developers with deep hands-on experience in Java and Apache Spark, combined with a strong foundation in object-oriented design principles.
**Responsibilities:**
+ Perform detailed impact analysis for code changes with understanding of dependencies across the application components
+ Design and develop scalable, high-performance code using Java and Bigdata / Java Spark
+ Write high-quality, maintainable code that is modular, testable, and adheres to SOLID principles and industry-standard design patterns.
+ Write robust unit tests using JUnit, with a focus on code coverage, business logic, readability and reusability.
+ Perform code reviews to ensure the code follows clean design / architecture and best engineering practices.
+ Operate in an environment of ownership and accountability, where quality and collaboration are core values
+ Mentor a junior developers and guide them through technical challenges
+ Work in a cross-functional Agile team, participate in daily stand-ups, sprint planning, retrospectives, and backlog grooming.
+ Translate user stories into technical tasks and drive timely, high-quality delivery of solutions.
+ Collaborate closely with Senior developers, Architects, Quality Engineers, DevOps, and Product owners to deliver high-quality code at speed
**Qualifications:**
+ 7+ years of development experience with hands-on experience in Java, Bigdata / Java Spark, object-oriented programming (OOP)
+ Experience with REST APIs, RDBMS database, and Kafka messaging systems
+ Exposure to microservices architecture and containerization tools (Docker, Kubernetes)
+ Proven experience leading teams and mentoring developers in a fast-paced development environment.
+ Strong understanding of software development lifecycle (SDLC) and Agile methodologies
+ Excellent communication skills and ability to work effectively in cross-functional teams
**Education:**
+ Bachelor's degree/University degree or equivalent experience
+ Master's degree preferred
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.

The Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming activities.

Responsibilities:

Conduct tasks related to feasibility studies, time and cost estimates, IT planning, risk technology, applications development, model development, and establish and implement new or revised applications systems and programs to meet specific business needs or user areas

Monitor and control all phases of development process and analysis, design, construction, testing, and implementation as well as provide user and operational support on applications to business users

Utilize in-depth specialty knowledge of applications development to analyze complex problems/issues, provide evaluation of business process, system process, and industry standards, and make evaluative judgement

Recommend and develop security measures in post implementation analysis of business usage to ensure successful system design and functionality

Consult with users/clients and other technology groups on issues, recommend advanced programming solutions, and install and assist customer exposure systems

Ensure essential procedures are followed and help define operating standards and processes

Serve as advisor or coach to new or lower level analysts

Has the ability to operate with a limited level of direct supervision.

Can exercise independence of judgement and autonomy.

Acts as SME to senior stakeholders and /or other team members.

Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

• 7 to 12 years of Application development experience 
• The primary area of Experience with Core Java/J2EE Application with complete command over OOPs and Design Patterns. 
• The candidate should be commendable in Data Structures and Algorithms. He should have worked on Core Application Development of complex size encompassing all areas of Java/J2EE.
• She/He should Thorough knowledge and hands on experience in following technologies Hadoop, Map Reduce Framework, Spark, YARN, Sqoop, Pig , Hue, Unix, Java, Sqoop, Impala, Cassandra on Mesos. Cloudera certification (CCDH) is an added advantage. 
• She/He should have implemented or part complex project execution in Big Data Spark eco system, where processing volumes of data thorough understanding of distributed processing and integrated applications.
• Exposure to ETL and BI tools will be good.
• Work in an agile environment following through the best practices of agile Scrum.
• Expertise in designing and optimizing the software solutions for performance and stability.
• Expertise in troubleshooting and problem solving.
• Expertise in Test driven development.

Education:

Bachelor’s degree/University degree or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

---

Job Family Group:

Technology

---

Job Family:

Applications Development

---

Time Type:

Full time

---

Most Relevant Skills

Please see the requirements listed above.

---

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

---