11,764 Spark Developer jobs in India

Scala Spark Developer

Full Time

Job Code: TI-82594 | Tavant Technologies India Private Limited 

India

15 positions

Required Experience

3 - 15 Years

Skills

scala,

spark,

Spark streaming

+ 3 more

Job Description

3+ years of strong development experience in Scala and Spark

Design, develop, test and deploy technical solutions

Implement automated acceptance tests

Roles & Responsibilities

3+ years of strong development experience in Scala and Spark
Good knowledge in OS concepts and hands-on with Linux systems
Strong Computer Science fundamentals in data structures, algorithm design, and problem-solving.
Strong distributed systems knowledge, and experience shipping enterprise software Organized, thorough, and detail-oriented
Design, develop, test and deploy technical solutions
Implement automated acceptance tests
Spark streaming, FLINK, Kafka, Kinesis

Eligibility

3+ years of strong development experience in Scala and Spark

About Company

With 21+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Consumer Lending, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and Asia-Pacific.Powered by Artificial Intelligence and Machine Learning algorithms, we help our customers improve their operational efficiency, productivity, speed, and accuracy. Our suite of products and solutions are routinely rated high by the industry.Ours is a challenging workplace where teams are diverse, competitive, and continually searching for tomorrow's technology and brilliant minds to create it. And we don’t focus just on what we do – we also care how we do it. So, bring your talent and ambition to make a difference. We’ll create a world of opportunities for you.

Java spark developer - CREQ188182 Description

Position: Java spark developer

primary skills: Java , spark, big data

Location: Hyd & BLR

8+ years of IT experience in Bigdata tech stack (Java Spark, Hadoop, Hive)
Experience in writing SQL for any one relation database
Extensive knowledge in HiveSQL Hadoop, SQL
Expereience in DevOps process (CICD, Jira, Bitbucket)
Experience in Bigdata tech stack (Java Spark, Hadoop, Hive)
Expereience in DevOps process (CICD, Jira, Bitbucket)
Extensive knowledge in HiveSQL Hadoop, SQL

Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills Hadoop, PySpark, Hive Years of Experience 8 Qualification

Education qualification: Any degree or equivalent

Experience: 6+ years

Travel No

Develop, test, and deploy data processing applications using Apache Spark and Scala. 

Optimize and tune Spark applications for better performance on large-scale data sets. 

Work with the Cloudera Hadoop ecosystem (., HDFS, Hive, Impala, HBase, Kafka) to build data pipelines and storage solutions. 

Collaborate with data scientists, business analysts, and other developers to understand data requirements and deliver solutions. 

Design and implement high-performance data processing and analytics solutions. 

Ensure data integrity, accuracy, and security across all processing tasks. 

Troubleshoot and resolve performance issues in Spark, Cloudera, and related technologies. 

Implement version control and CI/CD pipelines for Spark applications. 

Required Skills & Experience:  

Minimum 8 years of experience in application development. 

Strong hands on experience in Apache Spark, Scala, and Spark SQL for distributed data processing. 

Hands-on experience with Cloudera Hadoop (CDH) components such as HDFS, Hive, Impala, HBase, Kafka, and Sqoop. 

Familiarity with other Big Data technologies, including Apache Kafka, Flume, Oozie, and Nifi. 

Experience building and optimizing ETL pipelines using Spark and working with structured and unstructured data. 

Experience with SQL and NoSQL databases such as HBase, Hive, and PostgreSQL. 

Knowledge of data warehousing concepts, dimensional modeling, and data lakes. 

Ability to troubleshoot and optimize Spark and Cloudera platform performance. 

Familiarity with version control tools like Git and CI/CD tools (., Jenkins, GitLab). 

The Applications Development Intermediate Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming testing activities. Integrates in-depth specialty area knowledge with a solid understanding of industry standards and practices. Good understanding of how the team and area integrate with others in accomplishing the objectives of the subfunction/ job family. Applies analytical thinking and knowledge of data analysis tools and methodologies. Quality and timeliness of service provided will affect the effectiveness of own team and other closely related teams.
**Responsibilities:**
+ Utilize knowledge of applications development testing procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
+ Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
+ Apply fundamental knowledge of programming languages for design specifications.
+ Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
+ Serve as advisor or coach to new or lower level analysts
+ Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
+ Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
+ Has the ability to operate with a limited level of direct supervision.
+ Can exercise independence of judgement and autonomy.
+ Acts as SME to senior stakeholders and /or other team members.
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
+ Conducts initiatives related to User Acceptance Testing (UAT) process and product rollout into production. Testing specialists who work with technology project managers, UAT professionals and users to design and implement appropriate scripts/plans for an application testing strategy/approach. Responsibilities may also include software quality assurance testing.Conducts a variety of tests and analyses to ensure that systems and or applications meet or exceed specified standards and end-user requirements.Works closely with key stakeholders to understand business and functional requirements to develop test plans, test cases and scripts.Works complex testing assignments.
**Qualifications:**
+ Design, code, test, document and implement application release projects as part of development team.
+ Minimum 4 years of proven project experience
+ **Should be hands-on with Spark 2.0 and above, Java 8 and above.**
+ **Should be good with Hive / Oracle, Unix Shell Scripting**
+ Should have experience on Spring Boot and Rest API
+ Good to have knowledge on Agile methodologies
+ Work with BA and understand all functional and technical requirements of the project.
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.

The Senior Python Spark Developer- VP is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.
Responsibilities:
+ Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
+ Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
+ Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
+ Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
+ Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
+ Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
+ Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
Qualifications:
+ Highly experienced and skilled senior py-spark developer with 8-12 years of experience with software building and platform engineering.
+ Extensive development expertise in building the highly scaled and performant software platforms for data computation and processing.
+ Strong computer science fundamentals in data structures, algorithms, databases and operating systems.
+ Strong analytical and logical skills.
+ Hands-on experience in writing SQL queries .
+ Experience with source code management tools such as Bitbucket, Git etc
+ Experience working with banking domain like pricing, risk etc is plus
+ CFA/FRM certification is plus.
+ Extensive experience system analysis and in programming of software applications
+ Experience in managing and implementing successful projects
+ Subject Matter Expert (SME) in at least one area of Applications Development
+ Ability to adjust priorities quickly as circumstances dictate
+ Demonstrated leadership and project management skills
+ Consistently demonstrates clear and concise written and verbal communication
Education:
+ Bachelor's degree/University degree or equivalent experience
+ Master's degree preferred
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.

We are looking for a seasoned Developer who is passionate in writing clean and efficient code, building scalable systems, driving engineering excellence in a fast-paced, Agile environment.
This role is ideal for developers with deep hands-on experience in Java and Apache Spark, combined with a strong foundation in object-oriented design principles.
**Responsibilities:**
+ Perform detailed impact analysis for code changes with understanding of dependencies across the application components
+ Design and develop scalable, high-performance code using Java and Bigdata / Java Spark
+ Write high-quality, maintainable code that is modular, testable, and adheres to SOLID principles and industry-standard design patterns.
+ Write robust unit tests using JUnit, with a focus on code coverage, business logic, readability and reusability.
+ Perform code reviews to ensure the code follows clean design / architecture and best engineering practices.
+ Operate in an environment of ownership and accountability, where quality and collaboration are core values
+ Mentor a junior developers and guide them through technical challenges
+ Work in a cross-functional Agile team, participate in daily stand-ups, sprint planning, retrospectives, and backlog grooming.
+ Translate user stories into technical tasks and drive timely, high-quality delivery of solutions.
+ Collaborate closely with Senior developers, Architects, Quality Engineers, DevOps, and Product owners to deliver high-quality code at speed
**Qualifications:**
+ 7+ years of development experience with hands-on experience in Java, Bigdata / Java Spark, object-oriented programming (OOP)
+ Experience with REST APIs, RDBMS database, and Kafka messaging systems
+ Exposure to microservices architecture and containerization tools (Docker, Kubernetes)
+ Proven experience leading teams and mentoring developers in a fast-paced development environment.
+ Strong understanding of software development lifecycle (SDLC) and Agile methodologies
+ Excellent communication skills and ability to work effectively in cross-functional teams
**Education:**
+ Bachelor's degree/University degree or equivalent experience
+ Master's degree preferred
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.

We are looking for a seasoned Developer who is passionate in writing clean and efficient code, building scalable systems, driving engineering excellence in a fast-paced, Agile environment.

This role is ideal for developers with deep hands-on experience in Java and Apache Spark, combined with a strong foundation in object-oriented design principles.

Responsibilities:

Perform detailed impact analysis for code changes with understanding of dependencies across the application components

Design and develop scalable, high-performance code using Java and Bigdata / Java Spark

Write high-quality, maintainable code that is modular, testable, and adheres to SOLID principles and industry-standard design patterns.

Write robust unit tests using JUnit, with a focus on code coverage, business logic, readability and reusability.

Perform code reviews to ensure the code follows clean design / architecture and best engineering practices.

Operate in an environment of ownership and accountability, where quality and collaboration are core values

Mentor a junior developers and guide them through technical challenges

Work in a cross-functional Agile team, participate in daily stand-ups, sprint planning, retrospectives, and backlog grooming.

Translate user stories into technical tasks and drive timely, high-quality delivery of solutions.

Collaborate closely with Senior developers, Architects, Quality Engineers, DevOps, and Product owners to deliver high-quality code at speed

Qualifications:

7+ years of development experience with hands-on experience in Java, Bigdata / Java Spark, object-oriented programming (OOP)

Experience with REST APIs, RDBMS database, and Kafka messaging systems

Exposure to microservices architecture and containerization tools (Docker, Kubernetes)

Proven experience leading teams and mentoring developers in a fast-paced development environment.

Strong understanding of software development lifecycle (SDLC) and Agile methodologies

Excellent communication skills and ability to work effectively in cross-functional teams

Education:

Bachelor's degree/University degree or equivalent experience

Master’s degree preferred

---

Job Family Group:

Technology

---

Job Family:

Applications Development

---

Time Type:

Full time

---

Most Relevant Skills

Please see the requirements listed above.

---

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

---

The Senior Python Spark Developer- VP is a senior level position responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to lead applications systems analysis and programming activities.

Responsibilities:

Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements

Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards

Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint

Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation

Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals

Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions

Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary

Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.

Qualifications:

Highly experienced and skilled senior py-spark developer with 8-12 years of experience with software building and platform engineering.

Extensive development expertise in building the highly scaled and performant software platforms for data computation and processing.

Strong computer science fundamentals in data structures, algorithms, databases and operating systems.

Strong analytical and logical skills.

Hands-on experience in writing SQL queries .

Experience with source code management tools such as Bitbucket, Git etc

Experience working with banking domain like pricing, risk etc is plus

CFA/FRM certification is plus.

Extensive experience system analysis and in programming of software applications

Experience in managing and implementing successful projects

Subject Matter Expert (SME) in at least one area of Applications Development

Ability to adjust priorities quickly as circumstances dictate

Demonstrated leadership and project management skills

Consistently demonstrates clear and concise written and verbal communication

Education:

Bachelor’s degree/University degree or equivalent experience

Master’s degree preferred

---

Job Family Group:

Technology

---

Job Family:

Applications Development

---

Time Type:

Full time

---

Most Relevant Skills

Please see the requirements listed above.

---

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

---