23,392 Spark jobs in India

Spark Developer

Mumbai, Maharashtra ₹104000 - ₹1308780 Y Xoriant

Posted today

Job Viewed

Tap Again To Close

Job Description

Role Overview

We are seeking a hands-on Scala Developer with expertise in big data platforms to design, build, and optimize scalable technology solutions for financial crime controls. You will contribute to transaction monitoring, customer activity reviews, scenario optimization, and related transformation initiatives.

This role involves close collaboration with senior stakeholders and global development teams to define, influence, and implement next-generation solutions that meet both business needs and regulatory requirements.

Key Responsibilities

Design and implement tactical and strategic solutions to address business challenges.

Collaborate with stakeholders to understand business requirements and translate them into technology solutions.

Prepare technical design documents and solution artifacts in line with Agile (SCRUM) practices.

Conduct data analysis to support development, business, and testing needs.

Develop, test, and optimize high-quality Scala/Spark code.

Perform unit testing using automated BDD frameworks and support regression testing and UAT.

Ensure solutions follow firm standards for automated release and DevOps practices.

Work collaboratively with global FCT & NFRT teams to deliver consistent, scalable solutions.

Required Skills

5+ years of hands-on experience as a Scala/Spark developer.

Strong SQL expertise with RDBMS (DB2 preferred).

Proven ability to optimize code for performance, scalability, and configurability.

2+ years experience in HDFS platform development projects.

Proficiency in data analysis, data profiling, and data lineage.

Strong communication skills (oral and written).

Experience working in Agile/SCRUM environments.

Desired Skills

Familiarity with Actimize ACTONE platform.

Experience with Azure cloud implementations.

Knowledge of Behavior-Driven Development (BDD).

Big Data technology certifications.

Exposure to machine learning and predictive analytics.

This advertiser has chosen not to accept applicants from your region.

Spark Developer

Chennai, Tamil Nadu ₹90000 - ₹120000 Y Citi

Posted today

Job Viewed

Tap Again To Close

Job Description

ETL Developer will be responsible for designing, implementing, and optimizing distributed data processing jobs to handle large-scale data in Hadoop Distributed File System(HDFS) using Apache Spark and Python. This role required deep understanding of data engineering principles, proficiency in Python and hands-on experience with Spark and Hadoop ecosystems. Developer will collaborate with data engineers, analysts, and business stakeholders to process, transform and drive insights and data driven decisions.

Responsibilities:

  • Data Processing and Transformation:

Design and Implement of Spark applications to process and transform large datasets in HDFS.

Develop ETL Pipelines in Spark using Python for data Ingestion, cleaning, aggregation, and transformations.

Performance Optimization:

Optimize Spark jobs for efficiency, reducing run time and resource usage.

Finetune memory management, caching, and partitioning strategies for Optimal performance

Data Engineering with Hadoop and Spark:

Load data from different sources into HDFS, ensuring data accuracy and integrity.

Integrate Spark Applications with Hadoop frameworks like Hive, Sqoop etc.

Testing and debugging:

Troubleshoot and debug Spark Job failures, monitor job logs, and Spark UI to Identify Issues.

Qualifications:

  • 2-5 years of relevant experience
  • Experience in programming/debugging used in business applications
  • Working knowledge of industry practice and standards
  • Comprehensive knowledge of specific business area for application development
  • Working knowledge of program languages
  • Consistently demonstrates clear and concise written and verbal communication
  • Expertise in handling complex large-scale Warehouse environments
  • Hands-on experience writing complex SQL queries, exporting and importing large amounts of data using utilities

Education:

  • Bachelor's degree in a quantitative field (such as Engineering, Computer Science) or equivalent experience

This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.

-

Job Family Group:

Technology

-

Job Family:

Applications Development

-

Time Type:

Full time

-

Most Relevant Skills

Please see the requirements listed above.

-

Other Relevant Skills

For complementary skills, please see above and/or contact the recruiter.

-

Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law.

If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review Accessibility at Citi .

View Citi's EEO Policy Statement and the Know Your Rights poster.

This advertiser has chosen not to accept applicants from your region.

Spark Developer

Hyderabad, Andhra Pradesh ₹1200000 - ₹3600000 Y Infosys

Posted today

Job Viewed

Tap Again To Close

Job Description

Educational Requirements

Bachelor of Engineering

Service Line

Data & Analytics Unit

Responsibilities

A day in the life of an Infoscion- As part of the Infosys consulting team, your primary role would be to get to the heart of customer issues, diagnose problem areas, design innovative solutions and facilitate deployment resulting in client delight.
- You will develop a proposal by owning parts of the proposal document and by giving inputs in solution design based on areas of expertise.
- You will plan the activities of configuration, configure the product as per the design, conduct conference room pilots and will assist in resolving any queries related to requirements and solution design
- You will conduct solution/product demonstrations, POC/Proof of Technology workshops and prepare effort estimates which suit the customer budgetary requirements and are in line with organizations financial guidelines
- Actively lead small projects and contribute to unit-level and organizational initiatives with an objective of providing high quality value adding solutions to customers. If you think you fit right in to help our clients navigate their next in their digital transformation journey, this is the place for you

Additional Responsibilities:

  • Ability to develop value-creating strategies and models that enable clients to innovate, drive growth and increase their business profitability
  • Good knowledge on software configuration management systems
  • Awareness of latest technologies and Industry trends
  • Logical thinking and problem solving skills along with an ability to collaborate
  • Understanding of the financial processes for various types of projects and the various pricing models available
  • Ability to assess the current processes, identify improvement areas and suggest the technology solutions
  • One or two industry domain knowledge
  • Client Interfacing skills
  • Project and Team management

Technical and Professional Requirements:

  • Primary skills:Technology->Big Data - Data Processing->Spark

Preferred Skills:

Technology->Big Data - Data Processing->Spark

This advertiser has chosen not to accept applicants from your region.

Python Spark Developer

Chennai, Tamil Nadu ₹1500000 - ₹2500000 Y Rarr Technologies

Posted today

Job Viewed

Tap Again To Close

Job Description

Well versed with:

  • Very good proficiency in Python and Spark programming.
  • Pandas: Experience with data manipulation and analysis using Pandas.
  • Implementation experience of Spark Core, Spark SQL and Spark Streaming
  • Working with Spark in combination Hadoop Ecosystem
  • Design and implementation of low-latency, high-availability, and performance applications.
  • Should lead and guide a team of junior Python developers.
  • As Sr Python Developer responsibilities include coding, testing, debugging, and troubleshooting throughout the application development process.
  • Performance tuning, improvement, balancing, usability, and automation.
  • Collaborate with other team members and stakeholders.

Educational Qualification

  • Proficiency in Python programming.
  • Experience with Pandas for data manipulation and analysis.
  • Knowledge of Polars for efficient data processing.
  • Strong problem-solving skills and attention to detail.
  • Ability to work collaboratively in a team environment
This advertiser has chosen not to accept applicants from your region.

Java/ Spark Developer

Chennai, Tamil Nadu ₹104000 - ₹130878 Y Path Mentors Staffing Solution

Posted today

Job Viewed

Tap Again To Close

Job Description

Translate use cases into functional apps; design, build, and optimize Java/Spark code; identify bottlenecks and fix bugs; process data with Hive, Impala, HBASE. Skills: 8+ yrs Java, Big Data (HDFS, Spark, Kafka), SQL, multithreading, Agile, Git.

Required Candidate profile

Java/Spark Developer with 5+ years' experience in Big Data, HDFS, Hive, Kafka, SQL, and multithreading. Proficient in Agile, Git, and performance optimization with strong problem-solving skills.

This advertiser has chosen not to accept applicants from your region.

java + spark developer

₹750000 - ₹1500000 Y Infosys

Posted today

Job Viewed

Tap Again To Close

Job Description

Hiring Java + Spark Developer with experience range 5 to 15 Years of experience

Mandatory Skills: Java /Spark/ Pyspark/ Hadoop

Education: Btech/BE, BCA/MCA,Bsc/MSc

This advertiser has chosen not to accept applicants from your region.

Java Spark Developer

Pune, Maharashtra ₹90000 - ₹120000 Y Wipro

Posted today

Job Viewed

Tap Again To Close

Job Description

Java+Spark

  • Primary skill - Apache Spark Secondary skill - Java
  • Strong knowledge in Apache Spark framework Core Spark, Spark Data Frames, Spark streaming
  • Hands-on experience in any one of the programming languages (Java)
  • Good understanding of distributed programming concepts.
  • Experience in optimizing Spark DAG, and Hive queries on Tez
  • Experience using tools like Git, Autosys, Bitbucket, Jira
  • Ability to apply DWH principles within Hadoop environment and NoSQL databases.

Mandatory Skills: Apache Spark.Experience: 5-8 Years.

This advertiser has chosen not to accept applicants from your region.
Be The First To Know

About the latest Spark Jobs in India !

Scala Spark Developer

Chennai, Tamil Nadu ₹1250000 - ₹2500000 Y Path Mentors Staffing Solution

Posted today

Job Viewed

Tap Again To Close

Job Description

Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions

Required Candidate profile

Scala/Spark Developer with 5+ years' experience in building scalable data pipelines using Scala, Spark, Hadoop, Kafka. Skilled in SQL, NoSQL, HDFS, and optimizing big data processes for reliability.

This advertiser has chosen not to accept applicants from your region.

Senior Spark Developer

Mumbai, Maharashtra ₹1200000 - ₹3600000 Y BNP Paribas

Posted today

Job Viewed

Tap Again To Close

Job Description

The Senior Spark Tech Lead will be responsible for integrating and maintaining the Quantexa platform, a spark based software provided by a UK fintech, into our existing systems to enhance our anti-money laundering capabilities. This role requires a deep expertise in Spark development, as well as an ability to analyze and understand underlying data. Additionally, the candidate should have an interest in exploring open-source applications distributed by Apache, Kubernetes, OpenSearch and Oracle.

Should be able to work as a Scrum Master

Responsibilities

Direct Responsibilities

Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.

Develop and maintain Spark-based applications deployed on Kubernetes clusters.

Conduct data analysis to understand and interpret underlying data structures.

Collaborate with cross-functional teams to ensure seamless integration and functionality.

Stay updated with the latest trends and best practices in Spark development and Kubernetes.

Contributing Responsibilities

Taking complete ownership of project activities and understand each tasks in details.

Ensure that the team delivers on time without any delays and deliveries are of high quality standards.

Estimation, Planning and scheduling of the project. Ensure all internal timelines are respected and project is on track.

Work with team to develop robust software adhering to the timelines & following all the standard guidelines.

Act proactively to ensure smooth team operations and effective collaboration

Make sure team adheres to all compliance processes and intervene if required

Task assignment to the team and tracking until task completion

Proactive Status reporting to the management.

Identify Risks in the project and highlight to Manager.

Create Contingency and Backup planning as necessary. Create Mitigation Plan.

Take decision by own based on situation.

Play the role of mentor and coach team members as and when required to meet the target goals

Gain functional knowledge on applications worked upon

Create knowledge repositories for future reference.

Arrange knowledge sharing sessions to enhance team's functional capability.

Evaluation of new tools and coming with POCs.

Provide feedback of team to upper management on timely basis

Technical & Behavioral Competencies

Key Responsibilities

Integrate and upgrade the Quantexa tool with our existing systems for enhanced anti-money laundering measures.

Develop and maintain Spark-based applications deployed on Kubernetes clusters.

Conduct data analysis to understand and interpret underlying data structures.

Collaborate with cross-functional teams to ensure seamless integration and functionality.

Stay updated with the latest trends and best practices in Spark development and Kubernetes.

Required Qualifications

7+ Years of experience in development

Extensive experience in Hadoop, Spark, Scala development (5 years min).

Strong analytical skills and experience in data analysis (SQL), data processing (such as ETL), parsing, data mapping and handling real-life data quality issues.

Excellent problem-solving abilities and attention to detail.

Strong communication and collaboration skills.

Experience in Agile development.

High quality coding skill, incl. code control, unit testing, design, and documentation (code, test). Experience with tools such as sonar. Experience with GIT, Jenkins.

Specific Qualifications (if required)

Experience with development and deployment of spark application and deployment on Kubernetes clusters

Hands-on development experience (Java, Scala, etc.) via system integration projects, Python, Elastic (optional).

Skills Referential

Behavioural Skills : (Please select up to 4 skills)

Ability to collaborate / Teamwork

Adaptability

Creativity & Innovation / Problem solving

Attention to detail / rigor

Transversal Skills: (Please select up to 5 skills)

Analytical Ability

Ability to develop and adapt a process

Ability to develop and leverage networks

Choose an item.

Choose an item.

Education Level:

Bachelor Degree or equivalent

Experience Level

At least 7 years

Fluent in English

Team player

Strong analytical skills

Quality oriented and well organized

Willing to work under pressure and mission oriented

Excellent Oral and Written Communication Skills, Motivational Skills, Results-Oriented

This advertiser has chosen not to accept applicants from your region.

Scala Spark Developer

Pune, Maharashtra ₹900000 - ₹1200000 Y Path Mentors Staffing Solution

Posted today

Job Viewed

Tap Again To Close

Job Description

Scala/Spark Developer: 5+ yrs experience in designing scalable data pipelines with Scala, Spark, Hadoop, Kafka. Skilled in data formats(Avro,Parquet),HDFS, SQL, NoSQL. Proficient in troubleshooting, optimization, delivering reliable bigdata solutions

Required Candidate profile

Scala/Spark Developer with 5+ years' experience in building scalable data pipelines using Scala, Spark, Hadoop, Kafka. Skilled in SQL, NoSQL, HDFS, and optimizing big data processes for reliability.

This advertiser has chosen not to accept applicants from your region.
 

Nearby Locations

Other Jobs Near Me

Industry

  1. request_quote Accounting
  2. work Administrative
  3. eco Agriculture Forestry
  4. smart_toy AI & Emerging Technologies
  5. school Apprenticeships & Trainee
  6. apartment Architecture
  7. palette Arts & Entertainment
  8. directions_car Automotive
  9. flight_takeoff Aviation
  10. account_balance Banking & Finance
  11. local_florist Beauty & Wellness
  12. restaurant Catering
  13. volunteer_activism Charity & Voluntary
  14. science Chemical Engineering
  15. child_friendly Childcare
  16. foundation Civil Engineering
  17. clean_hands Cleaning & Sanitation
  18. diversity_3 Community & Social Care
  19. construction Construction
  20. brush Creative & Digital
  21. currency_bitcoin Crypto & Blockchain
  22. support_agent Customer Service & Helpdesk
  23. medical_services Dental
  24. medical_services Driving & Transport
  25. medical_services E Commerce & Social Media
  26. school Education & Teaching
  27. electrical_services Electrical Engineering
  28. bolt Energy
  29. local_mall Fmcg
  30. gavel Government & Non Profit
  31. emoji_events Graduate
  32. health_and_safety Healthcare
  33. beach_access Hospitality & Tourism
  34. groups Human Resources
  35. precision_manufacturing Industrial Engineering
  36. security Information Security
  37. handyman Installation & Maintenance
  38. policy Insurance
  39. code IT & Software
  40. gavel Legal
  41. sports_soccer Leisure & Sports
  42. inventory_2 Logistics & Warehousing
  43. supervisor_account Management
  44. supervisor_account Management Consultancy
  45. supervisor_account Manufacturing & Production
  46. campaign Marketing
  47. build Mechanical Engineering
  48. perm_media Media & PR
  49. local_hospital Medical
  50. local_hospital Military & Public Safety
  51. local_hospital Mining
  52. medical_services Nursing
  53. local_gas_station Oil & Gas
  54. biotech Pharmaceutical
  55. checklist_rtl Project Management
  56. shopping_bag Purchasing
  57. home_work Real Estate
  58. person_search Recruitment Consultancy
  59. store Retail
  60. point_of_sale Sales
  61. science Scientific Research & Development
  62. wifi Telecoms
  63. psychology Therapy
  64. pets Veterinary
View All Spark Jobs