2754 Spark jobs in Bengaluru

TCS is Hiring For Spark & Scala Developer

Job Location : Bangalore

Experience : 6 - 12 years

Must have skills :

• Must have 6+ years of IT experience
• Must have good experience in Spark and Scala
• Good to have experience instreaming systems like Spark streaming and Storm
• Experience with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance, Scalability
• Good knowledge of Hive, Sqoop, Spark, data warehousing and information management best practices
• Expertise in big data infrastructure , distributed systems, data modelling ,query processing and relational
• Experience with Scala - Object Orient Programming concepts (Singleton and Companion Object, Class, Case Class, File Handling and Multi threading), Collections (Array, String, Tuple, Set, List, Map), Pattern Matching.

Good to have skills :

• Excellent interpersonal, organizational, written communication, oral communication and listening skills
• Should come up with the work estimation and should provide inputs to managers on resource and risk planning.
• Strong knowledge and hands-on experience on Unix shell scripting
• Ability to coordinate with SMEs , stakeholders, manage timelines, escalation & provide on time status
• Understanding of No-SQL databases(Cassandra)

Wipro Limited (NYSE: WIT, BSE: , NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic portfolio of capabilities in consulting, design, engineering, and operations, we help clients realize their boldest ambitions and build future-ready, sustainable businesses. With over 230,000 employees and business partners across 65 countries, we deliver on the promise of helping our customers, colleagues, and communities thrive in an ever-changing world. For additional information, visit us at

Role Purpose

The purpose of this role is to design, test and maintain software programs for operating systems or applications which needs to be deployed at a client end and ensure its meet 100% quality assurance parameters

Essential Skills

Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.

Excellent Knowledge and hands-on experience of at least 4+ years in Scala and PySpark.

Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandator

Strong Unix and Shell Scripting Skill

Excellent Inter-personal skills and for experienced candidates' Excellent leadership skill

Mandatory for anyone to have Good knowledge of any of the CSPs like Azure,AWS or GCP; Certifications on Azure will be additional Plus

Essential Skills

Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.

Excellent Knowledge and hands-on experience of at least 4+ years in Scala and PySpark.

Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandator

Strong Unix and Shell Scripting Skill

Excellent Inter-personal skills and for experienced candidates' Excellent leadership skill

Mandatory for anyone to have Good knowledge of any of the CSPs like Azure,AWS or GCP; Certifications on Azure will be additional Plus

Deliver

No.

Performance Parameter

Measure

1.

Continuous Integration, Deployment & Monitoring of Software

100% error free on boarding & implementation, throughput %, Adherence to the schedule/ release plan

2.

Quality & CSAT

On-Time Delivery, Manage software, Troubleshoot queries, Customer experience, completion of assigned certifications for skill upgradation

3.

MIS & Reporting

100% on time MIS & report generation

Mandatory Skills: PySpark.

Experience: 3-5 Years.

Reinvent your world. We are building a modern Wipro. We are an end-to-end digital transformation partner with the boldest ambitions. To realize them, we need people inspired by reinvention. Of yourself, your career, and your skills. We want to see the constant evolution of our business and our industry. It has always been in our DNA - as the world around us changes, so do we. Join a business powered by purpose and a place that empowers you to design your own reinvention. Come to Wipro. Realize your ambitions. Applications from people with disabilities are explicitly welcome.

TCS is Hiring For Spark & Scala Developer

Job Location : Bangalore

Experience : 6 - 12 years

Must have skills :

• Must have 6+ years of IT experience
• Must have good experience in Spark and Scala
• Good to have experience instreaming systems like Spark streaming and Storm
• Experience with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance, Scalability
• Good knowledge of Hive, Sqoop, Spark, data warehousing and information management best practices
• Expertise in big data infrastructure , distributed systems, data modelling ,query processing and relational
• Experience with Scala - Object Orient Programming concepts (Singleton and Companion Object, Class, Case Class, File Handling and Multi threading), Collections (Array, String, Tuple, Set, List, Map), Pattern Matching.

Good to have skills :

• Excellent interpersonal, organizational, written communication, oral communication and listening skills
• Should come up with the work estimation and should provide inputs to managers on resource and risk planning.
• Strong knowledge and hands-on experience on Unix shell scripting
• Ability to coordinate with SMEs , stakeholders, manage timelines, escalation & provide on time status
• Understanding of No-SQL databases(Cassandra)

TCS is Hiring For Spark & Scala Developer

Job Location : Bangalore

Experience : 6 - 12 years

Must have skills :

• Must have 6+ years of IT experience
• Must have good experience in Spark and Scala
• Good to have experience instreaming systems like Spark streaming and Storm
• Experience with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance, Scalability
• Good knowledge of Hive, Sqoop, Spark, data warehousing and information management best practices
• Expertise in big data infrastructure , distributed systems, data modelling ,query processing and relational
• Experience with Scala - Object Orient Programming concepts (Singleton and Companion Object, Class, Case Class, File Handling and Multi threading), Collections (Array, String, Tuple, Set, List, Map), Pattern Matching.

Good to have skills :

• Excellent interpersonal, organizational, written communication, oral communication and listening skills
• Should come up with the work estimation and should provide inputs to managers on resource and risk planning.
• Strong knowledge and hands-on experience on Unix shell scripting
• Ability to coordinate with SMEs , stakeholders, manage timelines, escalation & provide on time status
• Understanding of No-SQL databases(Cassandra)

TCS is Hiring For Spark & Scala Developer

Job Location : Bangalore

Experience : 6 - 12 years

Must have skills :

• Must have 5+ years of IT experience
• Must have good experience in Spark and Scala
• Good to have experience instreaming systems like Spark streaming and Storm
• Expereicne with Spark Data processing, Performance Tuning, Memory Management, Fault Tolerance, Scalability
• Good knowledge of Hive,Sqoop,Spark, data warehousing and information management best practices
• Expertise in big data infrastructure , distributed systems, data modelling ,query processing and relational
• Experience with Scala - Object Orient Programming concepts (Singleton and Companion Object, Class, Case Class, File Handling and Multi threading), Collections (Array, String, Tuple, Set, List, Map), Pattern Matching.

Good to have skills :

• Excellent interpersonal, organizational, written communication, oral communication and listening skills
• Should come up with the work estimation and should provide inputs to managers on resource and risk planning.
• Strong knowledge and hands-on experience on Unix shell scripting
• Ability to coordinate with SMEs , stakeholders, manage timelines, escalation & provide on time status
• Understanding of No-Sql databases(Cassandra)

Role - Spark / Scala Data Engineer

Experience - 8 to 10 yrs

Location - Bangalore/Chennai/Hyderabad/Delhi/Pune

Must Have- Big Data Hadoop - Hive and Spark/Scala solid experience- SQL advance knowledge - Been able to test changes and issues properly, replicating the code functionality into SQL- Worked with Code Repositories as GIT, Maven, .- DevOps Knowledge (Jenkins, Scripts, .) - Tools used for deploying software into environments, use of Jira.Good to have:- Analyst Skills - Being able to translate technical requirements to non-technical partners and to deliver clear solutions. Been able to create test cases scenarios.- Control-m solid experience - Been able to create jobs, modify parameters- Documentation - Experience of carrying out data and process analysis to create specifications documents- Finance Knowledge - Have a experience working in Financial Services / Banking organization with an understanding of Financial Services / Retail, Business and Corporate Banking- AWS knowledge- Unix / Linux

Proficiency in both Scala and Python

Profile:- Scala with Functional Programming, python ( Java is second option)

Exp.:- 4+ Years of Experience Scala ( 2+ years experienced in data engineering, python, scala)

Skills :-

Mandatory:- Scala, Play Framework, Slick, PostgreSQL, python, Spark (Basic), Akka (Basic), REST API, Microservices

Good to have:- AWS, Kubernetes (K8s), Oozie, Hive

Versed with Agile Process and JIRA

Job Overview

Designs/develops software solutions requiring general domain knowledge and developing business experience.

Analyzes user requirements/needs and makes decisions within limited parameters under regular supervision.

Essential Functions

Designs/develops software solutions requiring general domain knowledge and developing business experience.

Works at all layers of the application stack including front-end user interface and backend development.

Analyzes user requirements/needs and makes decisions within limited parameters under regular supervision. Build and optimize RESTful APIs and microservices using the Play Framework.

Implement and manage database access with Slick and relational databases like PostgreSQL, ensuring efficient query performance.

Collaborate on distributed data processing pipelines using Apache Spark (basic level) and integrate with batch/stream processing frameworks.

Develop concurrent and distributed systems leveraging Akka (basic level).

Supports and may lead projects within own organization with limited complexity, including the development of small to medium size system components.

Has broad understanding of quality standards and work requires minimal revision.

Reviews functional specifications and other validation deliverables as assigned.

Provides peer support and helps on-board new Associate Software Engineers to the team.

Ensure code quality, robustness, scalability, and security in high-performance production environments.

Collaborate closely with cross-functional teams to deliver end-to-end solutions in Agile (Scrum/Kanban) processes using JIRA.

Participate in design discussions, code reviews, and contribute to continuous improvement of system architecture.

Write unit tests, integration tests, and maintain high standards for software reliability and maintainability.

Good to Have

Experience with AWS cloud services for deployment and scaling.

Exposure to containerization and orchestration tools like Docker and Kubernetes (K8s).

Familiarity with big data ecosystem tools like Hive and Oozie.

Understanding of DevOps practices and modern CI/CD pipelines.

Basic knowledge or hands-on experience with frontend development using for UI integration.

Key Requirements

4+ years of professional experience in software development with strong expertise in Scala and functional programming concepts.

Proficiency in Play Framework, Slick, PostgreSQL, and hands-on experience building and maintaining REST APIs and microservices.

Basic working knowledge of Apache Spark and Akka for distributed and concurrent application development.

Strong understanding of software engineering fundamentals including data structures, algorithms, and system design.

Familiarity with Agile development practices and collaboration tools such as JIRA.

Good communication, problem-solving, and collaboration skills with ability to work across teams.

Qualifications

• Bachelor's Degree Computer Science, a related field, or equivalent experience

IQVIA is a leading global provider of clinical research services, commercial insights and healthcare intelligence to the life sciences and healthcare industries. We create intelligent connections to accelerate the development and commercialization of innovative medical treatments to help improve patient outcomes and population health worldwide . Learn more