1901 Spark jobs in Bengaluru

Spark/Scala Developer

Bengaluru, Karnataka Maneva Consulting Pvt. Ltd

Posted today

Job Viewed

Tap Again To Close

Job Description

Greetings from Maneva!

Job Description

Job Title - Spark/Scala Developer

Experience - 7 -15 Years

Location - Bangalore

Notice - Immediate to 15 days

Requirements:-

  • Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.
  • Excellent Knowledge and hands-on experience of at least 4+ years in Spark And Scala.
  • Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory
  • Strong Unix and Shell Scripting Skills.
  • Excellent Inter-personal skills and for experienced candidates’ Excellent leadership skills.
  • Mandatory for anyone to have Good knowledge of any of the CSPs like Azure, AWS or GCP; Certifications on Azure will be additional plus.

If you are excited to grab this opportunity, please apply directly or share your CV at   and 

This advertiser has chosen not to accept applicants from your region.

Spark/Scala Developer

560002 Bangalore City, Karnataka Maneva Consulting Pvt. Ltd

Posted 13 days ago

Job Viewed

Tap Again To Close

Job Description

Permanent

Greetings from Maneva!

Job Description

Job Title - Spark/Scala Developer

Experience - 7 -15 Years

Location - Bangalore

Notice - Immediate to 15 days

Requirements:-

  • Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc.
  • Excellent Knowledge and hands-on experience of at least 4+ years in Spark And Scala.
  • Excellent Knowledge of the Hadoop eco System- Knowledge of Hive mandatory
  • Strong Unix and Shell Scripting Skills.
  • Excellent Inter-personal skills and for experienced candidates’ Excellent leadership skills.
  • Mandatory for anyone to have Good knowledge of any of the CSPs like Azure, AWS or GCP; Certifications on Azure will be additional plus.

If you are excited to grab this opportunity, please apply directly or share your CV at   and 

This advertiser has chosen not to accept applicants from your region.

Big Data Spark

Bengaluru, Karnataka Anicalls (Pty) Ltd

Posted today

Job Viewed

Tap Again To Close

Job Description

• 2 to 5 years hands-on Experience on Spark Core, Spark-SQL, Scala-Programming, and Streaming datasets in Big Data platform
• Should have extensive working experience in Hive and other components of the Hadoop ecosystem (HBase, Zookeeper, Kafka, and Flume)
• Should be able to understand the complex transformation logic and translate them to Spark-SQL queries.
• Unix Shell Scripting and setting up CRON
• Familiar with Data Warehouse concepts and Change Data Capture (CDC and SCD Types)
• Should have worked on Cloudera distribution framework, Oozie Workflow (or any Scheduler), Jenkins (or any version controller).
• Prior Experience in Consumer Banking Domain is an advantage.
• Prior Experience in the agile delivery method is an advantage.
• Excellent understanding of technology life cycles and the concepts and practices required to build big data solutions
• Core Java skillset is an added advantage. Airflow is an added advantage.
• Good Knowledge and Experience in any database (Teradata or Data Lake or Oracle or SQL Server) is a plus.
This advertiser has chosen not to accept applicants from your region.

Big Data Developer (Spark/Scala + Python)

Bellandur, Karnataka Synechron

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Summary

Synechron is seeking an experienced Big Data Developer with strong expertise in Spark, Scala, and Python to lead and contribute to large-scale data projects. The role involves designing, developing, and implementing robust data solutions that leverage emerging technologies to enhance business insights and operational efficiency. The successful candidate will play a key role in driving innovation, mentoring team members, and ensuring the delivery of high-quality data products aligned with organizational objectives.

Software Requirements

  • Required: Apache Spark (latest stable version)Scala (version 2.12 or higher)Python (version 3.6 or higher)Big Data tools and frameworks supporting Spark and Scala
  • Preferred: Cloud platforms such as AWS, Azure, or GCP for data deploymentData processing or orchestration tools like Kafka, Hadoop, or AirflowData visualization tools for data insights
  • Overall Responsibilities

  • Lead the development and implementation of data pipelines and solutions using Spark, Scala, and Python
  • Collaborate with business and technology teams to understand data requirements and translate them into scalable solutions
  • Mentor and guide junior team members on best practices in big data development
  • Evaluate and recommend new technologies and tools to improve data processing and quality
  • Stay informed about industry trends and emerging technologies relevant to big data and analytics
  • Ensure timely delivery of data projects with high standards of quality, performance, and security
  • Lead technical reviews, code reviews, and provide inputs to improve overall development standards and practices
  • Contribute to architecture design discussions and assist in establishing data governance standards
  • Technical Skills (By Category)

    Programming Languages:

  • Essential: Spark (Scala), Python
  • Preferred: Knowledge of Java or other JVM languages
  • Data Management & Databases:

  • Experience with distributed data storage solutions (HDFS, S3, etc.)
  • Familiarity with NoSQL databases (e.g., Cassandra, HBase) and relational databases for data integration
  • Cloud Technologies:

  • Preferred: Cloud platforms (AWS, Azure, GCP) for data processing, storage, and deployment
  • Frameworks & Libraries:

  • Spark MLlib, Spark SQL, Spark Streaming
  • Data processing libraries in Python (pandas, PySpark)
  • Development Tools & Methodologies:

  • Version control (Git, Bitbucket)
  • Agile methodologies (Scrum, Kanban)
  • Data pipeline orchestration tools (Apache Airflow, NiFi)
  • Security & Compliance:

  • Understanding of data security best practices and data privacy regulations
  • Experience Requirements

  • 5 to 10 years of hands-on experience in big data development and architecture
  • Proven experience in designing and developing large-scale data pipelines using Spark, Scala, and Python
  • Demonstrated ability to lead technical projects and mentor team members
  • Experience working with cross-functional teams including data analysts, data scientists, and business stakeholders
  • Track record of delivering scalable, efficient, and secure data solutions in complex environments
  • Day-to-Day Activities

  • Develop, test, and optimize scalable data pipelines using Spark, Scala, and Python
  • Collaborate with data engineers, analysts, and stakeholders to gather requirements and translate into technical solutions
  • Lead code reviews, mentor junior team members, and enforce coding standards
  • Participate in architecture design and recommend best practices in big data development
  • Monitor data workflows performance and troubleshoot issues to ensure data quality and reliability
  • Stay updated with industry trends and evaluate new tools and frameworks for potential implementation
  • Document technical designs, data flows, and implementation procedures
  • Contribute to continuous improvement initiatives to optimize data processing workflows
  • Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
  • Relevant certifications in cloud platforms, big data, or programming languages are advantageous
  • Continuous learning on innovative data technologies and frameworks
  • Professional Competencies

  • Strong analytical and problem-solving skills with a focus on scalable data solutions
  • Leadership qualities with the ability to guide and mentor team members
  • Excellent communication skills to articulate technical concepts to diverse audiences
  • Ability to work collaboratively in cross-functional teams and fast-paced environments
  • Adaptability to evolving technologies and industry trends
  • Strong organizational skills for managing multiple projects and priorities
  • Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


    All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

    This advertiser has chosen not to accept applicants from your region.

    Big Data Developer (Spark/Scala + Python)

    Bengaluru, Karnataka Synechron

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Job Summary

    Synechron is seeking an experienced Big Data Developer with strong expertise in Spark, Scala, and Python to lead and contribute to large-scale data projects. The role involves designing, developing, and implementing robust data solutions that leverage emerging technologies to enhance business insights and operational efficiency. The successful candidate will play a key role in driving innovation, mentoring team members, and ensuring the delivery of high-quality data products aligned with organizational objectives.

    Software Requirements

  • Required: Apache Spark (latest stable version)Scala (version 2.12 or higher)Python (version 3.6 or higher)Big Data tools and frameworks supporting Spark and Scala
  • Preferred: Cloud platforms such as AWS, Azure, or GCP for data deploymentData processing or orchestration tools like Kafka, Hadoop, or AirflowData visualization tools for data insights
  • Overall Responsibilities

  • Lead the development and implementation of data pipelines and solutions using Spark, Scala, and Python
  • Collaborate with business and technology teams to understand data requirements and translate them into scalable solutions
  • Mentor and guide junior team members on best practices in big data development
  • Evaluate and recommend new technologies and tools to improve data processing and quality
  • Stay informed about industry trends and emerging technologies relevant to big data and analytics
  • Ensure timely delivery of data projects with high standards of quality, performance, and security
  • Lead technical reviews, code reviews, and provide inputs to improve overall development standards and practices
  • Contribute to architecture design discussions and assist in establishing data governance standards
  • Technical Skills (By Category)

    Programming Languages:

  • Essential: Spark (Scala), Python
  • Preferred: Knowledge of Java or other JVM languages
  • Data Management & Databases:

  • Experience with distributed data storage solutions (HDFS, S3, etc.)
  • Familiarity with NoSQL databases (e.g., Cassandra, HBase) and relational databases for data integration
  • Cloud Technologies:

  • Preferred: Cloud platforms (AWS, Azure, GCP) for data processing, storage, and deployment
  • Frameworks & Libraries:

  • Spark MLlib, Spark SQL, Spark Streaming
  • Data processing libraries in Python (pandas, PySpark)
  • Development Tools & Methodologies:

  • Version control (Git, Bitbucket)
  • Agile methodologies (Scrum, Kanban)
  • Data pipeline orchestration tools (Apache Airflow, NiFi)
  • Security & Compliance:

  • Understanding of data security best practices and data privacy regulations
  • Experience Requirements

  • 5 to 10 years of hands-on experience in big data development and architecture
  • Proven experience in designing and developing large-scale data pipelines using Spark, Scala, and Python
  • Demonstrated ability to lead technical projects and mentor team members
  • Experience working with cross-functional teams including data analysts, data scientists, and business stakeholders
  • Track record of delivering scalable, efficient, and secure data solutions in complex environments
  • Day-to-Day Activities

  • Develop, test, and optimize scalable data pipelines using Spark, Scala, and Python
  • Collaborate with data engineers, analysts, and stakeholders to gather requirements and translate into technical solutions
  • Lead code reviews, mentor junior team members, and enforce coding standards
  • Participate in architecture design and recommend best practices in big data development
  • Monitor data workflows performance and troubleshoot issues to ensure data quality and reliability
  • Stay updated with industry trends and evaluate new tools and frameworks for potential implementation
  • Document technical designs, data flows, and implementation procedures
  • Contribute to continuous improvement initiatives to optimize data processing workflows
  • Qualifications

  • Bachelor’s or Master’s degree in Computer Science, Information Technology, or a related field
  • Relevant certifications in cloud platforms, big data, or programming languages are advantageous
  • Continuous learning on innovative data technologies and frameworks
  • Professional Competencies

  • Strong analytical and problem-solving skills with a focus on scalable data solutions
  • Leadership qualities with the ability to guide and mentor team members
  • Excellent communication skills to articulate technical concepts to diverse audiences
  • Ability to work collaboratively in cross-functional teams and fast-paced environments
  • Adaptability to evolving technologies and industry trends
  • Strong organizational skills for managing multiple projects and priorities
  • Diversity & Inclusion are fundamental to our culture, and Synechron is proud to be an equal opportunity workplace and is an affirmative action employer. Our Diversity, Equity, and Inclusion (DEI) initiative ‘Same Difference’ is committed to fostering an inclusive culture – promoting equality, diversity and an environment that is respectful to all. We strongly believe that a diverse workforce helps build stronger, successful businesses as a global company. We encourage applicants from across diverse backgrounds, race, ethnicities, religion, age, marital status, gender, sexual orientations, or disabilities to apply. We empower our global workforce by offering flexible workplace arrangements, mentoring, internal mobility, learning and development programs, and more.


    All employment decisions at Synechron are based on business needs, job requirements and individual qualifications, without regard to the applicant’s gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law.

    This advertiser has chosen not to accept applicants from your region.

    Snowflake, Spark

    Bengaluru, Karnataka Talent Worx

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Talent Worx is thrilled to announce an exciting opportunity for the roles of Snowflake and Spark Developers! Join us in revolutionizing the data analytics landscape as we partner with one of the Big 4 firms in India.

    What impact will you make?

    Your contributions will play a vital role in shaping our clients' success stories by utilizing innovative technologies and frameworks. Envision a dynamic culture that supports inclusion, collaboration, and exceptional performance. With us, you will discover unrivaled opportunities to accelerate your career and achieve your goals.

    The Team

    In our Analytics & Cognitive (A&C) practice, you will find a dedicated team committed to unlocking the value hidden within large datasets. Our globally-connected network ensures that our clients gain actionable insights that support fact-driven decision-making, leveraging advanced techniques including big data, cloud computing, cognitive capabilities, and machine learning.

    Work you will do

    As a key player in our organization, you will contribute directly to enhancing our clients’ competitive positioning and performance with innovative and sustainable solutions. We expect you to collaborate closely with our teams and clients to deliver outstanding results across various projects.

    Requirements

    • 5+years of relevant experience in Spark and Snowflake with practical experience in at least one project implementation.
    • Strong experience in developing ETL pipelines and data processing workflows using Spark.
    • Expertise in Snowflake architecture, including data loading and unloading processes, table structures, and virtual warehouses.
    • Proficiency in writing complex SQL queries in Snowflake for data transformation and analysis.
    • Experience with data integration tools and techniques, ensuring the seamless ingestion of data.
    • Familiarity with building and monitoring data pipelines in a cloud environment.
    • Exposure to Agile methodology and tools like Jira and Confluence.
    • Strong analytical and problem-solving skills, with meticulous attention to detail.
    • Excellent communication and interpersonal skills to foster collaborations with clients and team members.
    • Ability to travel as required by project demands.

    Qualifications

    • Snowflake certification or equivalent qualification is a plus.
    • Prior experience working with both Snowflake and Spark in a corporate setting.
    • Formal education in Computer Science, Information Technology, or a related field.
    • Proven track record of working with cross-functional teams.

    Benefits

    Work with one of the Big 4's in India

    Healthy work Environment

    Work Life Balance

    This advertiser has chosen not to accept applicants from your region.

    Sr. Spark Analyst

    Bengaluru, Karnataka Anicalls (Pty) Ltd

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Candidate should be able to:
    Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc.
    open to receiving feedback and constructive criticism.
    Proficiency working with large data stores
    understanding of Test Driven Development (TDD) or Pair Programming
    Candidate should have:
    Deep understanding of all aspects of database technologies - schema design, optimization, scalability, etc.
    Excellent communication skills
    passion for resolving user pain points through great design.
    Track record of contributions to open-source software projects.
    Experience in SDLC, especially testing and deployment.
    Professional ETL experience using Spark (Python or Scala)
    Experience in Software version control (e.g. git working knowledge or greater)
    Experience in Unix-like operating system environment (proficient)
    3+ years of CI/CD experience (Jenkins, Terraform, Cloud Formation, etc.)
    4+ years of experience designing technical solutions using object-oriented design concepts.
    3+ years of AWS solution engineering and architecture experience
    This advertiser has chosen not to accept applicants from your region.
    Be The First To Know

    About the latest Spark Jobs in Bengaluru !

    Big Data Engineer (Scala + Spark)

    Bengaluru, Karnataka Xebia

    Posted 7 days ago

    Job Viewed

    Tap Again To Close

    Job Description

    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer (Scala + Spark)

    Bengaluru, Karnataka Xebia

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    We’re Hiring – Big Data Engineer (Scala + Spark)

    Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)

    Budget: Up to 30 LPA

    Availability: Immediate to Max 2 Weeks Notice

    Must Have Skills:

    • Scala & Spark (Mandatory)
    • Big Data & Hadoop Ecosystem
    • Hive, Kafka, Oozie
    • Python
    • Data Structures & Algorithms
    • Design & Coding Skills
    • CI/CD Pipelines
    • Problem Solving & Communication Skills
    • Strong Organizational Skills

    Nice to Have:

    • Experience in distributed data processing & performance optimization

    Why Join Us?

    At Xebia, you’ll be part of a high-performance engineering team solving challenging data problems for global clients. We value innovation, ownership, and continuous learning.

    How to Apply:

    Send your updated CV to with the below details:

    • Full Name
    • Total Experience
    • Current CTC
    • Expected CTC
    • Current Location
    • Preferred Xebia Location (from above)
    • Notice Period / Last Working Day (if serving)
    • Primary Skills
    • LinkedIn Profile
    This advertiser has chosen not to accept applicants from your region.

    Big data engineer (scala + spark)

    Bengaluru, Karnataka Xebia

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    ? We’re Hiring – Big Data Engineer (Scala + Spark)? Location: Bangalore – Whitefield (Hybrid: 3 Days Office / Week)? Budget: Up to 30 LPA? Availability: Immediate to Max 2 Weeks NoticeMust Have Skills:Scala & Spark (Mandatory)Big Data & Hadoop EcosystemHive, Kafka, OoziePythonData Structures & AlgorithmsDesign & Coding SkillsCI/CD PipelinesProblem Solving & Communication SkillsStrong Organizational SkillsNice to Have:Experience in distributed data processing & performance optimizationWhy Join Us?At Xebia, you’ll be part of a high-performance engineering team solving challenging data problems for global clients. We value innovation, ownership, and continuous learning? How to Apply:Send your updated CV to with the below details:Full NameTotal ExperienceCurrent CTCExpected CTCCurrent LocationPreferred Xebia Location (from above)Notice Period / Last Working Day (if serving)Primary Skills Profile

    This advertiser has chosen not to accept applicants from your region.
     

    Nearby Locations

    Other Jobs Near Me

    Industry

    1. request_quote Accounting
    2. work Administrative
    3. eco Agriculture Forestry
    4. smart_toy AI & Emerging Technologies
    5. school Apprenticeships & Trainee
    6. apartment Architecture
    7. palette Arts & Entertainment
    8. directions_car Automotive
    9. flight_takeoff Aviation
    10. account_balance Banking & Finance
    11. local_florist Beauty & Wellness
    12. restaurant Catering
    13. volunteer_activism Charity & Voluntary
    14. science Chemical Engineering
    15. child_friendly Childcare
    16. foundation Civil Engineering
    17. clean_hands Cleaning & Sanitation
    18. diversity_3 Community & Social Care
    19. construction Construction
    20. brush Creative & Digital
    21. currency_bitcoin Crypto & Blockchain
    22. support_agent Customer Service & Helpdesk
    23. medical_services Dental
    24. medical_services Driving & Transport
    25. medical_services E Commerce & Social Media
    26. school Education & Teaching
    27. electrical_services Electrical Engineering
    28. bolt Energy
    29. local_mall Fmcg
    30. gavel Government & Non Profit
    31. emoji_events Graduate
    32. health_and_safety Healthcare
    33. beach_access Hospitality & Tourism
    34. groups Human Resources
    35. precision_manufacturing Industrial Engineering
    36. security Information Security
    37. handyman Installation & Maintenance
    38. policy Insurance
    39. code IT & Software
    40. gavel Legal
    41. sports_soccer Leisure & Sports
    42. inventory_2 Logistics & Warehousing
    43. supervisor_account Management
    44. supervisor_account Management Consultancy
    45. supervisor_account Manufacturing & Production
    46. campaign Marketing
    47. build Mechanical Engineering
    48. perm_media Media & PR
    49. local_hospital Medical
    50. local_hospital Military & Public Safety
    51. local_hospital Mining
    52. medical_services Nursing
    53. local_gas_station Oil & Gas
    54. biotech Pharmaceutical
    55. checklist_rtl Project Management
    56. shopping_bag Purchasing
    57. home_work Real Estate
    58. person_search Recruitment Consultancy
    59. store Retail
    60. point_of_sale Sales
    61. science Scientific Research & Development
    62. wifi Telecoms
    63. psychology Therapy
    64. pets Veterinary
    View All Spark Jobs View All Jobs in Bengaluru