10,722 Spark jobs in India
Sr. Spark Developer
Posted today
Job Viewed
Job Description
Understanding of different types of testing – Unit, Acceptance, Regression, Performance, etc.
open to receiving feedback and constructive criticism.
Proficiency working with large data stores
understanding of Test Driven Development (TDD) or Pair Programming
Candidate should have:
Deep understanding of all aspects of database technologies - schema design, optimization, scalability, etc.
Excellent communication skills
passion for resolving user pain points through great design.
Track record of contributions to open-source software projects.
Experience in SDLC, especially testing and deployment.
Professional ETL experience using Spark (Python or Scala)
Experience in Software version control (e.g. git working knowledge or greater)
Experience in Unix-like operating system environment (proficient)
3+ years of CI/CD experience (Jenkins, Terraform, Cloud Formation, etc.)
4+ years of experience designing technical solutions using object-oriented design concepts.
3+ years of AWS solution engineering and architecture experience
Java spark developer
Posted today
Job Viewed
Job Description
Experience in writing SQL for any one relation database
Extensive knowledge in HiveSQL Hadoop, SQL
Expereience in DevOps process (CICD, Jira, Bitbucket)
Experience in Bigdata tech stack (Java Spark, Hadoop, Hive)
Expereience in DevOps process (CICD, Jira, Bitbucket)
Extensive knowledge in HiveSQL Hadoop, SQL
Scala Spark Developer
Posted today
Job Viewed
Job Description
Scala Spark Developer
Full Time
Job Code: TI-82594 | Tavant Technologies India Private Limited
India
15 positions
Required Experience
3 - 15 Years
Skills
scala,
spark,
Spark streaming
+ 3 moreJob Description
3+ years of strong development experience in Scala and Spark
Design, develop, test and deploy technical solutions
Implement automated acceptance tests
Roles & Responsibilities
3+ years of strong development experience in Scala and Spark
Good knowledge in OS concepts and hands-on with Linux systems
Strong Computer Science fundamentals in data structures, algorithm design, and problem-solving.
Strong distributed systems knowledge, and experience shipping enterprise software Organized, thorough, and detail-oriented
Design, develop, test and deploy technical solutions
Implement automated acceptance tests
Spark streaming, FLINK, Kafka, Kinesis
Eligibility
3+ years of strong development experience in Scala and Spark
About Company
With 21+ years of experience building innovative digital products and solutions, Tavant provides impactful results to its customers. It has been the frontrunner in driving digital innovation and tech-enabled transformation across a wide range of industries such as Consumer Lending, Manufacturing, Agtech, Media & Entertainment, and Retail in North America, Europe, and Asia-Pacific.Powered by Artificial Intelligence and Machine Learning algorithms, we help our customers improve their operational efficiency, productivity, speed, and accuracy. Our suite of products and solutions are routinely rated high by the industry.Ours is a challenging workplace where teams are diverse, competitive, and continually searching for tomorrow's technology and brilliant minds to create it. And we don’t focus just on what we do – we also care how we do it. So, bring your talent and ambition to make a difference. We’ll create a world of opportunities for you.Scala/Spark Developer - Chennai
Posted today
Job Viewed
Job Description
Required Skills & Experience:
Spark Scala Developer
Posted today
Job Viewed
Job Description
Position: Spark Scala Developer
Company: Infotel India
At Infotel UK, a premier technology consulting firm, we are seeking a skilled Spark Scala Developer to join our dynamic team. In this role, you will leverage your expertise in Spark and Scala to design and implement advanced data processing solutions that drive insights and provide value to our clients. You will work closely with data scientists, analysts, and other developers to create efficient and scalable data pipelines.
Key Responsibilities:
- Design and develop data processing applications using Apache Spark and Scala.
- Collaborate with cross-functional teams to understand data requirements and design solutions accordingly.
- Optimize Spark jobs for performance, scalability, and efficiency.
- Integrate diverse data sources and manage data ingestion processes.
- Conduct unit testing and participate in code reviews to ensure adherence to best practices.
- Stay updated with the latest technologies and advancements in the field of big data and analytics.
Requirements
- Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
- Proven experience as a Spark Scala Developer or similar role, with hands-on experience in building and optimizing Spark applications.
- Strong proficiency in Scala programming and functional programming concepts.
- Experience with data processing frameworks and tools (e.g., Apache Spark, Apache Kafka, Hadoop).
- Familiarity with SQL and database technologies, including relational and NoSQL databases.
- Knowledge of cloud platforms (e.g., AWS, Azure, GCP) is a plus.
- Excellent problem-solving skills and ability to analyze complex data issues.
- Strong communication skills and ability to work collaboratively within a team.
Benefits
Apply today with your CV! All applications will be treated in strict confidentiality!
- Family Leave (Maternity, Paternity)
- Training & Development
- Life Insurance (Basic, Voluntary & AD&D)
- Paid Time Off (Vacation, Sick & Public Holidays)
The Work Environment is stimulating, creative, open, informal and it is based on teamwork, mutual trust and fairness for all. The open work environment gives each employee to be expert in the desired area and great learning opportunities to grow with the organization. Our unique culture supports open dialogue, candid feedback, and enduring relationships. We treat each other with dignity and respect, as human beings first, professionals second.
Java Spark Developer - C11 - PUNE
Posted today
Job Viewed
Job Description
**Responsibilities:**
+ Utilize knowledge of applications development testing procedures and concepts, and basic knowledge of other technical areas to identify and define necessary system enhancements, including using script tools and analyzing/interpreting code
+ Consult with users, clients, and other technology groups on issues, and recommend programming solutions, install, and support customer exposure systems
+ Apply fundamental knowledge of programming languages for design specifications.
+ Analyze applications to identify vulnerabilities and security issues, as well as conduct testing and debugging
+ Serve as advisor or coach to new or lower level analysts
+ Identify problems, analyze information, and make evaluative judgements to recommend and implement solutions
+ Resolve issues by identifying and selecting solutions through the applications of acquired technical experience and guided by precedents
+ Has the ability to operate with a limited level of direct supervision.
+ Can exercise independence of judgement and autonomy.
+ Acts as SME to senior stakeholders and /or other team members.
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
+ Conducts initiatives related to User Acceptance Testing (UAT) process and product rollout into production. Testing specialists who work with technology project managers, UAT professionals and users to design and implement appropriate scripts/plans for an application testing strategy/approach. Responsibilities may also include software quality assurance testing.Conducts a variety of tests and analyses to ensure that systems and or applications meet or exceed specified standards and end-user requirements.Works closely with key stakeholders to understand business and functional requirements to develop test plans, test cases and scripts.Works complex testing assignments.
**Qualifications:**
+ Design, code, test, document and implement application release projects as part of development team.
+ Minimum 4 years of proven project experience
+ **Should be hands-on with Spark 2.0 and above, Java 8 and above.**
+ **Should be good with Hive / Oracle, Unix Shell Scripting**
+ Should have experience on Spring Boot and Rest API
+ Good to have knowledge on Agile methodologies
+ Work with BA and understand all functional and technical requirements of the project.
**Education:**
+ Bachelor's degree/University degree or equivalent experience
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Databricks Developer + Spark
Posted today
Job Viewed
Job Description
Wissen Technology isHiring for Data bricks Developer + Spark
About Wissen Technology: Wissen Technology is a globally recognized organization known for building solid technology teams, working with major financial institutions, and delivering high-quality solutions in IT services. With a strong presence in the financial industry, we provide cutting-edge solutions to address complex business challenges.
Experience:7+Years
Location: Mumbai
Required Skills:
The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products. We offer an array of services including Core Business Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud Adoption, Mobility, Digital Adoption, Agile & DevOps, Quality Assurance & Test Automation.
Over the years, Wissen Group has successfully delivered $1 billion worth of projects for more than 20 of the Fortune 500 companies. Wissen Technology provides exceptional value in mission critical projects for its clients, through thought leadership, ownership, and assured on-time deliveries that are always ‘first time right’. The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them with the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients.
We have been certified as a Great Place to Work company for two consecutive years (2020-2022) and voted as the Top 20 AI/ML vendor by CIO Insider. Great Place to Work Certification is recognized world over by employees and employers alike and is considered the ‘Gold Standard’. Wissen Technology has created a Great Place to Work by excelling in all dimensions - High-Trust, High-Performance Culture, Credibility, Respect, Fairness, Pride and Camaraderie.
Website:
LinkedIn:
Wissen Leadership:
Wissen Live:
Wissen Thought Leadership:
Employee Speak:
Great Place to Work:
About Wissen Interview Process:
Latest in Wissen in CIO Insider:
Be The First To Know
About the latest Spark Jobs in India !
Databricks Developer + Spark
Posted today
Job Viewed
Job Description
Wissen Technology is Hiring for Databricks Developer + Spark
About Wissen Technology: Wissen Technology is a globally recognized organization known for building solid technology teams, working with major financial institutions, and delivering high-quality solutions in IT services. With a strong presence in the financial industry, we provide cutting-edge solutions to address complex business challenges.
Role Overview: We are seeking a skilled Databrick Certified Engineer with a strong background in Spark/PySparkto develop and optimize data processing applications. The ideal candidate will be responsible for building robust and scalable data processing solutions using Python, PySpark and Spark
Experience:7+Years
Location: Bangalore and Mumbai
Key Responsibilities:
Develop, maintain, and optimize scalable data processing applications using Python, Spark and PySpark.
Design and implement data solutions that meet performance and reliability requirements.
Collaborate with data engineers, data scientists, and other stakeholders to gather requirements and deliver high-quality solutions.
Write clean, efficient, and maintainable code following best practices and coding standards.
Perform data analysis and ensure data quality and integrity.
Monitor and troubleshoot performance issues in the data processing pipelines.
Implement and maintain CI/CD pipelines for automated testing and deployment.
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
Proven experience as a Databricks developer with expertise in Spark/PySpark.
Strong problem-solving skills and excellent communication.
The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products. We offer an array of services including Core Business Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud Adoption, Mobility, Digital Adoption, Agile & DevOps, Quality Assurance & Test Automation.
Over the years, Wissen Group has successfully delivered $1 billion worth of projects for more than 20 of the Fortune 500 companies. Wissen Technology provides exceptional value in mission critical projects for its clients, through thought leadership, ownership, and assured on-time deliveries that are always ‘first time right’. The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them with the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients.
We have been certified as a Great Place to Work company for two consecutive years (2020-2022) and voted as the Top 20 AI/ML vendor by CIO Insider. Great Place to Work Certification is recognized world over by employees and employers alike and is considered the ‘Gold Standard’. Wissen Technology has created a Great Place to Work by excelling in all dimensions - High-Trust, High-Performance Culture, Credibility, Respect, Fairness, Pride and Camaraderie.
Sr. Spark/Cassandra Developer
Posted today
Job Viewed
Job Description
Analyze, design, program, debug, and modify software enhancements and/or new products used in local, networked, or Internet-related computer programs, primarily for end-users
Write code and complete programming by using current programming languages and technologies
Interact with users to define system requirements and/or necessary modifications
Complete documentation and procedures for installation and maintenance
Typically interact with high-level individual contributors, managers, and program core teams
Collaborate with peers, junior engineers, technicians, and external design partners
Effectively communicate product architectures, design proposals and negotiate options at management levels
Perform testing and debugging of applications
Evaluating forms and processes for software systems testing and methodology, including writing and execution of test plans, debugging, and testing scripts and tools.
Design and integrate software systems running on multiple platform types into the overall architecture.
Lead a project requiring software applications development
Candidate should have:
Extensive experience with multiple software systems design tools and languages.
Excellent written and verbal communication skills; mastery of English. Ability to effectively communicate product architectures, design proposals, and negotiate options.
Experience in the overall architecture of software systems for products and solutions.
Excellent analytical and problem-solving skills.
Expert skills in programming Spark RDDs joins and data frames
Understanding of Mesos-based Spark deployment
Solid grasp of Cassandra internals - read/write paths, indexes, tombstones
Experience with Spark/Cassandra connector, SBT
Typically 6-10 years experience.
Strong Scala programming skills, Akka, DSL design, concepts of functional programming in Scala
Bachelor's or Master's degree in Computer Science, Information Systems, or equivalent
Cassandra administration skills - compaction, repairs, backup and restore
Cassandra data modeling, a solid understanding of consistency levels, partitioning
Cassandra performance monitoring and troubleshooting, JVM and garbage collection tuning