Big Data Engineer

Mumbai, Maharashtra Hexaware Technologies

Posted today

Job Viewed

Tap Again To Close

Job Description

Description

:
  • 4 or more years of experience working directly with enterprise data solutions
  • Hands on experience working in a public cloud environment and on-prem infrastructure.
  • Specialty on Columnar Databases like Redshift Spectrum and the AWS cloud infrastructure services (Redshift, S3, Lambda)
  • Excellent SQL skills and Python coding is a must
  • Experience with a wide variety of modern data processing technologies, including
  • Expert in Commonly used AWS services (S3, Lambda, Redshift, Glue, Athena)
  • Expert in Columnar databases primarily, Redshift
  • Expertise in Python is a must have
  • Big Data Stack (Spark, spectrum)
  • Data streaming (Kafka)
  • Knowledge on time series data stores like Apache pinot or druid is a plus
  • This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer

    Mumbai, Maharashtra Tata Consultancy Services

    Posted 1 day ago

    Job Viewed

    Tap Again To Close

    Job Description

    Greetings from TCS!

    TCS is hiring for Big Data

    Location: - Chennai/Mumbai/Pune

    Desired Experience Range: 6 to 12 years


    Must-Have

    • PySpark • Hive


    Good-to-Have

    • Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platform


    Thanks

    Anshika

    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer

    Thane, Maharashtra Tata Consultancy Services

    Posted 1 day ago

    Job Viewed

    Tap Again To Close

    Job Description

    Greetings from TCS!

    TCS is hiring for Big Data

    Location: - Chennai/Mumbai/Pune

    Desired Experience Range: 6 to 12 years


    Must-Have

    • PySpark • Hive


    Good-to-Have

    • Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platform


    Thanks

    Anshika

    This advertiser has chosen not to accept applicants from your region.

    Senior Big Data Engineer

    Mumbai, Maharashtra The Nielsen Company

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big, so we can all continuously improve. We enable your best to power our future.  Software Engineer  We are looking for both Senior and Software Engineers to join our Gracenote Tech team. The ideal candidates would have a passion for Clean Code, scalable architectures, Test Driven Development and DevOps.

    Job Purpose:

  • Develop and enhance our flagship Video, Audio, Automotive and Sports metadata software solutions.
  • Design applications with a Platform-first mentality where scale, consistency and reliability are at the core of every decision.
  • Job Description:

  • Evaluate, contribute to, and leverage open source technologies including Kubernetes, Trino, Spark, Airflow, Prometheus + friends, ELK, Jupyter, and more in order to create and enhance our internal SaaS/PaaS platforms.
  • Design software with a Product-owner mentality: your software is the product and as such you own the product as much as any business person does.
  • Work within small, highly configurable teams to deliver software in rapid increments using an iterative approach.
  • Develop applications to catalog and power the world’s largest entertainment metadata repository across the Video, Audio, Automotive and Sports verticals.
  • Interact with Product, Editorial and Client Experience teams to constantly refine the Gracenote offering.
  • Role Requirements:

  • Passionate about software development and DevOps
  • Competency in SQL and scripting in bash or some other scripting language
  • 5+ years of work experience with a programming language such as C++, Java, Python, Scala, Go, Pyspark, Hadoop
  • A solid grasp of computer science fundamentals: data structures, algorithms, memory management and distributed systems
  • Experience with Unix/Linux based platforms. A degree in computer science, engineering, math or related fields
  • Please be aware that job-seekers may be at risk of targeting by scammers seeking personal data or money. Nielsen recruiters will only contact you through official job boards, LinkedIn, or email with a domain. Be cautious of any outreach claiming to be from Nielsen via other messaging platforms or personal email addresses. Always verify that email communications come from an @ address. If you're unsure about the authenticity of a job offer or communication, please contact Nielsen directly through our official website or verified social media channels.
    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer - Scala

    Thane, Maharashtra Idyllic Services

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Job Title: Big Data Engineer – Scala

    Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai.

    Experience: 7–10 Years (Minimum 3+ years in Scala)

    Notice Period: Immediate to 30 Days

    Mode of Work: Hybrid


    Click the link below to learn more about the role and take the AI Interview to begin your application journey:


    Role Overview

    We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines , and hands-on experience in distributed data systems and cloud-based solutions.


    Key Responsibilities

    - Design, develop, and optimize large-scale data pipelines and distributed data processing systems.

    - Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

    - Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow .

    - Write efficient queries and perform data analysis using Jupyter Notebooks and SQL .

    - Collaborate with cross-functional teams to design scalable cloud-based data architectures .

    - Ensure delivery of high-quality code through code reviews, performance tuning, and best practices .

    - Build monitoring and alerting systems leveraging Splunk or equivalent tools .

    - Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

    - Contribute to product development with a focus on scalability, maintainability, and performance.


    Mandatory Skills

    - Scala – Minimum 3+ years of hands-on experience.

    - Strong expertise in Spark (PySpark) and Python .

    - Hands-on experience with Apache Kafka .

    - Knowledge of NiFi / Airflow for orchestration.

    - Strong experience in Distributed Data Systems (5+ years) .

    - Proficiency in SQL and query optimization.

    - Good understanding of Cloud Architecture .


    Preferred Skills

    - Exposure to messaging technologies like Apache Kafka or equivalent.

    - Experience in designing intuitive, responsive UIs for data analytics visualization.

    - Familiarity with Splunk or other monitoring/alerting solutions .

    - Hands-on experience with CI/CD tools (Git, Jenkins).

    - Strong grasp of software engineering concepts, data modeling, and optimization techniques .

    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer - Scala

    Mumbai, Maharashtra Idyllic Services

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Job Title: Big Data Engineer – Scala

    Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai.

    Experience: 7–10 Years (Minimum 3+ years in Scala)

    Notice Period: Immediate to 30 Days

    Mode of Work: Hybrid


    Click the link below to learn more about the role and take the AI Interview to begin your application journey:


    Role Overview

    We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines , and hands-on experience in distributed data systems and cloud-based solutions.


    Key Responsibilities

    - Design, develop, and optimize large-scale data pipelines and distributed data processing systems.

    - Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

    - Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow .

    - Write efficient queries and perform data analysis using Jupyter Notebooks and SQL .

    - Collaborate with cross-functional teams to design scalable cloud-based data architectures .

    - Ensure delivery of high-quality code through code reviews, performance tuning, and best practices .

    - Build monitoring and alerting systems leveraging Splunk or equivalent tools .

    - Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

    - Contribute to product development with a focus on scalability, maintainability, and performance.


    Mandatory Skills

    - Scala – Minimum 3+ years of hands-on experience.

    - Strong expertise in Spark (PySpark) and Python .

    - Hands-on experience with Apache Kafka .

    - Knowledge of NiFi / Airflow for orchestration.

    - Strong experience in Distributed Data Systems (5+ years) .

    - Proficiency in SQL and query optimization.

    - Good understanding of Cloud Architecture .


    Preferred Skills

    - Exposure to messaging technologies like Apache Kafka or equivalent.

    - Experience in designing intuitive, responsive UIs for data analytics visualization.

    - Familiarity with Splunk or other monitoring/alerting solutions .

    - Hands-on experience with CI/CD tools (Git, Jenkins).

    - Strong grasp of software engineering concepts, data modeling, and optimization techniques .

    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer - Scala

    Mumbai, Maharashtra Idyllic Services

    Posted 1 day ago

    Job Viewed

    Tap Again To Close

    Job Description

    Job Title: Big Data Engineer – Scala

    Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai.

    Experience: 7–10 Years (Minimum 3+ years in Scala)

    Notice Period: Immediate to 30 Days

    Mode of Work: Hybrid


    Click the link below to learn more about the role and take the AI Interview to begin your application journey:


    Role Overview

    We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines , and hands-on experience in distributed data systems and cloud-based solutions.


    Key Responsibilities

    - Design, develop, and optimize large-scale data pipelines and distributed data processing systems.

    - Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

    - Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow .

    - Write efficient queries and perform data analysis using Jupyter Notebooks and SQL .

    - Collaborate with cross-functional teams to design scalable cloud-based data architectures .

    - Ensure delivery of high-quality code through code reviews, performance tuning, and best practices .

    - Build monitoring and alerting systems leveraging Splunk or equivalent tools .

    - Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

    - Contribute to product development with a focus on scalability, maintainability, and performance.


    Mandatory Skills

    - Scala – Minimum 3+ years of hands-on experience.

    - Strong expertise in Spark (PySpark) and Python .

    - Hands-on experience with Apache Kafka .

    - Knowledge of NiFi / Airflow for orchestration.

    - Strong experience in Distributed Data Systems (5+ years) .

    - Proficiency in SQL and query optimization.

    - Good understanding of Cloud Architecture .


    Preferred Skills

    - Exposure to messaging technologies like Apache Kafka or equivalent.

    - Experience in designing intuitive, responsive UIs for data analytics visualization.

    - Familiarity with Splunk or other monitoring/alerting solutions .

    - Hands-on experience with CI/CD tools (Git, Jenkins).

    - Strong grasp of software engineering concepts, data modeling, and optimization techniques .

    This advertiser has chosen not to accept applicants from your region.
    Be The First To Know

    About the latest Senior data engineer Jobs in Mumbai !

    Big Data Engineer - Scala

    Thane, Maharashtra Idyllic Services

    Posted 1 day ago

    Job Viewed

    Tap Again To Close

    Job Description

    Job Title: Big Data Engineer – Scala

    Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai.

    Experience: 7–10 Years (Minimum 3+ years in Scala)

    Notice Period: Immediate to 30 Days

    Mode of Work: Hybrid


    Click the link below to learn more about the role and take the AI Interview to begin your application journey:


    Role Overview

    We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines , and hands-on experience in distributed data systems and cloud-based solutions.


    Key Responsibilities

    - Design, develop, and optimize large-scale data pipelines and distributed data processing systems.

    - Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

    - Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow .

    - Write efficient queries and perform data analysis using Jupyter Notebooks and SQL .

    - Collaborate with cross-functional teams to design scalable cloud-based data architectures .

    - Ensure delivery of high-quality code through code reviews, performance tuning, and best practices .

    - Build monitoring and alerting systems leveraging Splunk or equivalent tools .

    - Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

    - Contribute to product development with a focus on scalability, maintainability, and performance.


    Mandatory Skills

    - Scala – Minimum 3+ years of hands-on experience.

    - Strong expertise in Spark (PySpark) and Python .

    - Hands-on experience with Apache Kafka .

    - Knowledge of NiFi / Airflow for orchestration.

    - Strong experience in Distributed Data Systems (5+ years) .

    - Proficiency in SQL and query optimization.

    - Good understanding of Cloud Architecture .


    Preferred Skills

    - Exposure to messaging technologies like Apache Kafka or equivalent.

    - Experience in designing intuitive, responsive UIs for data analytics visualization.

    - Familiarity with Splunk or other monitoring/alerting solutions .

    - Hands-on experience with CI/CD tools (Git, Jenkins).

    - Strong grasp of software engineering concepts, data modeling, and optimization techniques .

    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer - Scala

    Navi Mumbai, Maharashtra Idyllic Services

    Posted 1 day ago

    Job Viewed

    Tap Again To Close

    Job Description

    Job Title: Big Data Engineer – Scala

    Location: Bangalore, Chennai, Gurgaon, Pune, Mumbai.

    Experience: 7–10 Years (Minimum 3+ years in Scala)

    Notice Period: Immediate to 30 Days

    Mode of Work: Hybrid


    Click the link below to learn more about the role and take the AI Interview to begin your application journey:


    Role Overview

    We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines , and hands-on experience in distributed data systems and cloud-based solutions.


    Key Responsibilities

    - Design, develop, and optimize large-scale data pipelines and distributed data processing systems.

    - Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.

    - Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow .

    - Write efficient queries and perform data analysis using Jupyter Notebooks and SQL .

    - Collaborate with cross-functional teams to design scalable cloud-based data architectures .

    - Ensure delivery of high-quality code through code reviews, performance tuning, and best practices .

    - Build monitoring and alerting systems leveraging Splunk or equivalent tools .

    - Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

    - Contribute to product development with a focus on scalability, maintainability, and performance.


    Mandatory Skills

    - Scala – Minimum 3+ years of hands-on experience.

    - Strong expertise in Spark (PySpark) and Python .

    - Hands-on experience with Apache Kafka .

    - Knowledge of NiFi / Airflow for orchestration.

    - Strong experience in Distributed Data Systems (5+ years) .

    - Proficiency in SQL and query optimization.

    - Good understanding of Cloud Architecture .


    Preferred Skills

    - Exposure to messaging technologies like Apache Kafka or equivalent.

    - Experience in designing intuitive, responsive UIs for data analytics visualization.

    - Familiarity with Splunk or other monitoring/alerting solutions .

    - Hands-on experience with CI/CD tools (Git, Jenkins).

    - Strong grasp of software engineering concepts, data modeling, and optimization techniques .

    This advertiser has chosen not to accept applicants from your region.

    Data Analytics/Big Data Engineer

    Mumbai, Maharashtra Anicalls (Pty) Ltd

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Responsibilities:
    Working in a challenging, fast-paced environment to create a meaningful impact on your work
    Identify business problems & use data analysis to find answers
    Code and maintain data platform & reporting analytics
    Design, build and maintain data pipelines.

    Qualifications

    Desire to collaborate with a smart, supportive engineering team
    Strong passion for data and willingness to learn new skills
    Experience with NoSQL Databases (i.e. DynamoDB, Couchbase, MongoDB)
    Experience with Data ETL tools (DBT and AWS Glue)
    Expert knowledge in SQL and deep experience managing relational databases such as PostgreSQL
    Experience coding in Python, Scala, or R
    Strong understanding of how to build a data pipeline
    This advertiser has chosen not to accept applicants from your region.
     

    Nearby Locations

    Other Jobs Near Me

    Industry

    1. request_quote Accounting
    2. work Administrative
    3. eco Agriculture Forestry
    4. smart_toy AI & Emerging Technologies
    5. school Apprenticeships & Trainee
    6. apartment Architecture
    7. palette Arts & Entertainment
    8. directions_car Automotive
    9. flight_takeoff Aviation
    10. account_balance Banking & Finance
    11. local_florist Beauty & Wellness
    12. restaurant Catering
    13. volunteer_activism Charity & Voluntary
    14. science Chemical Engineering
    15. child_friendly Childcare
    16. foundation Civil Engineering
    17. clean_hands Cleaning & Sanitation
    18. diversity_3 Community & Social Care
    19. construction Construction
    20. brush Creative & Digital
    21. currency_bitcoin Crypto & Blockchain
    22. support_agent Customer Service & Helpdesk
    23. medical_services Dental
    24. medical_services Driving & Transport
    25. medical_services E Commerce & Social Media
    26. school Education & Teaching
    27. electrical_services Electrical Engineering
    28. bolt Energy
    29. local_mall Fmcg
    30. gavel Government & Non Profit
    31. emoji_events Graduate
    32. health_and_safety Healthcare
    33. beach_access Hospitality & Tourism
    34. groups Human Resources
    35. precision_manufacturing Industrial Engineering
    36. security Information Security
    37. handyman Installation & Maintenance
    38. policy Insurance
    39. code IT & Software
    40. gavel Legal
    41. sports_soccer Leisure & Sports
    42. inventory_2 Logistics & Warehousing
    43. supervisor_account Management
    44. supervisor_account Management Consultancy
    45. supervisor_account Manufacturing & Production
    46. campaign Marketing
    47. build Mechanical Engineering
    48. perm_media Media & PR
    49. local_hospital Medical
    50. local_hospital Military & Public Safety
    51. local_hospital Mining
    52. medical_services Nursing
    53. local_gas_station Oil & Gas
    54. biotech Pharmaceutical
    55. checklist_rtl Project Management
    56. shopping_bag Purchasing
    57. home_work Real Estate
    58. person_search Recruitment Consultancy
    59. store Retail
    60. point_of_sale Sales
    61. science Scientific Research & Development
    62. wifi Telecoms
    63. psychology Therapy
    64. pets Veterinary
    View All Senior Data Engineer Jobs View All Jobs in Mumbai