Big Data Engineer

Hyderabad, Andhra Pradesh RandomTrees

Posted 1 day ago

Job Viewed

Tap Again To Close

Job Description

Job Title: Big Data Engineer

Experience: 5–9 Years

Location: Hyderabad-Hybrid

Employment Type: Full-Time

Job Summary:

We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL, Hadoop, and Data Lake/Data Warehouse architectures. Experience working with any cloud platform (AWS, Azure, or GCP) is preferred.

Required Skills:

  • 5–9 years of hands-on experience as a Big Data Engineer.
  • Strong proficiency in Apache Spark (PySpark or Scala).
  • Solid understanding and experience with SQL and database optimization.
  • Experience with data lake or data warehouse environments and architecture patterns.
  • Good understanding of data modeling, performance tuning, and partitioning strategies.
  • Experience in working with large-scale distributed systems and batch/stream data processing.
  • Preferred Qualifications:
  • Experience with cloud platforms such as AWS, Azure, or GCP is preferred.
  • Education:
  • Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Hyderabad, Andhra Pradesh RandomTrees

Posted 11 days ago

Job Viewed

Tap Again To Close

Job Description

Immediate #HIRING for a highly motivated and experienced Big Data Engineer to join our growing team.


We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies.


If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at


Job Title: Big Data Engineer

Experience: 5–9 Years

Location: Hyderabad-Hybrid

Employment Type: Full-Time


Job Summary:

We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL, Hadoop, and Data Lake/Data Warehouse architectures. Experience working with any cloud platform (AWS, Azure, or GCP) is preferred. Top Universities or colleges prefeered.

This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Hyderabad, Andhra Pradesh RandomTrees

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Title: Big Data Engineer
Experience: 5–9 Years
Location: Hyderabad-Hybrid
Employment Type: Full-Time

Job Summary:
We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL, Hadoop, and Data Lake/Data Warehouse architectures. Experience working with any cloud platform (AWS, Azure, or GCP) is preferred.
Required Skills:
5–9 years of hands-on experience as a Big Data Engineer.
Strong proficiency in Apache Spark (PySpark or Scala).
Solid understanding and experience with SQL and database optimization.
Experience with data lake or data warehouse environments and architecture patterns.
Good understanding of data modeling, performance tuning, and partitioning strategies.
Experience in working with large-scale distributed systems and batch/stream data processing.
Preferred Qualifications:
Experience with cloud platforms such as AWS, Azure, or GCP is preferred.
Education:
Bachelor’s or Master’s degree in Computer Science, Engineering, or a related field.
This advertiser has chosen not to accept applicants from your region.

Big Data Engineer

Hyderabad, Andhra Pradesh RandomTrees

Posted 9 days ago

Job Viewed

Tap Again To Close

Job Description

Immediate #HIRING for a highly motivated and experienced Big Data Engineer to join our growing team.

We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies.

If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at

Job Title: Big Data Engineer
Experience: 5–9 Years
Location: Hyderabad-Hybrid
Employment Type: Full-Time

Job Summary:
We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL, Hadoop, and Data Lake/Data Warehouse architectures. Experience working with any cloud platform (AWS, Azure, or GCP) is preferred. Top Universities or colleges prefeered.
This advertiser has chosen not to accept applicants from your region.

Big data engineer

Hyderabad, Andhra Pradesh Virtusa

Posted today

Job Viewed

Tap Again To Close

Job Description

Big data engineer - CREQ189284 Description
  • Position: Big data engineer
  • Primary: big data concepts, aws, pyspark
  • Location: HYD
  • Create Trigger based automation framework for Data Migration
    Identify roles/access needed for data migration from federated bucket to managed bucket and Build APIs for the same
    Integrate CDMS framework with Lake and Data bridge API
    Data migration from S3 Managed to Hadoop On prem
    Jobs for Daily and Bulk loads
    Test support for AVRO to test lake features
    Test support for Compression types like LZO, .ENC to test lake features
    ABINITIO integration: Build feature to create operation trigger for ABI pipeline
    Movement to new datacenter -SQL server migration
    Carlstadt to Ashburn (DR switchover)

    Develop and maintain data platforms using Python.
    Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity.
    Collaborate with cross functional teams to understand data requirements and design solutions that meet business needs .
    Implement and manage agents for monitoring, logging, and automation within AWS environments.
    Handling migration from PySpark to AWS.
    (Secondary) Resource must have hands on development experience with various Ab Initio components such as Rollup Scan join Partition by key Partition by Round Robin Gather Merge Interleave Lookup etc.
    Must have experience with SQL database programming SQL performance tuning relational model analysis.
    Good knowledge in developing UNIX scripts Oracle SQLPLSQL.
    Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging.
    Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management.
    Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
  • Primary Location Hyderabad, Andhra Pradesh, India Job Type Experienced Primary Skills Big Data, Python, Spark Years of Experience 12 Qualification
  • Education: Any degree or equivalent
  • Experience: 6+ years
  • Travel No
    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer

    Hyderabad, Andhra Pradesh Anicalls (Pty) Ltd

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Big Data Engineer 

    Specification-



    • 2 – 7 years of recent experience in
    data engineering.


    • Bachelor's Degree or more in Computer
    Science or a related field.
    • A solid track record of data management showing your flawless execution
    and attention to detail.


    • Strong knowledge of and experience with statistics.


    • Programming experience, ideally in , Spark, Kafka, or , and a willingness
    to learn new programming languages to meet goals and objectives.
    • Experience in C, Perl, Javascript, or other
    programming languages is a plus 
    • Knowledge of data cleaning, wrangling,
    visualization, and reporting, with an understanding of the best, most efficient
    use of associated tools and applications to complete these tasks.

    • In-depth knowledge of data mining, machine
    learning, natural language processing, or information retrieval.


    • Experience processing large amounts of
    structured and unstructured data, including integrating data from multiple
    sources.


    • Experience with machine learning tool kits including, H2O, Spark-ml or Mahout.
    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer

    Hyderabad, Andhra Pradesh Saaki Argus & Averil Consulting

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Hiring for Big Data:


    LOCATION: Chennai, Bengaluru, Hyderabad.


    EXPERIENCE: 7-10


    Notice Period : Immediate Joiner or 30 Day


    Key Skills


    • Hands-on experience on technologies like Python, SQL, Snowflake, HDFS , Hive, Scala, Spark, AWS, HBase and Cassandra.
    • Good knowledge in Data Warehousing concepts.
    • Proficient in Hadoop distributions such as Cloudera, Hortonworks.
    • Good working experience on technologies like Python , Scala, SQL & PL/SQL
    • Developers design and build the foundational architecture to manage massive-scale data storage, processing, and analysis using distributed, cloud-based systems and platforms.
    • Coding Big Data Pipelines.
    • Managing Big Data Infrastructure and Pipelines.

    This advertiser has chosen not to accept applicants from your region.
    Be The First To Know

    About the latest Senior data engineer Jobs in Hyderabad !

    Big Data Engineer

    Hyderabad, Andhra Pradesh RandomTrees

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Immediate #HIRING for a highly motivated and experienced Big Data Engineer to join our growing team.


    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies.


    If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at


    Job Title: Big Data Engineer

    Experience: 5–9 Years

    Location: Hyderabad-Hybrid

    Employment Type: Full-Time


    Job Summary:

    We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL, Hadoop, and Data Lake/Data Warehouse architectures. Experience working with any cloud platform (AWS, Azure, or GCP) is preferred. Top Universities or colleges prefeered.

    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer

    Hyderabad, Andhra Pradesh Kresta Softech Private Limited

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    We’re looking for a skilled Big Data Engineer.


    Role Highlights:

    Position: Big Data Engineer

    Experience: 4+ years

    Location- Remote

    Work mode- WFH

    Notice Period: Immediate/15 days joiners Mandatory.


    Key Skills:-


    Big Data, AWS, CI/CD Pipelines, Scala , Python or Java or C++

    This advertiser has chosen not to accept applicants from your region.

    Big Data Engineer

    Hyderabad, Andhra Pradesh RandomTrees

    Posted today

    Job Viewed

    Tap Again To Close

    Job Description

    Immediate #HIRING for a highly motivated and experienced Big Data Engineer to join our growing team.


    We’re a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies.


    If you're passionate about building robust applications and thrive in a dynamic environment, please share your resume at


    Job Title:
    Big Data Engineer

    Experience:
    5–9 Years

    Location:
    Hyderabad-Hybrid

    Employment Type:
    Full-Time


    Job Summary:

    We are seeking a skilled Big Data Engineer with 5–9 years of experience in building and managing scalable data pipelines and analytics solutions. The ideal candidate will have strong expertise in Big Data, Hadoop, Apache Spark, SQL, Hadoop, and Data Lake/Data Warehouse architectures. Experience working with any cloud platform (AWS, Azure, or GCP) is preferred. Top Universities or colleges prefeered.

    This advertiser has chosen not to accept applicants from your region.
     

    Nearby Locations

    Other Jobs Near Me

    Industry

    1. request_quote Accounting
    2. work Administrative
    3. eco Agriculture Forestry
    4. smart_toy AI & Emerging Technologies
    5. school Apprenticeships & Trainee
    6. apartment Architecture
    7. palette Arts & Entertainment
    8. directions_car Automotive
    9. flight_takeoff Aviation
    10. account_balance Banking & Finance
    11. local_florist Beauty & Wellness
    12. restaurant Catering
    13. volunteer_activism Charity & Voluntary
    14. science Chemical Engineering
    15. child_friendly Childcare
    16. foundation Civil Engineering
    17. clean_hands Cleaning & Sanitation
    18. diversity_3 Community & Social Care
    19. construction Construction
    20. brush Creative & Digital
    21. currency_bitcoin Crypto & Blockchain
    22. support_agent Customer Service & Helpdesk
    23. medical_services Dental
    24. medical_services Driving & Transport
    25. medical_services E Commerce & Social Media
    26. school Education & Teaching
    27. electrical_services Electrical Engineering
    28. bolt Energy
    29. local_mall Fmcg
    30. gavel Government & Non Profit
    31. emoji_events Graduate
    32. health_and_safety Healthcare
    33. beach_access Hospitality & Tourism
    34. groups Human Resources
    35. precision_manufacturing Industrial Engineering
    36. security Information Security
    37. handyman Installation & Maintenance
    38. policy Insurance
    39. code IT & Software
    40. gavel Legal
    41. sports_soccer Leisure & Sports
    42. inventory_2 Logistics & Warehousing
    43. supervisor_account Management
    44. supervisor_account Management Consultancy
    45. supervisor_account Manufacturing & Production
    46. campaign Marketing
    47. build Mechanical Engineering
    48. perm_media Media & PR
    49. local_hospital Medical
    50. local_hospital Military & Public Safety
    51. local_hospital Mining
    52. medical_services Nursing
    53. local_gas_station Oil & Gas
    54. biotech Pharmaceutical
    55. checklist_rtl Project Management
    56. shopping_bag Purchasing
    57. home_work Real Estate
    58. person_search Recruitment Consultancy
    59. store Retail
    60. point_of_sale Sales
    61. science Scientific Research & Development
    62. wifi Telecoms
    63. psychology Therapy
    64. pets Veterinary
    View All Senior Data Engineer Jobs View All Jobs in Hyderabad