5,241 Azure Databricks jobs in India

Data Engineer – Azure & Databricks

Nadiad, Gujarat vueverse.

Job Viewed

Tap Again To Close

Job Description

Hybrid Role: Blr/HYD/Pune/Chennai


Job Description

We are looking for a skilled Data Engineer with strong expertise in the Azure Data Platform to design, develop, and optimize large-scale data pipelines and analytics solutions. The ideal candidate should have deep hands-on experience with Azure Databricks, PySpark, Azure Data Factory, and Synapse Analytics , with a focus on performance tuning and scalable design.


Key Responsibilities

  • Develop and optimize data pipelines using Azure Data Factory (ADF) for ingestion into Azure Databricks (ADB) .
  • Implement PySpark transformations in Databricks with a strong focus on performance tuning .
  • Build and maintain data layers (raw, curated, presentation) and ensure efficient export strategies for reporting and analytics.
  • Work with Azure Synapse for advanced querying, transformations, and reporting.
  • Configure and manage Azure Monitoring & Log Analytics for pipeline health, error handling, and automated alerts.
  • Implement automation using Logic Apps and Azure Functions for workflow orchestration and integration.
  • Ensure high-performance and scalable architecture across Databricks, Data Factory, and Synapse.
  • Collaborate with stakeholders to define best practices for data access, connection options, and reporting performance .


Required Skills

  • Strong hands-on experience with Azure Databricks (PySpark, performance tuning, data modeling).
  • Proficiency in Azure Data Factory (ADF) – pipeline development, monitoring, troubleshooting.
  • Solid understanding of Azure Synapse Analytics (SQL Pools, performance optimization).
  • Experience with Azure Monitoring, Log Analytics, and error-handling frameworks .
  • Good knowledge of Logic Apps & Azure Functions for automation and orchestration.
  • Strong understanding of data architecture patterns (data lakes, data warehouses, reporting layers).
  • Excellent troubleshooting, performance optimization, and analytical skills.


Good to Have

  • Experience with CI/CD for data pipelines (Azure DevOps).
  • Knowledge of Delta Lake and Lakehouse architecture .
  • Exposure to BFSI/Insurance domain data solutions.
This advertiser has chosen not to accept applicants from your region.

Job No Longer Available

This position is no longer listed on WhatJobs. The employer may be reviewing applications, filled the role, or has removed the listing.

However, we have similar jobs available for you below.

Azure Databricks Developer

Noida, Uttar Pradesh Coforge

Posted 11 days ago

Job Viewed

Tap Again To Close

Job Description

Core Responsibilities-


Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes:


  • Developing ETL pipelines using Python, SQL, and Delta Live Tables
  • Managing job execution through Databricks Jobs, including scheduling and parameterisation
  • Implementing data transformation using built-in Databricks features Collaborating with data architects and analysts to ensure data models align with business needs
  • Implementing security and governance using features like encryption, access control and data lineage tracking Data performance management using built-in Databricks features (i.e. concurrency for better query execution) Must be an expert in writing complex SQL queries.


Technical Skills


The following technical proficiencies are commonly required:


  • Languages: Python, SQL Databricks
  • Features: Delta Lake, Delta Live Tables, MLflow, Databricks Jobs, Secrets Management, encryption access control etc.
  • Azure Integration: Azure Key Vault, Azure Functions, Azure Data Lake, Azure DevOps
  • Deployment Pipelines: Experience with CI/CD for Databricks and integration with Snowflake schemas (DEV, PRE-PROD, PROD)
  • Monitoring & Optimisation: Cost analysis of clusters, performance tuning, and job concurrency management Desirable Experience Working knowledge of Control-M for orchestrating Databricks jobs
  • Familiarity with Power BI integration and semantic modelling Exposure to geospatial or time-series data processing using Databricks Basic knowledge of data modelling


Share your resume at if you are early or immediate joiner.

This advertiser has chosen not to accept applicants from your region.

Azure Databricks Architect

Pune, Maharashtra Persistent Systems

Posted 17 days ago

Job Viewed

Tap Again To Close

Job Description

About Position:


We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql.


  • Role: Azure Databricks Architect
  • Location: All Persistent Locations
  • Experience: 12 to 17 years
  • Job Type: Full Time Employment


What You'll Do:


  • 12+ years of experience in data architecture, data engineering, or analytics.
  • 5+ years of hands-on experience with Azure Databricks, Apache Spark, and Delta Lake.
  • Strong proficiency in Azure Data Lake, Azure Synapse, Azure Data Factory, and Azure SQL.
  • Expertise in Python, Scala, and SQL for data processing.
  • Deep understanding of data modeling, ETL/ELT processes, and distributed computing.
  • Experience with CI/CD pipelines and DevOps practices in data engineering.
  • Excellent communication and stakeholder management skills.
  • Azure certifications (e.g., Azure Solutions Architect, Azure Data Engineer) are a plus.


Expertise You'll Bring:


  • Experience in implementing ML/AI models in Databricks.
  • Knowledge of data governance tools like Purview.
  • Familiarity with real-time data processing using Kafka, Event Hubs, or Stream Analytics.


Benefits:


  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents


Inclusive Environment:


Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.


  • We offer hybrid work options and flexible working hours to accommodate various needs and preferences.
  • Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities.
  • If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive.


Our company fosters a values-driven and people-centric work environment that enables our employees to:


  • Accelerate growth, both professionally and personally
  • Impact the world in powerful, positive ways, using the latest technologies
  • Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
  • Unlock global opportunities to work and learn with the industry’s best


Let’s unleash your full potential at Persistent

For more detail, please contact –

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

This advertiser has chosen not to accept applicants from your region.

Azure Databricks Architect

Pune, Maharashtra Persistent Systems

Posted 2 days ago

Job Viewed

Tap Again To Close

Job Description

About Position:

We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql.

  • Role: Azure Databricks Architect
  • Location: All Persistent Locations
  • Experience: 12 to 17 years
  • Job Type: Full Time Employment

What You'll Do:

  • 12+ years of experience in data architecture, data engineering, or analytics.
  • 5+ years of hands-on experience with Azure Databricks, Apache Spark, and Delta Lake.
  • Strong proficiency in Azure Data Lake, Azure Synapse, Azure Data Factory, and Azure SQL.
  • Expertise in Python, Scala, and SQL for data processing.
  • Deep understanding of data modeling, ETL/ELT processes, and distributed computing.
  • Experience with CI/CD pipelines and DevOps practices in data engineering.
  • Excellent communication and stakeholder management skills.
  • Azure certifications (e.g., Azure Solutions Architect, Azure Data Engineer) are a plus.

Expertise You'll Bring:

  • Experience in implementing ML/AI models in Databricks.
  • Knowledge of data governance tools like Purview.
  • Familiarity with real-time data processing using Kafka, Event Hubs, or Stream Analytics.

Benefits:

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Inclusive Environment:

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

  • We offer hybrid work options and flexible working hours to accommodate various needs and preferences.
  • Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities.
  • If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive.

Our company fosters a values-driven and people-centric work environment that enables our employees to:

  • Accelerate growth, both professionally and personally
  • Impact the world in powerful, positive ways, using the latest technologies
  • Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
  • Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent

For more detail, please contact –

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

This advertiser has chosen not to accept applicants from your region.

Azure Databricks Developer

Noida, Uttar Pradesh Coforge

Posted 4 days ago

Job Viewed

Tap Again To Close

Job Description

Core Responsibilities-

Seasoned Databricks developer having 6+ years of experience is expected to design, build, and maintain scalable data pipelines and workflows using Azure Databricks. This includes:

  • Developing ETL pipelines using Python, SQL, and Delta Live Tables
  • Managing job execution through Databricks Jobs, including scheduling and parameterisation
  • Implementing data transformation using built-in Databricks features Collaborating with data architects and analysts to ensure data models align with business needs
  • Implementing security and governance using features like encryption, access control and data lineage tracking Data performance management using built-in Databricks features (i.e. concurrency for better query execution) Must be an expert in writing complex SQL queries.

Technical Skills

The following technical proficiencies are commonly required:

  • Languages: Python, SQL Databricks
  • Features: Delta Lake, Delta Live Tables, MLflow, Databricks Jobs, Secrets Management, encryption access control etc.
  • Azure Integration: Azure Key Vault, Azure Functions, Azure Data Lake, Azure DevOps
  • Deployment Pipelines: Experience with CI/CD for Databricks and integration with Snowflake schemas (DEV, PRE-PROD, PROD)
  • Monitoring & Optimisation: Cost analysis of clusters, performance tuning, and job concurrency management Desirable Experience Working knowledge of Control-M for orchestrating Databricks jobs
  • Familiarity with Power BI integration and semantic modelling Exposure to geospatial or time-series data processing using Databricks Basic knowledge of data modelling

Share your resume at if you are early or immediate joiner.

This advertiser has chosen not to accept applicants from your region.

Azure Databricks Architect

Pune, Maharashtra Persistent Systems

Posted today

Job Viewed

Tap Again To Close

Job Description

About Position:

We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql.

  • Role: Azure Databricks Architect
  • Location: All Persistent Locations
  • Experience: 12 to 17 years
  • Job Type: Full Time Employment

What You'll Do:

  • 12+ years of experience in data architecture, data engineering, or analytics.
  • 5+ years of hands-on experience with Azure Databricks, Apache Spark, and Delta Lake.
  • Strong proficiency in Azure Data Lake, Azure Synapse, Azure Data Factory, and Azure SQL.
  • Expertise in Python, Scala, and SQL for data processing.
  • Deep understanding of data modeling, ETL/ELT processes, and distributed computing.
  • Experience with CI/CD pipelines and DevOps practices in data engineering.
  • Excellent communication and stakeholder management skills.
  • Azure certifications (e.g., Azure Solutions Architect, Azure Data Engineer) are a plus.

Expertise You'll Bring:

  • Experience in implementing ML/AI models in Databricks.
  • Knowledge of data governance tools like Purview.
  • Familiarity with real-time data processing using Kafka, Event Hubs, or Stream Analytics.

Benefits:

  • Competitive salary and benefits package
  • Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications
  • Opportunity to work with cutting-edge technologies
  • Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards
  • Annual health check-ups
  • Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents

Inclusive Environment:

Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds.

  • We offer hybrid work options and flexible working hours to accommodate various needs and preferences.
  • Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities.
  • If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive.

Our company fosters a values-driven and people-centric work environment that enables our employees to:

  • Accelerate growth, both professionally and personally
  • Impact the world in powerful, positive ways, using the latest technologies
  • Enjoy collaborative innovation, with diversity and work-life wellbeing at the core
  • Unlock global opportunities to work and learn with the industry’s best

Let’s unleash your full potential at Persistent

For more detail, please contact –

“Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind.”

This advertiser has chosen not to accept applicants from your region.

Azure Databricks Architect

Hyderabad, Andhra Pradesh ValueMomentum

Posted today

Job Viewed

Tap Again To Close

Job Description

Job Summary:

Are you someone who has a strong data engineering background who is passionate about tackling complex enterprise business challenges by designing data driven solutions? Then read on!

ValueMomentum is looking for an experienced Databricks Architect to join our team and provide technical leadership and expertise in designing and implementing scalable and efficient data solutions using the Databricks platform. You will be part of a highly collaborative and growing team and solve complex business challenges leveraging the modern data and analytics technologies. As a Databricks Architect, you will play a critical role in driving the architectural direction, guiding the development team, and ensuring the successful delivery of complex data projects. This is an exciting opportunity to work with cutting-edge technologies, collaborate with cross-functional teams, and shape the future of our data infrastructure.

At ValueMomentum, we endorse a culture of experimentation and constantly strive for improvement and learning. You will be exposed to advanced tools, technologies, methodologies, and best practices that will help you develop your skills and grow in your career.

Know your team:

ValueMomentum’s (DL) team is trusted by leading insurance, financial services, and healthcare payers to empower businesses with real-time insights. The DL team is focussed on helping our customers modernize data infrastructure, create effective business intelligence capabilities and develop analytics models to generate business driven insights and outcomes. DL team provides a wide range of capabilities to our customers including advisory services, strategy consulting, data engineering, data management, data governance, BI and Analytics.

Responsibilities:

Job description

The Data Architect for presales will engage with clients to understand their data challenges, tailor technical solutions, and present compelling proposals. Bridge the gap between technical intricacies and client business needs, showcasing the value of our data architecture and domain expertise. Drive pre-sales success by leveraging deep understanding of data systems and strategic thinking.

Solution Development and Strategy

  • Develop and implement enterprise data architecture strategies aligned with organizational goals and industry best practices, tailoring solutions for presales engagements.
  • Provide reference architecture and guidelines for technology adoption, emphasizing cloud migration, and data modernization.
  • Data Solutions Delivery

  • Collaborate with business stakeholders to understand data needs and design solutions.
  • Create a unified data model showcasing the organization’s assets, relationships, and attributes.
  • Design and oversee the implementation of data integration, storage, and retrieval solutions, ensuring data accessibility, reliability, and performance.
  • Implement solutions leveraging AI and ML for better productivity.
  • Leadership and Innovation

  •  Provide technical guidance to data architects, engineers, and other data-related roles.
  •  Drive data governance initiatives, ensuring compliance.
  •  Research, architect, and deliver expanding solutions on the Data Analytics stack.
  •  Work with cross-functional project teams and provide data strategy and architecture, resolving performance and technical issues during proposal and delivery stages.
  • Building and Growth of Practice

  • Customize solutions to fit client needs and industry requirements.
  • Cultivate partnerships, emphasizing the long-term benefits of robust data architecture.
  • Drive innovation, integrating cutting-edge technologies into practices.
  • Establish industry thought leadership through active contributions.
  • Develop scalable frameworks adaptable to evolving client needs and growth.
  • Foster a collaborative team culture, encouraging knowledge sharing and skill development.
  • Manage Centre of Excellence for Data engineering and Analytics.
  • Marketing Support

  • Contribute for White Paper, Case Studies and Technical blogs.
  • Participate as a Panelist in technical session.
  • Support in activities for adding or enhancing partnership with Tech product companies.
  • What we need in you

  • Proven experience in designing and implementing complex data solutions aligned with business objectives.
  • Expertise in data modelling, integration, security, and governance
  • Hands-on experience with guiding the virtual data model definition, defining Data Virtualization architecture and deployment with focus on Azure, Databricks, PySpark technologies.
  • Prior experience with establishing best practices for business optimizations.
  • Experience with relational and non-relational data stores (Hadoop, SQL, Mongo DB), ETL or ELT tools (SSIS, Informatica, Matillion, DBT), DevOps, Data Lake and Data Fabric concepts
  • In-depth experience with data governance, data integration and related technologies.
  • Proficiency in a variety of database technologies, both relational and non-relational.
  • Knowledge of cloud-based data solutions (e.g., AWS, Azure).
  • Excellent collaboration and communication skills
  • Experience in Insurance Domain will be a differentiator.
  • Data architecture certifications (e.g., TOGAF, DAMA) are a plus.
  • Requirements:

    Candidates are required to have these mandatory skills:

  • Strong hands on in Pyspark and Apache Spark.
  • Experience in Native Spark Migration to Databricks.
  • Experience in Hadoop Migration to Databricks.
  • Experience in Building Data Governance Solutions like Unity Catalog, StarBust …etc
  • Build Very Strong Orchestration Layer in Databricks/ADF…. Workflows.
  • Build CICD for Databricks in Azure Devops.
  • Process near Real time Data thru Auto Loader, DLT Pipelines.
  • Implement Security Layer in Delta Lake.
  • Implement Massive Parallel Processing Layers in Spark SQL and PySpark.
  • Implement Cost effective Infrastructure in Databricks.
  • Experience In extracting logic and from on prem layers like SSIS, Stored procedures, Informatica, Vertica, Apache Hudi, Filesystems. etc into Pyspark.
  • Ability to Build Solutions as Cloud Agnostic.
  • About the Company:

    Headquartered in New Jersey, US, ValueMomentum is the largest standalone provider of IT Services and Solutions to Insurers. Our industry focus, expertise in technology backed by R&D, and our customer-first approach uniquely position us to deliver the value we promise and drive momentum to our customers’ initiatives. ValueMomentum is amongst the top 10 insurance-focused IT services firms in North America by number of customers. Leading Insurance firms trust ValueMomentum with their Digital, Data, Core, and IT Transformation initiatives.

    Benefits:

    We at ValueMomentum offer you a congenial environment to work and grow in the company of experienced professionals. Some benefits that are available to you are:

  • Career Advancement: Individual Career Development, coaching and mentoring programs for professional and leadership skill development.
  • Comprehensive training and certification programs.
  • Performance Management: Goal Setting, continuous feedback and year-end appraisal. Reward & recognition for the extraordinary performers.
  • Benefits: Comprehensive health benefits, wellness and fitness programs. Paid time off and holidays.
  • Culture: A highly transparent organization with an open-door policy and a vibrant culture
  • This advertiser has chosen not to accept applicants from your region.
    Be The First To Know

    About the latest Azure databricks Jobs in India !

     

    Nearby Locations

    Other Jobs Near Me

    Industry

    1. request_quote Accounting
    2. work Administrative
    3. eco Agriculture Forestry
    4. smart_toy AI & Emerging Technologies
    5. school Apprenticeships & Trainee
    6. apartment Architecture
    7. palette Arts & Entertainment
    8. directions_car Automotive
    9. flight_takeoff Aviation
    10. account_balance Banking & Finance
    11. local_florist Beauty & Wellness
    12. restaurant Catering
    13. volunteer_activism Charity & Voluntary
    14. science Chemical Engineering
    15. child_friendly Childcare
    16. foundation Civil Engineering
    17. clean_hands Cleaning & Sanitation
    18. diversity_3 Community & Social Care
    19. construction Construction
    20. brush Creative & Digital
    21. currency_bitcoin Crypto & Blockchain
    22. support_agent Customer Service & Helpdesk
    23. medical_services Dental
    24. medical_services Driving & Transport
    25. medical_services E Commerce & Social Media
    26. school Education & Teaching
    27. electrical_services Electrical Engineering
    28. bolt Energy
    29. local_mall Fmcg
    30. gavel Government & Non Profit
    31. emoji_events Graduate
    32. health_and_safety Healthcare
    33. beach_access Hospitality & Tourism
    34. groups Human Resources
    35. precision_manufacturing Industrial Engineering
    36. security Information Security
    37. handyman Installation & Maintenance
    38. policy Insurance
    39. code IT & Software
    40. gavel Legal
    41. sports_soccer Leisure & Sports
    42. inventory_2 Logistics & Warehousing
    43. supervisor_account Management
    44. supervisor_account Management Consultancy
    45. supervisor_account Manufacturing & Production
    46. campaign Marketing
    47. build Mechanical Engineering
    48. perm_media Media & PR
    49. local_hospital Medical
    50. local_hospital Military & Public Safety
    51. local_hospital Mining
    52. medical_services Nursing
    53. local_gas_station Oil & Gas
    54. biotech Pharmaceutical
    55. checklist_rtl Project Management
    56. shopping_bag Purchasing
    57. home_work Real Estate
    58. person_search Recruitment Consultancy
    59. store Retail
    60. point_of_sale Sales
    61. science Scientific Research & Development
    62. wifi Telecoms
    63. psychology Therapy
    64. pets Veterinary
    View All Azure Databricks Jobs