703 Data Engineering jobs in Delhi
Data Engineering Consultant
Posted 10 days ago
Job Viewed
Job Description
**Primary Responsibilities:**
+ Ingest data from multiple on-prem and cloud data sources using various tools & capabilities in Azure
+ Design and develop Azure Databricks processes using PySpark/Spark-SQL
+ Design and develop orchestration jobs using ADF, Databricks Workflow
+ Analyzing data engineering processes being developed and act as an SME to troubleshoot performance issues and suggest solutions to improve
+ Building test framework for the Databricks notebook jobs for automated testing before code deployment
+ Design and build POCs to validate new ideas, tools, and architectures in Azure
+ Continuously explore new Azure services and capabilities; assess their applicability to business needs
+ Prepare case studies and technical write-ups to showcase successful implementations and lessons learned
+ Work closely with clients, business stakeholders, and internal teams to gather requirements and translate them into technical solutions using best practices and appropriate architecture
+ Contribute to full lifecycle project implementations, from design and development to deployment and monitoring
+ Ensure solutions adhere to security, compliance, and governance standards
+ Monitor and optimize data pipelines and cloud resources for cost and performance efficiency
+ Identifies solutions to non-standard requests and problems
+ Mentor and support existing on-prem developers for cloud environment
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Undergraduate degree or equivalent experience
+ 7+ years of overall experience in Data & Analytics engineering
+ 5+ years of experience working with Azure, Databricks, and ADF, Data Lake
+ 5+ years of experience working with data platform or product using PySpark and Spark-SQL
+ Solid experience with CICD tools such as Jenkins, GitHub, Github Actions, Maven etc.
+ In-depth understanding of Azure architecture & ability to come up with efficient design & solutions
+ Highly proficient in Python and SQL
+ Proven excellent communication skills
+ **Key Skill:** Azure Data Engineer - Azure Databricks, Azure Data factory, Python/Pyspark, Terraform
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
_#Nic #NJP_
Data Engineering Lead
Posted 14 days ago
Job Viewed
Job Description
The Xbox Experiences and Platforms team is home to the engineering work that makes this vision possible, building the developer tools and services that enable game creators to craft incredible experiences, the commerce systems that connect publishers with their audience and help gamers engage with their next favorite games, the platforms on which those games play at their best, and the experiences that turn every screen into an Xbox.
**Responsibilities**
Do you want to influence product engineering teams to shape the next generation of data and analytics capabilities for Xbox? The Xbox Plaform Data Intelligence Team is looking for a highly-motivated Data Engineer with data platform experience. You will work closely with engineering and product management in designing, implementing, and evolving innovative capabilities tailored to drive analytics and insights on engineering features. You will leverage core data pipelines to identify insights and experiment ideas that influence product decisions. Our capabilities influence data-driven decision making across Xbox Leadership, Finance, Business Planning, and Engineering teams.
Collaboration, diversity, & self-direction are valued here. Expect to be given room and support to grow personally and professionally.
Technically challenging projects, a healthy and high-caliber team, game-changing products for excited fans. don't miss this rewarding opportunity!
**Responsibilities**
+ Work within and across teams to solve complex technical challenges
+ Develop engineering best-practices - continuously evaluate our processes and reporting to identify opportunities to improve, enhance, and automate existing and new capabilities with a fundamental understanding of the end-to-end scenario
+ Measure the success and usage patterns of the product / feature at various levels as well as key engineering metrics
+ Provide thought leadership, creation, and execution on data platform capabilities
+ Grow & foster an inclusive, creative, high-performance team culture
+ Coach & mentor other team members
+ Contribute to a data-driven culture as well as a culture of experimentation across the organization.
**Qualifications**
**Required:**
+ Bachelor's or Master's Degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or a related field, OR equivalent experience, with 8+ years of experience in business analytics, data science, software development, data modeling, or data engineering.
+ Experience working with cloud-based technologies, including relational databases, data warehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools, data lakes.
+ Self-motivated and organized to deliver results
**Preferred:**
+ 1+ year(s) people management experience
+ Experience with Azure Analytics stack, e.g., Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Data Explorer (Kusto), Azure Cosmos DB, Azure logic apps, Fabric/Power BI
+ Experience in modern DevOps practices (including Git, CI/CD)
+ Good interpersonal and communications (verbal and written) skills, including the ability to effectively communicate with both business and technical teams.
+ Ability to use judgement and rating schemes to turn qualitative information into quantitative estimates
+ Proficiency in scenario analytics, mining for insights
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations ( .
Data Engineering Analyst
Posted today
Job Viewed
Job Description
Worked collaboratively with cross-functional teams and stakeholders to achieve an organizational goal.
Worked in an agile environment and are comfortable running an agile process for the data and analytics team.
Strong experience in data pipelines, ETL design (both implementation and maintenance), data warehousing, and data modeling (preferably in dbt).
Implementation and tuning experience in the Big Data Ecosystem,
(such as Data Analytics (Dataproc, Airflow, Hadoop, Spark, Hive),
Google Cloud Platform AI and ML Services and Data Warehousing (such as BigQuery, schema design,
query tuning and optimization) and data migration and integration.
End to end hands-on to carry out complex POC, Pilot, Limited production rollout, assignments requiring the development of new or improved techniques and procedures.
Participated in deep architectural discussions to build confidence and ensure customer, success when building new, or migrating existing, applications, software, and services on the Google Cloud Platform.
advanced skills in SQL, data modeling, ETL/ELT development, and data warehousing.
Strong skills in Optimization - performance, pipeline, spark.
Experience on Pyspark.
5+ years of design & implementation experience with distributed applications.
5+ years of experience architecting/operating solutions built on Google Cloud Platform.
• Bachelor’s degree.
Data Engineering Lead
Posted today
Job Viewed
Job Description
Overview
On Team Xbox, we aspire to empower the world’s 3 billion gamers to play the games they want, with the people they want, anywhere they want. Gaming, the largest and fastest growing category in media & entertainment, represents an important growth opportunity for Microsoft. We are leading with innovation, as highlighted by bringing Xbox to new devices with Cloud Gaming, bringing the Game Pass subscription to PC, and our recent acquisition of Activision Blizzard King creating exciting new possibilities for players.
The Xbox Experiences and Platforms team is home to the engineering work that makes this vision possible, building the developer tools and services that enable game creators to craft incredible experiences, the commerce systems that connect publishers with their audience and help gamers engage with their next favorite games, the platforms on which those games play at their best, and the experiences that turn every screen into an Xbox.
Qualifications
Required:
Bachelor’s or Master’s Degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or a related field, OR equivalent experience, with 8+ years of experience in business analytics, data science, software development, data modeling, or data engineering.
Experience working with cloud-based technologies, including relational databases, data warehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools, data lakes.
Preferred:
Responsibilities
Do you want to influence product engineering teams to shape the next generation of data and analytics capabilities for Xbox? The Xbox Plaform Data Intelligence Team is looking for a highly-motivated Data Engineer with data platform experience. You will work closely with engineering and product management in designing, implementing, and evolving innovative capabilities tailored to drive analytics and insights on engineering features. You will leverage core data pipelines to identify insights and experiment ideas that influence product decisions. Our capabilities influence data-driven decision making across Xbox Leadership, Finance, Business Planning, and Engineering teams.
Collaboration, diversity, & self-direction are valued here. Expect to be given room and support to grow personally and professionally.
Technically challenging projects, a healthy and high-caliber team, game-changing products for excited fans… don’t miss this rewarding opportunity!
Responsibilities
Data Engineering Consultant
Posted today
Job Viewed
Job Description
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities:
Required Qualifications:
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
#Nic #NJP
Azure Architect (Data Engineering)
Posted 3 days ago
Job Viewed
Job Description
Job Title: Azure Architect – Analytics & Data Services
Location: Noida/Kolkata/Bengaluru
Job Type: Full-time
Experience: 8+ years
Industry: Analytics Services
Roles and Responsibilities
- Lead end-to-end architecture design for data and analytics solutions on Azure.
- Define and implement Azure-based modern data platforms, including data lakes and data warehouses.
- Partner with project managers to oversee solution delivery and ensure timelines and milestones are met.
- Collaborate with Pre-sales teams to support RFP responses, solutioning, and client presentations.
- Create and maintain comprehensive architectural documentation and design specifications.
- Review and guide implementation teams on best practices for deploying Azure services and data workloads.
- Ensure architecture aligns with organizational security, compliance, and governance standards.
- Oversee data integration pipelines and ETL/ELT processes using Azure tools.
- Support application migration and modernization efforts on Azure.
- Provide technical leadership and mentoring to development and data engineering teams.
- Troubleshoot architectural issues and provide hands-on support when needed.
- Regularly assess performance, scalability, and reliability of deployed solutions and suggest optimizations.
Required Technical and Professional Expertise
- 4+ years of hands-on experience with Microsoft Azure, including services such as Data Factory, Databricks, Synapse Analytics, and Azure Data Lake Storage.
- Proven expertise in designing and implementing enterprise-grade data and analytics solutions, including Data Lakes and Data Warehouses.
- Experience in application migration and modernization on cloud platforms (Azure, GCP preferred).
- Strong understanding of cloud security, identity management (including Active Directory), and compliance practices.
- Proficient in modern application architectures (microservices, containers, event-driven systems).
- Bachelor’s degree in engineering (B. Tech or equivalent) with a solid foundation in software engineering and architectural design.
- Strong documentation, stakeholder communication, and project leadership skills.
- Preferred Technical and Professional Expertise
- Microsoft Azure Certifications: AZ-900 (Azure Fundamentals), AZ-305 (Solution Architect Expert), DP-203 (Data Engineer Associate).
- Experience working with Azure Machine Learning (Azure ML).
About Polestar
As a data analytics and enterprise planning powerhouse, Polestar Solutions helps its customers bring out the most sophisticated insights from their data in a value-oriented manner. From analytics foundation to analytics innovation initiatives, we offer a comprehensive range of services that help businesses succeed with data.
We have a geographic presence in the United States (Dallas, Manhattan, New York, Delaware), UK(London) & India (Delhi-NCR, Mumbai, Bangalore & Kolkata) and have 600+ people strong world-class team. We are growing at a rapid pace and plan to double our growth each year. This provides immense growth and learning opportunities to those who are choosing to work with Polestar.
Our expertise and deep passion for what we do has brought us many accolades.
The list includes:
- Recognized as “Great Place to Work” - 2024
- Recognized as the Top 50 Companies for Data Scientists in 2023 by AIM.
- Financial Times awarded Polestar as High-Growth Companies across Asia-Pacific for a 5th time in a row in 2023.
- Featured on the Economic Times India's Growth Champions in FY2023.
- Polestar Analytics Selected as a 2022 Red Herring Global
- Top Data Science Providers in India 2022: Penetration and Maturity (PeMa) Quadrant
- FT ranking of 500 of the Asia-Pacific region’s high-growth companies.
- India’s most promising data science companies in 2022.
- Featured on Forrester's Now Tech: Customer Analytics Service Providers Report Q2, 2021.
- Recognized as Anaplan's India RSI Partner of the Year FY21.
- Elite Qlik Partner and a member of the ‘Qlik Partner Advisory Council’ & Microsoft Gold Partners for Data & Cloud Platforms Culture at Polestar.
We have one of the most progressive people’s practices which are all aimed at enabling fast-paced growth for those who deserve it.
Sr. Manager- Data Engineering
Posted 17 days ago
Job Viewed
Job Description
Looking for Manager Data Engineering :
- 12+ years total experince in data engineering and analytics.
- 2 years of experience in GCP Cloud services such as Big Query, Airflow DAG, Dataflow etc.
- 2 years of experience in Data Extraction and creating data pipeline workflows on Bigdata(Hive, HQL/Pyspark) with knowledge of Data Engineering concepts.
- Exposure in analyzing large data sets from multiple data sources, perform validation of data
- Knowledge of Hadoop Eco-system components like HDFS, Spark, Hive, Sqoop.
- Experience writing code in Python.
- Knowledge of SQL/HQL functionalities to write the optimized queries
- Ability to build a migration plan in collaboration with stakeholders
- Analytical and problem-solving skills
Be The First To Know
About the latest Data engineering Jobs in Delhi !
Sr. Manager- Data Engineering
Posted 2 days ago
Job Viewed
Job Description
Looking for Manager Data Engineering :
- 12+ years total experince in data engineering and analytics.
- 2 years of experience in GCP Cloud services such as Big Query, Airflow DAG, Dataflow etc.
- 2 years of experience in Data Extraction and creating data pipeline workflows on Bigdata(Hive, HQL/Pyspark) with knowledge of Data Engineering concepts.
- Exposure in analyzing large data sets from multiple data sources, perform validation of data
- Knowledge of Hadoop Eco-system components like HDFS, Spark, Hive, Sqoop.
- Experience writing code in Python.
- Knowledge of SQL/HQL functionalities to write the optimized queries
- Ability to build a migration plan in collaboration with stakeholders
- Analytical and problem-solving skills
Azure Architect (Data Engineering)
Posted 3 days ago
Job Viewed
Job Description
Job Title: Azure Architect – Analytics & Data Services
Location: Noida/Kolkata/Bengaluru
Job Type: Full-time
Experience: 8+ years
Industry: Analytics Services
Roles and Responsibilities
- Lead end-to-end architecture design for data and analytics solutions on Azure.
- Define and implement Azure-based modern data platforms, including data lakes and data warehouses.
- Partner with project managers to oversee solution delivery and ensure timelines and milestones are met.
- Collaborate with Pre-sales teams to support RFP responses, solutioning, and client presentations.
- Create and maintain comprehensive architectural documentation and design specifications.
- Review and guide implementation teams on best practices for deploying Azure services and data workloads.
- Ensure architecture aligns with organizational security, compliance, and governance standards.
- Oversee data integration pipelines and ETL/ELT processes using Azure tools.
- Support application migration and modernization efforts on Azure.
- Provide technical leadership and mentoring to development and data engineering teams.
- Troubleshoot architectural issues and provide hands-on support when needed.
- Regularly assess performance, scalability, and reliability of deployed solutions and suggest optimizations.
Required Technical and Professional Expertise
- 4+ years of hands-on experience with Microsoft Azure, including services such as Data Factory, Databricks, Synapse Analytics, and Azure Data Lake Storage.
- Proven expertise in designing and implementing enterprise-grade data and analytics solutions, including Data Lakes and Data Warehouses.
- Experience in application migration and modernization on cloud platforms (Azure, GCP preferred).
- Strong understanding of cloud security, identity management (including Active Directory), and compliance practices.
- Proficient in modern application architectures (microservices, containers, event-driven systems).
- Bachelor’s degree in engineering (B. Tech or equivalent) with a solid foundation in software engineering and architectural design.
- Strong documentation, stakeholder communication, and project leadership skills.
- Preferred Technical and Professional Expertise
- Microsoft Azure Certifications: AZ-900 (Azure Fundamentals), AZ-305 (Solution Architect Expert), DP-203 (Data Engineer Associate).
- Experience working with Azure Machine Learning (Azure ML).
About Polestar
As a data analytics and enterprise planning powerhouse, Polestar Solutions helps its customers bring out the most sophisticated insights from their data in a value-oriented manner. From analytics foundation to analytics innovation initiatives, we offer a comprehensive range of services that help businesses succeed with data.
We have a geographic presence in the United States (Dallas, Manhattan, New York, Delaware), UK(London) & India (Delhi-NCR, Mumbai, Bangalore & Kolkata) and have 600+ people strong world-class team. We are growing at a rapid pace and plan to double our growth each year. This provides immense growth and learning opportunities to those who are choosing to work with Polestar.
Our expertise and deep passion for what we do has brought us many accolades.
The list includes:
- Recognized as “Great Place to Work” - 2024
- Recognized as the Top 50 Companies for Data Scientists in 2023 by AIM.
- Financial Times awarded Polestar as High-Growth Companies across Asia-Pacific for a 5th time in a row in 2023.
- Featured on the Economic Times India's Growth Champions in FY2023.
- Polestar Analytics Selected as a 2022 Red Herring Global
- Top Data Science Providers in India 2022: Penetration and Maturity (PeMa) Quadrant
- FT ranking of 500 of the Asia-Pacific region’s high-growth companies.
- India’s most promising data science companies in 2022.
- Featured on Forrester's Now Tech: Customer Analytics Service Providers Report Q2, 2021.
- Recognized as Anaplan's India RSI Partner of the Year FY21.
- Elite Qlik Partner and a member of the ‘Qlik Partner Advisory Council’ & Microsoft Gold Partners for Data & Cloud Platforms Culture at Polestar.
We have one of the most progressive people’s practices which are all aimed at enabling fast-paced growth for those who deserve it.
Team lead - Data Engineering
Posted today
Job Viewed
Job Description
Job Summary
At Aristocrat, we prioritize offering top-tier gaming content and groundbreaking technology solutions. Our goal is to bring happiness to life through the power of play, and we are looking for an outstanding Team Lead in Data Engineering to join our dynamic team. This position provides an exciting chance to lead and encourage a team of dedicated engineers, guide architectural choices, and implement innovative data solutions that will greatly influence our business.
Data Engineering Team Lead builds data infrastructure, operates with cloud-based stacks, collaborates multi-functionally.
What You'll Do
Lead and manage a team of data engineers, driving delivery across multiple projects.
Architect and implement scalable, high-performance data pipelines using Snowflake, dbt, and Airflow.
Apply and guide others in using distributed systems and queueing technologies like Celery, Redis, or equivalents.
Own the end-to-end data lifecycle: ingestion, modeling, transformation, and delivery.
Partner with cross-functional teams (product, analytics, DevOps) to meet business data needs.
Implement engineering standards for code quality and performance.
Conduct regular 1:1s, technical reviews, and provide mentorship to team members.
Take initiative in capacity planning, hiring, and team scaling decisions.
What We're Looking For :-
7 -10 years of hands-on experience in data engineering.
2+ years of formal team leadership experience , including people management and project ownership.
Advanced knowledge of:
Snowflake for warehousing and performance tuning.
dbt for modular data modeling and testing.
Apache Airflow (or similar workflow orchestrators).
Distributed task and caching tools like Celery , Redis , or equivalents.
Python , SQL , and shell scripting.
Experience with cloud platforms such as AWS , Azure , or GCP .
Strong grasp of software development best practices, CI/CD, and data observability.
Preferred Qualifications
Experience with real-time data streaming (e.g., Kafka).
Familiarity with Terraform or other infrastructure-as-code tools.
Prior experience in startup or high-growth environments.
Exposure to BI platforms (e.g., Power BI, Looker, Tableau).