128 Data Preprocessing jobs in Noida
Data Engineering Consultant
Posted 4 days ago
Job Viewed
Job Description
**Primary Responsibility:**
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualification:**
+ Undergraduate degree or equivalent experience
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
Data Engineering Consultant
Posted 18 days ago
Job Viewed
Job Description
**Primary Responsibilities:**
+ Ingest data from multiple on-prem and cloud data sources using various tools & capabilities in Azure
+ Design and develop Azure Databricks processes using PySpark/Spark-SQL
+ Design and develop orchestration jobs using ADF, Databricks Workflow
+ Analyzing data engineering processes being developed and act as an SME to troubleshoot performance issues and suggest solutions to improve
+ Building test framework for the Databricks notebook jobs for automated testing before code deployment
+ Design and build POCs to validate new ideas, tools, and architectures in Azure
+ Continuously explore new Azure services and capabilities; assess their applicability to business needs
+ Prepare case studies and technical write-ups to showcase successful implementations and lessons learned
+ Work closely with clients, business stakeholders, and internal teams to gather requirements and translate them into technical solutions using best practices and appropriate architecture
+ Contribute to full lifecycle project implementations, from design and development to deployment and monitoring
+ Ensure solutions adhere to security, compliance, and governance standards
+ Monitor and optimize data pipelines and cloud resources for cost and performance efficiency
+ Identifies solutions to non-standard requests and problems
+ Mentor and support existing on-prem developers for cloud environment
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Undergraduate degree or equivalent experience
+ 7+ years of overall experience in Data & Analytics engineering
+ 5+ years of experience working with Azure, Databricks, and ADF, Data Lake
+ 5+ years of experience working with data platform or product using PySpark and Spark-SQL
+ Solid experience with CICD tools such as Jenkins, GitHub, Github Actions, Maven etc.
+ In-depth understanding of Azure architecture & ability to come up with efficient design & solutions
+ Highly proficient in Python and SQL
+ Proven excellent communication skills
+ **Key Skill:** Azure Data Engineer - Azure Databricks, Azure Data factory, Python/Pyspark, Terraform
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
_#Nic #NJP_
Data Engineering Lead
Posted 22 days ago
Job Viewed
Job Description
The Xbox Experiences and Platforms team is home to the engineering work that makes this vision possible, building the developer tools and services that enable game creators to craft incredible experiences, the commerce systems that connect publishers with their audience and help gamers engage with their next favorite games, the platforms on which those games play at their best, and the experiences that turn every screen into an Xbox.
**Responsibilities**
Do you want to influence product engineering teams to shape the next generation of data and analytics capabilities for Xbox? The Xbox Plaform Data Intelligence Team is looking for a highly-motivated Data Engineer with data platform experience. You will work closely with engineering and product management in designing, implementing, and evolving innovative capabilities tailored to drive analytics and insights on engineering features. You will leverage core data pipelines to identify insights and experiment ideas that influence product decisions. Our capabilities influence data-driven decision making across Xbox Leadership, Finance, Business Planning, and Engineering teams.
Collaboration, diversity, & self-direction are valued here. Expect to be given room and support to grow personally and professionally.
Technically challenging projects, a healthy and high-caliber team, game-changing products for excited fans. don't miss this rewarding opportunity!
**Responsibilities**
+ Work within and across teams to solve complex technical challenges
+ Develop engineering best-practices - continuously evaluate our processes and reporting to identify opportunities to improve, enhance, and automate existing and new capabilities with a fundamental understanding of the end-to-end scenario
+ Measure the success and usage patterns of the product / feature at various levels as well as key engineering metrics
+ Provide thought leadership, creation, and execution on data platform capabilities
+ Grow & foster an inclusive, creative, high-performance team culture
+ Coach & mentor other team members
+ Contribute to a data-driven culture as well as a culture of experimentation across the organization.
**Qualifications**
**Required:**
+ Bachelor's or Master's Degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or a related field, OR equivalent experience, with 8+ years of experience in business analytics, data science, software development, data modeling, or data engineering.
+ Experience working with cloud-based technologies, including relational databases, data warehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools, data lakes.
+ Self-motivated and organized to deliver results
**Preferred:**
+ 1+ year(s) people management experience
+ Experience with Azure Analytics stack, e.g., Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Data Explorer (Kusto), Azure Cosmos DB, Azure logic apps, Fabric/Power BI
+ Experience in modern DevOps practices (including Git, CI/CD)
+ Good interpersonal and communications (verbal and written) skills, including the ability to effectively communicate with both business and technical teams.
+ Ability to use judgement and rating schemes to turn qualitative information into quantitative estimates
+ Proficiency in scenario analytics, mining for insights
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations ( .
Data Engineering Consultant
Posted today
Job Viewed
Job Description
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibility:
Required Qualification:
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
Data Engineering Lead
Posted today
Job Viewed
Job Description
Overview
On Team Xbox, we aspire to empower the world’s 3 billion gamers to play the games they want, with the people they want, anywhere they want. Gaming, the largest and fastest growing category in media & entertainment, represents an important growth opportunity for Microsoft. We are leading with innovation, as highlighted by bringing Xbox to new devices with Cloud Gaming, bringing the Game Pass subscription to PC, and our recent acquisition of Activision Blizzard King creating exciting new possibilities for players.
The Xbox Experiences and Platforms team is home to the engineering work that makes this vision possible, building the developer tools and services that enable game creators to craft incredible experiences, the commerce systems that connect publishers with their audience and help gamers engage with their next favorite games, the platforms on which those games play at their best, and the experiences that turn every screen into an Xbox.
Qualifications
Required:
Bachelor’s or Master’s Degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or a related field, OR equivalent experience, with 8+ years of experience in business analytics, data science, software development, data modeling, or data engineering.
Experience working with cloud-based technologies, including relational databases, data warehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools, data lakes.
Preferred:
Responsibilities
Do you want to influence product engineering teams to shape the next generation of data and analytics capabilities for Xbox? The Xbox Plaform Data Intelligence Team is looking for a highly-motivated Data Engineer with data platform experience. You will work closely with engineering and product management in designing, implementing, and evolving innovative capabilities tailored to drive analytics and insights on engineering features. You will leverage core data pipelines to identify insights and experiment ideas that influence product decisions. Our capabilities influence data-driven decision making across Xbox Leadership, Finance, Business Planning, and Engineering teams.
Collaboration, diversity, & self-direction are valued here. Expect to be given room and support to grow personally and professionally.
Technically challenging projects, a healthy and high-caliber team, game-changing products for excited fans… don’t miss this rewarding opportunity!
Responsibilities
Data Engineering Analyst
Posted today
Job Viewed
Job Description
Worked collaboratively with cross-functional teams and stakeholders to achieve an organizational goal.
Worked in an agile environment and are comfortable running an agile process for the data and analytics team.
Strong experience in data pipelines, ETL design (both implementation and maintenance), data warehousing, and data modeling (preferably in dbt).
Implementation and tuning experience in the Big Data Ecosystem,
(such as Data Analytics (Dataproc, Airflow, Hadoop, Spark, Hive),
Google Cloud Platform AI and ML Services and Data Warehousing (such as BigQuery, schema design,
query tuning and optimization) and data migration and integration.
End to end hands-on to carry out complex POC, Pilot, Limited production rollout, assignments requiring the development of new or improved techniques and procedures.
Participated in deep architectural discussions to build confidence and ensure customer, success when building new, or migrating existing, applications, software, and services on the Google Cloud Platform.
advanced skills in SQL, data modeling, ETL/ELT development, and data warehousing.
Strong skills in Optimization - performance, pipeline, spark.
Experience on Pyspark.
5+ years of design & implementation experience with distributed applications.
5+ years of experience architecting/operating solutions built on Google Cloud Platform.
• Bachelor’s degree.
Sr. Manager- Data Engineering
Posted 24 days ago
Job Viewed
Job Description
Looking for Manager Data Engineering :
- 12+ years total experince in data engineering and analytics.
- 2 years of experience in GCP Cloud services such as Big Query, Airflow DAG, Dataflow etc.
- 2 years of experience in Data Extraction and creating data pipeline workflows on Bigdata(Hive, HQL/Pyspark) with knowledge of Data Engineering concepts.
- Exposure in analyzing large data sets from multiple data sources, perform validation of data
- Knowledge of Hadoop Eco-system components like HDFS, Spark, Hive, Sqoop.
- Experience writing code in Python.
- Knowledge of SQL/HQL functionalities to write the optimized queries
- Ability to build a migration plan in collaboration with stakeholders
- Analytical and problem-solving skills
Be The First To Know
About the latest Data preprocessing Jobs in Noida !
Sr. Manager- Data Engineering
Posted today
Job Viewed
Job Description
Looking for Manager Data Engineering :
- 12+ years total experince in data engineering and analytics.
- 2 years of experience in GCP Cloud services such as Big Query, Airflow DAG, Dataflow etc.
- 2 years of experience in Data Extraction and creating data pipeline workflows on Bigdata(Hive, HQL/Pyspark) with knowledge of Data Engineering concepts.
- Exposure in analyzing large data sets from multiple data sources, perform validation of data
- Knowledge of Hadoop Eco-system components like HDFS, Spark, Hive, Sqoop.
- Experience writing code in Python.
- Knowledge of SQL/HQL functionalities to write the optimized queries
- Ability to build a migration plan in collaboration with stakeholders
- Analytical and problem-solving skills
Team lead - Data Engineering
Posted today
Job Viewed
Job Description
Job Summary
At Aristocrat, we prioritize offering top-tier gaming content and groundbreaking technology solutions. Our goal is to bring happiness to life through the power of play, and we are looking for an outstanding Team Lead in Data Engineering to join our dynamic team. This position provides an exciting chance to lead and encourage a team of dedicated engineers, guide architectural choices, and implement innovative data solutions that will greatly influence our business.
Data Engineering Team Lead builds data infrastructure, operates with cloud-based stacks, collaborates multi-functionally.
What You'll Do
Lead and manage a team of data engineers, driving delivery across multiple projects.
Architect and implement scalable, high-performance data pipelines using Snowflake, dbt, and Airflow.
Apply and guide others in using distributed systems and queueing technologies like Celery, Redis, or equivalents.
Own the end-to-end data lifecycle: ingestion, modeling, transformation, and delivery.
Partner with cross-functional teams (product, analytics, DevOps) to meet business data needs.
Implement engineering standards for code quality and performance.
Conduct regular 1:1s, technical reviews, and provide mentorship to team members.
Take initiative in capacity planning, hiring, and team scaling decisions.
What We're Looking For :-
7 -10 years of hands-on experience in data engineering.
2+ years of formal team leadership experience , including people management and project ownership.
Advanced knowledge of:
Snowflake for warehousing and performance tuning.
dbt for modular data modeling and testing.
Apache Airflow (or similar workflow orchestrators).
Distributed task and caching tools like Celery , Redis , or equivalents.
Python , SQL , and shell scripting.
Experience with cloud platforms such as AWS , Azure , or GCP .
Strong grasp of software development best practices, CI/CD, and data observability.
Preferred Qualifications
Experience with real-time data streaming (e.g., Kafka).
Familiarity with Terraform or other infrastructure-as-code tools.
Prior experience in startup or high-growth environments.
Exposure to BI platforms (e.g., Power BI, Looker, Tableau).
Senior Manager - Data Engineering
Posted today
Job Viewed
Job Description
Our Company
Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.
We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours!
The Opportunity
We are seeking a dynamic and experienced ‘Senior Manager - Data Engineering’ to lead our data engineering team and drive our data strategy forward. In this role, you will play a pivotal part in shaping our data infrastructure, enabling data-driven decision-making, and supporting our organization's growth. You will work closely with cross-functional teams to design and implement scalable data solutions that enhance our analytics capabilities and optimize data flow and collection.
What You'll Do
What You Need to Succeed