134 Etl Processes jobs in Noida
Data Engineering Lead
Posted 2 days ago
Job Viewed
Job Description
The Xbox Experiences and Platforms team is home to the engineering work that makes this vision possible, building the developer tools and services that enable game creators to craft incredible experiences, the commerce systems that connect publishers with their audience and help gamers engage with their next favorite games, the platforms on which those games play at their best, and the experiences that turn every screen into an Xbox.
**Responsibilities**
Do you want to influence product engineering teams to shape the next generation of data and analytics capabilities for Xbox? The Xbox Plaform Data Intelligence Team is looking for a highly-motivated Data Engineer with data platform experience. You will work closely with engineering and product management in designing, implementing, and evolving innovative capabilities tailored to drive analytics and insights on engineering features. You will leverage core data pipelines to identify insights and experiment ideas that influence product decisions. Our capabilities influence data-driven decision making across Xbox Leadership, Finance, Business Planning, and Engineering teams.
Collaboration, diversity, & self-direction are valued here. Expect to be given room and support to grow personally and professionally.
Technically challenging projects, a healthy and high-caliber team, game-changing products for excited fans. don't miss this rewarding opportunity!
**Responsibilities**
+ Work within and across teams to solve complex technical challenges
+ Develop engineering best-practices - continuously evaluate our processes and reporting to identify opportunities to improve, enhance, and automate existing and new capabilities with a fundamental understanding of the end-to-end scenario
+ Measure the success and usage patterns of the product / feature at various levels as well as key engineering metrics
+ Provide thought leadership, creation, and execution on data platform capabilities
+ Grow & foster an inclusive, creative, high-performance team culture
+ Coach & mentor other team members
+ Contribute to a data-driven culture as well as a culture of experimentation across the organization.
**Qualifications**
**Required:**
+ Bachelor's or Master's Degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or a related field, OR equivalent experience, with 8+ years of experience in business analytics, data science, software development, data modeling, or data engineering.
+ Experience working with cloud-based technologies, including relational databases, data warehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools, data lakes.
+ Self-motivated and organized to deliver results
**Preferred:**
+ 1+ year(s) people management experience
+ Experience with Azure Analytics stack, e.g., Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Data Explorer (Kusto), Azure Cosmos DB, Azure logic apps, Fabric/Power BI
+ Experience in modern DevOps practices (including Git, CI/CD)
+ Good interpersonal and communications (verbal and written) skills, including the ability to effectively communicate with both business and technical teams.
+ Ability to use judgement and rating schemes to turn qualitative information into quantitative estimates
+ Proficiency in scenario analytics, mining for insights
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations ( .
Data Engineering Analyst
Posted 3 days ago
Job Viewed
Job Description
We are seeking a talented and motivated Data Engineer to join our growing data team. You will play a key role in building scalable data pipelines, optimizing data infrastructure, and enabling data-driven solutions.
**Primary Responsibilities:**
+ Design, develop, and maintain scalable ETL/ELT pipelines for batch and real-time data processing
+ Build and optimize data models and data warehouses to support analytics and reporting
+ Collaborate with analysts and software engineers to deliver high-quality data solutions
+ Ensure data quality, integrity, and security across all systems
+ Monitor and troubleshoot data pipelines and infrastructure for performance and reliability
+ Contribute to internal tools and frameworks to improve data engineering workflows
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ 5+ years of experience working on commercially available software and / or healthcare platforms as a Data Engineer
+ 3+ years of solid experience designing and building Enterprise Data solutions on cloud
+ 1+ years of experience developing solutions hosted within public cloud providers such as Azure or AWS or private cloud/container-based systems using Kubernetes/OpenShift
+ Experience with some of the modern relational databases
+ Experience with Data warehousing services preferably Snowflake
+ Experience in using modern software engineering and product development tools including Agile / SAFE, Continuous Integration, Continuous Delivery, DevOps etc.
+ Solid experience of operating in a quickly changing environment and driving technological innovation to meet business requirements
+ Skilled at optimizing SQL statements
+ Subject matter expert on Cloud technologies preferably Azure and Big Data ecosystem
**Preferred Qualifications:**
+ Experience with real-time data streaming and event-driven architectures
+ Experience building Big Data solutions on public cloud (Azure)
+ Experience building data pipelines on Azure with skills Databricks spark, scala, Azure Data factory, Kafka and Kafka Streams, App services, Az Functions
+ Experience developing RESTful Services in .NET, Java or any other language
+ Experience with DevOps in Data engineering
+ Experience with Microservices architecture
+ Exposure to DevOps practices and infrastructure-as-code (e.g., Terraform, Docker)
+ Knowledge of data governance and data lineage tools
+ Ability to establish repeatable processes, best practices and implement version control software in a Cloud team environment
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
Data Engineering Consultant
Posted 3 days ago
Job Viewed
Job Description
**Primary Responsibilities:**
+ Ingest data from multiple on-prem and cloud data sources using various tools & capabilities in Azure
+ Design and develop Azure Databricks processes using PySpark/Spark-SQL
+ Design and develop orchestration jobs using ADF, Databricks Workflow
+ Analyzing data engineering processes being developed and act as an SME to troubleshoot performance issues and suggest solutions to improve
+ Building test framework for the Databricks notebook jobs for automated testing before code deployment
+ Design and build POCs to validate new ideas, tools, and architectures in Azure
+ Continuously explore new Azure services and capabilities; assess their applicability to business needs
+ Prepare case studies and technical write-ups to showcase successful implementations and lessons learned
+ Work closely with clients, business stakeholders, and internal teams to gather requirements and translate them into technical solutions using best practices and appropriate architecture
+ Contribute to full lifecycle project implementations, from design and development to deployment and monitoring
+ Ensure solutions adhere to security, compliance, and governance standards
+ Monitor and optimize data pipelines and cloud resources for cost and performance efficiency
+ Identifies solutions to non-standard requests and problems
+ Mentor and support existing on-prem developers for cloud environment
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Undergraduate degree or equivalent experience
+ 7+ years of overall experience in Data & Analytics engineering
+ 5+ years of experience working with Azure, Databricks, and ADF, Data Lake
+ 5+ years of experience working with data platform or product using PySpark and Spark-SQL
+ Solid experience with CICD tools such as Jenkins, GitHub, Github Actions, Maven etc.
+ In-depth understanding of Azure architecture & ability to come up with efficient design & solutions
+ Highly proficient in Python and SQL
+ Proven excellent communication skills
+ **Key Skill:** Azure Data Engineer - Azure Databricks, Azure Data factory, Python/Pyspark, Terraform
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
Data Engineering Analyst
Posted today
Job Viewed
Job Description
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
We are seeking a talented and motivated Data Engineer to join our growing data team. You will play a key role in building scalable data pipelines, optimizing data infrastructure, and enabling data-driven solutions.
Primary Responsibilities:
Required Qualifications:
Preferred Qualifications:
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
Data Engineering Lead
Posted today
Job Viewed
Job Description
Overview
On Team Xbox, we aspire to empower the world’s 3 billion gamers to play the games they want, with the people they want, anywhere they want. Gaming, the largest and fastest growing category in media & entertainment, represents an important growth opportunity for Microsoft. We are leading with innovation, as highlighted by bringing Xbox to new devices with Cloud Gaming, bringing the Game Pass subscription to PC, and our recent acquisition of Activision Blizzard King creating exciting new possibilities for players.
The Xbox Experiences and Platforms team is home to the engineering work that makes this vision possible, building the developer tools and services that enable game creators to craft incredible experiences, the commerce systems that connect publishers with their audience and help gamers engage with their next favorite games, the platforms on which those games play at their best, and the experiences that turn every screen into an Xbox.
Qualifications
Required:
Bachelor’s or Master’s Degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or a related field, OR equivalent experience, with 8+ years of experience in business analytics, data science, software development, data modeling, or data engineering.
Experience working with cloud-based technologies, including relational databases, data warehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools, data lakes.
Preferred:
Responsibilities
Do you want to influence product engineering teams to shape the next generation of data and analytics capabilities for Xbox? The Xbox Plaform Data Intelligence Team is looking for a highly-motivated Data Engineer with data platform experience. You will work closely with engineering and product management in designing, implementing, and evolving innovative capabilities tailored to drive analytics and insights on engineering features. You will leverage core data pipelines to identify insights and experiment ideas that influence product decisions. Our capabilities influence data-driven decision making across Xbox Leadership, Finance, Business Planning, and Engineering teams.
Collaboration, diversity, & self-direction are valued here. Expect to be given room and support to grow personally and professionally.
Technically challenging projects, a healthy and high-caliber team, game-changing products for excited fans… don’t miss this rewarding opportunity!
Responsibilities
Data Engineering Analyst
Posted today
Job Viewed
Job Description
Worked collaboratively with cross-functional teams and stakeholders to achieve an organizational goal.
Worked in an agile environment and are comfortable running an agile process for the data and analytics team.
Strong experience in data pipelines, ETL design (both implementation and maintenance), data warehousing, and data modeling (preferably in dbt).
Implementation and tuning experience in the Big Data Ecosystem,
(such as Data Analytics (Dataproc, Airflow, Hadoop, Spark, Hive),
Google Cloud Platform AI and ML Services and Data Warehousing (such as BigQuery, schema design,
query tuning and optimization) and data migration and integration.
End to end hands-on to carry out complex POC, Pilot, Limited production rollout, assignments requiring the development of new or improved techniques and procedures.
Participated in deep architectural discussions to build confidence and ensure customer, success when building new, or migrating existing, applications, software, and services on the Google Cloud Platform.
advanced skills in SQL, data modeling, ETL/ELT development, and data warehousing.
Strong skills in Optimization - performance, pipeline, spark.
Experience on Pyspark.
5+ years of design & implementation experience with distributed applications.
5+ years of experience architecting/operating solutions built on Google Cloud Platform.
• Bachelor’s degree.
Data Engineering Consultant
Posted today
Job Viewed
Job Description
Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers, comprehensive benefits and career development opportunities. Come make an impact on the communities we serve as you help us advance health optimization on a global scale. Join us to start Caring. Connecting. Growing together.
Primary Responsibilities:
Required Qualifications:
At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission.
Be The First To Know
About the latest Etl processes Jobs in Noida !
Assoc Data Engineering Mgr
Posted 3 days ago
Job Viewed
Job Description
**About UHG**
**United Health Group is a leading health care company serving more than 85 million people worldwide. The organization is ranked 5th among Fortune 500 companies. UHG serves its customers through two different platforms - United Health Care (UHC) and Optum. UHC is responsible for providing healthcare coverage and benefits services, while Optum provides information and technology enabled health services.**
**India operations of UHG are aligned to Optum. The Optum Global Analytics Team, part of Optum, is involved in developing broad-based and targeted analytics solutions across different verticals for all lines of business.**
**Qualifications & Requirements:**
**·** **Bachelors / 4 year university degree**
**·** **Experience - Between 7-10 Years of Experience with below mentioned Skills**
**Must Have Skills**
+ Good understanding of Spark Architecture
+ Good understanding of Data Architecture and solutions in Azure
+ Good Skills in Azure Data Processing skills like Azure data Factory and Azure data Bricks
+ Good experience in building data pipelines using ADF
+ Strong proficiency in SQL and complex queries
+ Good experience with programming languages such as Python, PySpark.
+ Ability to learn and adapt to new data technologies
+ Knowledge & experience with Containerization - Docker, Kubernetes
+ Knowledge/Experience with Bigdata & Hadoop ecosystem - Spark, Hive, HBase, Sqoop etc.
+ Build / Deployment Automation - Jenkins.
+ Good problem-solving skills
+ Good communication skills
+ Act in a strategic capacity as a senior technical expert for all current Azure Cloud based solutions while keeping abreast of industry Cloud solutions
+ Lead project independently & with minimal guidance, including high level client communication and project planning.
**Good to Have**
+ Technical lead for Data Engineering - Data pipelines, Data modelling and Data warehouse.
+ Experience of developing cloud-based API gateways
+ Experience & exposure to API integration frameworks
+ Certified in Azure Data Engineering (AZ-205)
+ Excellent time management, communication, decision making, and presentation skills
**Position Responsibilities:**
**·** **Work under supervision of Data Architects to gather requirements to create Datamodel for Data Science & Business Intelligence projects**
**·** **Work closely with Data Architects to create project plans & list down exhaustive list of activities to be carried out to implement solution**
**·** **Engage in client communications for all important functions including data understanding/exploration, strategizing solutions etc.**
**·** **Document the Metadata information about the data sources used in the project & present that information to team members during team meetings**
**·** **Design & Develop Data Marts, De-normalized views & Data Models for projects**
**·** **Design & Develop Data Quality control processes around the data sets used for analysis**
**·** **Mentoring & Grooming Junior Engineers**
**·** **Lead and Drive Knowledge sharing session within the team**
**·** **Own the technical deliveries of the team**
**·** **Work with Senior team members to develop new capabilities for the team**
**·** **Being Accountable**
**·** **Possess Achievable Drive**
**·** **Passionate about software development**
**·** **Looks forward to build and apply technical and functional skills**
**·** **Focuses on understanding Goals, Priorities and Plans**
**·** **Possess problem solving approach**
Technical Lead (Data Engineering)
Posted 2 days ago
Job Viewed
Job Description
Who we are:
LUMIQ is the leading data and analytics company in the Financial Services and Insurance (FSI) industry. We are trusted by the world's largest FSIs, including insurers, banks, AMCs, and NBFCs, to address their data challenges. Our clients include 40+ enterprises with over $10B in deposits/AUM, collectively representing about 1B customers globally.
Our expertise lies in creating next-gen data technology products to help FSI enterprises organize, manage, and effectively use data. We have consistently challenged the status quo, introducing many industry-firsts like the first enterprise data platform in Asia on the cloud for a regulated entity.
Founded in 2013, LUMIQ has now completed a decade of innovation, backed by Info Edge Ventures(a JV between Temasek Holdings of Singapore and Naukri) and US-based Season 2 Ventures.
Our Culture:
At LUMIQ, we strive to create a community of passionate data professionals who aim to transcend the usual corporate dynamics. We offer you the freedom to ideate, commit, and navigate your career trajectory at your own pace.
Culture of ownership – empowerment to drive outcomes.
Our culture encourages 'Tech Poetry' – combining creativity and technology to create solutions that revolutionize industry. We trust our people to manage their responsibilities with minimal policy constraints. Our team is composed of the industry's brightest minds, from PhDs and engineers to industry specialists from Banking, Insurance, NBFCs, and AMCs, who will challenge and inspire you to reach new heights.
Job Description:
We are seeking a highly skilled Lead Data Engineer to join our dynamic team. In this role, you will not only design and develop our cloud-based data infrastructure but also lead a team of Data Engineers to deliver robust and scalable data solutions for our BFSI customers. As a Tech Lead, you will work at the intersection of cloud technologies, data engineering, and the BFSI domain, while guiding the team to ensure project success.
Key Responsibilities:
- Lead, mentor, and manage a team of Data Engineers to deliver high-quality data solutions.
- Design, develop, and implement cloud-based data pipelines, ETL processes, and data integration solutions using platforms like AWS, GCP, or Azure.
- Collaborate with cross-functional teams to understand data requirements and design scalable data models and architectures that align with BFSI industry needs.
- Optimize data storage, processing, and retrieval for maximum performance and cost-efficiency in cloud environments.
- Implement data security and compliance measures to ensure the protection and integrity of sensitive BFSI data.
- Work closely with data scientists and analysts to enable seamless access to high-quality data for analytical purposes.
- Troubleshoot and resolve data-related issues, ensuring data availability and reliability for BFSI customers.
- Stay updated on industry-best practices, emerging cloud technologies, and trends in the BFSI sector to drive continuous improvement and innovation.
- Manage project timelines, delegate tasks, and ensure the successful delivery of data engineering projects.
Qualifications:
- Minimum 7 years of experience.
- Proven experience in leading and managing a team of Data Engineers in previous roles.
- Bachelor’s degree in computer science, Engineering, or a related field. Master's degree preferred.
- Proven experience in cloud data engineering, with expertise in platforms such as AWS, Azure, or Google Cloud.
- Proficiency in programming languages like Python, Java, or Spark for data processing and ETL operations.
- Strong understanding of data warehousing concepts, data modeling, and database management systems.
- Experience with big data technologies (e.g., Hadoop, Spark) and data processing frameworks.
- Familiarity with BFSI industry data standards, compliance requirements, and security protocols.
- Excellent problem-solving skills and the ability to work in a collaborative, cross-functional team environment.
What do you get:
- Opportunity to contribute to an entrepreneurial culture and exposure to the startup hustler culture.
- Competitive Salary Packages.
- Group Medical Policies.
- Equal Employment Opportunity.
- Maternity Leave.
- Opportunities for upskilling and exposure to the latest technologies.
- 100% Sponsorship for certification.
- Flexible work hours.
Sr. Manager- Data Engineering
Posted 4 days ago
Job Viewed
Job Description
Looking for Manager Data Engineering :
- 12+ years total experince in data engineering and analytics.
- 2 years of experience in GCP Cloud services such as Big Query, Airflow DAG, Dataflow etc.
- 2 years of experience in Data Extraction and creating data pipeline workflows on Bigdata(Hive, HQL/Pyspark) with knowledge of Data Engineering concepts.
- Exposure in analyzing large data sets from multiple data sources, perform validation of data
- Knowledge of Hadoop Eco-system components like HDFS, Spark, Hive, Sqoop.
- Experience writing code in Python.
- Knowledge of SQL/HQL functionalities to write the optimized queries
- Ability to build a migration plan in collaboration with stakeholders
- Analytical and problem-solving skills