882 Data Engineering jobs in Delhi
Data Engineering Lead
Posted 8 days ago
Job Viewed
Job Description
The Xbox Experiences and Platforms team is home to the engineering work that makes this vision possible, building the developer tools and services that enable game creators to craft incredible experiences, the commerce systems that connect publishers with their audience and help gamers engage with their next favorite games, the platforms on which those games play at their best, and the experiences that turn every screen into an Xbox.
**Responsibilities**
Do you want to influence product engineering teams to shape the next generation of data and analytics capabilities for Xbox? The Xbox Plaform Data Intelligence Team is looking for a highly-motivated Data Engineer with data platform experience. You will work closely with engineering and product management in designing, implementing, and evolving innovative capabilities tailored to drive analytics and insights on engineering features. You will leverage core data pipelines to identify insights and experiment ideas that influence product decisions. Our capabilities influence data-driven decision making across Xbox Leadership, Finance, Business Planning, and Engineering teams.
Collaboration, diversity, & self-direction are valued here. Expect to be given room and support to grow personally and professionally.
Technically challenging projects, a healthy and high-caliber team, game-changing products for excited fans. don't miss this rewarding opportunity!
**Responsibilities**
+ Work within and across teams to solve complex technical challenges
+ Develop engineering best-practices - continuously evaluate our processes and reporting to identify opportunities to improve, enhance, and automate existing and new capabilities with a fundamental understanding of the end-to-end scenario
+ Measure the success and usage patterns of the product / feature at various levels as well as key engineering metrics
+ Provide thought leadership, creation, and execution on data platform capabilities
+ Grow & foster an inclusive, creative, high-performance team culture
+ Coach & mentor other team members
+ Contribute to a data-driven culture as well as a culture of experimentation across the organization.
**Qualifications**
**Required:**
+ Bachelor's or Master's Degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or a related field, OR equivalent experience, with 8+ years of experience in business analytics, data science, software development, data modeling, or data engineering.
+ Experience working with cloud-based technologies, including relational databases, data warehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools, data lakes.
+ Self-motivated and organized to deliver results
**Preferred:**
+ 1+ year(s) people management experience
+ Experience with Azure Analytics stack, e.g., Azure Data Lake, Azure Data Factory, Azure Synapse, Azure Data Explorer (Kusto), Azure Cosmos DB, Azure logic apps, Fabric/Power BI
+ Experience in modern DevOps practices (including Git, CI/CD)
+ Good interpersonal and communications (verbal and written) skills, including the ability to effectively communicate with both business and technical teams.
+ Ability to use judgement and rating schemes to turn qualitative information into quantitative estimates
+ Proficiency in scenario analytics, mining for insights
Microsoft is an equal opportunity employer. Consistent with applicable law, all qualified applicants will receive consideration for employment without regard to age, ancestry, citizenship, color, family or medical care leave, gender identity or expression, genetic information, immigration status, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran or military status, race, ethnicity, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable local laws, regulations and ordinances. If you need assistance and/or a reasonable accommodation due to a disability during the application process, read more about requesting accommodations ( .
Manager, Data Engineering
Posted today
Job Viewed
Job Description
At Cotality, we are driven by a single mission—to make the property industry faster, smarter, and more people-centric. Cotality is the trusted source for property intelligence, with unmatched precision, depth, breadth, and insights across the entire ecosystem. Our talented team of 5,000 employees globally uses our network, scale, connectivity and technology to drive the largest asset class in the world. Join us as we work toward our vision of fueling a thriving global property ecosystem and a more resilient society.
Cotality is committed to cultivating a diverse and inclusive work culture that inspires innovation and bold thinking; it's a place where you can collaborate, feel valued, develop skills and directly impact the real estate economy. We know our people are our greatest asset. At Cotality, you can be yourself, lift people up and make an impact. By putting clients first and continuously innovating, we're working together to set the pace for unlocking new possibilities that better serve the property industry.
Job Description
In India, we operate as Next Gear India Private Limited, a fully-owned subsidiary of Cotality with offices in Kolkata, West Bengal, and Noida, Uttar Pradesh. Next Gear India Private Limited plays a vital role in Cotality's Product Development capabilities, focusing on creating and delivering innovative solutions for the Property & Casualty (P&C) Insurance and Property Restoration industries.
While Next Gear India Private Limited operates under its own registered name in India, we are seamlessly integrated into the Cotality family, sharing the same commitment to innovation, quality, and client success.
When you join Next Gear India Private Limited, you become part of the global Cotality team. Together, we shape the future of property insights and analytics, contributing to a smarter and more resilient property ecosystem through cutting-edge technology and insights.
In India, we operate as Next Gear India Private Limited, a fully-owned subsidiary of Cotality with offices in Kolkata, West Bengal, and Noida, Uttar Pradesh. Next Gear India Private Limited plays a vital role in Cotality's Product Development capabilities, focusing on creating and delivering innovative solutions for the Property & Casualty (P&C) Insurance and Property Restoration industries.
While Next Gear India Private Limited operates under its own registered name in India, we are seamlessly integrated into the Cotality family, sharing the same commitment to innovation, quality, and client success.
When you join Next Gear India Private Limited, you become part of the global Cotality team. Together, we shape the future of property insights and analytics, contributing to a smarter and more resilient property ecosystem through cutting-edge technology and insights.
The
Manager of Data Engineering
is a leader with a passion for leveraging technical solutions to address business challenges. This role requires deep expertise in agile development practices and a commitment to extreme ownership of software products and platforms. The ideal candidate will collaborate closely with Product Managers and Engineering teams to drive both transformational and operational initiatives.
Key Responsibilities Would Include
- Motivate a high-performing team to achieve outstanding results while fostering individual growth and development.
- Proven track record of leading teams that have successfully built and launched products in highly scalable growth markets.
- Experience in building teams and leading organizational change within a fast-paced and highly regarded technology company.
- Partners with business product leadership to develop strategies and technology roadmaps.
- Positive client engagement at senior levels, managing and navigating relationships with peers, business line leaders, and engagement across the Protect matrix of services.
- IT solution development that aligns with the company's strategic architecture.
- Manage vendor solutions and deliverables.
- Responsible for the delivery of complex Data Engineering projects, including data marts, data lakes, data interchanges, and data warehouses.
- Responsible for managing the costs, optimizations, and overall cost strategies for cloud computing in your domain.
Experience
Job Qualifications:
- Total experience must be in range of 14-16 years.
- 10+ years of progressive experience in Data Engineering.
- Must be having 5+ years of exp. in MSSQL, Data Flow, GCP and Snowflake
- 5 – 8 years of experience leading technology teams.
- Proven success in delivering complex, high-impact projects with measurable business outcomes.
- Minimum 3 years of support in cloud-based data technologies.
Education
- A BS in Computer Science or an equivalent degree is highly preferred.
Technical Expertise
- Experience developing or leading development teams using the following technologies (or similar):
- Google Dataflow, Google Airflow, Microsoft Sql Server Integration Services (SSIS), PostgreSQL, Google BigQuery, Google Cloud Platform, REST Services, Data Visualization tools (e.g. PowerBI, SSRS)
- Industry Experience:
- Background in the Property and Casualty Insurance industry is preferred.
Cotality's Diversity Commitment
Cotality is fully committed to employing a diverse workforce and creating an inclusive work environment that embraces everyone's unique contributions, experiences and values. We offer an empowered work environment that encourages creativity, initiative and professional growth and provides a competitive salary and benefits package. We are better together when we support and recognize our differences.
Equal Opportunity Employer Statement
Cotality is an Equal Opportunity employer committed to attracting and retaining the best-qualified people available, without regard to race, ancestry, place of origin, colour, ethnic origin, citizenship, creed, sex, sexual orientation, record of offences, age, marital status, family status or disability. Cotality maintains a Drug-Free Workplace.
Please apply on our website for consideration.
Privacy Policy
Global Applicant Privacy Policy
By providing your telephone number, you agree to receive automated (SMS) text messages at that number from Cotality regarding all matters related to your application and, if you are hired, your employment and company business. Message & data rates may apply.
You can opt out at any time by responding STOP or UNSUBSCRIBING and will automatically be opted out company-wide.
Connect with us on social media Click on the quicklinks below to find out more about our company and associates
Data Engineering Manager
Posted today
Job Viewed
Job Description
Data Engineering Manager - Azure & Python
Experience: Years Exp.
Salary: Competitive
Preferred Notice Period: 30 Days
Shift: 10:00 AM to 7:00 PM IST
Opportunity Type: Noida (Remote for 6 months, Later Hybrid)
Placement Type: Permanent
(*Note: This is a requirement for one of Uplers' Clients)
Must have skills required :
Engineering management, Data Engineering, Azure Data Factory, Python, SQL OR NoSQL OR Azure, Backend OR FullStack
Nuaav (One of Uplers' Clients) is Looking for:
An Engineering Manager who is passionate about their work, eager to learn and grow, and who is committed to delivering exceptional results. If you are a team player, with a positive attitude and a desire to make a difference, then we want to hear from you.
Role Overview Description
As Engineering Manager Data Engineering at Nuaav, you will lead a talented team of data engineers focused on architecting and delivering enterprise-grade, scalable data platforms on Microsoft Azure. This role demands deep expertise in Azure cloud services and Python programming, combined with strong leadership skills to drive technical strategy, team growth, and execution of robust data infrastructures.
Key Responsibilities
- Lead, mentor, and grow a high-performing data engineering team delivering next-generation data solutions on Azure.
- Architect and oversee the development of scalable data pipelines and analytics platforms using Azure Data Lake, Data Factory, Databricks, and Synapse.
- Drive technical execution of data warehousing and BI solutions with advanced Python programming (including PySpark).
- Enforce high standards for data quality, consistency, governance, and security across data systems.
- Collaborate cross-functionally with product managers, software engineers, data scientists, and analysts to enable business insights and ML initiatives.
- Define and implement best practices for ETL design, data integration, and cloud-native workflows.
- Continuously optimize data processing for performance, reliability, and cost efficiency.
- Oversee technical documentation, onboarding, and process compliance within the engineering team.
- Stay abreast of industry trends in data engineering, Azure technologies, and cloud security to maintain cutting-edge capabilities.
Qualifications
- Bachelors or Masters degree in Computer Science, Engineering, or related field.
- 5+ years data engineering experience with significant team leadership or management exposure.
- Strong expertise in designing and building cloud data solutions on Microsoft Azure (Data Lake, Synapse, Data Factory, Databricks).
- Advanced Python skills for data transformation, automation, and pipeline development (including PySpark).
- Solid SQL skills; experience with big data tools like Spark, Hive, or Scala is a plus.
- Knowledge of CI/CD pipelines, DevOps practices, and Infrastructure-as-Code (Terraform, GitHub Actions).
- Experience with data security, governance, and compliance frameworks in cloud environments.
- Excellent communication, leadership, and project management capabilities.
Desired Skills
- Azure Data Factory, Databricks, Synapse Analytics expert.
- Proficiency with Python, PySpark, SQL for ETL and data workflows.
- Familiarity with big data frameworks (Spark, HDFS).
- Hands-on experience with DevOps tools and container technologies (GitHub, Docker, Kubernetes).
- Strong cross-functional collaboration and team mentoring skills.
This role offers an exciting opportunity to lead and scale mission-critical data infrastructure at Nuaav, a firm known for its boutique approach combining technical mastery with personalized client impact and agility in delivery. Candidates will thrive in a fast-paced, innovative setting with a clear path for growth and influence.
Why Join Nuaav?
- Opportunity to work in a strong AI driven consulting firm with direct client engagement and high-impact projects.
- Be part of a dynamic environment focused on innovation, agility, and quality over volume.
- Exposure to cutting-edge technologies across data engineering, AI, and product platforms.
- Work on global-scale digital transformation projects with close collaboration alongside senior consultants and corporate leaders.
- A culture that values personalized growth, client-centric excellence, and thought leadership.
How to apply for this opportunity:
Easy 3-Step Process:
1. Click On Apply And Register or log in on our portal
Upload updated Resume & Complete the Screening Form
Increase your chances to get shortlisted & meet the client for the Interview
About Our Client:
Nuaav is a boutique technology consulting firm focused on delivering innovative, scalable, and secure data engineering and AI solutions.
About Uplers:
Our goal is to make hiring and getting hired reliable, simple, and fast. Our role will be to help all our talents find and apply for relevant product and engineering job opportunities and progress in their career.
(Note: There are many more opportunities apart from this on the portal.)
So, if you are ready for a new challenge, a great work environment, and an opportunity to take your career to the next level, don't hesitate to apply today. We are waiting for you
Data Engineering Lead
Posted today
Job Viewed
Job Description
Overview
On Team Xbox, we aspire to empower the world’s 3 billion gamers to play the games they want, with the people they want, anywhere they want. Gaming, the largest and fastest growing category in media & entertainment, represents an important growth opportunity for Microsoft. We are leading with innovation, as highlighted by bringing Xbox to new devices with Cloud Gaming, bringing the Game Pass subscription to PC, and our recent acquisition of Activision Blizzard King creating exciting new possibilities for players.
The Xbox Experiences and Platforms team is home to the engineering work that makes this vision possible, building the developer tools and services that enable game creators to craft incredible experiences, the commerce systems that connect publishers with their audience and help gamers engage with their next favorite games, the platforms on which those games play at their best, and the experiences that turn every screen into an Xbox.
Qualifications
Required:
Bachelor’s or Master’s Degree in Computer Science, Mathematics, Software Engineering, Computer Engineering, or a related field, OR equivalent experience, with 8+ years of experience in business analytics, data science, software development, data modeling, or data engineering.
Experience working with cloud-based technologies, including relational databases, data warehouse, big data (e.g., Hadoop, Spark), orchestration/data pipeline tools, data lakes.
Preferred:
Responsibilities
Do you want to influence product engineering teams to shape the next generation of data and analytics capabilities for Xbox? The Xbox Plaform Data Intelligence Team is looking for a highly-motivated Data Engineer with data platform experience. You will work closely with engineering and product management in designing, implementing, and evolving innovative capabilities tailored to drive analytics and insights on engineering features. You will leverage core data pipelines to identify insights and experiment ideas that influence product decisions. Our capabilities influence data-driven decision making across Xbox Leadership, Finance, Business Planning, and Engineering teams.
Collaboration, diversity, & self-direction are valued here. Expect to be given room and support to grow personally and professionally.
Technically challenging projects, a healthy and high-caliber team, game-changing products for excited fans… don’t miss this rewarding opportunity!
Responsibilities
Data Engineering Analyst
Posted today
Job Viewed
Job Description
Worked collaboratively with cross-functional teams and stakeholders to achieve an organizational goal.
Worked in an agile environment and are comfortable running an agile process for the data and analytics team.
Strong experience in data pipelines, ETL design (both implementation and maintenance), data warehousing, and data modeling (preferably in dbt).
Implementation and tuning experience in the Big Data Ecosystem,
(such as Data Analytics (Dataproc, Airflow, Hadoop, Spark, Hive),
Google Cloud Platform AI and ML Services and Data Warehousing (such as BigQuery, schema design,
query tuning and optimization) and data migration and integration.
End to end hands-on to carry out complex POC, Pilot, Limited production rollout, assignments requiring the development of new or improved techniques and procedures.
Participated in deep architectural discussions to build confidence and ensure customer, success when building new, or migrating existing, applications, software, and services on the Google Cloud Platform.
advanced skills in SQL, data modeling, ETL/ELT development, and data warehousing.
Strong skills in Optimization - performance, pipeline, spark.
Experience on Pyspark.
5+ years of design & implementation experience with distributed applications.
5+ years of experience architecting/operating solutions built on Google Cloud Platform.
• Bachelor’s degree.
Senior Data Engineering Lead
Posted 7 days ago
Job Viewed
Job Description
**Primary Responsibilities:**
+ Administer and maintain Postgres and MySQL databases in Azure across multiple environments
+ Design and implement database solutions based on application requirements
+ Maintain documentation related to database design, architecture, and procedures
+ Tuning of the database and data models for performance
+ Database upgrades in the Azure environment
+ Working independently with minimal guidance on multiple tasks across multiple scrum teams
+ Ensuring security standards are met and backup strategies are in place
+ Understanding database architecture and design, suggesting improvements and updates to database architecture
+ Design and develop resilient, reliable, scalable and self-healing solutions to meet and exceed customer requirements
+ Relieve the team of "churn" and "waste" by introducing automation of menial tasks
+ Collaborate with engineers on partner-teams to build cohesive and optimal solutions
+ Communicate clearly and effectively in oral and written forms, and be able to present and demonstrate work to technical and non-technical stakeholders
+ Mentor junior members of the engineering team to develop and perform as highly as possible
+ Contribute to development team and help to achieve key business objectives
+ Contribute to large, complex projects to achieve key business objectives
+ Collaborate with the team on application architecture design and decision-making
+ Design and implement database enhancements in collaboration with different teams
+ Solves unique and complex problems with broad impact on the business
+ Translates highly complex concepts in ways that can be understood by a variety of audiences
+ The candidate must be able to work in a fast paced, high pressure environment
+ Present and demonstrate solutions to peers and Sr Management
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ 8+ years of Experience
+ 5+ years experience on Postgres database administration. Must have a good understanding of Postgres database architecture, administration and configuration
+ 5+ years of experience using SQL for querying, manipulation and managing data within the database
+ 5+ years experience in optimizing database performance through indexing, query tuning and other techniques
+ 3+ years experience on MySQL database administration. Must have a good understanding of Postgres database architecture, administration and configuration
+ 3+ years experience in systems analysis
+ 3+ years experience in presenting and demonstrating solutions to peers and Sr. Management
+ 2+ years experience with Postgres Flexible Server on Azure
+ 2+ years experience working in an Agile environment
+ Good knowledge of Postgres and MySQL security best practices including user management, access controls and data encryption
+ Proven solid communication and interpersonal skills
**Preferred Qualifications:**
+ 5+ years experience working in a Health Care Environment/ Medical Management experience
+ 3+ years Care Management and Utilization Management experience
+ 2+ years working in a cloud-based environment
+ Linux experience
+ Experience working in a virtual team environment
+ Github, Python, Snowflake, Java, Postgres, Azure
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
Azure Architect (Data Engineering)
Posted 3 days ago
Job Viewed
Job Description
Job Title: Azure Architect – Analytics & Data Services
Location: Noida/Kolkata/Bengaluru
Job Type: Full-time
Experience: 8+ years
Industry: Analytics Services
Roles and Responsibilities
- Lead end-to-end architecture design for data and analytics solutions on Azure.
- Define and implement Azure-based modern data platforms, including data lakes and data warehouses.
- Partner with project managers to oversee solution delivery and ensure timelines and milestones are met.
- Collaborate with Pre-sales teams to support RFP responses, solutioning, and client presentations.
- Create and maintain comprehensive architectural documentation and design specifications.
- Review and guide implementation teams on best practices for deploying Azure services and data workloads.
- Ensure architecture aligns with organizational security, compliance, and governance standards.
- Oversee data integration pipelines and ETL/ELT processes using Azure tools.
- Support application migration and modernization efforts on Azure.
- Provide technical leadership and mentoring to development and data engineering teams.
- Troubleshoot architectural issues and provide hands-on support when needed.
- Regularly assess performance, scalability, and reliability of deployed solutions and suggest optimizations.
Required Technical and Professional Expertise
- 4+ years of hands-on experience with Microsoft Azure, including services such as Data Factory, Databricks, Synapse Analytics, and Azure Data Lake Storage.
- Proven expertise in designing and implementing enterprise-grade data and analytics solutions, including Data Lakes and Data Warehouses.
- Experience in application migration and modernization on cloud platforms (Azure, GCP preferred).
- Strong understanding of cloud security, identity management (including Active Directory), and compliance practices.
- Proficient in modern application architectures (microservices, containers, event-driven systems).
- Bachelor’s degree in engineering (B. Tech or equivalent) with a solid foundation in software engineering and architectural design.
- Strong documentation, stakeholder communication, and project leadership skills.
- Preferred Technical and Professional Expertise
- Microsoft Azure Certifications: AZ-900 (Azure Fundamentals), AZ-305 (Solution Architect Expert), DP-203 (Data Engineer Associate).
- Experience working with Azure Machine Learning (Azure ML).
About Polestar
As a data analytics and enterprise planning powerhouse, Polestar Solutions helps its customers bring out the most sophisticated insights from their data in a value-oriented manner. From analytics foundation to analytics innovation initiatives, we offer a comprehensive range of services that help businesses succeed with data.
We have a geographic presence in the United States (Dallas, Manhattan, New York, Delaware), UK(London) & India (Delhi-NCR, Mumbai, Bangalore & Kolkata) and have 600+ people strong world-class team. We are growing at a rapid pace and plan to double our growth each year. This provides immense growth and learning opportunities to those who are choosing to work with Polestar.
Our expertise and deep passion for what we do has brought us many accolades.
The list includes:
- Recognized as “Great Place to Work” - 2024
- Recognized as the Top 50 Companies for Data Scientists in 2023 by AIM.
- Financial Times awarded Polestar as High-Growth Companies across Asia-Pacific for a 5th time in a row in 2023.
- Featured on the Economic Times India's Growth Champions in FY2023.
- Polestar Analytics Selected as a 2022 Red Herring Global
- Top Data Science Providers in India 2022: Penetration and Maturity (PeMa) Quadrant
- FT ranking of 500 of the Asia-Pacific region’s high-growth companies.
- India’s most promising data science companies in 2022.
- Featured on Forrester's Now Tech: Customer Analytics Service Providers Report Q2, 2021.
- Recognized as Anaplan's India RSI Partner of the Year FY21.
- Elite Qlik Partner and a member of the ‘Qlik Partner Advisory Council’ & Microsoft Gold Partners for Data & Cloud Platforms Culture at Polestar.
We have one of the most progressive people’s practices which are all aimed at enabling fast-paced growth for those who deserve it.
Be The First To Know
About the latest Data engineering Jobs in Delhi !
Sr. Manager- Data Engineering
Posted 6 days ago
Job Viewed
Job Description
Looking for Manager Data Engineering :
- 12+ years total experince in data engineering and analytics.
- 2 years of experience in GCP Cloud services such as Big Query, Airflow DAG, Dataflow etc.
- 2 years of experience in Data Extraction and creating data pipeline workflows on Bigdata(Hive, HQL/Pyspark) with knowledge of Data Engineering concepts.
- Exposure in analyzing large data sets from multiple data sources, perform validation of data
- Knowledge of Hadoop Eco-system components like HDFS, Spark, Hive, Sqoop.
- Experience writing code in Python.
- Knowledge of SQL/HQL functionalities to write the optimized queries
- Ability to build a migration plan in collaboration with stakeholders
- Analytical and problem-solving skills
Director of Data Engineering
Posted today
Job Viewed
Job Description
DMI is seeking a full-time Director of Data Engineering to support our manufacturing clients large-scale digital transformation. The Director of Data Engineering is responsible for ensuring the day-to-day leadership and guidance of the local, India-based data team. This role will be the primary interface with the client's US-based management team and will work cross-functionally with various IT functions to streamline project delivery
Duties and Responsibilities:
• Work with a distributed team with a primary focus on the management of resources, team assignments, and fostering career growth
• Input into the hiring of team members for the locally-based team
• Support compliance with best practices related to data availability and security procedures
• Apply proven communication and problem-solving skills to resolve support data issues as they arise
• Demonstrate skills in abstract development frameworks
• Demonstrate accountability to assigned work & timelines
• Demonstrated leadership skills.
• Demonstrated technical competence for the role.
• Demonstrated timely delivery of assigned tasks and effective communication on project status and escalation when needed.
Education and Experience:
• 8+ years of experience in management roles dealing with resourcing. Experience with defining employee career growth, mentorship, and all HR responsibilities.
• 20+ years or equivalent degree + experience
Required Skills/Certifications:
• Strong analytical and problem-solving skills - Ability to determine data patterns and perform root cause analysis to resolve production reporting bugs
• Familiarity with the data, analytics, and BI space and knowledge of Power BI
• Experience working with Microsoft data integration platforms such as Azure Data Factory, SSIS, Synapse
• Experience with SQL (Python experience a plus)
• Familiarity with Azure DevOps for source code management a plus
• Understanding of data management (e. g. permissions, security, and monitoring)
• Experience working with and building strong relationships with customers and external partners
• Excellent written and verbal communication skills, including logical structuring and delivering presentations
• Knowledge of working with helpdesk tools or platforms like ServiceNow is a plus
• Experience with cloud services (Azure) is a plus
• Experience in working with an onshore client is desirable
• Eagerness to learn and think critically to design improved processes
Preferred Experience with:
• Estimating and Planning
• Work breakdown for the team
• Data pipelines
• Data Transformations
• Code/Unit Test
• PR & Code Reviews
• Performance & Load Testing
• Functional & Regression Testing
• Tier 2 support/consulting
• Production Support
• Functional ask to Technical design
• Data Engineering
• Agile Methodologies
• CI/CD
• Metadata driven frameworks.
• Technical documentation
• Azure Synapse Spark
• Python
• Complex SQL
• Parquet & Delta file processing
• ETL Optimizations
• Azure DevOps
Sr. Manager- Data Engineering
Posted today
Job Viewed
Job Description
12+ years total experince in data engineering and analytics.
2 years of experience in GCP Cloud services such as Big Query, Airflow DAG, Dataflow etc.
2 years of experience in Data Extraction and creating data pipeline workflows on Bigdata(Hive, HQL/Pyspark) with knowledge of Data Engineering concepts.
Exposure in analyzing large data sets from multiple data sources, perform validation of data
Knowledge of Hadoop Eco-system components like HDFS, Spark, Hive, Sqoop.
Experience writing code in Python.
Knowledge of SQL/HQL functionalities to write the optimized queries
Ability to build a migration plan in collaboration with stakeholders
Analytical and problem-solving skills