What Jobs are available for Data Science Teams in India?
Showing 1552 Data Science Teams jobs in India
Data Engineering
Posted 7 days ago
Job Viewed
Job Description
Responsibilities:
- Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.
- Create the data integration and data diagram documentation.
- Lead the data validation, UAT and regression test for new data asset creation.
- Create and maintain data models, including schema design and optimization.
- Create and manage data pipelines that automate the flow of data, ensuring data quality and consistency.
Qualifications and Skills:
- Strong knowledge on Python and Pyspark
- Expectation is to have ability to write Pyspark scripts for developing data workflows.
- Strong knowledge on SQL, Hadoop, Hive, Azure, Databricks and Greenplum
- Expectation is to write SQL to query metadata and tables from different data management system such as, Oracle, Hive, Databricks and Greenplum.
- Familiarity with big data technologies like Hadoop, Spark, and distributed computing frameworks.
- Expectation is to use Hue and run Hive SQL queries, schedule Apache Oozie jobs to automate the data workflows.
- Good working experience of communicating with the stakeholders and collaborate effectively with the business team for data testing.
- Expectation is to have strong problem-solving and troubleshooting skills.
- Expectation is to establish comprehensive data quality test cases, procedures and implement automated data validation processes.
- Degree in Data Science, Statistics, Computer Science or other related fields or an equivalent combination of education and experience.
- 3-7 years of experience in Data Engineer.
- Proficiency in programming languages commonly used in data engineering, such as Python, Pyspark, SQL.
- Experience in Azure cloud computing platform, such as developing ETL processes using Azure Data Factory, big data processing and analytics with Azure Databricks.
- Strong communication, problem solving and analytical skills with the ability to do time management and multi-tasking with attention to detail and accuracy.
Is this job a match or a miss?
Data Engineering Manager
Posted 3 days ago
Job Viewed
Job Description
At Amgen, if you feel like you're part of something bigger, it's because you are. Our shared mission-to serve patients living with serious illnesses-drives all that we do.
Since 1980, we've helped pioneer the world of biotech in our fight against the world's toughest diseases. With our focus on four therapeutic areas -Oncology, Inflammation, General Medicine, and Rare Disease- we reach millions of patients each year. As a member of the Amgen team, you'll help make a lasting impact on the lives of patients as we research, manufacture, and deliver innovative medicines to help people live longer, fuller happier lives.
Our award-winning culture is collaborative, innovative, and science based. If you have a passion for challenges and the opportunities that lay within them, you'll thrive as part of the Amgen team. Join us and transform the lives of patients while transforming your career.
**Data Engineering Manager**
**What you will do**
Let's do this. Let's change the world. In this vital role you will lead a team of data engineers to build, optimize, and maintain scalable data architectures, data pipelines, and operational frameworks that support real-time analytics, AI-driven insights, and enterprise-wide data solutions. As a strategic leader, the ideal candidate will drive best practices in data engineering, cloud technologies, and Agile development, ensuring robust governance, data quality, and efficiency. The role requires technical expertise, team leadership, and a deep understanding of cloud data solutions to optimize data-driven decision-making.
+ Lead and mentor a team of data engineers, fostering a culture of innovation, collaboration, and continuous learning for solving complex problems of R&D division.
+ Oversee the development of data extraction, validation, and transformation techniques, ensuring ingested data is of high quality and compatible with downstream systems.
+ Guide the team in writing and validating high-quality code for data ingestion, processing, and transformation, ensuring resiliency and fault tolerance.
+ Drive the development of data tools and frameworks for running and accessing data efficiently across the organization.
+ Oversee the implementation of performance monitoring protocols across data pipelines, ensuring real-time visibility, alerts, and automated recovery mechanisms.
+ Coach engineers in building dashboards and aggregations to monitor pipeline health and detect inefficiencies, ensuring optimal performance and cost-effectiveness.
+ Lead the implementation of self-healing solutions, reducing failure points and improving pipeline stability and efficiency across multiple product features.
+ Oversee data governance strategies, ensuring compliance with security policies, regulations, and data accessibility best practices.
+ Guide engineers in data modeling, metadata management, and access control, ensuring structured data handling across various business use cases.
+ Collaborate with business leaders, product owners, and cross-functional teams to ensure alignment of data architecture with product requirements and business objectives.
+ Prepare team members for key partner discussions by helping assess data costs, access requirements, dependencies, and availability for business scenarios.
+ Drive Agile and Scaled Agile (SAFe) methodologies, handling sprint backlogs, prioritization, and iterative improvements to enhance team velocity and project delivery.
+ Stay up-to-date with emerging data technologies, industry trends, and best practices, ensuring the organization uses the latest innovations in data engineering and architecture.
**What we expect of you**
We are all different, yet we all use our unique contributions to serve patients. We are seeking a seasoned Engineering Manager (Data Engineering) to drive the development and implementation of our data strategy with deep expertise in R&D of Biotech or Pharma domain.
**Basic Qualifications:**
+ Doctorate degree **OR**
+ Master's degree and 4 to 6 years of experience in Computer Science, IT or related field **OR**
+ Bachelor's degree and 6 to 8 years of experience in Computer Science, IT or related field **OR**
+ Diploma and 10 to 12 years of experience in Computer Science, IT or related field
+ Experience leading a team of data engineers in the R&D domain of biotech/pharma companies.
+ Experience architecting and building data and analytics solutions that extract, transform, and load data from multiple source systems.
+ Data Engineering experience in R&D for Biotechnology or pharma industry
+ Demonstrated hands-on experience with cloud platforms (AWS) and the ability to architect cost-effective and scalable data solutions.
+ Proficiency in Python, PySpark, SQL.
+ Experience with dimensional data modeling.
+ Experience working with Apache Spark, Apache Airflow.
+ Experienced with software engineering best-practices, including but not limited to version control (Git, Subversion, etc.), CI/CD (Jenkins, Maven etc.), automated unit testing, and Dev Ops.
+ Experienced with AWS or GCP or Azure cloud services.
+ Understanding of end to end project/product life cycle
+ Well versed with full stack development & DataOps automation, logging frameworks, and pipeline orchestration tools.
+ Strong analytical and problem-solving skills to address complex data challenges.
+ Effective communication and interpersonal skills to collaborate with cross-functional teams.
**Preferred Qualifications:**
+ AWS Certified Data Engineer preferred
+ Databricks Certificate preferred
+ Scaled Agile SAFe certification preferred
+ Project Management certifications preferred
+ Data Engineering Management experience in Biotech/Pharma is a plus
+ Experience using graph databases such as Stardog or Marklogic or Neo4J or Allegrograph, etc.
**Soft Skills:**
+ Excellent analytical and troubleshooting skills
+ Strong verbal and written communication skills
+ Ability to work effectively with global, virtual teams
+ High degree of initiative and self-motivation
+ Ability to handle multiple priorities successfully
+ Team-oriented, with a focus on achieving team goals
+ Strong presentation and public speaking skills
**What you can expect of us**
As we work to develop treatments that take care of others, we also work to care for your professional and personal growth and well-being. From our competitive benefits to our collaborative culture, we'll support your journey every step of the way.
In addition to the base salary, Amgen offers competitive and comprehensive Total Rewards Plans that are aligned with local industry standards.
**Apply now and make a lasting impact with the Amgen team.**
**careers.amgen.com**
As an organization dedicated to improving the quality of life for people around the world, Amgen fosters an inclusive environment of diverse, ethical, committed and highly accomplished people who respect each other and live the Amgen values to continue advancing science to serve patients. Together, we compete in the fight against serious disease.
Amgen is an Equal Opportunity employer and will consider all qualified applicants for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability status, or any other basis protected by applicable law.
We will ensure that individuals with disabilities are provided reasonable accommodation to participate in the job application or interview process, to perform essential job functions, and to receive other benefits and privileges of employment. Please contact us to request accommodation.
Is this job a match or a miss?
Data Engineering manager
Posted 3 days ago
Job Viewed
Job Description
Who We Are:
Ever wonder who brings the entertainment to your flights? Panasonic Avionics Corporation is #1 in the industry for delivering inflight products such as movies, games, WiFi, and now Bluetooth headphone connectivity!
How exciting would it be to be a part of the innovation that goes into creating technology that delights millions of people in an industry that's here to stay! With our company's history spanning over 40 years, you will have stability, career growth opportunities, and will work with the brightest minds in the industry. And we are committed to a diverse and inclusive culture that will help our organization thrive! We seek diversity in many areas such as background, culture, gender, ways of thinking, skills and more.
If you want to learn more about us visit us at ( . And for a full listing of open job opportunities go to (
**The Position:**
We are seeking a proven Data Engineering Leader to drive the design, development, and deployment of scalable, secure, and high-performance data solutions. This role will lead high-performing teams, architect cloud-native data platforms, and collaborate closely with business, AI/ML, and BI teams to deliver end-to-end data products that power innovation and strategic decision-making.
The position offers the opportunity to shape data architecture strategy, establish best practices in Lakehouse and streaming solutions, and enable advanced analytics and AI/ML at scale.
**Responsibilities**
**What We're Looking For:**
+ Proven leadership in building and mentoring high-performing data engineering teams.
+ Expertise in architecting cloud-native data platforms on AWS, leveraging services such as EMR, EKS, Glue, Redshift, S3, Lambda, and SageMaker.
+ Strong background in Lakehouse architecture (Glue Catalog, Iceberg, Delta Lake) and distributed processing frameworks (Spark, Hive, Presto).
+ Experience with real-time streaming solutions (Kafka, Kinesis, Flink).
+ Proficiency in orchestrating complex data workflows with Apache Airflow.
+ Hands-on experience with GitLab CI/CD, Terraform, CloudFormation Templates, and Infrastructure-as-Code.
+ Strong understanding of MDM strategies and data governance best practices (GDPR, HIPAA, etc.).
+ Ability to design and develop middleware APIs (REST) to seamlessly integrate data pipelines with applications and analytics platforms.
+ Experience supporting AI/ML teams with feature engineering, training, and deployment pipelines using SageMaker.
+ Solid knowledge of SQL & NoSQL databases (Redshift, DynamoDB, PostgreSQL, Elasticsearch).
+ Familiarity with BI enablement and data modeling for visualization platforms like Amazon QuickSight.
+ In-depth knowledge of security best practices in AWS-based data architectures.
+ Demonstrated success in driving AI/ML initiatives from ideation to production.
**Our Principles:** ** **
Contribution to Society | Fairness & Honesty | Cooperation & Team Spirit | Untiring Effort for Improvement | Courtesy & Humility | Adaptability | Gratitude
**What We Offer:** ** **
At Panasonic Avionics Corporation we realize the most important aspects in leading our industry are the bright minds behind everything we do. We are proud to offer our employees a highly competitive, comprehensive and flexible benefits program.
**Qualifications**
**Educational Background:**
+ Bachelor's degree or higher in Computer Science, Data Engineering, Aerospace Engineering, or a related field.
+ Advanced degrees (Master's/PhD) in Data Science or AI/ML are a plus.
REQ-
Is this job a match or a miss?
Technologist, Data Engineering
Posted today
Job Viewed
Job Description
Sandisk understands how people and businesses consume data and we relentlessly innovate to deliver solutions that enable today's needs and tomorrow's next big ideas. With a rich history of groundbreaking innovations in Flash and advanced memory technologies, our solutions have become the beating heart of the digital world we're living in and that we have the power to shape.
Sandisk meets people and businesses at the intersection of their aspirations and the moment, enabling them to keep moving and pushing possibility forward. We do this through the balance of our powerhouse manufacturing capabilities and our industry-leading portfolio of products that are recognized globally for innovation, performance and quality.
Sandisk has two facilities recognized by the World Economic Forum as part of the Global Lighthouse Network for advanced 4IR innovations. These facilities were also recognized as Sustainability Lighthouses for breakthroughs in efficient operations. With our global reach, we ensure the global supply chain has access to the Flash memory it needs to keep our world moving forward.
**Job Description**
We are seeking a highly experienced and visionary **Senior Data Scientist** at the **Technologist level** to lead strategic AI/ML and GenAI initiatives. This role demands deep technical expertise, leadership in complex projects, and a passion for innovation in data science and advanced analytics.
**Key Responsibilities**
+ Lead the **end-to-end data science lifecycle** : problem definition, data acquisition, model development, deployment, and monitoring.
+ Architect and implement **scalable AI/ML solutions** using modern frameworks, cloud platforms, and MLOps best practices.
+ Drive **GenAI initiatives** including fine-tuning, prompt engineering, and integration into enterprise applications.
+ Provide **strategic direction and thought leadership** on advanced analytics adoption across the business.
+ Mentor, coach, and upskill a team of data scientists and engineers; foster a culture of **innovation and collaboration** .
+ Partner with cross-functional teams (engineering, product, factory operations, IT) to translate business needs into data-driven solutions.
+ Ensure model **robustness, fairness, interpretability** , and compliance with ethical AI standards.
+ Design and oversee **experimentation frameworks** (A/B testing, causal inference, statistical modeling) for data-driven decision making.
+ Stay ahead of **emerging trends** in AI, ML, and big data technologies; evaluate their potential for business impact.
+ Present insights, models, and strategies to **senior leadership and non-technical stakeholders** in clear, actionable terms.
**Qualifications**
+ MS/ME/MTech/PhD in Data Science, Statistics, Computer Science, or related fields.
+ ~15 years of experience in data science, AI/ML, or advanced analytics, including leadership in complex projects.
+ Proven expertise in:
+ Machine Learning, Deep Learning, and Statistical Modeling
+ Optimization techniques for solving complex, high-dimensional problems.
+ GenAI applications including architectures like RAG, fine-tuning, and LLMOps.
+ Synthetic data generation and handling highly imbalanced and high-volume datasets.
+ GenAI applications including architectures like RAG, fine-tuning, and LLMOps.
+ Experience with **anomaly detection, pretrained transformers** , and **custom embedding models** .
+ Strong proficiency in **Python and SQL** for data wrangling, analysis, and modeling.
+ Hands-on experience with **TensorFlow, PyTorch, Pyspark** , and related AI/ML frameworks.
+ Deep understanding of **Big Data platforms** (e.g., Spark, Hadoop, distributed databases, cloud data warehouses).
+ Experience in **MLOps** : model deployment, monitoring, versioning, and lifecycle management.
+ Strong knowledge of **data architecture, pipelines** , and feature engineering at scale.
+ Familiarity with **data visualization tools** : Tableau, Power BI, Matplotlib, Plotly.
+ Excellent communication and stakeholder management skills, with the ability to influence at senior levels.
**Additional Information**
Sandisk thrives on the power and potential of diversity. As a global company, we believe the most effective way to embrace the diversity of our customers and communities is to mirror it from within. We believe the fusion of various perspectives results in the best outcomes for our employees, our company, our customers, and the world around us. We are committed to an inclusive environment where every individual can thrive through a sense of belonging, respect and contribution.
Sandisk is committed to offering opportunities to applicants with disabilities and ensuring all candidates can successfully navigate our careers website and our hiring process. Please contact us at to advise us of your accommodation request. In your email, please include a description of the specific accommodation you are requesting as well as the job title and requisition number of the position for which you are applying.
Is this job a match or a miss?
Data Engineering Consultant
Posted 1 day ago
Job Viewed
Job Description
**Primary Responsibilities:**
+ Design, code, test, document, and maintain high-quality and scalable data pipelines/solutions in cloud
+ Willing to work in both dev and ops and should be open to work in ops with flexible timings in ops
+ Ingest and transform data using variety of technologies from variety of sources (API's, streaming, Files, Databases)
+ Develop reusable patterns and encourage innovation that will increase team's velocity
+ Design and develop applications in an agile environment, deploy using CI/CD
+ Participate with prototypes as well as design and code reviews, own or assist with incident and problem management
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regards to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ 2+ years of experience with the following:
+ Databricks, Python, Spark, Pyspark, SQL, Azure Data factory
+ Design and Implementation of Datawarehouse/Datalake (Databricks/snowflake)
+ Data architecture, Data modelling
+ Operations Processes, reporting from operations, Incident resolutions
+ 1+ years of experience with the following technologies:
+ Github actions/Jenkins or similar CICD tool, Cloud CICD, GitHub
+ NoSQL and relational databases
**Preferred Qualifications:**
+ Knowledge of Apache Kafka
+ Knowledge of Data ingestions from variety of API's
+ Working in Agile/Scrum environment
+ Proven self-starter who can learn things quickly, who is enthusiastic and actively engaged
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone-of every race, gender, sexuality, age, location and income-deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
Is this job a match or a miss?
Data Engineering Analyst
Posted 2 days ago
Job Viewed
Job Description
The role interacts regularly with technology teams and is responsible for supporting Production work for Clients which involves extraction, monitoring, data validation, working on investigation tickets, process improvements and automation. Data operations team has taken up new product work on the EIS space. So we are looking for someone with good experience in Azure and Data bricks.
**Primary Responsibility:**
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regard to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Bachelor's degree in Computer Science or any engineering
+ 2+ years of experience in Data analysis and functional QC
+ Solid analytical and problem-solving skills
+ Solid SQL skills
+ Fair knowledge on Cloud (AWS)
+ Proven passion to work with lot of data in a challenging environment
+ Technical aptitude for learning new technologies
+ Basic Knowledge on Cloud (AWS)
+ Basic knowledge in Spark Sql
+ Basic Knowledge in Python
+ Basic US Healthcare knowledge
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
Is this job a match or a miss?
Consultant, Data Engineering
Posted 3 days ago
Job Viewed
Job Description
Data Science is all about breaking new ground to enable businesses to answer their most urgent questions. Pioneering massively parallel data-intensive analytic processing, our mission is to develop a whole new approach to generating meaning and value from petabyte-scale data sets and shape brand new methodologies, tools, statistical methods and models. What's more, we are in collaboration with leading academics, industry experts and highly skilled engineers to equip our customers to generate sophisticated new insights from the biggest of big data.
Join us to do the best work of your career and make a profound social impact as a **Consultant, Data Engineering** on our **Data Engineering** Team in **Bangalore.**
**What you'll achieve**
As a **Consultant, Data Engineering** , you will be responsible for developing technical tools and programs to automate the data management process, integrating medium to large structured data sets. You will have the opportunity to partner with Data Scientists, Architects or Businesses to design strategic projects and improve complex processes.
**You will:**
+ Design and build analytics solutions that deliver transformative insights from extremely large data sets.
+ Design, develop, and implement web applications for self-service delivery of analytics.
+ Design and develop APIs, database objects, machine learning algorithms, and necessary server-side code to support applications.
+ Work closely with team members to quickly integrate new components and features into current application ecosystem.
+ Continuously evaluate industry trends for opportunities to utilize new technologies and methodologies, and implement these into the solution stack as appropriate.
**Take the first step towards your dream career**
Every Dell Technologies team member brings something unique to the table. Here's what we are looking for with this role:
**Essential Requirements**
+ 13 to 18 years of experience in the using Data engineering technologies, including Big Data Tools like SQL Server, Teradata, Hadoop, Spark, and R.
+ Experience in big data platforms and solution designs to both technical and non-technical stakeholders.
+ Experience in machine learning and ability to write, tune, and debug performant SQL.
+ Experience in full stack development using Object-Oriented languages like, C#, .NET, HTML5, JavaScript.
+ Experience in Cloud Services, or Object Function Scripting Languages
**Desirable Requirements**
+ Demonstrated ability creating rich web interfaces using a modern client-side framework.
**Who we are**
We believe that each of us has the power to make an impact. That's why we put our team members at the center of everything we do. If you're looking for an opportunity to grow your career with some of the best minds and most advanced tech in the industry, we're looking for you.
Dell Technologies is a unique family of businesses that helps individuals and organizations transform how they work, live and play. Join us to build a future that works for everyone because Progress Takes All of Us.
**Application closing date: 15 Oct 2025**
Dell Technologies is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. Read the full Equal Employment Opportunity Policy here ( .
**Job ID:** R
Is this job a match or a miss?
Be The First To Know
About the latest Data science teams Jobs in India !
Director Data Engineering
Posted 3 days ago
Job Viewed
Job Description
We are seeking a visionary and technically adept Senior Data Engineering Leader to architect, scale, and optimize our data infrastructure. This role will drive the design and implementation of robust, cost-efficient, and observable data pipelines that power analytics, AI/ML, and operational systems across the enterprise. The ideal candidate will be a strategic thinker who can influence senior leadership and lead high-performing engineering teams.
**Primary Responsibilities:**
+ Data Pipeline Architecture: Design and implement scalable, high-performance data pipelines that support batch and real-time processing across diverse data domains
+ Total Cost of Ownership (TCO): Architect solutions with a focus on long-term sustainability, balancing performance, scalability, and cost efficiency
+ Operational Observability: Establish proactive monitoring, alerting, and logging frameworks to ensure system health, data quality, and SLA adherence
+ CI/CD & Automation: Champion automated testing, deployment, and release processes using modern DevOps practices. Ensure robust version control and rollback strategies
+ Blue-Green Deployments: Implement blue-green or canary deployment strategies to minimize downtime and risk during releases
+ Strategic Communication: Translate complex architectural decisions into business value. Confidently present and defend architectural choices to senior technology and business leaders
+ Leadership & Mentorship: Lead and mentor a team of data engineers, fostering a culture of innovation, accountability, and continuous improvement
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regard to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Undergraduate degree or equivalent experience
+ Proven experience leading enterprise-scale data engineering initiatives
+ Hands-on experience with CI/CD pipelines, infrastructure-as-code (e.g., Terraform), and containerization (e.g., Docker, Kubernetes)
+ Experience with data governance, privacy, and compliance frameworks
+ Experience with AI/ML data pipelines and MLOps practices
+ Experience in healthcare, finance, or any other regulated industries
+ Deep expertise in data architecture, distributed systems, and cloud-native technologies (e.g., AWS, GCP, Azure)
+ Solid command of data modeling, ETL/ELT, orchestration tools (e.g., Airflow, dbt), and streaming platforms (e.g., Kafka)
+ Demonstrated success in implementing observability frameworks (e.g., Prometheus, Grafana, Datadog)
+ Proven excellent communication and stakeholder management skills
#Exetech
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
Is this job a match or a miss?
Data Engineering Consultant
Posted 3 days ago
Job Viewed
Job Description
**Primary Responsibilities:**
+ The Data Engineering Consultant role will be working in support of the Information Security organization Data Enablement team. Defining, designing, constructing, processing and supporting data pipelines, data products and data assets, all in support of a wide variety of client use cases within the Security organization
+ In this role, you will be working with a variety of programming languages on a tech stack that leverages Snowflake, various Cloud CSP data storage offerings, Airflow orchestration and scheduling and various internal CICD and Devops packages. You will be supporting our ongoing data strategy and solutions with a focus on Medalion Data architecture
+ You will be working with other engineers, analysts and clients in understanding business problems, designing proposed solutions and supporting the products that you help to build
+ A successful candidate for this role will have experience working in a data products environment, is deeply skilled with Snowflake and Airflow and is skilled in building and supporting complex data pipelines and ETL/ELT with Python, Spark, Pyspark, Scala, Java and SQL and has demonstrated experience supporting industry standard data governance processes and data quality processes. Demonstrated ability to conduct data modeling and data model construction and support are also essential as is the ability to performance tune and optimize data pipelines
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regard to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Undergraduate degree in Computer Science, Data Science, Data Analytics, Mathematics, Information Systems or some related field with an emphasis on coding, analytics or applied mathematics
+ 4+ years previous experience with direct hands on data engineering on Snowflake with Airflow
+ 5+ years hand on experience coding complex data pipelines with Python, Pyspark, Scala, SQL and related languages
+ 3+ years experience working with and integrating pipelines and tech stack components to database products like Postgres, MySQL, MS SQLserver, Oracle, Mongo, Cassandra
+ Demonstrated experience working with and operating on one of the following cloud storage technologies - AWS, GCP, Azure
+ Demonstrated experience operating in an environment with modern data governance processes and protocols
+ Demonstrated experience building data quality monitoring solutions
+ Demonstrated experience working with modern CICD and devops principals including automated deployment
+ Demonstrated problem solving skills
+ Solid communications skills - verbally and written
**Preferred Qualifications:**
+ Advanced degree in computer science, math, analytics, data science or other similarly technical field
+ Experience with Security data and information security
+ Experience with Health care data
+ Experience implementing data privacy controls for variety of data from HIPAA to PII to PCI etc.
+ Experience with streaming technologies like KAFKA
+ Experience building and ingesting data from APIs
+ Experience with Azure Data Factory
+ Exposure to reporting technologies like Tableau, Powerbi, Microstrategy
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
#NJP
Is this job a match or a miss?
Data Engineering Consultant
Posted 3 days ago
Job Viewed
Job Description
**Primary Responsibilities:**
+ Support the full data engineering lifecycle including research, proof of concepts, design, development, testing, deployment, and maintenance of data management solutions
+ Utilize knowledge of various data management technologies to drive data engineering projects
+ Lead data acquisition efforts to gather data from various structured or semi-structured source systems of record to hydrate client data warehouse and power analytics across numerous health care domains
+ Leverage combination of ETL/ELT methodologies to pull complex relational and dimensional data to support loading DataMart's and reporting aggregates
+ Eliminate unwarranted complexity and unneeded interdependencies
+ Detect data quality issues, identify root causes, implement fixes, and manage data audits to mitigate data challenges
+ Implement, modify, and maintain data integration efforts that improve data efficiency, reliability, and value
+ Leverage and facilitate the evolution of best practices for data acquisition, transformation, storage, and aggregation that solve current challenges and reduce the risk of future challenges
+ Effectively create data transformations that address business requirements and other constraints
+ Partner with the broader analytics organization to make recommendations for changes to data systems and the architecture of data platforms
+ Support the implementation of a modern data framework that facilitates business intelligence reporting and advanced analytics
+ Prepare high level design documents and detailed technical design documents with best practices to enable efficient data ingestion, transformation and data movement.
+ Leverage DevOps tools to enable code versioning and code deployment.
+ Leverage data pipeline monitoring tools to detect data integrity issues before they result into user visible outages or data quality issues
+ Leverage processes and diagnostics tools to troubleshoot, maintain and optimize solutions and respond to customer and production issues
+ Continuously support technical debt reduction, process transformation, and overall optimization
+ Leverage and contribute to the evolution of standards for high quality documentation of data definitions, transformations, and processes to ensure data transparency, governance, and security
+ Ensure that all solutions meet the business needs and requirements for security, scalability, and reliability
+ Comply with the terms and conditions of the employment contract, company policies and procedures, and any and all directives (such as, but not limited to, transfer and/or re-assignment to different work locations, change in teams and/or work shifts, policies in regard to flexibility of work benefits and/or work environment, alternative work arrangements, and other decisions that may arise due to the changing business environment). The Company may adopt, vary or rescind these policies and directives in its absolute discretion and without any limitation (implied or otherwise) on its ability to do so
**Required Qualifications:**
+ Bachelor's Degree (preferably in information technology, engineering, math, computer science, analytics, engineering or other related field)
+ 5+ years of combined experience in data engineering, ingestion, normalization, transformation, aggregation, structuring, and storage
+ 5+ years of combined experience working with industry standard relational, dimensional or non-relational data storage systems
+ 5+ years of experience in designing ETL/ELT solutions using tools like Informatica, DataStage, SSIS, PL/SQL, T-SQL, etc.
+ 5+ years of experience in managing data assets using SQL, Python, Scala, VB.NET or other similar querying/coding language
+ 3+ years of experience in Micorsoft Azure Cloud, Azure Data Factory, Data Bricks, Spark, Scala / Python , ADO, Github, Expert in SQL/Advanced SQL
+ 3+ years of experience working with healthcare data or data to support healthcare organizations
_At UnitedHealth Group, our mission is to help people live healthier lives and make the health system work better for everyone. We believe everyone - of every race, gender, sexuality, age, location and income - deserves the opportunity to live their healthiest life. Today, however, there are still far too many barriers to good health which are disproportionately experienced by people of color, historically marginalized groups and those with lower incomes. We are committed to mitigating our impact on the environment and enabling and delivering equitable care that addresses health disparities and improves health outcomes - an enterprise priority reflected in our mission._
Is this job a match or a miss?