2,106 Python Data Engineer jobs in India

Talent Worx is a growing services & recruitment consulting firm, we are hiring for our client which is a leading Big4 Consulting firm and provider of financial intelligence, data analytics, and AI-driven solutions, empowering businesses worldwide with insights for confident decision-making. Join to work on cutting-edge technologies, drive digital transformation, and shape the future of global markets. We are looking for a Python Data Engineer with deep expertise in API development, big data processing, and cloud deployment. The ideal candidate will have experience with FastAPI, PySpark, and DevOps pipelines, and be capable of leading a team while delivering high-performance, scalable data-driven applications.

• API Development: Design, build, and maintain scalable APIs using FastAPI and RESTful principles.
• Big Data Processing: Develop efficient data pipelines using PySpark to process and analyze large-scale datasets.
• Full-Stack Integration: Collaborate with frontend teams to implement end-to-end feature integration and ensure seamless user experiences.
• CI/CD Pipelines: Create and manage CI/CD workflows using GitHub Actions and Azure DevOps to support reliable and automated deployments.
• Containerization: Build and deploy containerized applications using Docker for both development and production environments.
• Team Leadership: Lead and mentor a team of engineers; conduct code reviews and provide technical guidance to ensure best practices and quality standards.
• Code Optimization: Write clean, maintainable, and high-performance Python code with a focus on scalability and reusability.
• Cloud Deployment: Deploy, monitor, and maintain applications in Azure or other cloud platforms ensuring high availability and resilience.
• Cross-Functional Collaboration: Work with product managers, designers, and other stakeholders to transform business requirements into technical solutions.
• Documentation: Maintain clear and comprehensive documentation for APIs, systems, and workflows to support ongoing development and maintenance.

Requirements

• Programming: Advanced proficiency in Python , with hands-on experience in FastAPI and REST API development.
• Big Data: Expertise in PySpark and large-scale data processing techniques.
• DevOps Tools: Strong knowledge of GitHub Actions , Azure DevOps , and Docker .
• Cloud Platforms: Experience with Azure or similar cloud environments for deployment and scaling.
• System Integration: Demonstrated experience in backend-to-frontend integration.
• Leadership: Proven track record of leading and mentoring software development teams.
• Collaboration: Excellent communication skills
  
  Note: We are looking for immediate joiners only - who can join us in less than a month.

Wissen Technology isHiring forPython + Data Engineer

About Wissen Technology: Wissen Technology is a globally recognized organization known for building solid technology teams, working with major financial institutions, and delivering high-quality solutions in IT services. With a strong presence in the financial industry, we provide cutting-edge solutions to address complex business challenges.

Location: Mumbai

Key Responsibilities

Required Skills:

The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products. We offer an array of services including Core Business Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud Adoption, Mobility, Digital Adoption, Agile & DevOps, Quality Assurance & Test Automation. 

Over the years, Wissen Group has successfully delivered $1 billion worth of projects for more than 20 of the Fortune 500 companies. Wissen Technology provides exceptional value in mission critical projects for its clients, through thought leadership, ownership, and assured on-time deliveries that are always ‘first time right’. The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them with the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients. 

We have been certified as a Great Place to Work company for two consecutive years ) and voted as the Top 20 AI/ML vendor by CIO Insider. Great Place to Work Certification is recognized world over by employees and employers alike and is considered the ‘Gold Standard’. Wissen Technology has created a Great Place to Work by excelling in all dimensions - High-Trust, High-Performance Culture, Credibility, Respect, Fairness, Pride and Camaraderie.

Website:

LinkedIn:

Wissen Leadership:

Wissen Live:

Wissen Thought Leadership:

Employee Speak:

Great Place to Work:

About Wissen Interview Process:

Latest in Wissen in CIO Insider:

Job Title: Data EngineerJob Summary:We are looking for a proficient Data Engineer with expertise in Amazon Redshift, Python, ApacheAirflow, dbt (Data Build Tool), API integration, and AWS. This role will be responsible for developingand maintaining scalable data pipelines, integrating data from multiple sources, and ensuring thatour data architecture supports business intelligence, reporting, and analytics requirements. You willcollaborate with cross-functional teams to build and optimize our data infrastructure and provideclean, high-quality data to the business.Key Responsibilities: Data Pipeline Development: Build and maintain robust ETL/ELT pipelines using Python, ApacheAirflow, and dbt to extract, transform, and load data from various sources into Amazon Redshift. Amazon Redshift Management: Design, optimize, and maintain Amazon Redshift clusters,ensuring the warehouse is capable of handling large-scale data efficiently. API Integration: Develop solutions to integrate external APIs for data ingestion, ensuring properdata extraction, transformation, and integration into our data infrastructure. Data Modeling: Create and maintain scalable data models in Redshift that support analytics andreporting needs, including designing star and snowflake schemas for optimized querying. AWS Infrastructure Management: Leverage AWS services such as S3, Lambda, EC2, andCloudWatch to build and maintain a scalable and cost-efficient data architecture. dbt (Data Build Tool): Use dbt to manage and automate SQL transformations, ensuring modular,reusable, and well-documented data transformation logic. Workflow Orchestration: Utilize Apache Airflow to orchestrate and automate data workflows,ensuring reliable data pipelines and scheduled jobs. Data Quality & Testing: Implement and maintain data validation checks and testing frameworksto ensure data integrity, accuracy, and compliance across all data pipelines. Collaboration: Work closely with data scientists, analysts, and product teams to understand dataneeds and provide technical solutions that meet business objectives. Performance Optimization: Tune SQL queries and manage the performance of Redshift clustersto ensure fast, efficient data access and analysis. Data Governance: Enforce data governance policies to ensure compliance with security, privacy,and data quality standards throughout the data lifecycle.Key Skills & Qualifications: Bachelors/Masters degree in Computer Science, Engineering, Data Science, or a related field. 3+ years of experience in data engineering with expertise in Amazon Redshift, Python, and AWS. Strong experience with Apache Airflow for workflow scheduling and orchestration. Hands-on experience with dbt (Data Build Tool) for managing SQL transformations and datamodels. Proficiency in API development and integration, including the use of RESTful APIs for dataingestion. Extensive experience with AWS services such as S3, Lambda, EC2, RDS, and CloudWatch.

Expertise in data modeling concepts and designing efficient data structures (e.g., star schemas,snowflake schemas) in a data warehouse environment. Advanced knowledge of SQL for querying and optimizing large datasets in Redshift. Experience building ETL/ELT pipelines and integrating data from multiple sources, includingstructured and unstructured data. Familiarity with version control systems like Git and best practices for code management anddeployment automation. Knowledge of data governance principles, including data security, privacy, and quality control.Preferred Qualifications: Experience with real-time data processing tools such as Kafka or Kinesis. Familiarity with data visualization tools like Tableau, Looker, or Power BI. Knowledge of other data warehousing solutions like Snowflake or Google BigQuery. Experience with DevOps practices for managing infrastructure and CI/CD pipelines (Docker,Kubernetes). Understanding of machine learning pipelines and how data engineering supports AI/ML initiatives.Soft Skills: Strong analytical and problem-solving skills. Ability to work independently and as part of a cross-functional team. Strong written and verbal communication skills, with the ability to explain technical concepts tonon-technical stakeholders. Detail-oriented, proactive, and self-motivated with a focus on continuous improvement. Strong organizational and project management skills to handle multiple tasks

Payroll

Data Engineer (Software and Web Development)

Cloud Architects (Software and Web Development)

DevOps Engineers (Software and Web Development)

Database Administrator (Software and Web Development)

Software Engineer (Software and Web Development)

• Python - 3 Years
• Amazon Redshift - 3 Years
• AWS - 3 Years
• Apache Airflow - 1 Years
• ETL(Extract, Transform, Load) - 1 Years
• Kubernetes - 1 Years

Wissen Technology isHiring forPython + Data Engineer

About Wissen Technology: Wissen Technology is a globally recognized organization known for building solid technology teams, working with major financial institutions, and delivering high-quality solutions in IT services. With a strong presence in the financial industry, we provide cutting-edge solutions to address complex business challenges

Location:Bangalore

Key Responsibilities

Required Skills:

The Wissen Group was founded in the year 2000. Wissen Technology, a part of Wissen Group, was established in the year 2015. Wissen Technology is a specialized technology company that delivers high-end consulting for organizations in the Banking & Finance, Telecom, and Healthcare domains. We help clients build world class products. We offer an array of services including Core Business Application Development, Artificial Intelligence & Machine Learning, Big Data & Analytics, Visualization & Business Intelligence, Robotic Process Automation, Cloud Adoption, Mobility, Digital Adoption, Agile & DevOps, Quality Assurance & Test Automation. 

Over the years, Wissen Group has successfully delivered $1 billion worth of projects for more than 20 of the Fortune 500 companies. Wissen Technology provides exceptional value in mission critical projects for its clients, through thought leadership, ownership, and assured on-time deliveries that are always ‘first time right’. The technology and thought leadership that the company commands in the industry is the direct result of the kind of people Wissen has been able to attract. Wissen is committed to providing them with the best possible opportunities and careers, which extends to providing the best possible experience and value to our clients. 

We have been certified as a Great Place to Work company for two consecutive years ) and voted as the Top 20 AI/ML vendor by CIO Insider. Great Place to Work Certification is recognized world over by employees and employers alike and is considered the ‘Gold Standard’. Wissen Technology has created a Great Place to Work by excelling in all dimensions - High-Trust, High-Performance Culture, Credibility, Respect, Fairness, Pride and Camaraderie.

Website:

LinkedIn:

Wissen Leadership:

Wissen Live:

Wissen Thought Leadership:

Employee Speak:

Great Place to Work:

About Wissen Interview Process:

Latest in Wissen in CIO Insider:

• 7+ years of experience in application development using Python and backend technologies.
• Strong ability to understand and interpret business requirements into well-defined technical solutions .

Backend Development:

• Expertise in Python backend development with frameworks like Tornado and FastAPI .
• Strong understanding of RESTful APIs, token authentication, and data compression .
• Experience in working with scalable application architectures .

Database & Cloud:

• Experience working with RDBMS models in cloud environments.
• Understanding of databases like ClickHouse, MS SQL, PostgreSQL, and Snowflake (added advantage).
• Basic knowledge of cloud technologies such as Databricks, ADLS, and OAuth/Secrets .

Software Development & DevOps:

• Experience with version control systems (Bitbucket, Git CLI) and issue tracking systems (JIRA).
• Hands-on experience with DevOps tools for CI/CD, build, and deployment .
• Familiarity with private package registries like JFrog .

Soft Skills & Methodologies:

• Strong problem-solving, debugging, and investigative skills.
• Ability to analyze log files, error messages, and performance issues to find root causes.
• Experience working in Agile environments at scale.
• Excellent verbal and written communication skills .

Job Title: Data EngineerJob Summary:We are looking for a proficient Data Engineer with expertise in Amazon Redshift, Python, ApacheAirflow, dbt (Data Build Tool), API integration, and AWS. This role will be responsible for developingand maintaining scalable data pipelines, integrating data from multiple sources, and ensuring thatour data architecture supports business intelligence, reporting, and analytics requirements. You willcollaborate with cross-functional teams to build and optimize our data infrastructure and provideclean, high-quality data to the business.Key Responsibilities: Data Pipeline Development: Build and maintain robust ETL/ELT pipelines using Python, ApacheAirflow, and dbt to extract, transform, and load data from various sources into Amazon Redshift. Amazon Redshift Management: Design, optimize, and maintain Amazon Redshift clusters,ensuring the warehouse is capable of handling large-scale data efficiently. API Integration: Develop solutions to integrate external APIs for data ingestion, ensuring properdata extraction, transformation, and integration into our data infrastructure. Data Modeling: Create and maintain scalable data models in Redshift that support analytics andreporting needs, including designing star and snowflake schemas for optimized querying. AWS Infrastructure Management: Leverage AWS services such as S3, Lambda, EC2, andCloudWatch to build and maintain a scalable and cost-efficient data architecture. dbt (Data Build Tool): Use dbt to manage and automate SQL transformations, ensuring modular,reusable, and well-documented data transformation logic. Workflow Orchestration: Utilize Apache Airflow to orchestrate and automate data workflows,ensuring reliable data pipelines and scheduled jobs. Data Quality & Testing: Implement and maintain data validation checks and testing frameworksto ensure data integrity, accuracy, and compliance across all data pipelines. Collaboration: Work closely with data scientists, analysts, and product teams to understand dataneeds and provide technical solutions that meet business objectives. Performance Optimization: Tune SQL queries and manage the performance of Redshift clustersto ensure fast, efficient data access and analysis. Data Governance: Enforce data governance policies to ensure compliance with security, privacy,and data quality standards throughout the data lifecycle.Key Skills & Qualifications: Bachelors/Masters degree in Computer Science, Engineering, Data Science, or a related field. 3+ years of experience in data engineering with expertise in Amazon Redshift, Python, and AWS. Strong experience with Apache Airflow for workflow scheduling and orchestration. Hands-on experience with dbt (Data Build Tool) for managing SQL transformations and datamodels. Proficiency in API development and integration, including the use of RESTful APIs for dataingestion. Extensive experience with AWS services such as S3, Lambda, EC2, RDS, and CloudWatch.

Expertise in data modeling concepts and designing efficient data structures (e.g., star schemas,snowflake schemas) in a data warehouse environment. Advanced knowledge of SQL for querying and optimizing large datasets in Redshift. Experience building ETL/ELT pipelines and integrating data from multiple sources, includingstructured and unstructured data. Familiarity with version control systems like Git and best practices for code management anddeployment automation. Knowledge of data governance principles, including data security, privacy, and quality control.Preferred Qualifications: Experience with real-time data processing tools such as Kafka or Kinesis. Familiarity with data visualization tools like Tableau, Looker, or Power BI. Knowledge of other data warehousing solutions like Snowflake or Google BigQuery. Experience with DevOps practices for managing infrastructure and CI/CD pipelines (Docker,Kubernetes). Understanding of machine learning pipelines and how data engineering supports AI/ML initiatives.Soft Skills: Strong analytical and problem-solving skills. Ability to work independently and as part of a cross-functional team. Strong written and verbal communication skills, with the ability to explain technical concepts tonon-technical stakeholders. Detail-oriented, proactive, and self-motivated with a focus on continuous improvement. Strong organizational and project management skills to handle multiple tasks

Payroll

Data Engineer (Software and Web Development)

Cloud Architects (Software and Web Development)

DevOps Engineers (Software and Web Development)

Database Administrator (Software and Web Development)

Software Engineer (Software and Web Development)

• Python - 3 Years
• Amazon Redshift - 3 Years
• AWS - 3 Years
• Apache Airflow - 1 Years
• ETL(Extract, Transform, Load) - 1 Years
• Kubernetes - 1 Years

Job Title: Data EngineerJob Summary:We are looking for a proficient Data Engineer with expertise in Amazon Redshift, Python, ApacheAirflow, dbt (Data Build Tool), API integration, and AWS. This role will be responsible for developingand maintaining scalable data pipelines, integrating data from multiple sources, and ensuring thatour data architecture supports business intelligence, reporting, and analytics requirements. You willcollaborate with cross-functional teams to build and optimize our data infrastructure and provideclean, high-quality data to the business.Key Responsibilities: Data Pipeline Development: Build and maintain robust ETL/ELT pipelines using Python, ApacheAirflow, and dbt to extract, transform, and load data from various sources into Amazon Redshift. Amazon Redshift Management: Design, optimize, and maintain Amazon Redshift clusters,ensuring the warehouse is capable of handling large-scale data efficiently. API Integration: Develop solutions to integrate external APIs for data ingestion, ensuring properdata extraction, transformation, and integration into our data infrastructure. Data Modeling: Create and maintain scalable data models in Redshift that support analytics andreporting needs, including designing star and snowflake schemas for optimized querying. AWS Infrastructure Management: Leverage AWS services such as S3, Lambda, EC2, andCloudWatch to build and maintain a scalable and cost-efficient data architecture. dbt (Data Build Tool): Use dbt to manage and automate SQL transformations, ensuring modular,reusable, and well-documented data transformation logic. Workflow Orchestration: Utilize Apache Airflow to orchestrate and automate data workflows,ensuring reliable data pipelines and scheduled jobs. Data Quality & Testing: Implement and maintain data validation checks and testing frameworksto ensure data integrity, accuracy, and compliance across all data pipelines. Collaboration: Work closely with data scientists, analysts, and product teams to understand dataneeds and provide technical solutions that meet business objectives. Performance Optimization: Tune SQL queries and manage the performance of Redshift clustersto ensure fast, efficient data access and analysis. Data Governance: Enforce data governance policies to ensure compliance with security, privacy,and data quality standards throughout the data lifecycle.Key Skills & Qualifications: Bachelors/Masters degree in Computer Science, Engineering, Data Science, or a related field. 3+ years of experience in data engineering with expertise in Amazon Redshift, Python, and AWS. Strong experience with Apache Airflow for workflow scheduling and orchestration. Hands-on experience with dbt (Data Build Tool) for managing SQL transformations and datamodels. Proficiency in API development and integration, including the use of RESTful APIs for dataingestion. Extensive experience with AWS services such as S3, Lambda, EC2, RDS, and CloudWatch.

Expertise in data modeling concepts and designing efficient data structures (e.g., star schemas,snowflake schemas) in a data warehouse environment. Advanced knowledge of SQL for querying and optimizing large datasets in Redshift. Experience building ETL/ELT pipelines and integrating data from multiple sources, includingstructured and unstructured data. Familiarity with version control systems like Git and best practices for code management anddeployment automation. Knowledge of data governance principles, including data security, privacy, and quality control.Preferred Qualifications: Experience with real-time data processing tools such as Kafka or Kinesis. Familiarity with data visualization tools like Tableau, Looker, or Power BI. Knowledge of other data warehousing solutions like Snowflake or Google BigQuery. Experience with DevOps practices for managing infrastructure and CI/CD pipelines (Docker,Kubernetes). Understanding of machine learning pipelines and how data engineering supports AI/ML initiatives.Soft Skills: Strong analytical and problem-solving skills. Ability to work independently and as part of a cross-functional team. Strong written and verbal communication skills, with the ability to explain technical concepts tonon-technical stakeholders. Detail-oriented, proactive, and self-motivated with a focus on continuous improvement. Strong organizational and project management skills to handle multiple tasks

Payroll

Data Engineer (Software and Web Development)

Cloud Architects (Software and Web Development)

DevOps Engineers (Software and Web Development)

Database Administrator (Software and Web Development)

Software Engineer (Software and Web Development)

• Python - 3 Years
• Amazon Redshift - 3 Years
• AWS - 3 Years
• Apache Airflow - 1 Years
• ETL(Extract, Transform, Load) - 1 Years
• Kubernetes - 1 Years

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist.

In this role, you will:

To be successful in this role, you should meet the following requirements:

Some careers shine brighter than others.

If you’re looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.

HSBC is one of the largest banking and financial services organisations in the world, with operations in 64 countries and territories. We aim to be where the growth is, enabling businesses to thrive and economies to prosper, and, ultimately, helping people to fulfil their hopes and realise their ambitions.

We are currently seeking an experienced professional to join our team in the role of Consultant Specialist.

In this role, you will:

To be successful in this role, you should meet the following requirements: