291 Data Engineer jobs in Kochi
Senior Data Engineer / Data Engineer
Posted today
Job Viewed
Job Description
LOOKING FOR IMMEDIATE JOINERS OR 15 DAYS NOTICE PERIODS AND THIS IS WORK FROM HOME OPPORTUNITY
Position: Senior Data Engineer / Data Engineer
Desired Experience: 3-8 years
Salary: Best-in-industry
You will act as a key member of the Data consulting team, working directly with the partners and senior
stakeholders of the clients designing and implementing big data and analytics solutions. Communication
and organisation skills are keys for this position, along with a problem-solution attitude.
What is in it for you:
Opportunity to work with a world class team of business consultants and engineers solving some of
the most complex business problems by applying data and analytics techniques
Fast track career growth in a highly entrepreneurial work environment
Best-in-industry renumeration package
Essential Technical Skills:
Technical expertise with emerging Big Data technologies, such as: Python, Spark, Hadoop, Clojure,
Git, SQL and Databricks; and visualization tools: Tableau and PowerBI
Experience with cloud, container and micro service infrastructures
Experience working with divergent data sets that meet the requirements of the Data Science and
Data Analytics teams
Hands-on experience with data modelling, query techniques and complexity analysis
Desirable Skills:
Experience/Knowledge of working in an agile environment and experience with agile
methodologies such as Scrum
Experience of working with development teams and product owners to understand their
requirement
Certifications on any of the above areas will be preferred.
Your duties will include:
Develop data solutions within a Big Data Azure and/or other cloud environments
Working with divergent data sets that meet the requirements of the Data Science and Data Analytics
teams
Build and design Data Architectures using Azure Data factory, Databricks, Data lake, Synapse
Liaising with CTO, Product Owners and other Operations teams to deliver engineering roadmaps
showing key items such as upgrades, technical refreshes and new versions
Perform data mapping activities to describe source data, target data and the high-level or
detailed transformations that need to occur;
Assist Data Analyst team in developing KPIs and reporting in tools viz. Power BI, Tableau
Data Integration, Transformation, Modelling
Maintaining all relevant documentation and knowledge bases
Research and suggest new database products, services and protocols
Essential Personal Traits:
You should be able to work independently and communicate effectively with remote teams.
Timely communication/escalation of issues/dependencies to higher management.
Curiosity to learn and apply emerging technologies to solve business problems
Data engineer
Posted today
Job Viewed
Job Description
We are seeking a highly skilled with 4+ of experience with Azure Data Engineer with strong expertise in Python, Scala, Spark (Py Spark & Scala Spark), and Azure Cloud technologies. The ideal candidate will have hands-on experience designing, building, and optimizing ETL pipelines, working with Databricks, and managing large-scale data processing workflows.Key ResponsibilitiesDesign, develop, and maintain scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark.Implement data transformation workflows using Py Spark and Scala Spark for high-performance data processing.Work extensively with Azure Cloud services including Azure Data Lake, Azure Data Factory, Azure Databricks, Azure SQL Database, and related services.Troubleshoot, debug, and resolve job failures by identifying root causes.Optimize data processing jobs for performance and cost efficiency.Collaborate with business and technical teams to gather requirements and translate them into effective data solutions.Develop reusable and efficient data engineering solutions following best practices.Maintain detailed documentation for solutions, processes, and troubleshooting guides.Technical Skills RequiredMicrosoft Certified: Azure Fundamentals (preferred)Microsoft Certified: Azure Data Engineer Associate (preferred)Strong programming skills in Python and Scala.Hands-on experience with Spark (Py Spark & Scala Spark).Proficiency in SQL for data querying and transformation.Good knowledge of Azure Cloud, Azure Data Factory (ADF), and Azure Databricks.Strong understanding of ETL pipeline design and implementation.Proven ability to troubleshoot jobs and analyze root causes effectively.
Data engineer
Posted today
Job Viewed
Job Description
Data engineer
Posted today
Job Viewed
Job Description
Data engineer
Posted today
Job Viewed
Job Description
Be The First To Know
About the latest Data engineer Jobs in Kochi !