22,635 Hdfs jobs in India
Data Analyst (SQL,HDFS, Hive)
Posted today
Job Viewed
Job Description
RiskInsight Consulting Pvt Ltd is looking for a Data Analyst with expertise in SQL and HDFS (Hadoop Distributed File System) to join our dynamic team. The selected candidate will play a crucial role in analyzing large datasets and providing actionable insights to drive business decisions. If you are a detail-oriented individual with a passion for data, we want to hear from you!
- Design, implement, and maintain data pipelines and workflows using HDFS for data management.
- Conduct data extraction, transformation, and loading (ETL) processes using SQL and Hive.
- Perform rigorous data analysis to identify trends, inconsistencies, and insights for stakeholders.
- Collaborate with business units to understand their analytical needs and deliver data-driven insights.
- Create visualizations and generate reports to present findings to both technical and non-technical audiences.
- Ensure data integrity and security throughout all stages of data processing.
- Stay informed about industry advancements in data analysis and contribute to best practices in the field.
Requirements
- Bachelor’s degree in Computer Science, Data Science, Mathematics, or related field.
- Proven experience in a Data Analyst role with strong expertise in SQL and HDFS.
- Hands-on experience with Hive for querying and analyzing large datasets.
- Familiarity with data visualization tools such as Tableau, Power BI, or similar.
- Excellent problem-solving and analytical skills with the ability to draw meaningful conclusions from data.
- Strong communication skills to effectively share insights with diverse teams.
- Ability to work independently and as part of a team in a fast-paced environment.
Benefits
Competitive salary and benefits package.
Opportunity to work on cutting-edge technologies and solve complex challenges.
Dynamic and collaborative work environment with opportunities for growth and career advancement.
Regular training and professional development opportunities.
Java Spark Senior Lead Developer (Java, Spark, HDFS, Hive) - Vice President
Posted 2 days ago
Job Viewed
Job Description
**Responsibilities:**
+ Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and process improvements
+ Resolve variety of high impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards
+ Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint
+ Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation
+ Develop comprehensive knowledge of how areas of business, such as architecture and infrastructure, integrate to accomplish business goals
+ Provide in-depth analysis with interpretive thinking to define issues and develop innovative solutions
+ Serve as advisor or coach to mid-level developers and analysts, allocating work as necessary
+ Appropriately assess risk when business decisions are made, demonstrating particular consideration for the firm's reputation and safeguarding Citigroup, its clients and assets, by driving compliance with applicable laws, rules and regulations, adhering to Policy, applying sound ethical judgment regarding personal behavior, conduct and business practices, and escalating, managing and reporting control issues with transparency.
**Qualifications:**
+ 10+ years of relevant experience in Apps Development or systems analysis role
+ Extensive experience system analysis and in programming of software applications
+ Experience in managing and implementing successful projects
+ Subject Matter Expert (SME) in at least one area of Applications Development
+ Ability to adjust priorities quickly as circumstances dictate
+ Demonstrated leadership and project management skills
+ Consistently demonstrates clear and concise written and verbal communication
**Skills required:**
+ **Highly experienced and skilled Java technical lead with 10+years of experience with software building and platform engineering.**
+ **i)Hands-on development expertise in Java with Spark.** **Extensive knowledge of HDFS, Hive(Relevant experience of around4-5 years .** **ii) Hands on knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns.** **iii) Familiarity with data formats like Avro, Parquet, CSV, JSON.** **iv) Java knowledge with advanced skills in multithreading and multiprocessing, along with extensive experience in efficiently processing large-scale data.** **v) Knowledge in Hadoop, YARN, Hive, Impala, Spark, and Spark SQL with extensive high volume of data processing pipeline development.**
+ **Extensive development expertise in building the high scaled and performant software platforms for data computation and processing.**
+ **Expert level knowledge of core Java concepts and framework such as Spring Boot, Microservices and well versed with OOPs concepts and design patterns.**
+ **Java expert with advanced skills in multithreading and multiprocessing, along with extensive experience in efficiently processing large-scale data.**
+ **Expertise and hands-on experience on working with Apache Spark using Java and understanding of the Bigdata ecosystem and design principles**
+ **Hands-on experience on Unix and python/shell scripting.**
+ **Good knowledge in Hadoop, YARN, Hive, Spark, and Spark SQL with extensive high volume of data processing pipeline development.**
+ **Strong computer science fundamentals in data structures, algorithms, databases, and operating systems.**
+ **Highly experienced with Unix based operating systems and shell scripting.**
+ **Strong analytical and logical skills.**
+ **Hands-on experience in writing SQL queries.**
+ **Experience with source code management tools such as Bitbucket, Git etc.**
**Education:**
+ Bachelor's degree/University degree or equivalent experience
+ Master's degree preferred
This job description provides a high-level review of the types of work performed. Other job-related duties may be assigned as required.
---
**Job Family Group:**
Technology
---
**Job Family:**
Applications Development
---
**Time Type:**
Full time
---
**Most Relevant Skills**
Please see the requirements listed above.
---
**Other Relevant Skills**
For complementary skills, please see above and/or contact the recruiter.
---
_Citi is an equal opportunity employer, and qualified candidates will receive consideration without regard to their race, color, religion, sex, sexual orientation, gender identity, national origin, disability, status as a protected veteran, or any other characteristic protected by law._
_If you are a person with a disability and need a reasonable accommodation to use our search tools and/or apply for a career opportunity review_ _Accessibility at Citi ( _._
_View Citi's_ _EEO Policy Statement ( _and the_ _Know Your Rights ( _poster._
Citi is an equal opportunity and affirmative action employer.
Minority/Female/Veteran/Individuals with Disabilities/Sexual Orientation/Gender Identity.
Data Storage Specialist
Posted today
Job Viewed
Job Description
We are seeking a highly skilled Data Storage Specialist to design, implement and maintain cloud-based infrastructure and services.
The ideal candidate will have in-depth knowledge of Ceph, ZFS and NFS storage technologies and experience with container runtimes, Kubernetes internals and cloud providers.
Main Responsibilities:
- Designing and implementing distributed storage systems.
- Troubleshooting and resolving issues related to storage, networking and container orchestration.
- Implementing monitoring, logging and alerting for infrastructure using tools like Prometheus.
- Collaborating with development and SRE teams to ensure seamless CI/CD and infrastructure reliability.
- Participating in on-call rotation and incident response.
- Documenting architectural decisions and standard operating procedures.
Requirements:
- 3+ years of experience in DevOps, Site Reliability Engineering or Cloud Infrastructure roles.
- Proficient in Ceph (RADOS, RBD, CephFS) and ZFS administration.
- Solid experience managing NFS servers and performance tuning.
- Preferred knowledge of Kubernetes internals, networking and cluster lifecycle management.
- Experience with container runtimes (Docker, containerd), Helm etc.
- Cloud providers (AWS, GCP, or Azure) experience a plus.
Desired Qualifications:
- Rook-Ceph operator experience for Kubernetes.
- CSI storage drivers and volume provisioning knowledge in Kubernetes.
- Certifications such as CKA, CKAD or RHCSA a plus.
Education Requirements:
- Bachelor's degree in computer science or computer engineering.
About the Role:
The role involves working with customer engineering teams on various cloud projects including migration, containerization and transformation initiatives.
Experience in regulated environments beneficial.
This is an opportunity for candidates who enjoy a challenging work environment where problems they solve are constantly evolving.
),Data Storage Specialist
Posted today
Job Viewed
Job Description
Data Storage Manager
Posted today
Job Viewed
Job Description
Job Description: Database Administrator (DBA)
We are seeking a detail-oriented and proactive Junior Database Administrator (DBA) with 1–2 years of hands-on experience managing Microsoft SQL Server (or other RDBMS) environments. The ideal candidate will support database performance, availability, and security, while assisting in maintenance tasks like backups, restores, and monitoring.
Required Skills:
- Strong knowledge of RDBMS (Relational Database Management Systems) and Database Concepts .
- Proficient in writing complex SQL queries , Stored Procedures , User Defined Functions (UDFs) , and Triggers .
- Good understanding of the ETL (Extract, Transform, Load) process .
- Hands-on experience with SSIS (SQL Server Integration Services) and SSRS (SQL Server Reporting Services) .
- Experience in creating and managing SQL Server Agent Jobs .
- Ability to perform Database Performance Tuning and Optimization to improve efficiency of slow-running queries and processes.
- Experience with Backup and Recovery strategies, including Restore operations and Disaster Recovery planning.
Data Storage Specialist
Posted today
Job Viewed
Job Description
Storage Engineer (HP Storage)
Location: Bangalore
Mode: Hybrid
Shift : Rotational Shift
Responsibilities:
· Install, configure, and manage physical and virtual storage solutions, including SAN, NAS, and cloud storage platforms.
· Provision and manage storage for both on-premises and cloud-based environments to meet organizational needs.
· Monitor storage usage and plan for capacity expansion to prevent shortages.
· Optimize storage space by implementing data deduplication, compression, and tiered storage strategies.
· Monitor and maintain the performance of storage systems, troubleshooting any issues to ensure efficient access and minimal downtime.
· Implement performance tuning strategies to maintain the storage systems' speed and reliability.
· Design and implement robust backup solutions to ensure data integrity and security.
· Ensure proper scheduling and regular execution of backups across all systems.
· Maintain a clear understanding of the backup data lifecycle, including retention policies and periodic testing of restore processes.
· Develop and test disaster recovery plans to ensure data can be recovered quickly and effectively in case of a system failure.
· Regularly review and update disaster recovery procedures and strategies.
· Collaborate with IT security teams to ensure data protection from unauthorized access and cyber threats.
· Ensure storage systems meet regulatory and industry standards such as GDPR, HIPAA, SOC 2, and others.
· Maintain detailed documentation and perform audits to verify compliance with relevant regulations.
· Continuously monitor the health, performance, and capacity of storage systems to ensure high availability and reliability.
· Use storage monitoring tools to identify potential risks and resolve issues proactively.
· Generate regular reports on storage utilization, performance metrics, and system health for management review.
· Document storage configurations, troubleshooting steps, and backup procedures to ensure continuity and best practices.
· Work with other IT teams, such as system administrators, network engineers, and security teams, to ensure smooth integration and performance of storage solutions.
· Provide support and guidance to other teams regarding storage-related issues, backups, and recovery procedures.
· Coordinate with external storage vendors for procurement, support, and troubleshooting of storage hardware or services.
Experience Required:
· Bachelor’s degree in Computer Science, Information Technology, or a related field, or equivalent work experience.
· Minimum of 3-5 years of experience managing storage infrastructure (SAN, NAS, cloud storage solutions).
· Hands-on experience with backup software and disaster recovery tools (e.G., Veeam, Commvault, NetBackup).
· Knowledge of cloud storage platforms (AWS S3, Azure Storage).
· In-depth knowledge of storage protocols such as iSCSI, NFS, SMB, and Fibre Channel.
· Familiarity with storage technologies like NetApp, EMC, HPE, or other enterprise storage solutions.
· Strong understanding of storage performance, troubleshooting, and capacity management.
· Experience with scripting and automation tools for managing storage systems (e.G., PowerShell, Python).
· Solid understanding of data backup and disaster recovery strategies.
· Knowledge of security practices for storage systems, including encryption and access control mechanisms.
Data Storage Specialist
Posted today
Job Viewed
Job Description
Job Title: NetApp storage
Experience: 6-8 Years
Location : Mumbai
Roles and Responsibilities
- Evaluation and Deployment: Assessing and deploying various NetApp Storage Products (ONTAP filers, FSx ONTAP, CVO,Eseries,StorageGrid etc.)
Implementing various ONTAP technologies like SVM DR/SNAPLOCK to meet backup requirements effectively.
- Lifecycle Management: Taking charge of the lifecycle management of NetApp ONTAP Filers, ensuring their continued efficiency and reliability.
- Security and Compliance: Ensuring that all NetApp ONTAP systems deployed in Datacenters and the Cloud adhere to strict security and compliance standards.
- Backup and Recovery: Defining robust Backup policies and overseeing the management of backup and recovery processes
- System Health Monitoring: Maintaining the health of deployed storage systems in both on-premises and cloud environments through NetApp's monitoring tools
like OCUM, Cloud Insights, and other vendor/cloud providers' tools.
- Thorough understanding of one or more of the following protocols, applications, and platforms: NFS, CIFS, SAN, iSCSI, TCP/IP, RAID, NetApp Storage System operating systems like Data ONTAP, StorageGrid, and E-Series Operating System (EOS)
- Proficiency in configuring, administering, and troubleshooting UNIX/Linux systems
- Comprehensive knowledge of storage-related security and best practices for system hardening
- Perform Capacity planning exercise while collaborating with application owners to forecast and meet capacity requirements efficiently.
- Drive Infrastructure automation initiatives across the board to solve operational challenges, build tools to monitoring and alerting.
Be The First To Know
About the latest Hdfs Jobs in India !
Data Storage Specialist
Posted today
Job Viewed
Job Description
Primary Skill: DELL, PURE, Brocade
Secondary Skill: Cisco, HPE & Netapp
YOE: 5-8 years
Job Description
Design and Implementation
o Architect deploy and manage SAN solutions with a focus on DELL PURE
Cisco Brocade and HPE technologies
o Design and implement scalable highavailability SAN environments to
support business applications and disaster recovery solutions
Administration and Maintenance
o Perform regular SAN maintenance updates and patches to ensure optimal
performance and security
o Monitor SAN performance and troubleshoot issues to minimize downtime
and data loss
o Manage SAN capacity planning and performance tuning
Cloud-Based Data Storage Engineer
Posted today
Job Viewed
Job Description
As a Storage Infrastructure Specialist, you will design and implement cloud-based storage systems and services. This role focuses on the development, deployment, and maintenance of highly available, scalable data storage systems.
You will have deep experience with distributed storage technologies including Ceph, ZFS, and NFS. Key responsibilities include designing storage architectures, troubleshooting storage and networking issues, implementing monitoring and logging tools, and collaborating with development teams.
Requirements include 3+ years of experience in DevOps or Cloud Infrastructure roles, proficiency with Ceph and ZFS administration, and solid experience managing NFS servers.
Desired qualifications include experience with container orchestration systems and knowledge of CSI storage drivers.
Data Storage Solutions Specialist
Posted today
Job Viewed
Job Description
This is a chance to make a significant impact in the development of AI and data management solutions. We are seeking a driven professional to work on creating storage solutions for high-performance computing and AI/ML applications.
Responsibilities include:
- Efficient analysis of bug reports and development of software fixes on multiple platforms.
- Triage, diagnose, and troubleshoot problems in a timely manner, often working in production environments.
- Collaborate with engineering managers and a geographically distributed team to ensure professional delivery and customer engagement.
The ideal candidate will have experience designing, implementing, and shipping software using Linux kernel development tooling and practices.
Our success is driven by our commitment to innovation, customer-centricity, and a passionate team dedicated to delivering exceptional results.