CDP Hadoop Administration

3 days ago


Chennai, Tamil Nadu, India Smart Analytica Full time ₹ 9,00,000 - ₹ 12,00,000 per year

Job Overview: Smartavya Analytica Private Limited is seeking an experienced Hadoop Administrator to manage and support our Hadoop ecosystem. The ideal candidate will have strong expertise in Hadoop cluster administration, excellent troubleshooting skills, and a proven track record of maintaining and optimizing Hadoop environments. Key Responsibilities:Install, configure, and manage Hadoop clusters, including HDFS, YARN, Hive, HBase, and other ecosystem components.

Monitor and manage Hadoop cluster performance, capacity, and security. Perform routine maintenance tasks such as upgrades, patching, and backups. Implement and maintain data ingestion processes using tools like Sqoop, Flume, and Kafka.

Ensure high availability and disaster recovery of Hadoop clusters. Collaborate with development teams to understand requirements and provide appropriate Hadoop solutions. Troubleshoot and resolve issues related to the Hadoop ecosystem.

Maintain documentation of Hadoop environment configurations, processes, and procedures. Requirement:Experience in Installing, configuring and tuning Hadoop distributions. Hands on experience in Cloudera.

Understanding of Hadoop design principals and factors that affect distributed system performance, including hardware and network considerations. Provide Infrastructure Recommendations, Capacity Planning, work load management. Develop utilities to monitor cluster better Ganglia, Nagios etc.

Manage large clusters with huge volumes of data

Perform Cluster maintenance tasks

Create and removal of nodes, cluster monitoring and troubleshooting

Manage and review Hadoop log files

Install and implement security for Hadoop clusters

Install Hadoop Updates, patches and version upgrades. Automate the same through scripts

Point of Contact for Vendor escalation. Work with Hortonworks in resolving issues

Should have Conceptual/working knowledge of basic data management concepts like ETL, Ref/Master data, Data quality, RDBMSWorking knowledge of any scripting language like Shell, Python, PerlShould have experience in Orchestration & Deployment tools.



  • Chennai, Tamil Nadu, India Smartavya Analytica Full time ₹ 7,00,000 - ₹ 12,00,000 per year

    Job Title: Hadoop AdministratorLocation: Chennai, IndiaExperience: 5 yrs of experience in IT, with At least 2+ years of experience with cloud and system administration. At least 3 years of experience with and strong understanding of big data technologies in Hadoop ecosystem Hive, HDFS, Map/Reduce, Flume, Pig, Cloudera, HBase Sqoop, Spark etc.Company:...


  • Chennai, Tamil Nadu, India beBeeHadoop Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Administration Expert">This role is crucial for managing and optimizing our extensive Hadoop platforms, which span thousands of nodes per cluster. As a Big Data Administration expert, you will be responsible for performing comprehensive Big Data Administration and Engineering activities on multiple open-source platforms, including Hadoop, Kafka,...


  • Chennai, Tamil Nadu, India Randstad Digital Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    As a Data Management Practitioner, you will be responsible for maintaining the quality and compliance of an organization's data assets. Your typical day will involve designing and implementing data strategies that ensure data integrity while enforcing governance policies. You will establish protocols to handle data, safeguard sensitive information, and...

  • Linux Administrator

    5 days ago


    Chennai, Tamil Nadu, India Zoho Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Zoho is one of the world's most prolific software companies. With 55+ applications in nearly every major business category, including sales, marketing, customer service, accounting and back office operations, and an array of productivity and collaboration tools built from the ground up, Zoho has the depth and breadth to solve even the most complex business...


  • Chennai, Tamil Nadu, India MAGELLANIC CLOUD LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    We are seeking a skilled and experienced Database Administrator (DBA) to manage and support our database environments. The ideal candidate will be responsible for maintaining the performance, integrity, and security of our databases. You will work closely with other IT team members and stakeholders to ensure our data systems operate efficiently and meet...

  • Data Scientist

    10 hours ago


    Chennai, Tamil Nadu, India Synergy Group Full time

    Job Description- Strong experience (2+ years) with Building statistical models, applying machine learning techniques- Experience (3+ years) on Big Data technologies such as Hadoop, Spark, Airflow/Databricks- Proven experience (3+ years) in solving complex problems with multi-layered data sets, as well as optimizing existing machine learning libraries and...


  • Chennai, Tamil Nadu, India beBeeKafka Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    We are seeking a seasoned Kafka Administrator to join our team. The ideal candidate will have extensive experience in designing, implementing, and managing large-scale Kafka clusters.Key ResponsibilitiesDesign, deploy, and manage high-performance Kafka clusters on-prem and cloud-based environments.Perform regular upgrades, patches, and disaster recovery...

  • DevOps Engineer

    5 days ago


    Chennai, Tamil Nadu, India beBeeCloud Full time ₹ 30,00,000 - ₹ 3,61,79,000

    Cloud Architect RoleJob Responsibilities:This position involves designing and developing repeatable on-premise and hybrid cloud architectures using best practices on infrastructure as code orchestrations toolings, CI/CD, GitOps, etc. The goal is to create scalable architectures that can be implemented from development to production environments, with a focus...


  • Chennai, Tamil Nadu, India beBeeData Full time ₹ 25,00,000 - ₹ 50,00,000

    Job TitleAnalyze, design and implement large-scale data systems in a fast-paced environment.About the RoleThis is an intermediate-level position responsible for participating in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team.Contribute to applications systems analysis and...


  • Chennai, Tamil Nadu, India Citi Full time US$ 1,50,000 - US$ 2,00,000 per year

    Senior Data EngineerWe are seeking a highly skilled and motivated Senior Data Engineer to design, develop, and implement cutting-edge data engineering solutions using modern big data and cloud technologies. In this role, you will collaborate with product owners, data scientists, analysts, and technologists to deliver scalable, high-performance data products...