Big Data Admin

5 days ago

Pune, Maharashtra, India Whiteklay Full time ₹ 5,00,000 - ₹ 8,00,000 per year

Job Title:
Big Data Admin

Location:
Pune

Employment Type:
Full-time

Responsibilities:

Big Data Ecosystem Management:

  1. Install, configure, and maintain big data platforms like Hadoop, HPE Ezmeral Data Fabric, Apache Druid, or Apache Kafka.
  2. Monitor and manage distributed systems, ensuring optimal cluster performance and resource utilization.
  3. Perform routine maintenance, upgrades, and patching of big data systems.

Linux System Administration:

  1. Manage Linux-based servers, including configuration, troubleshooting, and performance tuning.
  2. Automate administrative tasks using shell scripting or tools like Ansible, Puppet, or Chef.
  3. Ensure the security and hardening of Linux servers used in the big data environment

.

Cluster Monitoring and Troubleshooting:

  1. Monitor and analyze system performance metrics to ensure high availability and scalability.
  2. Identify and resolve issues within the big data cluster, such as node failures, job errors, or network bottlenecks.

Backup, Recovery, and Security:

  1. Implement data backup and recovery strategies to ensure data durability and integrity.
  2. Enforce security measures, including user access controls, encryption, and auditing.

Documentation and Reporting:

  1. Maintain up-to-date documentation for configurations, processes, and best practices.
  2. Provide regular reports on system health, usage, and performance trends.

Requirements:

  • Education:
    Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Experience:
    3–5 years of experience in big data administration or a similar role.
  • Technical Skills:
  • Strong proficiency in Linux system administration (Red Hat, CentOS, Ubuntu, etc.).
  • Hands-on experience with big data platforms like Hadoop (HDFS, YARN, Hive, etc.), Apache Kafka, or Apache Druid.
  • Familiarity with cluster management tools like Ambari, Cloudera Manager, or similar.
  • Knowledge of scripting languages (e.g., Bash, Python) for automation tasks.
  • Understanding of networking concepts, storage systems, and distributed computing.

Additional Skills:

  • Experience with monitoring tools (e.g., Prometheus, Grafana, Nagios).
  • Knowledge of containerized environments (e.g., Kubernetes, Docker) is a plus.
  • Basic understanding of data governance and security best practices.

  • Big Data

    5 days ago

    Pune, Maharashtra, India Emergys Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Work Location:Pune(Work-from -Office mode)Notice Period:Immediate to 30 DaysExperience:2+ yearsMust Have skills:Hadoop Administration (Cloudera CDP/CDH, Hortonworks HDP) – hands-on experience in setup, configuration, and support.Linux/Unix System Administration – strong knowledge of OS internals, shell/bash scripting, and automation.Security...

  • Power BI Admin

    1 week ago

    Pune, Maharashtra, India Admin Looks Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Urgently looking for the Remote Power BI AdminExperience:6+ years of experience in Power BI administration, management, and support.Strong background in BI environments, with hands-on experience in Power BI Service and Power BI Report Server.Familiarity with data integration, data modeling, and ETL processes as they pertain to Power BI.Technical...

  • Big Data

    3 days ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-Have- PySpark- HiveGood-to-Have- Spark- HBase- DQ tool- Agile Scrum experience- Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data

    1 week ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data

    1 week ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data

    2 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Professional

    7 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job TitleWe are currently seeking a highly skilled Big Data professional to join our team. The ideal candidate will have 6-12 years of experience in Big Data and related technologies.Key Skills:More than 5.8 years of experience in data engineering and architecture.Proficiency in Spark, Scala, Java, and SQL.Strong understanding of data structures and...

  • Big Data Developer

    6 days ago

    Pune, Maharashtra, India MRO Full time

    Analyst - Big Data DeveloperWe are seeking a highly skilled Analyst -Big Data Developer to join our dynamic team.The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.You will be responsible for designing, implementing, and maintaining...

  • Big Data Specialist

    5 days ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Expert - Big Data SpecialistDescription:We are seeking a highly skilled professional to join our team. The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.Main Responsibilities:Data Solutions: Design and implement robust...

  • Big Data Expert

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Big Data DeveloperThis role is ideal for a skilled and ambitious professional with expertise in big data technologies. As a Big Data Developer, you will play a key part in designing, developing, and maintaining large-scale data processing systems using Hadoop, Spark, and NoSQL databases.Key Responsibilities:Develop scalable data pipelines using Apache Kafka,...