Big Data Admin

4 days ago

Pune, Maharashtra, India Whiteklay Full time ₹ 5,00,000 - ₹ 12,00,000 per year

Job Title:
Big Data Admin

Location:
Pune

Employment Type:
Full-time

Responsibilities:

Big Data Ecosystem Management:

  1. Install, configure, and maintain big data platforms like Hadoop, HPE Ezmeral Data Fabric, Apache Druid, or Apache Kafka.
  2. Monitor and manage distributed systems, ensuring optimal cluster performance and resource utilization.
  3. Perform routine maintenance, upgrades, and patching of big data systems.

Linux System Administration:

  1. Manage Linux-based servers, including configuration, troubleshooting, and performance tuning.
  2. Automate administrative tasks using shell scripting or tools like Ansible, Puppet, or Chef.
  3. Ensure the security and hardening of Linux servers used in the big data environment

.

Cluster Monitoring and Troubleshooting:

  1. Monitor and analyze system performance metrics to ensure high availability and scalability.
  2. Identify and resolve issues within the big data cluster, such as node failures, job errors, or network bottlenecks.

Backup, Recovery, and Security:

  1. Implement data backup and recovery strategies to ensure data durability and integrity.
  2. Enforce security measures, including user access controls, encryption, and auditing.

Documentation and Reporting:

  1. Maintain up-to-date documentation for configurations, processes, and best practices.
  2. Provide regular reports on system health, usage, and performance trends.

Requirements:

  • Education:
    Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Experience:
    3–5 years of experience in big data administration or a similar role.
  • Technical Skills:
  • Strong proficiency in Linux system administration (Red Hat, CentOS, Ubuntu, etc.).
  • Hands-on experience with big data platforms like Hadoop (HDFS, YARN, Hive, etc.), Apache Kafka, or Apache Druid.
  • Familiarity with cluster management tools like Ambari, Cloudera Manager, or similar.
  • Knowledge of scripting languages (e.g., Bash, Python) for automation tasks.
  • Understanding of networking concepts, storage systems, and distributed computing.

Additional Skills:

  • Experience with monitoring tools (e.g., Prometheus, Grafana, Nagios).
  • Knowledge of containerized environments (e.g., Kubernetes, Docker) is a plus.
  • Basic understanding of data governance and security best practices.

  • Big Data

    4 days ago

    Pune, Maharashtra, India Emergys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Work Location:Pune(Work-from -Office mode)Notice Period:Immediate to 30 DaysExperience:2+ yearsMust Have skills:Hadoop Administration (Cloudera CDP/CDH, Hortonworks HDP) – hands-on experience in setup, configuration, and support.Linux/Unix System Administration – strong knowledge of OS internals, shell/bash scripting, and automation.Security...

  • Power BI Admin

    7 days ago

    Pune, Maharashtra, India Admin Looks Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Urgently looking for the Remote Power BI AdminExperience:6+ years of experience in Power BI administration, management, and support.Strong background in BI environments, with hands-on experience in Power BI Service and Power BI Report Server.Familiarity with data integration, data modeling, and ETL processes as they pertain to Power BI.Technical...

  • Big Data

    3 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiJob Description:-Must-Have- PySpark- HiveGood-to-Have- Spark- HBase- DQ tool- Agile Scrum experience- Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data

    4 weeks ago

    Pune, Maharashtra, India Tata Consultancy Services Full time

    Greetings from TCS Skill: Big Data Years of Experience: 6 - 12 years Location: Pune/ Mumbai/ Chennai Notice Period: 0 - 45 days Job Description:- Must-Have PySpark Hive Good-to-Have Spark HBase DQ tool Agile Scrum experience Exposure in data ingestion from disparate sources onto Big Data platform

  • Big Data

    1 week ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data Lead

    2 days ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Developer

    4 weeks ago

    Pune, Maharashtra, India MRO Full time

    Analyst - Big Data DeveloperWe are seeking a highly skilled Analyst -Big Data Developer to join our dynamic team.The ideal candidate will have extensive experience with big data technologies and a strong background in developing and optimizing data integration frameworks and applications.You will be responsible for designing, implementing, and maintaining...

  • Big Data Architect

    17 hours ago

    Pune, Maharashtra, India Consulting Pandits Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Architect - Build the Future of Data Management Are you passionate about designing and implementing scalable and resilient data architectures? Do you have a strong understanding of big data technologies and a keen eye for problem-solving? We're looking for a seasoned Big Data Architect to join our team in Pune and help us shape the future of data...

  • Big Data Engineer

    4 weeks ago

    Pune, Maharashtra, India Nice Software Solutions Pvt. Ltd. Full time

    Big Data Engineer (PySpark)Location: Pune/Nagpur (WFO)Experience: 8 - 12 YearsEmployment Type: Full-timeJob OverviewWe are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Big Data Tester

    1 week ago

    Pune, Maharashtra, India Shavish Hr And Digital Marketing Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Big data Tester have a good Big Data testing, focusing on both automated & manual testing for data validation.Strong understanding of Hadoop ecosystem.Skilled in writing & executing SQL queries. Hands-on exp. with JIRA or Bugzilla.