Big Data Admin

4 days ago

Pune, Maharashtra, India Whiteklay Full time ₹ 5,00,000 - ₹ 12,00,000 per year

Job Title:
Big Data Admin

Location:
Pune

Employment Type:
Full-time

Responsibilities:

Big Data Ecosystem Management:

  1. Install, configure, and maintain big data platforms like Hadoop, HPE Ezmeral Data Fabric, Apache Druid, or Apache Kafka.
  2. Monitor and manage distributed systems, ensuring optimal cluster performance and resource utilization.
  3. Perform routine maintenance, upgrades, and patching of big data systems.

Linux System Administration:

  1. Manage Linux-based servers, including configuration, troubleshooting, and performance tuning.
  2. Automate administrative tasks using shell scripting or tools like Ansible, Puppet, or Chef.
  3. Ensure the security and hardening of Linux servers used in the big data environment

.

Cluster Monitoring and Troubleshooting:

  1. Monitor and analyze system performance metrics to ensure high availability and scalability.
  2. Identify and resolve issues within the big data cluster, such as node failures, job errors, or network bottlenecks.

Backup, Recovery, and Security:

  1. Implement data backup and recovery strategies to ensure data durability and integrity.
  2. Enforce security measures, including user access controls, encryption, and auditing.

Documentation and Reporting:

  1. Maintain up-to-date documentation for configurations, processes, and best practices.
  2. Provide regular reports on system health, usage, and performance trends.

Requirements:

  • Education:
    Bachelor's degree in Computer Science, Information Technology, or a related field.
  • Experience:
    3–5 years of experience in big data administration or a similar role.
  • Technical Skills:
  • Strong proficiency in Linux system administration (Red Hat, CentOS, Ubuntu, etc.).
  • Hands-on experience with big data platforms like Hadoop (HDFS, YARN, Hive, etc.), Apache Kafka, or Apache Druid.
  • Familiarity with cluster management tools like Ambari, Cloudera Manager, or similar.
  • Knowledge of scripting languages (e.g., Bash, Python) for automation tasks.
  • Understanding of networking concepts, storage systems, and distributed computing.

Additional Skills:

  • Experience with monitoring tools (e.g., Prometheus, Grafana, Nagios).
  • Knowledge of containerized environments (e.g., Kubernetes, Docker) is a plus.
  • Basic understanding of data governance and security best practices.

  • Big Data

    4 days ago

    Pune, Maharashtra, India Emergys Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Work Location:Pune(Work-from -Office mode)Notice Period:Immediate to 30 DaysExperience:2+ yearsMust Have skills:Hadoop Administration (Cloudera CDP/CDH, Hortonworks HDP) – hands-on experience in setup, configuration, and support.Linux/Unix System Administration – strong knowledge of OS internals, shell/bash scripting, and automation.Security...

  • Big Data Lead

    18 hours ago

    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Big Data Tester

    1 week ago

    Pune, Maharashtra, India Shavish Hr And Digital Marketing Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Big data Tester have a good Big Data testing, focusing on both automated & manual testing for data validation.Strong understanding of Hadoop ecosystem.Skilled in writing & executing SQL queries. Hands-on exp. with JIRA or Bugzilla.

  • Senior Salesforce Admin

    2 weeks ago

    Pune, Maharashtra, India NTT DATA Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Creating, configuring, and maintaining custom reports and dashboards Managing users, permissions, profiles, list views and groups Creating and customize page layouts Editing and maintaining data quality, account, and contact information Supporting creation and migration of new development features Required: 3 Years of Business Systems Analysis experience,...

  • Big Data Developer

    1 week ago

    Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...

  • Big Data

    3 days ago

    Pune, Maharashtra, India Vi (Vodafone Idea) Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    GM - Application Operations Vodafone Idea Limited is an Aditya Birla Group and Vodafone Group partnership. It is India's leading telecom service provider. The Company provides pan India Voice and Data services across 2G, 3G and 4G platform. With the large spectrum portfolio to support the growing demand for data and voice, the company is committed to...

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India RiskInsight Consulting Pvt Ltd. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ResponsibilitiesDesign, develop, and implement robust Big Data solutions using technologies such as Hadoop, Spark, and NoSQL databasesBuild and maintain scalable data pipelines for effective data ingestion, transformation, and analysisCollaborate with data scientists, analysts, and cross-functional teams to understand business requirements and translate them...

  • Big Data Engineer

    4 days ago

    Pune, Maharashtra, India Talent Sketchers Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Designation: Big Data EngineerExperience: 4+ YearsWork Mode: Remote OpportunityNotice Period: Immediate Joiners/ Serving Notice PeriodJob Description:Role: Big Data EngineerThis Data Engineer will be engaged in data science-related research and software application development and engineering duties related to our enterprise-grade Wi-Fi technology to provide...

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greetings from TCSTCS is hiring forBig DataLocation: -Chennai/Mumbai/PuneDesired Experience Range:6 to 12 yearsMust-Have• PySpark • HiveGood-to-Have• Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platformThanksAnshika

  • Big Data Developer

    3 weeks ago

    Pune, Maharashtra, India, Maharashtra UST Full time

    We are seeking a Big Data Engineer with strong hands-on experience in Spark and AWS technologies. The ideal candidate should demonstrate a deep understanding of big data concepts, programming fundamentals, and the ability to solve complex problems related to scalability, failure handling, and optimization. Key Responsibilities:Design, develop, and optimize...