Senior Big Data Administrator

2 days ago

Chennai, Tamil Nadu, India beBeeHadoop Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Big Data Administration Expert">

This role is crucial for managing and optimizing our extensive Hadoop platforms, which span thousands of nodes per cluster. As a Big Data Administration expert, you will be responsible for performing comprehensive Big Data Administration and Engineering activities on multiple open-source platforms, including Hadoop, Kafka, HBase, and Spark.

">

Key Responsibilities:

  • Perform root cause analysis for major production incidents and develop clear learning documentation.
  • Identify and implement high-availability solutions for services with single points of failure to ensure continuous operation.
  • Plan and execute capacity expansions and upgrades in a timely manner to prevent scaling issues and bugs.
  • Automate repetitive tasks to significantly reduce manual effort and prevent human errors, leveraging tools like Ansible, Shell scripting, or Python scripting.
  • Tune alerting mechanisms and set up robust observability to proactively identify issues and performance problems.
  • Collaborate closely with Level 3 teams to review new use cases and implement cluster hardening techniques, building robust and reliable platforms.
  • Create standard operating procedure (SOP) documents and guidelines for effectively managing and utilizing the Big Data platforms.
  • Ensure that the Hadoop platform consistently meets performance and service level agreement (SLA) requirements.
  • Perform security remediation, automation, and self-healing as per requirements to maintain a secure and resilient environment.

Required Skills & Qualifications:

  • 5- 12 years of experience in Big Data Administration and Engineering.
  • Minimum of 2 years of dedicated Hadoop admin support experience.
  • For senior roles, 3-5 years of Hadoop Admin support experience with 500+ node clusters is expected.
  • Strong proficiency in Hadoop administration automation using tools like Ansible, Shell scripting, or Python scripting.
  • Solid DevOps skills, with the ability to code in at least one language, preferably Python.
  • Hands-on experience with Hadoop, Kafka, HBase, and Spark platforms.
  • Proven strong troubleshooting and debugging skills.

Benefits of Working with Us">

  • Big Data Administrator

    3 days ago

    Chennai, Tamil Nadu, India beBeeAdministrator Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job TitleWe are seeking an experienced Big Data Administrator to lead our team in the development and maintenance of large-scale data systems.">Key Responsibilities:Design, deploy and manage Cloudera clusters for efficient data processing.Migrate data between various systems ensuring seamless integration.Optimize system performance through advanced...

  • Senior Big Data Python Developer

    1 day ago

    Chennai, Tamil Nadu, India Innovatz Global Full time US$ 90,000 - US$ 1,20,000 per year

    Company DescriptionInnovatz is a Global Management Consulting, Technology Services, and Business Process Outsourcing Company headquartered in Kuala Lumpur, Malaysia. With a strong presence in America, China, India, Australia, Korea, Hong Kong, and various other countries, Innovatz has a skilled workforce of over 500, including Subject Matter Experts, Project...

  • Highly Experienced Big Data Strategist

    2 days ago

    Chennai, Tamil Nadu, India beBeeBigDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data ArchitectJob Description:We are seeking a seasoned Senior Big Data Architect to lead the design, development and deployment of industry-leading big data and AI applications. As a key member of our team, you will be responsible for providing architectural guidance that fosters the adoption of Databricks across business-facing functions.Key...

  • Pando - Senior Data Warehousing Engineer - Big Data

    4 weeks ago

    Chennai, Tamil Nadu, India Pando Corp Private Limited Full time

    About the jobSenior Data Warehouse Engineer Pando (www.pando.ai) is pioneering the future of autonomous logistics with innovative AI capabilities. Trusted by Fortune 500 enterprises with global customers across North America, Europe, and Asia Pacific regions, we are leading the global disruption of supply chain software, with our AI-powered, no-code, &...

  • Senior Big Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India Luxoft Full time US$ 1,04,000 - US$ 1,30,878 per year

    Project descriptionWe've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products .ResponsibilitiesChoosing the right technologies for our use cases, deploy and operate.Setting up Data stores...

  • Senior IT Manager: Big Data Solutions

    4 days ago

    Chennai, Tamil Nadu, India beBeeExperience Full time ₹ 33,121

    We are seeking a senior manager to lead our development team under finance and tax departments.Key Responsibilities:Requirements analysis and engineeringEnd-to-end development covering analysis, design, development, data management, devops integration using pipeline build and maintenance, solutioning for other non-functional requirementsInfrastructure...

  • Senior Big Data Developer

    7 days ago

    Chennai, Tamil Nadu, India beBeeDatabricksDeveloper Full time

    Big Data Developer OpportunityAbout the RoleWe are seeking a skilled developer to design, build, and manage big data processing and analytics solutions using PySpark within the Databricks platform. This role is crucial for working with relevant technologies, ensuring smooth data operations, and contributing significantly to business objectives through expert...

  • Senior Big Data Engineer

    2 days ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Platform EngineerAt our organization, we are building a world-class big data platform to bring value out of data for us and for our customers.We aim to democratize data, support exploding business, provide reporting and analytics self-service tools, and fuel existing and new business critical initiatives.Our mission is to build scalable, available,...

  • Senior Big Data Technologist

    2 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Software EngineerWe are seeking a highly skilled and experienced professional to join our team as a Data Software Engineer.Key Responsibilities:Develop, optimize, and maintain big data pipelines using Apache Spark and Python.Implement distributed computing solutions and large-scale data processing.Build and maintain stream-processing systems...

  • Big Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India Insight Global Full time

    Position: Big Data EngineerDuration: 12+ monthsLocation: India - Chennai or GurgaonRate: 4-17 LPARequired Skills & ExperienceAt least 6+ Years of experience with PySpark and MapRProgramming background with PythonExperience with SQL (Relational Databases) doing data modeling, Oracle experience is a plus.Experience with PowerBI and/or TableauJob...