Senior Big Data Operations Specialist

1 day ago

Madurai, Tamil Nadu, India beBeeDataiku Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title

Big Data Platform Administrator

Madurai, India

About the Role

We are seeking an experienced Big Data Platform Administrator to manage our day-to-day operations.

The ideal candidate will have a strong background in Hadoop, Hive, HBase, and BigSQL, with experience in administering and monitoring Big Data Platform components.

Key Responsibilities
  • Manage big data platform handling day-to-day operations.
  • Administer and monitor Big Data Platform components including Hadoop, Hive, HBase, BigSQL, etc.
  • Support technical and application team requests for data copies across environments, data cleanup, query tuning, etc.
  • Troubleshoot and resolve issues related to user queries, application jobs, etc.
  • Monitor and troubleshoot Big Data Platform including hosted DBs, tools, and services.
  • Create encryption zones, manage encryption keys, and copy data between the encryption zones.
  • Support projects/initiatives related to data acquisition, processing, and utilization through Big Data Platform.
  • Maintain and support Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments.
  • Install new versions, patches, support upgrades of CDP Private Cloud and IBM BigSQL.
  • Monitor and troubleshoot platform issues and performance tuning.
  • Support security policies, documentation, and compliance.
  • Document processes and policies for Hadoop System Administration Platform support activities.
  • Work with end users to identify and resolve issues.
  • Work with vendors to resolve issues as needed.
  • Provide governance and support to project teams.
  • Upgrade to CDP Private Cloud to CDP Public Cloud.
Required Skills
  • 35 Years Of Experience In Hadoop Ecosystem, HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR.
  • 6 Years Of Experience With Java And Linux/Unix.
  • 4 Years Of Experience With Security Scripting and Automation.
  • 2 Years Of Experience In R, Python, Flume, Storm, Kafka.
  • 2 Years Of Experience With IBM BigSQL Or Similar MPP SQL Engines.
  • 2 Years Of Experience With MYSQL.
  • 1 Year Of Experience With CICD.
  • Experience With Administration And Performance Tuning Of Hadoop Distributions Open Source And Commercial.
  • Highly Competent With Data Lake Concepts And Big Data Capabilities.
  • Good Understanding Of Data Virtualization Replication Data G.
  • Experience With AWS Or Other Cloudbased PaaSSaaS Environments.
  • Experience With AWS EMR.
  • Strong Communication Skill.
  • Mandatory Skills : Dataiku.

  • Big Data Specialist

    7 days ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Big Data SpecialistWe are seeking a highly skilled professional to design, develop and maintain data pipelines for large-scale data ingestion, transformation and storage.About the RoleThe successful candidate will be responsible for designing efficient data pipelines using Big Data ecosystems and working closely with cross-functional teams to deliver...

  • Senior Big Data Engineer

    1 week ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Job OpportunitySkill: Big Data Hadoop SpecialistYears of Experience: 6 - 12 yearsLocation: IndiaNotice Period: FlexibleJob Description:Key Responsibilities:Develop and implement big data solutions using Spark, Hive, and HBase.Design and deploy scalable data pipelines for efficient data ingestion from disparate sources onto the Big Data...

  • Big Data Infrastructure Specialist

    1 week ago

    Madurai, Tamil Nadu, India beBeeInfrastructure Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Big Data Infrastructure Specialist, you will be responsible for designing and optimizing large-scale data processing environments.Key Responsibilities:Designing and implementing high-performance data clustersMigrating data between different systems using efficient tools and techniquesPerforming performance tuning and optimization to ensure seamless data...

  • Senior Big Data Architect

    5 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Cloud and Big Data Expertise WantedWe are seeking a skilled Cloud and Big Data Architect to join our team.This is a full-time role offering flexibility for remote work, with a strong focus on Big Data management and data quality skills.Hands-on experience in Azure for 3-4 years, with overall professional experience of less than 10 years.Proficient in Big...

  • Senior Big Data Architect

    2 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Optimal Data Pipeline ArchitectDesign, develop and maintain scalable data pipelines that extract, transform, and load data from various sources.Mandatory Qualifications:Expertise in big data technologies such as Apache Spark with proficiency in either Scala or Python programming languages.Hands-on experience with data transformation tools like DBT (Data...

  • Senior Data Specialist

    1 week ago

    Madurai, Tamil Nadu, India beBeeDataSpecialist Full time US$ 1,00,000 - US$ 1,20,000

    Senior Data SpecialistThe role of a Senior Data Specialist revolves around developing and implementing data-driven solutions to drive business growth. We are seeking an experienced professional to join our team and leverage their skills in data analysis, machine learning, and optimization methodologies.Key Responsibilities:Develop and maintain advanced data...

  • Senior Big Data Specialist

    7 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Lead Data ArchitectJob OverviewDevelop and maintain large-scale data architectures that handle structured and unstructured data.Design and implement ETL/ELT processes for data pipelines, ensuring reliability, scalability, and high availability.Collaborate with cross-functional teams to leverage AWS services and power business-critical data workflows.Work...

  • Big Data Engineering Specialist

    1 day ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Big Data EngineerWe are seeking a skilled data engineer to lead our team in developing large-scale data pipelines and distributed data processing systems.Key Responsibilities:Design, develop, and optimize scalable data architectures and data processing systems.Work extensively with Scala, Spark, and Python for data transformation and...

  • Big Data Engineer

    1 week ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Solutions ArchitectWe are seeking a skilled professional to design and develop large-scale data processing systems using cutting-edge technologies.Key Responsibilities:Design and implement big data architectures using PySpark, Hive, and SparkDevelop and maintain efficient data processing pipelinesCollaborate with cross-functional teams to integrate big...

  • Big Data Specialist

    3 days ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 60,00,000 - ₹ 1,00,00,000

    Job TitleWe seek a skilled Big Data Tester with expertise in Python, Java, and SQL to develop and execute test cases for Fixed Income trading workflows.Key Responsibilities:Write custom data validation scripts based on provided regression test cases.Read, understand, and translate stored procedure logic into test automation.Compare datasets across...