Big Data Cluster Specialist

3 days ago


Allahabad, Uttar Pradesh, India beBeeHadoop Full time ₹ 80,00,000 - ₹ 1,50,00,000

Job Overview:

Hadoop administrators are responsible for designing, deploying and maintaining large-scale Hadoop clusters.

Key Responsibilities:

  • Plan and execute the deployment of Hadoop clusters in on-premises or cloud environments
  • Monitor and optimize cluster performance to ensure optimal data processing and retrieval times
  • Collaborate with cross-functional teams to identify opportunities to improve data management and analytics processes
  • Develop and implement best practices for data security, backup and recovery, and disaster recovery procedures

Requirements:

  • 6-8 years of experience in Hadoop administration or a related field
  • Proficiency in Linux and scripting languages such as Python or Bash
  • Strong knowledge of Hadoop ecosystem components including MapReduce, Hive, Pig and Sqoop
  • Ability to work in a fast-paced environment and prioritize multiple tasks effectively

Benefits:

  • Opportunity to work with cutting-edge technologies and contribute to the development of innovative solutions
  • Competitive salary and benefits package
  • Collaborative and dynamic work environment
  • Professional growth and development opportunities

  • Big Data Expert

    4 days ago


    Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 40,00,000

    Greetings from our organizationOur Team is Looking for a Talented Big Data ProfessionalYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:We are Seeking Highly Skilled Professionals to Join Our TeamPySparkHiveKey Skills:SparkHBaseData Quality toolsAgile Scrum methodologiesData ingestion from multiple...


  • Allahabad, Uttar Pradesh, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering SpecialistJob Overview:As a Data Engineering Specialist, you will play a pivotal role in designing and developing large-scale data processing systems using cutting-edge technologies.This challenging position requires expertise in big data technologies, including PySpark and Hive. Familiarity with Spark, HBase, and data quality...


  • Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerWe are seeking a highly skilled professional with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our data engineering team.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark (PySpark), and Python for data...


  • Allahabad, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleWe are seeking a highly skilled Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines using Python, SQL, and cloud-based technologies.Data Engineering Expertise: Develop and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks to extract, transform, and load data from various sources.Big...


  • Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a senior data engineer to lead our big data engineering team. As a key member of the team, you will be responsible for developing architectures that meet business needs and providing technical leadership.The role involves setting up cloud-based data lakes and implementing standardized data models. You will develop data pipelines...

  • Big Data Developer

    3 days ago


    Allahabad, Uttar Pradesh, India beBeeDataInfrastructure Full time ₹ 12,50,000 - ₹ 17,50,000

    Job Title: Data Infrastructure SpecialistSeeking a seasoned data architect to design and build scalable data systems that handle high-volume financial information.This role involves leading the development of robust data pipelines that ensure data integrity, reliability, and real-time availability across our platforms.The ideal candidate will have expertise...


  • Allahabad, Uttar Pradesh, India beBeeMachineLearning Full time ₹ 15,00,000 - ₹ 20,00,000

    Business Intelligence SpecialistThe ideal candidate will excel in extracting valuable insights from complex data sets, asking the right questions and finding the right answers to drive strategic business decisions.Key Responsibilities:Assess quality, cleanse, and structure raw data for downstream processing using industry-standard tools and techniques.Design...

  • Big Data Specialist

    6 days ago


    Allahabad, Uttar Pradesh, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Data Engineering RoleJob Title: Data EngineerWe are seeking a skilled Data Engineer to support data-driven initiatives.This role involves designing scalable pipelines, working with streaming data, and collaborating with data scientists and stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines and ETL...

  • Data Engineer

    5 days ago


    Allahabad, Uttar Pradesh, India beBeeInformatica Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data Engineer - Informatica SpecialistAbout the RoleThe successful candidate will be responsible for designing and developing scalable ETL workflows using Informatica BDM/DEI. This will involve integrating data from structured and unstructured sources, including big data platforms.The ideal candidate will have strong data warehousing concepts to...


  • Allahabad, Uttar Pradesh, India beBeeKafkaAdmin Full time ₹ 15,00,000 - ₹ 30,00,000

    Kafka Administrator Job DescriptionAs a seasoned Kafka administrator, you will play a pivotal role in deploying and maintaining production-grade Kafka clusters to ensure seamless data processing and high availability.Main Responsibilities:Deploy and upgrade Kafka clusters to guarantee optimal performance and fault tolerance.Implement automation tools such as...