Senior Data Engineer for Hadoop and Big Data Platforms

5 days ago


Bengaluru, Karnataka, India beBeeBigDataAdministrator Full time ₹ 36,00,000 - ₹ 48,00,000
Job Overview

We are seeking an experienced Big Data Administrator to manage our big data platform, encompassing Hadoop, Hive, HBase, and BigSQL. The successful candidate will oversee daily operations, troubleshoot issues, maintain security, and work on projects related to data acquisition, processing, and utilization through the big data platform.

Key Responsibilities
  • Administer and monitor big data platform components.
  • Support technical and application teams.
  • Maintain the CDP Private Cloud and IBM BigSQL across multiple environments.
  • Work closely with vendors, end-users, and project teams to ensure seamless operation of the platform.
Requirements
  1. Bachelors or Masters degree in Computer Science or relevant field.
  2. At least 7 years of experience in Hadoop Ecosystem (HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR).
  3. Experience with Java and Linux/Unix is necessary.
  4. Strong knowledge of security scripting and automation, as well as AWS or other cloud-based PaaS/SaaS environments.
  5. Ability to work with administration and performance tuning of Hadoop distributions, both open-source and commercial.
  6. Good understanding of data virtualization, replication, and data governance.
  7. Highly competent with Data Lake concepts and Big Data capabilities.

  • Data Engineer

    4 days ago


    Bengaluru, Karnataka, India beBeeHadoop Full time ₹ 1,04,000 - ₹ 1,30,878

    **Data Engineer - Big Data & Hadoop SpecialistWe are seeking a highly skilled Data Engineer to join our team and take on the role of Big Data & Hadoop Specialist. The ideal candidate will have experience in designing, developing, and maintaining large-scale data processing systems using Hadoop and other related technologies.Key Responsibilities:Design,...


  • Bengaluru, Karnataka, India beBeeBigData Full time ₹ 20,00,000 - ₹ 35,00,000

    We are looking for a seasoned big data professional with expertise in Scala and cloud technologies to lead our data engineering efforts.Job DescriptionThe ideal candidate will have hands-on experience designing, developing, and optimizing data pipelines and ETL workflows using Hadoop, Apache Airflow, Kubernetes, and Containers. They will work closely with...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    ">Big Data Engineer">Job Description: As a senior big data engineer, you will play a key role in designing and implementing large-scale data processing systems. You will work with cross-functional teams to develop and deploy data pipelines that integrate with various data sources and enable business insights.">Develop scalable and efficient data pipelines...

  • Big Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Coders Brain Full time

    Job DescriptionRoles and Responsibilities:- Develop scalable infrastructure and platform to collect, analyze and process large amounts of structured and unstructured data with real-time data interpretation.- Work closely across an array of various teams and organizations in the company (including partners, customers)Basic Qualifications:- Bachelor's degree...


  • Bengaluru, Karnataka, India Guide&Bridge Full time US$ 1,50,000 - US$ 2,00,000 per year

    Job Title: Senior Big Data EngineerExperience Required: 3+ YearsAbout the RoleWe are looking for an experiencedSenior Big Data Engineerto design, build, and optimize large-scale data pipelines and platforms. The ideal candidate will have strong expertise in distributed data processing, cloud-based data solutions, and a proven ability to work with complex...


  • Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Solutions EngineerWe are seeking a highly skilled and experienced Big Data Solutions Engineer to lead and manage our team of data engineers. As a key member of our organization, you will be responsible for designing, building, and maintaining scalable big data platforms and pipelines that meet the needs of our business.Your primary focus will be on...


  • Bengaluru, Karnataka, India beBeeCloud Full time ₹ 9,00,000 - ₹ 12,00,000

    **Job Title:** Senior Cloud Engineer - Big Data Specialist**Job Description:** We are seeking an experienced Senior Cloud Engineer to join our team. As a cloud expert, you will be responsible for designing and implementing scalable big data solutions using Google Cloud Platform (GCP).We need a candidate with extensive production experience in GCP and a...


  • Bengaluru, Karnataka, India beBeeHadoop Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Senior Hadoop Engineer PositionWe are seeking a skilled Senior Hadoop Engineer to fill a key role in our organization. The ideal candidate will possess a deep understanding of Hadoop and its associated tools, including Hive, Spark, and HDFS.Responsibilities:Hadoop Expertise: Leverage in-depth knowledge of Hadoop and related tools to conduct comprehensive...


  • Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the Role We are seeking experienced professionals to join our team as Senior Data Engineers. In this role, you will be responsible for designing and developing efficient data pipelines using big data tools and AWS services. Key Responsibilities: Data Pipeline Development: Design and develop efficient data pipelines as per business requirements while...


  • Bengaluru, Karnataka, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:">In this role, you will be responsible for designing and implementing data pipelines and ETL workflows to streamline data processing.You will work with Apache Hadoop, Airflow, Kubernetes, and Containers to optimize data analytics and mining techniques.A strong background in cloud-based big data solutions on GCP and Azure is...