Big Data Platform Manager

3 days ago

Ghaziabad, Uttar Pradesh, India beBeeDataScience Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Description:

We are seeking a seasoned big data professional to join our team and take charge of the day-to-day operations of our big data platform.

  • Manage the big data platform, ensuring smooth operation and optimal performance.
  • Administer and monitor Big Data Platform components such as Hadoop, Hive, HBase, BigSQL, etc.
  • Support technical and application team requests for data copies across environments, data cleanup, query tuning, etc.
  • Troubleshoot and resolve issues related to user queries, application jobs, etc.
  • Monitor and troubleshoot Big Data Platform including hosted DBs, tools, and services.
  • Create encryption zones, manage encryption keys, and copy data between the encryption zones.
  • Support projects/initiatives related to data acquisition, processing, and utilization through Big Data Platform.
  • Maintain and support Big Data Platform, CDP Private Cloud, and IBM BigSQL across multiple environments.
  • Install new versions, patches, support upgrades of CDP Private Cloud and IBM BigSQL.
  • Monitor and troubleshoot platform issues and performance tuning.
  • Support security policies, documentation, and compliance.
  • Document processes and policies for Hadoop System Administration Platform support activities.
Requirements
  • Bachelor's or Master's degree in Computer Science or relevant field.
  • 35 years of experience in the Hadoop ecosystem, HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR.
  • 6 years of experience with Java and Linux/Unix.
  • 4 years of experience with security scripting and automation.
  • 2 years of experience in R, Python, Flume, Storm, Kafka.
  • 2 years of experience with IBM BigSQL or similar MPP SQL engines.
  • 2 years of experience with MySQL.
  • 1 year of experience with CICD.
  • Experience with administration and performance tuning of Hadoop distributions, open-source, and commercial.
  • Highly competent with Data Lake concepts and Big Data capabilities.
  • Good understanding of data virtualization, replication, Data G.
  • Experience with AWS or other cloud-based PaaS/SaaS environments.
  • Experience with AWS EMR.
  • Strong communication skills.
  • Mandatory Skills: Dataiku.

  • Big Data Expert

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineer OpportunityWe are seeking an experienced Senior Data Engineer to join our team. The successful candidate will have a strong background in data engineering, with expertise in designing, building, and optimizing scalable data pipelines on cloud platforms.Responsibilities:Design and implement data ingestion, transformation, and integration...

  • Big Data Specialist

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data ExpertWelcome to a unique career opportunity in the field of Big Data!With years of experience spanning 6-12 years, you will have the chance to work on diverse projects, leveraging your skills in data analysis and interpretation.Our ideal candidate will be based in Pune, Mumbai, or Chennai, with a notice period ranging from 0-45 days.Job...

  • Advanced Big Data Solutions Architect

    3 days ago

    Ghaziabad, Uttar Pradesh, India beBeeBigDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,80,00,000

    Enterprise Big Data EngineerAre you a skilled big data engineer looking for a challenging opportunity? We are seeking an experienced Enterprise Big Data Engineer to join our team.This is a fantastic opportunity to be an integral part of a team building a next-generation platform using big data and micro-services technology.As a key member of our engineering...

  • Senior Big Data Developer Position

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data DeveloperWe are seeking a skilled Big Data Developer to assume this role. The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, and Hive.Main Responsibilities:Data Processing: Design, develop, and maintain efficient data pipelines for ingestion, transformation, and storage of large-scale...

  • Big Data Expert

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a seasoned data engineer to spearhead our big data initiatives. The ideal candidate will possess hands-on expertise in Spark, Scala, and PySpark, as well as a solid understanding of database management.Key Responsibilities:Analyzing technical requirements and developing solutions that meet business needsCoding using Spark and...

  • Big Data Engineer

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Big Data Engineer PositionWe are seeking a highly skilled professional to lead the design and development of scalable data pipelines using big data processing, cloud-based analytics, and advanced visualisation technologies.The ideal candidate will have hands-on experience with Apache Airflow, Apache Spark, Azure data services, Python programming, and...

  • Big Data Specialist

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 15,00,000

    Role Overview:We are seeking a highly skilled Big Data Engineer with 2+ years of experience to join our organization.The successful candidate will be responsible for designing, developing, and maintaining large-scale data systems.

  • Senior Big Data Specialist

    3 days ago

    Ghaziabad, Uttar Pradesh, India beBeeBigData Full time ₹ 15,00,000 - ₹ 25,00,000

    Transform Your Career as a Big Data DeveloperJob OverviewWe are seeking an experienced Big Data Developer to join our delivery team, with a focus on project support and mentoring junior engineers. This role is ideal for a developer who thrives in a technical environment and is passionate about coaching and developing the next generation of talent.You will...

  • Big Data Engineering Expert

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,60,00,000 - ₹ 2,20,00,000

    About Data EngineeringMResult is a global digital solutions partner trusted by leading Fortune 500 companies.We help companies streamline operations and unlock business value with our expertise in data and analytics, machine learning, AI, and automation.Role RequirementsIn this role, you will be a key contributor to our mission of empowering clients with...

  • Leading Big Data Architectures

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewThe role of Senior Data Engineer (Lead) is responsible for leading a team of big data engineers in developing architectures that meet client and business needs. Key responsibilities include providing technical leadership, guiding the team, and ensuring timely delivery of projects.This position requires close collaboration with clients and team...