Big Data Platform Manager

16 hours ago

Surat, Gujarat, India beBeeDataiku Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Big Data Platform Manager Job

We are seeking a highly skilled Big Data Platform Manager to join our team. This is a challenging role that requires expertise in managing big data platforms, including day-to-day operations, administration, and monitoring of components.

  • Manage big data platforms with day-to-day operations including administration and monitoring of components Hadoop Hive HBase BigSQL etc.
  • Support technical and application teams requests for data copies across environments data cleanup query tuning etc.
  • Troubleshoot and resolve issues related to user queries application jobs etc.
  • Monitor and troubleshoot big data platform including hosted DBs tools and services.
  • Create encryption zones manage encryption keys and copy data between the encryption zones.
  • Support projects initiatives related to data acquisition processing and utilization through big data platform.
  • Maintain and support big data platform CDP Private Cloud and IBM BigSQL across multiple environments.
  • Install new versions patches support upgrades of CDP Private Cloud and IBM BigSQL.
  • Monitor and troubleshoot platform issues and performance tuning.
  • Support security policies documentation and compliance.
  • Document processes and policies for hadoop system administration platform support activities.
  • Work with end users to identify and resolve issues.
  • Work with vendors to resolve issues as needed.
  • Provide governance and support to project teams.
Requirements
  • Bachelors or Masters degree in Computer Science or applicable field of study.
  • 35 years of experience in Hadoop Ecosystem HDFS MapReduce Hive HBase Spark Scala Yarn Sqoop Ranger Knox Kerberos LDAP SOLR.
  • 6 years of experience with Java And LinuxUnix.
  • 4 years of experience with Security Scripting and Automation.
  • 2 years of experience in R Python Flume Storm Kafka.
  • 2 years of experience with IBM BigSQL Or Similar MPP SQL Engines.
  • 2 years of experience with MYSQL.
  • 1 year of experience with CICD.
  • Experience with administration and performance tuning of Hadoop distributions open source and commercial.
  • Highly competent with Data Lake concepts and big data capabilities.
  • Good understanding of data virtualization replication data G.
  • Experience with AWS or other Cloudbased PaaSSaaS environments.
  • Experience with AWS EMR.
  • Strong communication skill.
  • Mandatory Skills: Dataiku.

  • Big Data Engineer

    2 days ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Big Data Solutions ArchitectWe are seeking a highly skilled professional to lead the design and implementation of scalable data engineering solutions. The ideal candidate will have strong hands-on experience in architecting and implementing complex data architectures leveraging AWS services.Key Responsibilities:Design, develop, and optimize big...

  • Big Data Expert Wanted

    1 week ago

    Surat, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Expert WantedWe're seeking a seasoned data professional to spearhead our big data endeavors. The ideal candidate will have 6-12 years of experience in managing and processing large datasets using PySpark, Hive, and other relevant tools.Mandatory Skills:PySpark: Proficiency in crafting complex Spark jobs and optimizing performanceHive: Experience...

  • Big Data Project Manager

    6 days ago

    Surat, Gujarat, India beBeeProject Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Senior Project DirectorRole Overview:We seek an experienced senior-level professional to oversee large-scale projects within big data and analytics environments.The role involves delivering complex technical projects on time, within scope, while ensuring client satisfaction and seamless execution.Key Responsibilities:Oversee large-scale projects within big...

  • Big Data Solutions Architect

    3 days ago

    Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Role: Data Information ArchitectKey Responsibilities:Communicate effectively with customers to ensure mutual understanding and satisfaction.Utilize expertise in big data technologies like Azure Databricks, Python/Scala/Spark/PySpark, HIVE, HBase, Impala, and Parquet to drive business outcomes.Apply strong SQL and RDBMS skills to analyze and optimize...

  • Big Data Engineer

    2 weeks ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerOverview:We are seeking an experienced Big Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop scalable big data architectures using technologies like AWS, Python, and PySpark.Build and...

  • Big Data Engineer

    14 hours ago

    Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    As a Big Data Engineer, you will be responsible for developing scalable and efficient big data solutions using Hadoop, Spark, Hive, HDFS, and Kafka.This role requires strong expertise in big data technologies, excellent problem-solving skills, and effective communication with colleagues.The ideal candidate will have:8+ years of professional experience in big...

  • Big Data Architect

    5 days ago

    Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Big Data ArchitectWe are seeking a highly skilled Big Data Architect to design, build, and maintain large-scale data pipelines.Key Responsibilities:Design and implement robust data architectures using cloud-based technologies such as AWS Glue, Lambda, and DBT.Develop and optimize data models in Snowflake for high scalability and performance.Write efficient...

  • Big Data Engineer

    4 days ago

    Surat, Gujarat, India beBeeData Full time ₹ 25,00,000 - ₹ 37,50,000

    Unlock Your Career PotentialWe are seeking an experienced professional to lead the development and maintenance of scalable data pipelines, building out new API integrations, and collaborating with analytics and business teams to improve data models that feed business intelligence tools.This role requires strong technical and communication skills, with 6+...

  • Senior Big Data Developer

    14 hours ago

    Surat, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data EngineerWe are seeking a highly skilled professional with expertise in data processing, architecture, and engineering to join our team.The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines using technologies like Spark, Python, and Apache Kafka.Key Responsibilities:Data Ingestion and Processing:...

  • Big Data Developer

    7 days ago

    Surat, Gujarat, India beBeeDataScientist Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Overview:We are seeking a talented professional to join our team as a Big Data Developer.Key Responsibilities:Design and develop efficient programs/systems for data analyticsTranslate client requirements into system requirementsEstimate work requirements to provide information on project estimationsCode, test, and document new or modified data...