Chief Big Data Engineer

3 hours ago

Rajkot, Gujarat, India beBeeDataiku Full time ₹ 20,00,000 - ₹ 26,00,000
Big Data Administration Opportunity

We are seeking a highly skilled individual to manage our big data platform.

The ideal candidate will have extensive experience in administering and monitoring big data components, as well as supporting technical and application teams.

This is an excellent opportunity for someone who is passionate about big data and wants to work on a challenging project.

  • Job Description:
  • Administer and monitor Big Data Platform components Hadoop Hive HBase BigSQL etc.
  • Support technical and application team requests data copies across environments data cleanup query tuning etc.
  • Troubleshoot and resolve issues related to user queries application jobs etc.
  • Monitor and troubleshoot Big Data Platform including hosted DBs tools and services.
  • Creating encryption zones managing encryption keys and copying data between the encryption zones.
  • Support projects initiatives related to data acquisition processing and utilization through Big Data Platform.
  • Maintain and support Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments.
  • Install new versions patches support upgrades of CDP Private Cloud and IBM BigSQL.
  • Monitor and troubleshoot platform issues and performance tuning.
  • Support security policies documentation and compliance.
  • Document processes and policies for Hadoop System Administration Platform support activities.
  • Work with end users to identify and resolve issues.
  • Work with vendors to resolve issues as needed.
  • Provide governance and support to project teams.
  • Upgrade to CDP Private Cloud to CDP Public Cloud.
Requirements
  • Bachelors or Masters degree in Computer Science or applicable field of study.
  • 35 Years Of Experience In Hadoop Ecosystem HDFS MapReduce Hive HBase Spark Scala Yarn Sqoop Ranger Knox Kerberos LDAP SOLR.
  • 6 Years Of Experience With Java And LinuxUnix.
  • 4 Years Of Experience With Security Scripting and Automation.
  • 2 Years Of Experience In R Python Flume Storm Kafka.
  • 2 Years Of Experience With IBM BigSQL Or Similar MPP SQL Engines.
  • 2 Years Of Experience with MYSQL.
  • 1 Years Of Experience wit CICD.
  • Experience with administration and performance tuning of Hadoop distributions open source and commercial.
  • Highly competent with Data Lake concepts and Big Data capabilities.
  • Good understanding of data virtualization replication Data G.
  • Experience with AWS or other Cloudbased PaaSSaaS environments.
  • Experience with AWS EMR.
  • Strong communication skill.
  • Mandatory Skills : Dataiku.

  • Senior Big Data Engineer

    1 week ago

    Rajkot, Gujarat, India beBeeBigDataEngineer Full time ₹ 75,00,000 - ₹ 1,50,00,000

    Senior Big Data EngineerWe are seeking a highly skilled Senior Big Data Engineer to join our team. The successful candidate will be responsible for designing, building, and maintaining large-scale data systems.

  • Senior Big Data Engineer

    6 hours ago

    Rajkot, Gujarat, India beBeeEngineer Full time ₹ 15,00,000 - ₹ 26,00,000

    Job Description:We are seeking a skilled Big Data Engineer to join our team, with a focus on delivering high-impact projects and mentoring junior engineers. This role is ideal for an engineer who thrives in a technical environment and is passionate about coaching and developing the next generation of talent.This role involves working on live client projects,...

  • Data Engineer Leader

    4 days ago

    Rajkot, Gujarat, India beBeeBigDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job SummaryWe are seeking a seasoned Data Engineer Leader to spearhead our big data and AI initiatives.The ideal candidate will have extensive experience in designing, developing, and maintaining large-scale data processing systems using Hadoop, Spark, Scala, and Hive.Key Responsibilities:Developing and implementing big data solutions to drive business...

  • Senior Big Data Architect

    1 week ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Azure Data EngineerThe role of the data engineer involves working with large datasets and designing efficient systems to store, process, and retrieve data.About the Role: As a data engineer, you will be responsible for architecting, building, testing, and deploying large-scale data processing systems. You will work closely with cross-functional...

  • Data Engineer

    7 days ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 3,00,00,000 - ₹ 6,00,00,000

    Job Title: Data EngineerWe are seeking a skilled data engineer to design, develop and maintain large-scale data processing systems.The ideal candidate will have a strong background in big data technologies such as PySpark, Hive, Spark, and HBase. Experience with data ingestion from disparate sources onto the big data platform is highly desirable.We require...

  • Senior Big Data Expert

    1 week ago

    Rajkot, Gujarat, India beBeeDataDriven Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Data ArchitectAbout the Role:We are looking for an experienced Data Architect to lead our Big Data initiatives.Key Responsibilities:Design and Implement Big Data SolutionsLead a team of engineers in developing and maintaining large-scale data processing systemsCollaborate with cross-functional teams to drive business growth through data-driven...

  • Data Engineer

    4 days ago

    Rajkot, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data DeveloperWe are seeking a seasoned professional in big data engineering to join our team.Design and develop scalable big data architectures using Apache Hadoop or similar technologies.Develop and implement ETL (Extract, Transform, Load) processes to integrate multiple data sources.Collaborate with cross-functional teams to identify business...

  • Senior Big Data Developer

    1 week ago

    Rajkot, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Big Data EngineerWe are seeking a skilled Big Data Engineer to join our data engineering team. The ideal candidate will have strong expertise in Scala, Spark, Python, NiFi, and Apache Kafka.Key Responsibilities:Design, develop, and optimize large-scale data pipelines and distributed data processing systems.Work extensively with Scala, Spark...

  • Big Data Specialist

    2 days ago

    Rajkot, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data SpecialistAbout the Role:Data specialists play a critical role in extracting valuable insights from complex data sets. They design, build, deploy, and maintain large-scale data processing systems that enable organizations to make informed business decisions.Key Responsibilities:Design and develop scalable data pipelines using modern...

  • Chief Data Architectural Specialist

    4 days ago

    Rajkot, Gujarat, India beBeeEngineer Full time ₹ 1,84,25,000 - ₹ 2,47,50,000

    Job OverviewOur organization is seeking a skilled Senior Big Data Engineer to lead our data engineering teams.The ideal candidate will possess a strong background in Scala and Python, with experience in Apache Spark, HDFS, and distributed blob storages. They should also be familiar with technologies such as Kubernetes, Terraform, and Helm.Key...