Big Data Expert

2 days ago

Dombivli, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

About Us

We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.

We cater to over 700 clients with our extensive domain and technology expertise to drive superior competitive differentiation, customer experiences, and business outcomes.

Job Description:

  • We are looking for a highly skilled On-Premises Cloud Era Big Data Administrator to manage big data platforms and ensure seamless day-to-day operations.
  • The ideal candidate will handle administration and monitoring of Big Data Platform components including Hadoop, Hive, HBase, BigSQL, etc.
  • This role requires strong technical skills to support technical and application team requests for data copies across environments, data cleanup, query tuning, etc.
  • The incumbent will troubleshoot and resolve issues related to user queries, application jobs, etc.
  • Maintaining the integrity and performance of the Big Data Platform is crucial, including hosted DBs, tools, and services.
  • Key responsibilities include creating encryption zones, managing encryption keys, and copying data between encryption zones.
  • The selected candidate will support projects and initiatives related to data acquisition, processing, and utilization through Big Data Platform.
  • Maintenance and support of Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments is also required.
  • Upgrades of CDP Private Cloud and IBM BigSQL need to be supported and installed in a timely manner.
  • The successful candidate will monitor and troubleshoot platform issues and performance tuning.
  • Adhering to security policies, documentation, and compliance is essential.
  • Documenting processes and policies for Hadoop System Administration Platform support activities is key.
  • Effective communication with end-users to identify and resolve issues is necessary.
  • Collaboration with vendors to resolve issues as needed is required.
  • Providing governance and support to project teams is critical.
  • Experience with upgrades to CDP Private Cloud to CDP Public Cloud is an asset.
  • A Bachelor's or Master's degree in Computer Science or an applicable field of study is required.
  • 35 years of experience in Hadoop Ecosystem, HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR is mandatory.
  • 6 years of experience with Java and Linux/Unix is required.
  • 4 years of experience with security scripting and automation is necessary.
  • 2 years of experience in R, Python, Flume, Storm, Kafka is desirable.
  • 2 years of experience with IBM BigSQL or similar MPP SQL Engines is required.
  • 2 years of experience with MySQL is required.
  • 1 year of experience with CICD is necessary.
  • Experience with administration and performance tuning of Hadoop distributions, open-source and commercial is essential.
  • Strong understanding of Data Lake concepts and Big Data capabilities is necessary.
  • Good knowledge of data virtualization, replication, Data G is desirable.
  • Experience with AWS or other cloud-based Paas/Saas environments is an asset.
  • Experience with AWS EMR is required.
  • Strong communication skills are necessary.
  • Mandatory Skills: Dataiku.

  • Big Data Expert

    1 week ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data ExpertWe are seeking a highly skilled Big Data expert to join our team. As a Big Data expert, you will be responsible for designing and implementing data solutions that meet business needs.Job Description:Design and implement data pipelines using PySpark and Hive.Analyze large datasets to gain insights and inform business decisions.Required...

  • Big Data Expert

    5 days ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleData Engineers play a pivotal role in designing, executing, and managing large-scale distributed data systems.They are responsible for monitoring performance, optimizing existing projects, and researching new big data tools and frameworks to integrate into our platform.As a Data Engineer II, you will work closely with cross-functional teams to...

  • Big Data Tester

    4 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a highly skilled and motivated individual to fill the role of Big Data Tester. This position involves designing and executing comprehensive User Acceptance tests in QA/production labs with multiple machines/virtual machines.Key Responsibilities:Develop expertise in Extract, Transform, Load (ETL) concepts, flow, and...

  • Big Data Strategist

    5 days ago

    Dombivli, Maharashtra, India beBeeCloud Full time ₹ 20,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled and passionate Big Data Architect to join our team. The ideal candidate will have hands-on experience in Azure, proficient in Big Data technologies, and strong understanding of data management principles.Required Skills & QualificationsHands-on experience in Azure for a minimum of 3–4 years, with overall professional...

  • Senior Big Data Specialist

    7 days ago

    Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Developer OpportunityWe are seeking an experienced professional to lead our big data development team. The ideal candidate will have a strong background in Python, PySpark and AWS technologies.

  • Principal Big Data Developer

    2 weeks ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 1,08,00,000 - ₹ 2,02,40,000

    Big Data EngineerWe are seeking a skilled Big Data Engineer to join our team.About the Role:Design, develop and deploy large-scale data processing systems using Python and PySpark.Work with big data technologies such as Hadoop, Spark and NoSQL databases.Collaborate with cross-functional teams to identify business requirements and design data...

  • Big Data Systems Developer

    1 week ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 80,00,000 - ₹ 2,00,00,000

    About the JobWe are seeking a skilled data processing professional to develop and maintain large-scale data systems.Job SummaryThe ideal candidate will have expertise in big data technologies and experience with tools such as PySpark, Hive, Spark, HBase, and DQ tools.Main ResponsibilitiesCreate efficient data processing systems using big data...

  • Big Data Analytics Specialist

    3 days ago

    Dombivli, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    About this role: We are seeking a seasoned data analytics professional with extensive experience in Big Data technologies and Google Cloud Platform services to design and implement scalable data solutions.

  • Big Data Engineering Specialist

    5 days ago

    Dombivli, Maharashtra, India beBeeBigDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Big Data Engineering SpecialistWe are seeking a seasoned professional to lead our big data engineering efforts, leveraging expertise in cloud-based architectures and scalable data pipelines.Drive the design and implementation of high-performance data processing systems using Spark, ensuring optimal cost and performance balance.Analyze existing data...

  • Senior Big Data Engineering Professional

    2 days ago

    Dombivli, Maharashtra, India beBeeDataExpert Full time ₹ 25,00,000 - ₹ 35,00,000

    Job OverviewWe are seeking an accomplished Big Data Developer to join our delivery team and contribute to the development of live client projects.You will play a key role in designing, implementing, and maintaining big data solutions using cutting-edge technologies like Hadoop, Spark, Hive, HDFS, and Kafka.