Big Data Expert

2 weeks ago

Morādābād, Uttar Pradesh, India beBeeData Full time ₹ 17,99,500 - ₹ 24,99,959

About Us:

We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.

Job Description:

  • Manage big data platform
  • Administer and monitor Big Data Platform components Hadoop Hive HBase BigSQL etc
  • Support Technical and Application team requests data copies across environments data cleanup query tuning etc
  • Troubleshoot and resolve issues related to user queries application jobs etc
  • Monitor and troubleshoot Big Data Platform including hosted DBs tools and services
  • Creating encryption zones managing encryption keys and copying data between the encryption zones
  • Support projects/initiatives related to data acquisition processing and utilization through Big Data Platform
  • Maintain and support Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments
  • Install new versions patches support upgrades of CDP Private Cloud and IBM BigSQL
  • Monitor and troubleshoot platform issues and performance tuning
  • Support security policies documentation and compliance
  • Document processes and policies for Hadoop System Administration Platform support activities
  • Work with end users to identify and resolve issues
  • Work with vendors to resolve issues as needed
  • Provide governance and support to project teams
  • Upgrade to CDP Private Cloud to CDP Public Cloud

Key Requirements:

  • Bachelor's or Master's degree in Computer Science or relevant field of study
  • 35 years of experience in Hadoop Ecosystem HDFS MapReduce Hive HBase Spark Scala Yarn Sqoop Ranger Knox Kerberos LDAP SOLR
  • 6 years of experience with Java and Linux/Unix
  • 4 years of experience with Security Scripting and Automation
  • 2 years of experience in R Python Flume Storm Kafka
  • 2 years of experience with IBM BigSQL or similar MPP SQL Engines
  • 2 years of experience with MySQL
  • 1 year of experience with CI/CD
  • Experience with administration and performance tuning of Hadoop distributions open source and commercial
  • Highly competent with Data Lake concepts and Big Data capabilities
  • Good understanding of data virtualization replication Data G
  • Experience with AWS or other cloud-based PaaS/SaaS environments
  • Experience with AWS EMR
  • Strong communication skills
  • Mandatory Skills: Dataiku

  • Big Data Specialist

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Opportunity: Big Data Expert">We are seeking a skilled professional to join our team as a Big Data expert. The ideal candidate will have hands-on experience with Big Data development and engineering, with a strong focus on mentoring junior engineers.This role involves working on live client projects, providing technical support, contributing to solution...

  • Big Data Expert

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    About UsWe are a leading professional services organization offering high-quality solutions to businesses. Our expertise lies in utilizing best-of-breed technologies, rapidly deployable solutions and flexible engagement models.About the RoleJob Credentials- Experience: 5 to 12 years. We seek individuals with strong skills in big data spark, SQL, Hive,...

  • Big Data Engineer Leader

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeBigDataEngineer Full time ₹ 30,00,000 - ₹ 42,00,000

    Job Title: Big Data Engineer LeaderWe are seeking an experienced Big Data Engineer to lead our data engineering team. The ideal candidate will have a strong background in designing and implementing large-scale data pipelines, as well as experience with cloud-based infrastructure.The successful candidate will have a deep understanding of big data technologies...

  • Expert Data Pipeline Developer

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Engineering Expert NeededWe are seeking an experienced Data Engineer to join our team. This individual will be responsible for designing and implementing data pipelines, as well as orchestrating workflows and processing data.Key Responsibilities:Design and deploy data pipelines using Big Query.Orchestrate workflows using Apache Airflow.Process and...

  • Senior Big Data Engineer

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineering Role OverviewThis is a data engineering role where you will design, develop and maintain scalable data pipelines using modern cloud & big data platforms.As a key member of our team, you will collaborate with cross-functional teams to identify business requirements and implement data solutions.We are looking for someone with strong...

  • Senior Big Data Specialist

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description:">Create and maintain data pipelines, ensuring seamless integration with various data sources.Design and implement scalable data architectures to support business growth.">">Requirements:">Expertise in Apache Spark and experience with performance tuning and optimization.Proficiency in either Scala or Python.Hands-on experience with dbt (Data...

  • Data Scientist and Analytics Expert

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataScience Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Data Scientist and Analytics ExpertAbout the Role:We are seeking a highly skilled Data Scientist to join our team. As a Data Scientist, you will play a key role in driving business growth through data-driven decision-making.Main Responsibilities:Analyze complex data sets to identify trends and patterns, and develop predictive models to inform...

  • Expert Data Architect

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataArchitecture Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a seasoned Data Architecture Expert to join our team. As a key member, you will play a pivotal role in helping clients transform their corporate finance functions by leveraging advanced analytics.Working closely with senior stakeholders, you will design and implement data strategies in the finance space, covering various use...

  • Big Data Expert

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Greetings from TCSJob Title: Azure Data EngineerRequired Skillset: Azure Databricks(Strong), Scala(strong), Pyspark(Good to have)Location: PAN INDIAExperience Range: 4-10 yearsJob Description4 or more years of experience working on Azure Databricks using Scala, PySpark4 or more years of experience on Azure Cloud platform4 or more years of full Software...

  • Big Data Architect

    2 weeks ago

    Morādābād, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Expert Data Architectural EngineerWe are seeking a highly skilled data engineer to fill a pivotal role within our organization. The ideal candidate will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures that drive business growth and success.About the RoleThis is an exceptional opportunity for a seasoned...