Senior Big Data Professional

1 day ago

Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 1,40,00,000

About the Company:

We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.

Our team is powered by entrepreneurial professionals across more than 30 countries, catering to over 700 clients with extensive domain and technology expertise to drive competitive differentiation, customer experiences, and business outcomes.

Data Engineer Job Title:

Job Description:

  • Looking for highly skilled On-prem Cloud Era Big Data Administrator to manage big data platform including Hadoop Hive HBase BigSQL etc
  • Handle day-to-day operations administer and monitor Big Data Platform components
  • Support technical and application team requests for data copies across environments data cleanup query tuning etc
  • Troubleshoot and resolve issues related to user queries application jobs etc
  • Monitor and troubleshoot Big Data Platform including hosted DBs tools and services
  • Creating encryption zones managing encryption keys and copying data between the encryption zones
  • Support projects/initiatives related to data acquisition processing and utilization through Big Data Platform
  • Maintain and support Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments
  • Install new versions patches support upgrades of CDP Private Cloud and IBM BigSQL
  • Monitor and troubleshoot platform issues and performance tuning
  • Support security policies documentation and compliance
  • Document processes and policies for Hadoop System Administration Platform support activities
  • Work with end users to identify and resolve issues
  • Work with vendors to resolve issues as needed
  • Provide governance and support to project teams
  • Upgrade to CDP Private Cloud to CDP Public Cloud

Required Skills and Qualifications:

  • Bachelors or Masters degree in Computer Science or applicable field of study
  • 35 years of experience in Hadoop Ecosystem HDFS MapReduce Hive HBase Spark Scala Yarn Sqoop Ranger Knox Kerberos LDAP SOLR
  • 6 years of experience with Java and Linux/Unix
  • 4 years of experience with security scripting and automation
  • 2 years of experience in R Python Flume Storm Kafka
  • 2 years of experience with IBM BigSQL or similar MPP SQL Engines
  • 2 years of experience with MySQL
  • 1 year of experience with CICD
  • Experience with administration and performance tuning of Hadoop distributions open-source and commercial
  • Highly competent with Data Lake concepts and Big Data capabilities
  • Good understanding of data virtualization replication Data G
  • Experience with AWS or other cloud-based PaaS/SaaS environments
  • Experience with AWS EMR
  • Strong communication skill
  • Mandatory skills: Dataiku

  • Big Data Professional

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data ProfessionalWe are seeking an experienced Big Data Professional to join our team. The ideal candidate will have a strong background in big data analytics, including data ingestion, processing, and visualization.Key Responsibilities:Design and implement data ingestion pipelines from disparate sources onto a big data platform.Develop and...

  • Senior Big Data Architect

    2 days ago

    Thiruvananthapuram, Kerala, India beBeeDataScience Full time ₹ 1,50,00,000 - ₹ 2,15,00,000

    ">Big Data DeveloperOur team is looking for a highly skilled Big Data Developer to join our crew. As a Big Data Developer, you will play a key role in designing and implementing large-scale data processing systems.">For this position, we are seeking an experienced professional with expertise in big data technologies such as Spark, SQL, Hive, and Scala. The...

  • Big Data Expert

    1 day ago

    Thiruvananthapuram, Kerala, India beBeeBigData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Overview">We are seeking a skilled Big Data Engineer to join our delivery team, with a focus on hands-on project support and mentoring junior engineers. This role is ideal for a developer who thrives in a technical environment and is passionate about coaching and developing talent.You will work on live client projects, provide technical support,...

  • Big Data Infrastructure Specialist

    5 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:Senior Big Data EngineerAs a senior big data engineer, you will lead distributed teams and manage multiple geographies and time zones. Your expertise in data engineering will drive business outcomes for enterprise companies undergoing transformation.Key Responsibilities:Lead cross-functional teams to develop scalable data...

  • Big Data Specialist

    3 days ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data Specialist We are seeking a skilled and experienced Big Data Specialist to join our team. As a key member of our analytics team, you will be responsible for designing and implementing data processing solutions using Hadoop and Spark. The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, and...

  • Senior Big Data Specialist

    22 hours ago

    Thiruvananthapuram, Kerala, India beBeeBigDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About UsJob Opportunity: Big Data EngineerWe are seeking a highly skilled individual to fill the role of Big Data Engineer. The ideal candidate will have a proven track record in building, scaling, and optimizing large-scale data pipelines.Key Responsibilities:Design, develop, and optimize distributed data processing systems.Work extensively with Scala,...

  • Senior Data Architect

    2 weeks ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 22,50,000

    Seeking a visionary leader to spearhead the development of scalable data pipelines and analytics platforms on Microsoft Azure and Databricks.The ideal candidate will have in-depth expertise in Big Data platforms, drive the design and delivery of end-to-end data solutions, collaborate with cross-functional teams, and promote best practices in data...

  • Big Data Solutions Architect

    5 days ago

    Thiruvananthapuram, Kerala, India beBeeBigDataDeveloper Full time ₹ 20,00,000 - ₹ 25,00,000

    Are you passionate about harnessing the power of big data to drive business growth?Job Overview:We are seeking a skilled Big Data Developer to join our team and contribute to the design, development, and implementation of scalable big data solutions.Key Responsibilities:Develop and implement high-performance big data pipelines using cutting-edge technologies...

  • Senior Big Data Specialist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:Data Engineer RoleWe are seeking a skilled Data Engineer to join our dynamic data team. As a key member of our data infrastructure team, you will design, develop and maintain robust data pipelines, data warehouses and analytics platforms that serve as the backbone of our digital marketing product development.The ideal candidate will have experience...

  • Big Data Specialist

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time US$ 5,00,000 - US$ 10,00,000

    As a Big Data Engineer, you will be responsible for designing and developing large-scale data processing systems. This role requires expertise in handling complex data pipelines and ensuring high-performance data analytics.Key Responsibilities: