Big Data Administrator for Dataiku and R

2 weeks ago

Palakkad, Kerala, India beBeeDataiku Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

About this role:

We are seeking a highly skilled Big Data Administrator to manage our big data platforms using Dataiku and R.

Key Responsibilities:

  1. Leverage your skills as an On-Premise Cloud Era Big Data Administrator to administer and monitor Big Data Platform components, including Hadoop, Hive, HBase, BigSQL, etc.
  2. Support technical and application team requests for data copies across environments, data cleanup, query tuning, etc.
  3. Troubleshoot and resolve issues related to user queries, application jobs, etc.
  4. Monitor and troubleshoot Big Data Platform, including hosted DBs, tools, and services.
  5. Create encryption zones, manage encryption keys, and copy data between the encryption zones.
  6. Support projects and initiatives related to data acquisition, processing, and utilization through Big Data Platform.
  7. Maintain and support Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments.
  8. Install new versions, patches, and support upgrades of CDP Private Cloud and IBM BigSQL.
  9. Monitor and troubleshoot platform issues and performance tuning.
  10. Support security policies, documentation, and compliance.
  11. Document processes and policies for Hadoop System Administration Platform support activities.
  12. Collaborate with end-users to identify and resolve issues.
  13. Work with vendors to resolve issues as needed.
  14. Provide governance and support to project teams.
  15. Upgrade to CDP Private Cloud to CDP Public Cloud.

Requirements:

  • Bachelor's or Master's degree in Computer Science or relevant field of study.
  • 35 years of experience in Hadoop Ecosystem (HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR).
  • 6 years of experience with Java and Linux/Unix.
  • 4 years of experience with Security Scripting and Automation.
  • 2 years of experience in R, Python, Flume, Storm, Kafka.
  • 2 years of experience with IBM BigSQL or similar MPP SQL Engines.
  • 2 years of experience with MySQL.
  • 1 year of experience with CI/CD.
  • Experience with administration and performance tuning of Hadoop distributions (open-source and commercial).
  • Highly competent with Data Lake concepts and Big Data capabilities.
  • Good understanding of data virtualization, replication, and Data G.
  • Experience with AWS or other cloud-based PaaS/SaaS environments.
  • Experience with AWS EMR.
  • Strong communication skill.
  • Mandatory Skills: Dataiku.

This is a great opportunity to leverage your expertise in big data technologies and work on high-profile projects.

We offer competitive salary and benefits package.

  • Big Data Engineering Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Opening for a Skilled Big Data DeveloperWe are seeking a skilled professional to join our team as a Big Data developer. The ideal candidate will have hands-on experience with Big Data development and engineering, as well as strong analytical skills.This role is ideal for a developer who thrives in a technical environment and has experience working on...

  • Big Data Engineer

    2 weeks ago

    Palakkad, Kerala, India beBeeDatabaseengineering Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled data architect to join our team. As a data architect, you will be responsible for designing and implementing data pipelines that support business growth.Key Responsibilities:Create optimal data pipeline architectureDevelop events/streaming based architecture/designIdentify, design, and implement...

  • Big Data Engineer at Google Cloud

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data Engineer - Big Data SolutionsOur team is seeking a seasoned data engineer to design and implement scalable big data solutions on Google Cloud Platform.Design, develop, and optimize data pipelines using GCP services such as BigQuery, Dataflow, and Apache Airflow.Utilize the Big Data Hadoop ecosystem to manage and process vast datasets...

  • Big Data Integration Specialist

    1 week ago

    Palakkad, Kerala, India beBeeDataIntegration Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Big Data Integration SpecialistWe are seeking an experienced professional with expertise in data ingestion and pipeline development to join our team. This role requires a strong understanding of integrating various data sources into cloud-based platforms.The ideal candidate will have hands-on experience with data pipelines, automation, and...

  • Big Data Developer

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 7,00,000 - ₹ 14,00,000

    Key Responsibilities:The ideal candidate will have 3-5 years of experience in designing, developing and maintaining large-scale data systems using AWS services.Core responsibilities include:Designing and implementing scalable data pipelines using AWS Glue and DatabricksDeveloping and deploying real-time data processing applications using Apache Spark and...

  • Data Insights Professional

    2 weeks ago

    Palakkad, Kerala, India beBeeDataInsights Full time ₹ 1,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Insights ProfessionalSummary: As a data-driven professional, you will work with large-scale datasets to derive actionable business insights. You will have strong expertise in AI/ML techniques, advanced analytics, and experience working with big data platforms and tools.Key Responsibilities:Work with complex datasets to identify trends,...

  • Big Data Developer

    2 weeks ago

    Palakkad, Kerala, India Iris Software Inc. Full time

    About the Company:Iris is a professional software services organization offering high-quality, cost-effective solutions to businesses. It has helped meet the IT requirements of companies ranging from those among the Fortune 100 to medium-sized firms by utilizing best-of-breed technologies, rapidly deployable solutions and flexible engagement models. With...

  • Senior Data Architect

    1 week ago

    Palakkad, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    As a seasoned data architect, you will design and implement complex data pipelines that integrate with Big Query and Dataflow.About the Role:Develop and maintain scalable databases to support business growth.Collaborate with cross-functional teams to gather requirements and implement data-driven solutions.Requirements:4+ years of experience in IT, with...

  • Data Insights Specialist

    2 weeks ago

    Palakkad, Kerala, India beBeeBusiness Full time ₹ 15,00,000 - ₹ 24,00,000

    Senior Business Insights ProfessionalA driven analytical professional with 4-7 years of experience in extracting, processing, and interpreting complex data from diverse sources. Proficient in SQL, Python, R, and Tableau to analyze large datasets, design predictive models, and deploy analytical solutions.Main Responsibilities:Data Extraction and Analysis:...

  • Financial Data Analyst Intern

    2 weeks ago

    Palakkad, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Looking for a challenging opportunity in data science? We are seeking a skilled Data Specialist to join our team. The ideal candidate will have strong problem-solving and analytical skills, with the ability to self-learn and work independently.">Job Description">This is an exciting opportunity to work on cutting-edge projects involving financial data...