Senior Big Data Administrator

19 hours ago

Hyderabad, Telangana, India beBeeDataiku Full time ₹ 1,20,00,000 - ₹ 1,50,00,000
Big Data Administrator

About the role:

We are seeking a highly skilled Big Data Administrator to manage our big data platform.

The ideal candidate will have experience with administration and performance tuning of Hadoop distributions, both open source and commercial.

  • Job Description: The successful candidate will be responsible for managing big data platform components including Hadoop, Hive, HBase, BigSQL, etc.
  • Administer and monitor Big Data Platform components.
  • Support technical and application team requests for data copies across environments, data cleanup, query tuning, etc.
  • Troubleshoot and resolve issues related to user queries, application jobs, etc.
Responsibilities:
  1. Creating encryption zones, managing encryption keys, and copying data between the encryption zones.
  2. Supporting projects/initiatives related to data acquisition, processing, and utilization through Big Data Platform.
  3. Maintaining and supporting Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments.
  4. Installing new versions, patches, support upgrades of CDP Private Cloud and IBM BigSQL.
  5. Monitoring and troubleshooting platform issues and performance tuning.
  6. Supporting security policies, documentation, and compliance.
  7. Documenting processes and policies for Hadoop System Administration Platform support activities.
  8. Working with end users to identify and resolve issues.
  9. Collaborating with vendors to resolve issues as needed.
  10. Providing governance and support to project teams.
  11. Upgrading to CDP Private Cloud to CDP Public Cloud.
Requirements:
  • Bachelor's or Master's degree in Computer Science or applicable field of study.
  • 35 Years Of Experience In Hadoop Ecosystem, HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR.
  • 6 Years Of Experience With Java And Linux/Unix.
  • 4 Years Of Experience With Security Scripting and Automation.
  • 2 Years Of Experience In R, Python, Flume, Storm, Kafka.
  • 2 Years Of Experience With IBM BigSQL Or Similar MPP SQL Engines.
  • 2 Years Of Experience with MYSQL.
  • 1 Years Of Experience with CICD.
  • Experience with administration and performance tuning of Hadoop distributions open source and commercial.
  • Highly competent with Data Lake concepts and Big Data capabilities.
  • Good understanding of data virtualization, replication, Data G.
  • Experience with AWS or other Cloudbased PaaSSaaS environments.
  • Experience with AWS EMR.
  • Strong communication skill.
  • Mandatory Skills : Dataiku.

We offer a competitive salary and benefits package.

If you are a motivated and detail-oriented individual with a passion for working with big data, we encourage you to apply.

  • Senior Big Data Engineer

    4 days ago

    Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Big Data Database Administrator

    1 week ago

    Hyderabad, Telangana, India beBeeDatabase Full time ₹ 40,00,000 - ₹ 50,00,000

    Job SummaryWe are seeking an experienced Database Administrator to manage our big data systems and contribute to the development of innovative solutions.About the RoleAs a key member of our team, you will have the opportunity to grow and learn in a dynamic environment with access to cutting-edge technologies.Key ResponsibilitiesCreate standards for...

  • Big Data,Hadoop Administration

    5 days ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time US$ 90,000 - US$ 1,20,000 per year

    Role : Big data Hadoop Administration/Cloudera CDH AdministrationLocation: HyderabadExperience: 4 to 10 YearsMust Have skills:Installing Hadoop in Linux environment.Deployment in a Hadoop cluster and its maintenance.Health check of a Hadoop cluster monitoring whether it is up and running all the time.Analyze the storage data volume and allocating the space...

  • Senior Data Architect

    2 weeks ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 9,00,000 - ₹ 13,20,000

    Big Data Engineering OpportunitiesWe are seeking a skilled Senior Data Engineer to develop and manage our company's Big Data solutions. As a key member of our team, you will be responsible for designing and implementing Big Data tools and frameworks, ELT processes, and cloud platforms. You will also collaborate with development teams and maintain production...

  • Senior Big Data Developer

    7 days ago

    Hyderabad, Telangana, India beBeeBigData Full time ₹ 9,00,000 - ₹ 12,00,000

    About the RoleThis is a senior-level position in our organization, and we're looking for an experienced Big Data Developer to join our team. The ideal candidate will have extensive experience in designing, developing, and maintaining big data processing jobs using PySpark or Scala/Java.The selected candidate will work closely with our AWS team to integrate...

  • Senior Data Engineer

    5 days ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 13,20,000

    Job Summary:We are seeking an experienced Senior Data Engineer to develop and implement our company's Big Data solutions. The ideal candidate will have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills.The successful Senior Data Engineer will be responsible for:Designing and implementing...

  • Senior Database Administrator(Big Data)

    1 week ago

    Hyderabad, Telangana, India Garmin Technologies Full time

    POSITION SUMMARY: Performs and plans management and administration of technology in area of specialty. Works with team members to ensure technology is effectively supporting enterprise systems. Shares knowledge and provides mentoring to other IT associates.ESSENTIAL FUNCTIONS:- Analyze existing database systems and recommend improvements- Work with IT...

  • Big Data Solutions Architect

    3 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerWe are seeking a seasoned Senior Big Data Engineer to spearhead the design, development, and implementation of cutting-edge Big Data analytics platforms.About the Role:Design, develop, deploy and maintain scalable Big Data pipelines using technologies such as Spark, Kafka, Glue, EMR, Hudi, Schema Registry, and Data Lineage.Leverage...

  • Senior Database Administrator(Big Data)

    1 day ago

    Hyderabad, Telangana, India Garmin Technologies Full time

    POSITION SUMMARY: Performs and plans management and administration of technology in area of specialty. Works with team members to ensure technology is effectively supporting enterprise systems. Shares knowledge and provides mentoring to other IT associates. ESSENTIAL FUNCTIONS: Analyze existing database systems and recommend improvements Work with IT Manager...

  • Big Data

    2 weeks ago

    Hyderabad, Telangana, India RiskInsight Consulting Pvt Ltd Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    ResponsibilitiesProvide technical support and troubleshooting for Big Data applications and systems built on the Hadoop ecosystem. Monitor system performance, analyze logs, and identify potential issues before they impact services. Collaborate with engineering teams to deploy and configure Hadoop clusters and related components. Assist in maintenance and...