Big Data Specialist

6 days ago

Kurnool, Andhra Pradesh, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 1,99,99,999

Data Scientist

We're seeking a seasoned professional to manage our big data platform, oversee day-to-day operations, administer and monitor Big Data Platform components, and support technical and application team requests.

  1. Administer and monitor Big Data Platform components (Hadoop, Hive, HBase, BigSQL, etc.)
  2. Support technical and application team requests for data copies across environments, data cleanup, query tuning, etc.
  3. Troubleshoot and resolve issues related to user queries, application jobs, etc.
  4. Monitor and troubleshoot Big Data Platform including hosted DBs, tools, and services.
  5. Create encryption zones, manage encryption keys, and copy data between the encryption zones.
  6. Support projects/initiatives related to data acquisition, processing, and utilization through Big Data Platform.
  7. Maintain and support Big Data Platform (CDP Private Cloud and IBM BigSQL) across multiple environments.
  8. Install new versions, patches, support upgrades of CDP Private Cloud and IBM BigSQL.
  9. Monitor and troubleshoot platform issues and performance tuning.
  10. Support security policies, documentation, and compliance.
  11. Document processes and policies for Hadoop System Administration Platform support activities.
  12. Work with end-users to identify and resolve issues.
  13. Work with vendors to resolve issues as needed.
  14. Provide governance and support to project teams.
  15. Upgrade to CDP Private Cloud to CDP Public Cloud.
Requirements
  • Bachelor's or Master's degree in Computer Science or applicable field of study.
  • 35 years of experience in Hadoop Ecosystem (HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR).
  • 6 years of experience with Java and Linux/Unix.
  • 4 years of experience with Security Scripting and Automation.
  • 2 years of experience in R, Python, Flume, Storm, Kafka.
  • 2 years of experience with IBM BigSQL or similar MPP SQL Engines.
  • 2 years of experience with MySQL.
  • 1 year of experience with CICD.
  • Experience with administration and performance tuning of Hadoop distributions (open-source and commercial).
  • Highly competent with Data Lake concepts and Big Data capabilities.
  • Good understanding of data virtualization, replication, and Data Governance.
  • Experience with AWS or other cloud-based PaaS/SaaS environments.
  • Experience with AWS EMR.
  • Strong communication skill.
  • Mandatory Skills: Dataiku.
About Us

We are a global technology consulting and digital solutions company that enables enterprises to reimagine business models and accelerate innovation through digital technologies.

  • Enterprise Big Data Specialist

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Development PositionA leading organization seeks an experienced big data developer to join their team.As a big data developer, you will be responsible for designing, developing, and maintaining large-scale data processing systems using big data technologies such as Apache Spark, SQL, Hive, and Scala.Developing and deploying scalable data pipelines...

  • Strategic Big Data Solutions Specialist

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer PositionWe are seeking a highly skilled Big Data Engineer to fill a key role in our organization.Design and implement large-scale big data solutions using technologies such as PySpark, Hive, Spark, HBase, and DQ tools to drive business growth and success.Develop and maintain scalable data pipelines to ingest data from disparate sources onto...

  • Big Data Cloud Solutions Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Architect - Big Data ExpertAt the heart of our organization lies a pivotal role that demands expertise in managing complex data environments. As a Cloud Architect with specialization in Big Data, you will be responsible for designing and implementing cutting-edge cloud solutions.Key Responsibilities:Develop hybrid cloud architectures to migrate...

  • Lead Big Data Analyst

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeDataScientist Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Data Scientist RoleWe are seeking a highly skilled Data Scientist to join our team. As a Data Scientist, you will be working with large datasets to gain valuable insights and drive business growth through data-driven decisions.Key Responsibilities:Create and implement complex data models to process and analyze big dataDesign and optimize efficient data...

  • Cloud Big Data Architect

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeBigData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Description:We are seeking a highly skilled professional to join our organization in the role of Big Data Engineer with deep expertise in Big Data technologies and cloud computing.Main Responsibilities:Design, develop, and optimize big data architectures leveraging cloud services for large-scale, complex data processing.Build and maintain data pipelines...

  • Big Data Systems Developer

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a Data Systems Developer to design, build, and maintain large-scale data processing systems using Big Data technologies.Key Responsibilities:Design and develop scalable data processing systems.Collaborate with cross-functional teams to identify business requirements and design data pipelines.Analyze complex data sets to inform...

  • Senior Big Data Engineer

    6 days ago

    Kurnool, Andhra Pradesh, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Overview:We are seeking a seasoned Big Data professional to lead our high-impact project team, focusing on hands-on project delivery and technical mentoring. This role is ideal for an experienced developer who thrives in a fast-paced environment and is passionate about coaching and developing junior engineers.You will work closely with cross-functional...

  • Senior Big Data Developer

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data Engineer WantedWe are seeking a skilled Data Engineer to lead our distributed data systems. The successful candidate will be responsible for designing, executing and managing large and complex distributed data systems.The ideal candidate will have experience in big data technologies (Apache Hadoop) and relational databases (MySQL/PostgreSQL)....

  • Senior Big Data Specialist

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title:Data EngineerWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines that enable our company to make data-driven decisions.About the Role:Design and develop scalable data pipelines using Hadoop, Spark,...

  • Expert Big Data Solutions Architect

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 1,10,00,000 - ₹ 2,21,00,000

    About the RoleOur organization specializes in digital engineering and technology solutions.We focus on executing complex business challenges with creativity and innovation.Job OverviewWe are seeking a seasoned professional with expertise in Big Data technologies and Google Cloud Platform services.Main Responsibilities:Data Pipeline Development: Design,...