Senior Data Engineer

16 hours ago

Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Data Engineering Role for Cloud Big Data Platforms

About the Position:

We are seeking a highly skilled and experienced Senior Data Engineer to administer and monitor our cloud-based big data platforms.

Key Responsibilities:

  • Administer and monitor Big Data Platform components (Hadoop, Hive, HBase, BigSQL, etc.)
  • Support technical and application team requests (data copies across environments, data cleanup, query tuning, etc.)
  • Troubleshoot and resolve issues related to user queries, application jobs, etc.
  • Monitor and troubleshoot Big Data Platform, including hosted DBs, tools, and services
  • Create encryption zones, manage encryption keys, and copy data between the encryption zones
  • Support projects/ initiatives related to data acquisition, processing, and utilization through Big Data Platform
  • Maintain and support Big Data Platform CDP Private Cloud and IBM BigSQL across multiple environments
  • Install new versions, patches, and support upgrades of CDP Private Cloud and IBM BigSQL
  • Monitor and troubleshoot platform issues and performance tuning
  • Support security policies, documentation, and compliance
  • Document processes and policies for Hadoop System Administration Platform support activities

Requirements:

  • Bachelor's or Master's degree in Computer Science or applicable field of study
  • At least 35 years of experience in Hadoop Ecosystem (HDFS, MapReduce, Hive, HBase, Spark, Scala, Yarn, Sqoop, Ranger, Knox, Kerberos, LDAP, SOLR)
  • 6 years of experience with Java and Linux/Unix
  • 4 years of experience with Security Scripting and Automation
  • 2 years of experience in R, Python, Flume, Storm, Kafka
  • 2 years of experience with IBM BigSQL or similar MPP SQL Engines
  • 2 years of experience with MySQL
  • 1 year of experience with CICD
  • Experience with administration and performance tuning of Hadoop distributions (open-source and commercial)
  • Highly competent with Data Lake concepts and Big Data capabilities
  • Good understanding of data virtualization, replication, and Data G
  • Experience with AWS or other cloud-based PaaS/SaaS environments
  • Experience with AWS EMR
  • Strong communication skills
  • Mandatory Skills: Dataiku

We offer a dynamic work environment and excellent opportunities for professional growth and development.

Please note that this position requires strong expertise in big data platforms, data engineering, and cloud computing. We encourage applications from highly motivated and qualified individuals who share our passion for innovation and excellence.

  • Senior Data Engineering Specialist

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineering SpecialistA leading organization is seeking an experienced Senior Data Engineering Specialist to lead its data engineering efforts. The ideal candidate will have a strong background in designing, developing, and maintaining large-scale data systems.

  • Senior Backend Data Engineer

    19 hours ago

    Rajahmundry, Andhra Pradesh, India beBeeBackend Full time ₹ 15,01,000 - ₹ 20,12,500

    Senior Backend Data EngineerWe're seeking a highly skilled Senior Backend Data Engineer to join our team. As a key member of our engineering team, you will design and develop data pipelines, connect external systems, and ensure the scalability and reliability of our infrastructure.

  • Senior Data Engineering Specialist

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Senior Data Engineering Specialist","Job Summary:We are seeking a highly skilled Senior Data Engineering Specialist to join our team. As a key member of the data engineering team, you will be responsible for designing, building and maintaining large-scale data systems.","Key Responsibilities:","Design and develop scalable data pipelines for...

  • Senior Big Data Engineer

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data EngineerAbout the RoleWe are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies and experience working with large-scale data processing systems.The successful candidate will be responsible for designing, implementing, and maintaining scalable...

  • Senior Data Engineer

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job DescriptionAs a senior data engineer, you will be responsible for designing, developing, and maintaining complex data models using LookML.You will work closely with clients to understand their business needs and develop tailored solutions that meet their requirements.Your primary goal will be to create a single source of truth for our clients' data by...

  • Senior Data Engineering Leader

    5 days ago

    Rajahmundry, Andhra Pradesh, India beBeeBigDataExpert Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    Job Title: Senior Big Data EngineerOur organization is seeking an experienced and skilled Senior Big Data Engineer to lead the development of large-scale data processing systems. The ideal candidate will have a strong background in distributed systems, cloud computing, and big data technologies.Proven leadership skills with experience managing...

  • Senior Data Engineering Professional

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Opening: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure who thrives in a fast-paced engineering environment.You'll work across the full data stack from ingestion and transformation to orchestration and delivery playing a key role in...

  • Data Engineering Leader

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Senior Data Engineering LeadWe are seeking an experienced data engineering leader to drive our team's success.13+ years of experience in IT, with 6+ years in technical product management or delivery lead roles.

  • Senior Data Engineering Lead

    6 days ago

    Rajahmundry, Andhra Pradesh, India beBeeGenerative Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Data Architect - Generative AI ExpertThis role will have the opportunity to take on a senior leadership position in our team, working closely with stakeholders to drive project success across various industries.Develop and present technical solutions to clients using Azure-based architecture.Take charge of projects involving data engineering and...

  • Data Engineering Lead

    2 weeks ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 8,71,200 - ₹ 11,48,800

    Senior Data EngineerWe are seeking a seasoned data engineer to lead the development of large-scale data engineering solutions.Key Responsibilities:Design and develop high-quality data engineering solutions using Python, PySpark, and other relevant technologies.Collaborate with cross-functional teams to ensure seamless integration of data engineering...