Big Data Expert

2 days ago

Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 3,50,00,000
Job Title: Data Platform Architect

The role of a Data Engineer Manager is to provide technical direction for a highly scalable data platform in clinical oncology or the healthcare domain.

This includes a tech stack spanning AWS, Python, Terraform, and all the new buzz around AI.

A blend of strong technical skills in areas like data architecture, ETL, cloud platforms, and big data technologies, alongside crucial soft skills such as leadership, communication, problem-solving, business acumen, and project management.

The manager must oversee the design and maintenance of data systems, manage and mentor a team, and align technical solutions with business objectives.

Key Responsibilities:

  • Lead research, proof of concept, architecture, development, testing, deployment, and ongoing maintenance of data solutions
  • Design and implement modular, flexible, secure, and reliable data systems that scale with business needs
  • Integrate pipeline observability to detect and resolve issues proactively
  • Develop tools and processes to debug, optimize, and maintain production systems
  • Identify and address legacy inefficiencies to improve performance and maintainability
  • Quickly diagnose and resolve unknown issues across complex systems
  • Maintain clear documentation of data models, transformations, and pipelines to ensure security and governance compliance
Requirements:
  • 12+ years of experience in data engineering
  • Strong programming skills in languages like Python, SQL, and Scala
  • Deep understanding of SQL, NoSQL (e.g., MongoDB), and relational databases (e.g., PostgreSQL)
  • Expertise in cloud environments such as AWS, Azure, or GCP
  • Experience with tools like Spark, Kafka, Hadoop, and Snowflake

  • Expert Big Data Professional

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Big Data Cluster SpecialistWe are seeking an experienced Big Data specialist to manage and maintain our Cloudera cluster. The ideal candidate will have a strong background in administering large-scale data processing systems.Key Responsibilities:Building and managing distributed data processing environmentsMigrating data between platforms to ensure seamless...

  • Big Data Technology Architect

    12 hours ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionWe are seeking a seasoned technologist to spearhead the development of our Enterprise TruRisk Platform. This is an exciting opportunity to be part of a dynamic team that leverages Big Data & Micro-Services technology to process massive transaction data and drive business-impacting initiatives.The ideal candidate will have expertise in...

  • Expert Big Data Systems Architect

    3 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    At the heart of our data infrastructure lies a critical need for talented professionals skilled in harnessing the power of big data technologies.Job DescriptionWe are seeking an experienced Data Engineer to design, develop, and maintain large-scale data processing systems using cutting-edge technologies such as Azure/AWS Databricks,...

  • Big Data Analyst

    4 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data AnalystWe are seeking a skilled professional to join our team as a Big Data Analyst. As a key member of our organization, you will be responsible for analyzing and interpreting complex data sets to inform business decisions.Gathering and analyzing large datasets to identify trends and patternsDeveloping and maintaining databases and data...

  • Senior Big Data Engineer

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data EngineerAbout the RoleWe are seeking an experienced Senior Big Data Engineer to join our team. The ideal candidate will have a strong background in big data technologies and experience working with large-scale data processing systems.The successful candidate will be responsible for designing, implementing, and maintaining scalable...

  • Big Data Specialist

    5 days ago

    Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe seek an experienced Big Data Specialist to design and develop scalable ETL pipelines for batch data ingestion and egress.The ideal candidate will have a strong background in Python, Scala, and Azure Cloud technologies.Key ResponsibilitiesDevelop and maintain ETL pipelines using Azure Data Factory, Databricks, and Spark.Implement data...

  • Senior Big Data Architect

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 40,00,000

    We're looking for a seasoned leader to spearhead our big data initiatives.The ideal candidate will have a proven track record of building scalable and extensible big data platforms, providing the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.This role requires strong technical expertise, excellent...

  • Big Data Solutions Architect

    2 days ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Big Data Engineer to join our team and drive innovation within our organization.Key Responsibilities-Design, develop, and optimize scalable data engineering solutions leveraging AWS services for large-scale, complex data processing.Build and maintain data pipelines using Spark (Scala) for both structured and unstructured...

  • Senior Data Engineer

    12 hours ago

    Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering Role for Cloud Big Data PlatformsAbout the Position:We are seeking a highly skilled and experienced Senior Data Engineer to administer and monitor our cloud-based big data platforms.Key Responsibilities:Administer and monitor Big Data Platform components (Hadoop, Hive, HBase, BigSQL, etc.)Support technical and application team requests (data...

  • Chief Big Data Architect

    1 week ago

    Rajahmundry, Andhra Pradesh, India beBeeDistributed Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Role OverviewAt a leading data-driven organization, we are seeking an experienced Data Engineer with expertise in Apache Ray to play a pivotal role in our team.Key Responsibilities:Deep understanding of Distributed Computing FrameworksOperate, monitor, and troubleshoot all aspects of our production and non-production environments.Automate...