Large Scale Data Engineer

1 week ago

Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Overview

We are seeking a seasoned professional to spearhead the design and implementation of large-scale data ecosystems.

This role will involve collaborating with cross-functional teams to develop and refine data pipelines, leveraging technologies such as Kafka, Pulsar, and Flink to process structured and unstructured data in real-time.

The ideal candidate will have expertise in Java for building scalable data applications and services.

Additionally, experience with modern data warehouses and query engines (Trino, Spark) is essential for delivering sub-second operations and analytics.

We value candidates who can ensure data integrity, security, and compliance across multi-tenant systems.

Ongoing learning and staying ahead of trends in the data ecosystem is also expected.

  • Key Responsibilities:
  • Design and implement petabyte-scale data architectures
  • Develop and optimize streaming pipelines using Kafka, Pulsar, and Flink
  • Leverage Java to build scalable data applications and services
  • Work with modern data warehouses and query engines (Trino, Spark)
  • Ensure data integrity, security, and compliance
  • Stay up-to-date with industry trends and best practices

About Our Ideal Candidate:

We are looking for an individual with strong technical skills and a passion for data engineering. The ideal candidate should have:

  • Expert Proficiency:
  • Java for data-intensive applications
  • Hands-on experience with lakehouse architectures, stream processing (Flink), and event streaming (Kafka/Pulsar)
  • Strong SQL skills and familiarity with RDBMS/NoSQL databases
  • Proven track record in optimizing query engines (e.g., Spark, Presto) and data pipelines
  • Knowledge of data governance, security frameworks, and multi-tenant systems

  • Expert Data Engineer for Large-Scale Projects

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataArchitecture Full time ₹ 16,31,153 - ₹ 25,44,661

    Job Title: Senior Data ArchitectA senior data architect leads the design and development of complex data projects, including large-scale data engineering, integration, and warehousing initiatives.Key responsibilities include:Designing and implementing robust data architectures to support business growth and efficiencyDeveloping custom integrations between...

  • Large Scale AI Solutions Developer

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeAi Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    About this OpportunityWe are seeking a highly skilled AI Model Engineer to develop and implement large-scale AI solutions on cloud platforms.Responsibilities:Design, deploy and maintain autonomous AI systems using LangChain, AutoGen, CrewAI or LangGraph technologies.Develop and integrate generative AI models (LLMs, Transformers, GANs, Diffusion Models) using...

  • Data Engineer

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeCloud Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineering and Cloud Solutions LeadWe are seeking a seasoned delivery lead to drive large-scale data engineering and cloud platform programs. The role involves managing complex enterprise ecosystems, leading teams, ensuring governance, and enabling innovation through data and AI.About the Role:The ideal candidate will have extensive experience...

  • Data Engineering Professional

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Job OverviewWe are seeking a skilled Data Engineer to join our organization. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Google Cloud Platform (GCP) services.The ideal candidate will have 4-8 years of experience in data engineering, with...

  • Big Data Engineer

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering ProfessionalKey Responsibilities:Utilize Apache Spark for large-scale data processing.Work with Delta Lake tables for advanced data analytics.Main Skills and Qualifications:Proficient in SQL and Python, with a strong emphasis on SQL.Experience in Apache Spark for data processing using Python.Understanding of Delta files and...

  • Data Engineer

    2 weeks ago

    Kurnool, Andhra Pradesh, India Exult Global Full time

    Role: Data EngineerExperience: 3-5 yrsNotice Period: ImmediateWork Mode: Hybrid Job DescriptionRequirements:• Proficient in Python (Including popular python packages e.g. Pandas, NumPy etc.) and SQL• Strong background in distributed data processing and storage (e.g. Apache, Spark, Hadoop)• Large scale (TBs of data) data engineering skills - Model data,...

  • Data Driven Machine Learning Engineer

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeMachineLearning Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About Our TeamWe're a dynamic team dedicated to harnessing the power of machine learning to revolutionize our marketplace experience.Our mission is to create a platform where users can discover new and exciting opportunities with ease, and we're looking for talented engineers like you to help us achieve this goal.Key ResponsibilitiesDevelop and maintain...

  • Data Engineering Professional

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 7,00,000 - ₹ 14,00,000

    Data Engineering OpportunityWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in data engineering, with a proven track record of designing and implementing scalable data pipelines.AWSPythonPySparkDatabricksKey Responsibilities:Design and implement data pipelines using AWS servicesDevelop and...

  • Senior Data Engineer Role

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 19,00,000

    Senior Data EngineerWe are seeking a seasoned data engineer to lead our team in delivering high-quality data solutions. This is an exciting opportunity for a senior professional with expertise in data engineering and technical leadership.Key responsibilities will include:Designing, developing, and maintaining large-scale data pipelinesCollaborating with...

  • Senior Data Engineering Position

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Opportunity: Data EngineerWe are seeking experienced professionals to fill the role of Data Engineer in Kurnool, India.The ideal candidate will possess a strong technical background and have a minimum of 6 years of relevant experience in data engineering.Key Responsibilities:Design, develop, and maintain large-scale data processing systems using...