Senior Big Data Engineer

1 week ago

Hyderabad, Telangana, India beBeeSoftware Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

Streaming Data Platform Developer

We're looking for a seasoned software engineer to help us build and scale the next generation of streaming platforms and infrastructure.

Key Responsibilities :

  • Design and build data platforms and streaming engines that are real-time and batch in nature.
  • Optimize existing data platforms and infrastructure while exploring other technologies.
  • Provide technical leadership to the data engineering team on how data should be stored and processed more efficiently and quickly at scale.
  • Build and scale stream & batch processing platforms using the latest open-source technologies.
  • Work with data engineering teams and help with reference implementation for different use cases.
  • Improve existing tools to deliver value to the users of the platform.
  • Work with data engineers to create services that can ingest and supply data to and from external sources and ensure data quality and timeliness.

Required Skills :

  • 8+ years of software development experience with at least 3+ years of experience on open-source big data technologies.
  • Knowledge of common design patterns used in Complex Event Processing.
  • Knowledge in Streaming technologies : Apache Kafka, Kafka Streams, KSQL, Spark, Spark Streaming.
  • Proficiency in Java, Scala.
  • Strong hands-on experience in SQL, Hive, Spark SQL, Data Modeling, Schema design.
  • Experience and deep understanding of traditional, NoSQL and columnar databases.
  • Experience of building scalable infrastructure to support stream, batch and micro-batch data processing.
  • Experience utilizing Apache Iceberg as the backbone of a modern lakehouse architecture, supporting schema evolution, partitioning, and scalable data compaction across petabyte-scale datasets.
  • Experience utilizing AWS Glue as a centralized data catalog to register and manage Iceberg tables, enabling seamless integration with real-time query engines and improving data discovery across distributed systems.
  • Experience working with Druid/ StarRocks /Apache Pinot etc., powering low-latency queries, routine Kafka ingestion, and fast joins across both historical and real-time data.

Benefits :

You'll work with a talented team of engineers to build cutting-edge technology. You'll have opportunities to learn new skills and grow your career.

About This Role :

This role is a great opportunity for someone who is passionate about building scalable and efficient data processing systems.

  • Senior Big Data Engineer

    6 days ago

    Hyderabad, Telangana, India Veltris Full time

    Position-Senior Big Data EngineerMust have Big Data analytics platform experience.• Key stacks: Spark, Druid, Drill, ClickHouse.• 8 years experience in Python/Java, CI/CD, infrastructure & cloud, Terraform, plus depth in:           o Big Data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.           o Graph...

  • Senior Data Engineer

    7 days ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 13,20,000

    Job Summary:We are seeking an experienced Senior Data Engineer to develop and implement our company's Big Data solutions. The ideal candidate will have in-depth knowledge of Hadoop technologies, excellent project management skills, and high-level problem-solving skills.The successful Senior Data Engineer will be responsible for:Designing and implementing...

  • Senior Big Data Engineer

    7 days ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 16,32,000 - ₹ 21,66,000

    Big Data Engineer RoleAs a skilled Big Data Engineer, you will be responsible for developing, constructing, testing and maintaining data acquisition pipelines for large volumes of structured and unstructured data. This role is ideal for those who enjoy working with big data and have experience in handling large datasets.Responsibilities:Develop data...

  • Senior Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...

  • Big Data engineer

    2 weeks ago

    Hyderabad, Telangana, India Cozzera Full time

    Job Title: Data Engineer Location: Hyderabad | Type: Full-time Description: We're hiring a Big Data Engineer to design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills: Strong software engineering with Java,...

  • Senior Data Engineer

    7 days ago

    Hyderabad, Telangana, India beBeeBigData Full time ₹ 15,00,000 - ₹ 28,00,000

    **Job Opportunity:**We are seeking a skilled Big Data professional to join our team.The ideal candidate will have 2+ years of experience in big data engineering with expertise in Scala, AWS, and Python or Java.**Key Responsibilities:**Design and implement big data solutions using Hadoop and SparkDevelop and deploy scalable data processing...

  • Big Data engineer

    1 week ago

    Hyderabad, Telangana, India Cozzera Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Data Engineer Location:Hyderabad | Type:Full-time Description:We're hiring aBig Data Engineerto design and implement scalable data pipelines and streaming applications. You'll work with modern big data technologies and cloud platforms to power real-time data solutions. Key Skills:Strong software engineering with Java, Scala, or PythonExpertise in...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India Allegis Group Full time US$ 1,20,000 - US$ 2,00,000 per year

    Role & responsibilitiesConsult on or participate in moderately complex initiatives and deliverables within Software Engineering and contribute to large-scale planning related to Software Engineering deliverables.Review and analyze moderately complex Software Engineering challenges that require an in-depth evaluation of variable factors.Contribute to the...

  • Big Data Solutions Architect

    5 days ago

    Hyderabad, Telangana, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerWe are seeking a seasoned Senior Big Data Engineer to spearhead the design, development, and implementation of cutting-edge Big Data analytics platforms.About the Role:Design, develop, deploy and maintain scalable Big Data pipelines using technologies such as Spark, Kafka, Glue, EMR, Hudi, Schema Registry, and Data Lineage.Leverage...

  • Big Data Engineer

    1 week ago

    Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data EngineerWe are looking for a skilled Big Data Engineer to design, develop, and maintain large-scale data pipelines using PySpark and Databricks. Key Responsibilities:Design and implement scalable data architectures using PySpark and Databricks.Develop and optimize Spark applications using Spark UI and performance tuning techniques.Work with large...