Building Robust Data Pipelines

4 days ago


Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 22,00,000
Data Engineering Specialist

Our organization is seeking a highly skilled Data Engineering Specialist to design, develop, and maintain robust data pipelines for processing channel activity data.

This role involves working with various data sources, including Hadoop and Terradata, to ensure seamless integration and high-quality data.

The ideal candidate will possess strong knowledge of AWS cloud infrastructure, including services like Pyspark, Glue, EMR, lambda, Redshift, Athena, and Iceberg. Additionally, they will have expertise in Python for building automated data engineering solutions and data transformations.

Main Responsibilities:

  • Design, develop, and maintain data pipelines for processing channel activity data, focusing on digital channels and integrating multiple sources of data.
  • Work on AWS cloud infrastructure to ensure high availability, scalability, and performance.
  • Leverage Python for building automated data engineering solutions and data transformations.
  • Collaborate with cross-functional teams to ensure effective data ingestion and processing.
  • Contribute to architecture decisions related to data lakes, data warehouses, and big data ecosystems.
  • Ensure data quality, governance, and integrity across all data systems.

Desirable Qualifications:

  • A degree in Computer Science, Engineering, or a related field.
  • Certifications or experience in AWS Cloud or relevant data engineering tools would be beneficial.
  • Experience in working with Snowflake would be an advantage.
  • Knowledge of ingesting real-time data (Apache Kafka) would be an asset.


  • Bengaluru, Karnataka, India beBeeBackend Full time ₹ 12,00,000 - ₹ 20,00,000

    Backend Engineer PositionAt PetYosa, we're developing a cutting-edge AI-powered pet ecosystem. Our goal is to create a trustworthy and enjoyable experience for pet parents and service partners across India.About the RoleWe're seeking a talented Backend Engineer who excels at designing and implementing robust systems. This position involves architecting APIs,...


  • Bengaluru, Karnataka, India beBeeKafkaEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking an experienced Kafka Engineer to join our team. In this role, you will design, develop, and implement scalable Kafka-based data pipelines, producers, consumers, and stream processing using Kafka Streams/KSQL.As a key member of the engineering team, you will collaborate directly with business teams to gather and analyze technical...


  • Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Data Engineering OpportunityThis role involves designing and developing scalable data pipelines for batch and real-time processing. This includes building robust data models and data integration workflows from multiple structured and unstructured data sources, ensuring reliable data delivery and availability through collaboration with Data Scientists,...


  • Bengaluru, Karnataka, India beBeeBackend Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Role: MLOps EngineerWith over 7 years of experience in the field, you will develop and maintain scalable machine learning pipelines.Key Responsibilities:Develop Efficient Pipelines: Create and maintain efficient machine learning pipelines using Python and frameworks like Tornado and FastAPI.Build and Manage Applications: Utilize Python and popular...


  • Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleData Engineering ManagerRole OverviewThe Senior Data Engineer will design, develop, and maintain scalable data pipelines and infrastructure to support data-driven decision-making and advanced analytics. They must have deep expertise in data engineering, strong problem-solving skills, and the ability to collaborate with cross-functional teams to...


  • Bengaluru, Karnataka, India beBeeDataPipelineSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced Senior Data Pipeline Specialist to lead the development and maintenance of complex data pipelines and enterprise-grade data systems.Job DescriptionThe ideal candidate will have 6-15 years of experience in ETL testing, software development, and data engineering. They must be proficient in Python, SQL, DWH, CI/CD, AWS, Automation,...


  • Bengaluru, Karnataka, India beBeeDataPlatformEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    Data Platform Engineer RoleOur company is seeking a skilled Data Platform Engineer to join our team. As a Data Platform Engineer, you will be responsible for designing, developing, and maintaining data pipelines to extract, transform, and load data from various sources into our data warehouse or data lake environment.We take pride in building innovative...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking an experienced Data Engineer to join our team.As a Data Engineer, you will design, build, and maintain robust data pipelines for processing channel activity data. You will work on AWS cloud infrastructure and orchestration tools like Airflow to ensure high availability, scalability, and performance.You will collaborate with cross-functional...


  • Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 30,00,000

    Data Engineer - Design, Build, and Deliver Robust Data PipelinesWe are seeking a skilled data engineer to design, develop, and maintain high-performance data pipelines. The ideal candidate will have hands-on expertise with ETL tools and data platforms, a strong understanding of database systems, and proficiency in developing complex SQL queries.Key...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 1,75,00,000 - ₹ 2,25,00,000

    Data Engineer Position">We are seeking a skilled Data Engineer to design, develop and maintain robust data pipelines and infrastructure for healthcare operations. You will be responsible for the ingestion, transformation, and availability of complex healthcare datasets, enabling our data scientists to develop impactful solutions.