Data Pipeline Specialist

4 days ago


Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000
Job Title

Senior Data Engineer

Job Description

As a Senior Data Engineer, you will design, implement, and optimize data pipelines for large-scale data processing. You will work with data scientists, analysts, and engineers to ensure data availability and quality.

Key responsibilities include developing and maintaining ETL/ELT workflows using Spark, Hadoop, Hive, and Airflow, as well as writing efficient and optimized SQL queries for data extraction, transformation, and analysis.

Required Skills and Qualifications
  • 4-6 years of experience in a Data Engineering role
  • Strong hands-on experience with PySpark and SQL
  • Good working knowledge of GCP or any major cloud platform (AWS, Azure)
  • Experience with Hadoop, Hive, and distributed data systems
  • Proficiency in data orchestration tools such as Apache Airflow
Benefits

Developing expertise in cutting-edge technologies like PySpark, SQL, and GCP

Others

The ideal candidate will have a Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field and be able to work independently in a fast-paced, agile environment.



  • Bengaluru, Karnataka, India beBeeDataEngineer Full time

    Job Title: Azure Databricks EngineerAs a skilled Data Engineer, you will play a pivotal role in our dynamic team.High Impact Required: Immediate joiners only. Please note that candidates with less than 12 months of experience will not be considered.Key Responsibilities:Our ideal candidate will have strong expertise in building and optimizing data pipelines...


  • Bengaluru, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the JobAre you ready for a new career challenge?We are currently seeking an ETL Developer to join our team.The successful candidate will have at least 5 years of experience in designing and implementing data pipelines using Databricks (PySpark/Scala/SQL).The role involves assessing current-state Informatica ETL jobs, mappings, workflows, and...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,25,000 - US$ 1,75,000

    About the RoleWe are seeking a Senior Data Engineer with expertise in building scalable data pipelines and integrating healthcare data. Reporting to the Head of AI and Engineering, you will design, build, and operate the backbone of our AI-powered applications.You will work closely with software engineers, ML specialists, and clinical partners to bring our...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Job Title: Senior Data EngineerAbout the Role:This is an exceptional opportunity to join our organization as a Senior Data Engineer. As a key member of our data team, you will be responsible for designing, building, and optimizing scalable data pipelines using cloud-native technologies.Key Responsibilities:Design and architect high-throughput ETL pipelines...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We're seeking a skilled Data Engineer to support our team.Key Responsibilities:Design, build, and maintain robust, scalable data pipelines for large volume data from various sources.Integrate data from multiple sources, ensuring consistency and reliability.Develop and maintain efficient data models and schemas.Manage and optimize databases for performance,...


  • Bengaluru, Karnataka, India beBeeAutomatedTesting Full time

    Job Opportunity:The role of Senior Consultant involves designing, developing and implementing automated test cases for complex data pipelines.Ability to design, develop, and implement automated test cases for complex data pipelines is a mustAWS experience is essentialPharma expertise is also requiredProficiency in programming languages such as Python, R, or...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Job OpportunityAs a data engineer, you will play a key role in designing and implementing large-scale data pipelines using Azure Data Factory. Your expertise in ETL principles and best practices will be crucial in setting up a robust and scalable data infrastructure.Experience with building data pipelines using Azure Data Factory is essential.Proficiency in...


  • Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 50,00,000

    Job Overview:We are seeking a skilled Data Architect with strong expertise in designing and building scalable, efficient data flows and pipelines in a cloud environment.The ideal candidate will have hands-on experience with real-time data ingestion using Kafka, proficiency in Spark for data processing, and familiarity with AWS cloud services such as Glue and...


  • Bengaluru, Karnataka, India beBeeCloudSecurity Full time ₹ 15,00,000 - ₹ 25,00,000

    System Test Automation SpecialistWe are building a system test automation infrastructure to continuously test a big data pipeline stack end to end across dozens of different ecosystems, clouds, and connectors.This role involves developing a comprehensive understanding of the product and creating a thorough system test plan. Automating the system-test plan is...


  • Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Job OverviewWe are seeking a seasoned Data Engineering Specialist to join our team and drive the development of scalable data pipelines using Python & SQL. The ideal candidate will have 3–5 years of hands-on experience in data engineering or data management, preferably within data-driven domains.Key Responsibilities:Design, develop, and maintain ETL...