Big Data Pipeline Specialist

1 week ago


Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 25,50,000

Job Summary

We are seeking an experienced Data Engineering Specialist to join our team.

The ideal candidate will have a strong background in designing and developing scalable data pipelines using big data technologies.

  • Main Responsibilities:
  • Developing ETL processes using PySpark and Hive to extract, transform, and load data into Big Data platforms.
  • Designing and implementing data ingestion processes from disparate sources onto Big Data platforms.
  • Collaborating with cross-functional teams to identify business requirements and translate them into technical solutions.
  • Maintaining and improving the overall quality of data within the Big Data platform.

Requirements:

  • 6-12 years of experience in big data engineering.
  • Strong knowledge of PySpark, Hive, Spark, HBase, and DQ tools.
  • Experience with Agile Scrum methodologies.

About This Role

This is an excellent opportunity for a skilled Data Engineer to take on new challenges and contribute to the success of our organization.

What We Offer

A competitive salary and benefits package, as well as opportunities for career growth and professional development.


  • Big Data Specialist

    1 week ago


    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data SpecialistWe are on the lookout for a highly skilled and experienced Big Data Specialist to spearhead our data pipeline development. This individual will play a pivotal role in designing, building, and maintaining robust data pipelines using cloud-based technologies.Design and develop scalable data pipelines using cloud services (GCP, AWS, or...

  • Big Data Innovator

    6 days ago


    Ellore, Andhra Pradesh, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking experienced professionals to fill a Big Data Specialist role.This is an opportunity for individuals with 6-12 years of experience in Bigdata and related technologies.The ideal candidate will have:Over 5.8 years of experience in Big Data projectsProficiency in Big Data technologies including PySpark, Scala Spark, Java Spark SQLA good...


  • Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Opportunity: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to lead the design, development, and deployment of scalable data pipelines and ETL processes using Databricks.Responsibilities:Collaborate with stakeholders to understand data requirements and develop technical solutions that meet their needs.Design,...

  • Big Data Specialist

    1 week ago


    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,25,00,000

    Job Overview:Data architects at top organizations design and develop large-scale data pipelines for ingestion, transformation, and storage. They work with Big Data ecosystems such as Hadoop, Spark, Hive, and similar technologies to process structured and unstructured data.ResponsibilitiesDevelop efficient ETL processes to integrate data from multiple sources...

  • Big Data Leader

    5 hours ago


    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a seasoned Big Data professional to spearhead the design and implementation of scalable big data analytics platforms.This senior role requires a deep understanding of key technologies like Spark, Druid, Drill, ClickHouse, and experience with big data pipelines: Spark, Kafka, Glue, EMR, Hudi, Schema Registry, Data Lineage.A strong background in...


  • Ellore, Andhra Pradesh, India beBeeAzureDatabricksEngineer Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Job Title: Azure Databricks Developer About the Role:We are seeking a seasoned professional with 7+ years of experience in designing, developing, and optimizing data pipelines using Azure Data Factory. The ideal candidate will be proficient in leveraging big data technologies to drive business growth and enhance operational efficiency. Key...


  • Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking a highly skilled Big Data Engineer to lead our data engineering teams and manage cross-team collaboration.The ideal candidate will have a strong background in big data engineering, with experience in designing and developing large-scale data processing pipelines using Apache Spark and Scala/Python.Responsibilities include...


  • Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,29,74,400 - ₹ 2,03,60,600

    Data Engineering ProfessionalAs a skilled Data Engineer, you will play a pivotal role in designing and developing scalable data pipelines that drive business growth. Our innovative platform harnesses the power of big data to deliver real-time insights and strategic recommendations.Key Responsibilities:Design and build production-level data pipelines that...


  • Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,10,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled data engineer to lead our big data initiatives.Designs and develops scalable data pipelines using Apache Spark, Hive, and PySpark technologies.Collaborates with analytics teams to improve data models that feed business intelligence tools, driving data-driven decision making.Develops efficient ETL...


  • Ellore, Andhra Pradesh, India beBeeData Full time ₹ 12,60,000 - ₹ 20,16,000

    Job Role: Senior Data EngineerThe role of a Senior Data Engineer is to design and implement data pipeline architecture that is optimal.Key Responsibilities:Create and maintain data pipeline architecture that is efficient and scalable.Design and implement events/streaming based architecture/design.Identify and implement internal process improvements.Build the...