Data Pipeline Specialist

3 days ago

Chennai Bengaluru Bangalore, India beBeeDataEngineer Full time ₹ 1,04,000 - ₹ 1,30,878
Data Engineering Opportunity

Our organization is seeking a highly skilled Data Engineer to design, build, and optimize scalable data pipelines using Apache Airflow or similar frameworks. The ideal candidate will have strong proficiency in Python and SQL, with additional experience in languages such as Java or Scala.

  • Detailed Job Description:
  • Create efficient ETL pipelines for large datasets, leveraging Spark (PySpark), Kafka, Flink, or similar tools for distributed data processing and real-time streaming solutions.
  • Develop robust data models, ensuring data consistency, integrity, and performance across warehouses and lakes.
  • Optimize query performance through indexing, partitioning, and tuning techniques for large-scale datasets.
  • Collaborate with data scientists, analysts, and software engineers to support data-driven decision-making.

Required Skills and Qualifications:

  • Strong knowledge of cloud platforms like AWS, Google Cloud Platform (GCP), or Microsoft Azure for building and managing data infrastructure.
  • Hands-on experience with ETL tools such as Apache Airflow or comparable data transformation frameworks.
  • Familiarity with data warehousing concepts and data modeling principles.
  • Expertise in working with data lakes and cloud-based storage solutions like Amazon S3, Google Cloud Storage, or Azure Blob Storage.

Benefits:

  • Ongoing training and development opportunities.
  • A collaborative and dynamic work environment.
  • The chance to work on high-profile projects and make a significant impact.

  • Data Pipelines Specialist

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeDataPipelines Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Pipelines SpecialistAbout the Role:We are seeking a skilled Data Pipelines Specialist to join our team. The ideal candidate will have hands-on experience designing, building, and maintaining production-grade pipelines at scale.Dream Job Responsibilities:Create end-to-end ETL/ELT processes that ensure reliability, scalability, and high...

  • Data Pipeline Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time ₹ 12,00,000 - ₹ 25,00,000

    Job Opportunity: Data Pipeline SpecialistWe are seeking a skilled data pipeline expert to validate and optimize our data transformations.ETL testing methodologies and best practicesDebugging data issues and resolving discrepanciesWorking with large datasets in cloud environmentsThe ideal candidate should have hands-on experience in Databricks, Python, SQL,...

  • Data Pipeline Specialist

    1 week ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time

    Job Title: Data Pipeline SpecialistA leading IT consulting and software solutions provider is seeking a highly skilled professional to design, build, and maintain scalable and reliable data pipelines.This role involves developing ETL processes to ensure data quality, integrity, and consistency. The ideal candidate will collaborate with analysts, scientists,...

  • Pipeline Design Specialist

    5 days ago

    Noida, Bengaluru / Bangalore, India beBeePipelineDesign Full time ₹ 15,00,000 - ₹ 28,00,000

    Pipeline Design SpecialistWe are seeking an experienced Pipeline Design Specialist to join our team.About the Role:The successful candidate will be responsible for designing and developing pipeline systems, ensuring they meet safety and regulatory standards.Key Responsibilities:Pipeline Design: Develop detailed designs for pipeline systems, including layout,...

  • Data Pipeline Developer

    7 days ago

    Chennai, Bengaluru / Bangalore, India beBeeInformatician Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Summary:The successful candidate will be responsible for developing, optimizing and managing ETL pipelines using Informatica Intelligent Cloud Services (IICS).Key Responsibilities:Develop high-quality ETL pipelines using IICS to extract, transform and load data from various sources.Optimize existing pipelines to improve performance and efficiency.Design...

  • Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeDataPipeline Full time US$ 1,00,000 - US$ 1,50,000

    Job Overview- We are seeking a highly skilled Data Pipeline Specialist to join our team. The ideal candidate will have experience building and productionizing data pipelines using industry-leading technologies.- A strong background in working with complex SQL datasets is required, as well as expertise in building efficient SQL scripts using BigQuery Syntax-...

  • Data Pipeline Specialist

    5 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Job Title : Data Pipeline SpecialistKey Responsibilities :Develop and manage scalable data pipelines using PySpark and SQL to drive business growth.Collaborate with cross-functional teams to implement data-driven solutions leveraging AWS services.Utilize Databricks for advanced data processing and analytics, working closely with data scientists and analysts...

  • Senior Data Pipeline Specialist

    2 weeks ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a highly skilled Senior Data Pipeline Specialist to join our team.As a Senior Data Pipeline Specialist, you will be responsible for designing and developing real-time and batch data pipelines using tools like Apache NiFi, Apache Kafka, and Apache Airflow.Design and develop scalable data pipelines that meet the needs of various business...

  • Senior Data Pipeline Specialist

    6 days ago

    Chennai, Tamil Nadu, India beBeeDataPipelineSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    We are seeking a skilled Data Pipeline Specialist to lead our data engineering efforts. This is an exciting opportunity for an experienced professional to drive innovation and growth in our organization.About the RoleThis role will involve designing, developing, and maintaining scalable and robust data architectures and pipelines. The successful candidate...

  • Data Pipeline Architect

    2 weeks ago

    Bengaluru, Karnataka, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000

    Freelance Azure Data Factory SpecialistWe are seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and...