Data Pipeline Specialist

3 days ago

Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000
Job Overview

As a seasoned data pipeline specialist, we seek a highly skilled and motivated ETL developer to join our team.

The ideal candidate will have extensive experience in designing, developing, and maintaining efficient data pipelines using IBM DataStage (Cloud Pak for Data) and AWS Glue/Lambda for ingestion from varied sources such as flat files, APIs, Oracle, DB2, etc.

They will be responsible for building and optimizing data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.

Required Skills and Qualifications
  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version)
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation
Benefits

This role offers the opportunity to work on cutting-edge technology and collaborate with a talented team of data engineers.

What We Offer

A dynamic work environment, opportunities for growth and professional development, and a competitive compensation package.

  • Data Pipeline Specialist

    24 hours ago

    Tirupati, Andhra Pradesh, India beBeeGenaideveloper Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job OpportunityThe role of a Data Scientist involves leveraging data pipelining tools, reporting tools including PowerBI and Microsoft Excel, as well as Confluence.Key Responsibilities:Develop and maintain complex data pipelines using Python programming language.Drive business outcomes through GenAI concepts and use cases.Collaborate with cross-functional...

  • Chief Data Pipeline Architect

    22 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Title:Azure Data EngineerJob Description:We are seeking a skilled data engineer to develop, optimize and maintain automated data pipelines supporting governance and analytics initiatives.This role involves designing, building and deploying ETL/ELT pipelines in Databricks (PySpark, SQL, Delta Lake) to ingest, transform and curate metadata from multiple...

  • Senior AWS Data Pipeline Architect

    24 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job SummaryWe are seeking an experienced Data Engineer with expertise in AWS to join our organization. As a Data Engineer, you will design and implement robust data pipelines using AWS, Python, and SQL to support business analytics and decision-making across multiple domains.The ideal candidate will have a strong command of SQL for creating, managing, and...

  • Lead Data Pipeline Developer

    24 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Data engineers design, build and maintain systems that store, process and retrieve data. Their primary responsibility is to ensure data quality, security and integrity.Key ResponsibilitiesDesign and implement data pipelines using Azure Data FactoryDevelop and maintain complex SQL queries to extract insights from large datasetsCollaborate with...

  • Data Architect

    3 hours ago

    Tirupati, Andhra Pradesh, India beBeedata Full time US$ 1,80,000 - US$ 2,00,000

    Job Title:Data Architect – Cloud Integration SpecialistWe are seeking an experienced Data Architect to lead our cloud integration strategy, focusing on scalable data pipelines and real-time data integration workflows.

  • Data Engineering Specialist

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeDatabase Full time ₹ 24,82,500 - ₹ 25,35,000

    Job Title: Information ArchitectJob Description:We are seeking a highly skilled Data Integration Specialist to join our team. As an experienced professional in data engineering, you will design and implement robust data pipelines using RDBMS and cloud-based services.Key Responsibilities:Develop and maintain complex ETL processes using MySQL, Oracle SQL, and...

  • Data Architect Specialist

    2 days ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    **Job Overview**We are seeking a talented Data Engineer to join our team. The ideal candidate will design, build, and maintain high-performance data pipelines that process large amounts of data.**Responsibilities:**Design and implement scalable batch processing systems using Python and big data technologiesOptimize database performance, focusing on...

  • Highly Experienced Data Pipeline Specialist

    4 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerJob Description

  • AI & Data Science Specialist

    3 weeks ago

    Tirupati, Andhra Pradesh, India Esentrics IT Full time

    Company Description:At ESENTRICS IT PRIVATE LIMITED, we don't just write code — we craft digital experiences. From bold concepts to intelligent software, we engineer solutions that anticipate tomorrow's challenges and drive lasting impact. Our innovative approach is designed to transform ideas into reality, providing cutting-edge solutions for our...

  • Data Solutions Specialist

    21 hours ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 9,21,600 - ₹ 18,43,200

    Data Solutions SpecialistJob Overview:We seek a Data Solutions Specialist to join our global engineering team, bringing expertise to a multi-year project initiative.Main Responsibilities:Create efficient data solutions using Palantir Foundry/Workshop, PySpark, and Typescript.Collaborate with cross-functional teams to drive business outcomes through...