Senior Data Pipeline Specialist

6 days ago

Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000
ETL Developer Position

We are seeking a skilled ETL Developer to join our team in building scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.

Key Responsibilities:
  • Design, develop, and maintain ETL pipelines using IBM DataStage (CP4D) and AWS Glue/Lambda for ingestion from varied sources.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.

Required Skills and Experience:

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.

Benefits:

This role offers the opportunity to work on complex data engineering projects, collaborate with experienced professionals, and grow your skills in a rapidly evolving field.

  • Senior Data Pipeline Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeAutomation Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OverviewWe are seeking a highly skilled professional to join our team as a Senior ETL Tester for an exciting in-house project. The successful candidate will have the opportunity to work with a talented group, contribute to cutting-edge initiatives, and enhance their skills in a dynamic environment.This is a senior-level position that requires extensive...

  • Data Pipeline Specialist

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 80,00,000

    Junior Data Engineer PositionWe are seeking a highly motivated and skilled Junior Data Engineer to join our team. As a Junior Data Engineer, you will be responsible for building data pipelines and automation scripts, supporting the implementation of analytical algorithms under guidance, and contributing to documentation and testing processes.Key...

  • Senior Data Transformation Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataTransformation Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Transformation Specialist">As a seasoned Senior Data Transformation Specialist, you will play a pivotal role in leading the design, implementation, and maintenance of ETL processes. This includes working closely with cross-functional teams to identify data transformation requirements, develop and execute efficient data pipelines, and...

  • Senior Data Pipeline Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Key Data Engineer RoleWe are seeking a highly skilled and experienced data engineer to design, implement, and maintain large-scale data engineering solutions.Design and develop scalable data pipelines using Azure services such as Azure Data Factory, Azure Databricks, and other cloud-based tools.Implement data warehousing and business intelligence solutions...

  • Data Engineering Specialist

    7 days ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Data Engineering SpecialistJob Summary:We are seeking a skilled Data Engineering Specialist to design, develop, and maintain large-scale data pipelines using Google Cloud Platform (GCP) tools.Responsibilities:Developing high-volume data acquisition pipelines for structured and unstructured dataCreating complex datasets based on business...

  • Chief Data Pipeline Architect

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer PositionWe are seeking a highly skilled Senior Data Engineer to join our team. This role involves designing, building, and optimizing scalable data pipelines on AWS.The ideal candidate will have strong programming skills in Python and/or Scala, as well as hands-on experience with Apache Spark for big data processing on AWS cloud....

  • Data Pipeline Development Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataDriven Full time ₹ 15,00,000 - ₹ 25,00,000

    About Us:We are a leading organization that leverages cutting-edge innovations to drive business growth.Our team is passionate about harnessing the power of data to unlock new opportunities and improve decision-making.Analyze complex data sets to identify trends and insightsCollaborate with cross-functional teams to implement data-driven solutionsData...

  • Senior Data Pipeline Developer

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineer Role OverviewWe are seeking a highly skilled Data Engineer to design, develop, test, and support data pipelines and applications using AWS cloud services.Key Responsibilities:Design and implement robust ETL pipelines using PySpark, focusing on performance, scalability, and data qualityTranslate business requirements into technical solutions...

  • Senior Data Integration Specialist

    1 week ago

    Kurnool, Andhra Pradesh, India beBeeDataIntegration Full time ₹ 12,07,200 - ₹ 21,45,900

    Senior Data Integration SpecialistJob Description:We are seeking a highly skilled Senior Data Integration Specialist to join our team.The ideal candidate will have experience in designing and implementing data pipelines, integrating external systems and interfaces, and working with large datasets.Development of crawling/fetch pipelines (API-first;...

  • Data Pipeline Architect

    2 weeks ago

    Kurnool, Andhra Pradesh, India beBeeEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Lead Data Platform Engineer\At our company, we are seeking a highly skilled and experienced Lead Data Platform Engineer to join our team.\As a key member of our engineering team, you will be responsible for designing, building, and operating production-grade data pipelines. You will also lead the delivery of these projects, ensuring they are...