Senior Data Pipeline Specialist

5 days ago


Vadodara, Gujarat, India beBeeDataScientist Full time ₹ 18,00,000 - ₹ 25,00,000
ETL Data Architect

We are seeking a seasoned ETL Developer to lead the design and implementation of scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake.

  • Design, develop, and maintain efficient data flows leveraging best practices for schema design, partitioning, and transformation logic.
  • Collaborate with cross-functional teams to ensure timely delivery of critical data assets supporting analytics and AI/ML use cases.

Key Responsibilities:

  1. Develop and optimize data loading strategies for curated datasets into Snowflake, focusing on optimal schema design and data transformation techniques.
  2. Participate in code reviews, performance tuning, and defect triage sessions to enhance overall system reliability and efficiency.
  3. Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  4. Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.

Required Skills and Experience:

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.


  • Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data Pipeline EngineerJob Description:We are seeking an experienced Data Pipeline Engineer to design, build, and maintain large-scale data pipelines that handle structured and unstructured data.The ideal candidate will have a strong background in data engineering, experience with AWS services, and excellent problem-solving skills.As a key...


  • Vadodara, Gujarat, India beBeeDataPipeline Full time ₹ 50,00,000 - ₹ 1,00,00,000

    Join a Cutting-Edge Team as a Data Pipeline SpecialistPosition: Trainee Engineer with a Focus on Data Automation and AnalyticsKey ResponsibilitiesCollaborate in designing and implementing data pipelines and automation scriptsSupport the development of analytical algorithms under guidance from experienced professionalsContribute to the creation and testing of...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team and support data-driven initiatives. This role involves building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines...


  • Vadodara, Gujarat, India beBeeQuality Full time ₹ 12,00,000 - ₹ 18,00,000

    ETL Specialist: Data Pipeline Quality AssuranceWe are seeking a skilled ETL specialist to ensure the integrity and quality of our data pipelines.Key Responsibilities:With extensive experience in QA with automation, you will identify and report defects in our ETL processes.In an agile setting, you will work closely with cross-functional teams to guarantee...

  • Senior Data Engineer

    2 weeks ago


    Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,25,000

    Job Title: Data Engineering SpecialistA challenging role for an experienced professional to design and implement scalable data pipelines using Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks, and SQL endpoints.We are looking for a skilled expert with hands-on experience in Azure Synapse, Microsoft Fabric, Azure Data Factory, Azure Storage,...


  • Vadodara, Gujarat, India beBeeDataFlow Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Flow SpecialistA skilled professional is required to build and manage Data Lakes, Data Warehouses, and Data Pipelines using Oracle Data Flow or Apache Spark (PySpark). The ideal candidate will have a solid understanding of data patterns, Python, and SQL.The successful candidate will be proficient in orchestrating data workflows, ensuring...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior ETL Developer Job DescriptionWe are seeking an experienced professional to fill the role of Senior ETL Developer. The successful candidate will have a strong background in data engineering and 6+ years of experience in development and maintenance.Key Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Key Engineering RoleA highly skilled data engineer is sought to design and build large-scale data pipelines using Google Cloud Platform.Develop, construct, test, and maintain data acquisition pipelines for structured and unstructured data using tools like Python, Data Flow, DataStream, CDC, and BigQuery.Build complex datasets based on business requirements...


  • Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer OpportunityUnlock business potential by designing and developing scalable data pipelines using cloud technologies.Main Responsibilities:Design and develop data pipelines using Glue, Python, EMR/Spark, and Kafka/Kinesis streaming.Develop relational databases with a preference for Aurora Postgres.Write complex SQL queries and stored...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 1,80,00,000

    Data Engineer RoleCodeVyasa is seeking a seasoned Data Engineer to join our team of rockstar developers. This role requires a minimum of 4+ years of experience in designing, developing, and maintaining data pipelines and ETL processes using AWS services.The ideal candidate will have hands-on experience with AWS cloud services (S3, Lambda, EC2, RDS, Glue,...