
Senior Data Pipeline Specialist
5 days ago
We are seeking a seasoned ETL Developer to lead the design and implementation of scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake.
- Design, develop, and maintain efficient data flows leveraging best practices for schema design, partitioning, and transformation logic.
- Collaborate with cross-functional teams to ensure timely delivery of critical data assets supporting analytics and AI/ML use cases.
Key Responsibilities:
- Develop and optimize data loading strategies for curated datasets into Snowflake, focusing on optimal schema design and data transformation techniques.
- Participate in code reviews, performance tuning, and defect triage sessions to enhance overall system reliability and efficiency.
- Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
- Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
Required Skills and Experience:
- 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
- Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
- Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
- Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
-
Senior Data Pipeline Engineer
2 weeks ago
Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Senior Data Pipeline EngineerJob Description:We are seeking an experienced Data Pipeline Engineer to design, build, and maintain large-scale data pipelines that handle structured and unstructured data.The ideal candidate will have a strong background in data engineering, experience with AWS services, and excellent problem-solving skills.As a key...
-
Data Pipeline Specialist
2 weeks ago
Vadodara, Gujarat, India beBeeDataPipeline Full time ₹ 50,00,000 - ₹ 1,00,00,000Join a Cutting-Edge Team as a Data Pipeline SpecialistPosition: Trainee Engineer with a Focus on Data Automation and AnalyticsKey ResponsibilitiesCollaborate in designing and implementing data pipelines and automation scriptsSupport the development of analytical algorithms under guidance from experienced professionalsContribute to the creation and testing of...
-
Senior Data Pipeline Specialist
2 weeks ago
Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team and support data-driven initiatives. This role involves building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines...
-
Data Pipeline Quality Assurance Specialist
1 week ago
Vadodara, Gujarat, India beBeeQuality Full time ₹ 12,00,000 - ₹ 18,00,000ETL Specialist: Data Pipeline Quality AssuranceWe are seeking a skilled ETL specialist to ensure the integrity and quality of our data pipelines.Key Responsibilities:With extensive experience in QA with automation, you will identify and report defects in our ETL processes.In an agile setting, you will work closely with cross-functional teams to guarantee...
-
Senior Data Engineer
2 weeks ago
Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,25,000Job Title: Data Engineering SpecialistA challenging role for an experienced professional to design and implement scalable data pipelines using Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks, and SQL endpoints.We are looking for a skilled expert with hands-on experience in Azure Synapse, Microsoft Fabric, Azure Data Factory, Azure Storage,...
-
Expert Data Pipeline Developer
2 weeks ago
Vadodara, Gujarat, India beBeeDataFlow Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Data Flow SpecialistA skilled professional is required to build and manage Data Lakes, Data Warehouses, and Data Pipelines using Oracle Data Flow or Apache Spark (PySpark). The ideal candidate will have a solid understanding of data patterns, Python, and SQL.The successful candidate will be proficient in orchestrating data workflows, ensuring...
-
Advanced Data Pipeline Architect
1 week ago
Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Senior ETL Developer Job DescriptionWe are seeking an experienced professional to fill the role of Senior ETL Developer. The successful candidate will have a strong background in data engineering and 6+ years of experience in development and maintenance.Key Responsibilities:Collaborate with stakeholders to understand data requirements and translate them into...
-
Chief Data Pipeline Architect
6 days ago
Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000Key Engineering RoleA highly skilled data engineer is sought to design and build large-scale data pipelines using Google Cloud Platform.Develop, construct, test, and maintain data acquisition pipelines for structured and unstructured data using tools like Python, Data Flow, DataStream, CDC, and BigQuery.Build complex datasets based on business requirements...
-
Cloud Data Pipeline Specialist
1 week ago
Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Data Engineer OpportunityUnlock business potential by designing and developing scalable data pipelines using cloud technologies.Main Responsibilities:Design and develop data pipelines using Glue, Python, EMR/Spark, and Kafka/Kinesis streaming.Develop relational databases with a preference for Aurora Postgres.Write complex SQL queries and stored...
-
Senior Data Pipeline Specialist
1 week ago
Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 1,80,00,000Data Engineer RoleCodeVyasa is seeking a seasoned Data Engineer to join our team of rockstar developers. This role requires a minimum of 4+ years of experience in designing, developing, and maintaining data pipelines and ETL processes using AWS services.The ideal candidate will have hands-on experience with AWS cloud services (S3, Lambda, EC2, RDS, Glue,...