Senior Data Pipeline Developer

14 hours ago

Bhavnagar, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000
Job Title: Senior Data Pipeline Developer

We are seeking an experienced data pipeline developer to join our team. As a senior member, you will be responsible for designing and implementing scalable and efficient data pipelines using IBM DataStage and AWS Glue.

The ideal candidate will have a strong background in ETL development and experience with cloud-based technologies such as AWS and Snowflake.

Key Responsibilities:

  • Design, develop, and maintain ETL pipelines using IBM DataStage and AWS Glue/Lambda for ingestion from varied sources.
  • Build and optimize data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Work closely with data governance teams to ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
  • Troubleshoot and resolve issues in QA/UAT/Production environments as needed.

Required Skills and Qualifications:

  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage (preferably CP4D version).
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
  • Experience with data profiling, cleansing, and quality validation routines.
  • Understanding of data lake/data warehouse architectures and DevOps practices.

Benefits:

  • Collaborative and dynamic work environment.
  • Opportunities for professional growth and development.
  • Competitive compensation and benefits package.

Others:

  • AWS or Snowflake certification is a plus.
  • Experience with Collibra, BigID, or other metadata/governance tools.
  • Exposure to Data Mesh/Data Domain models.
  • Experience with agile/Scrum delivery and Jira/Confluence tools.

  • Data Pipeline Architect

    14 hours ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerAbout the Role:We are seeking a skilled professional to lead the development and operation of data pipelines that support AI-powered applications. As a Senior Data Engineer, you will work closely with software engineers, ML specialists, and clinical partners to design, build, and scale data infrastructure that meets the needs...

  • Lead Data Pipeline Developer

    7 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job SummaryWe are seeking skilled professionals to work on integration, development, and support within a newly implemented platform.Main Responsibilities:Building and managing data pipelines (Azure Data Factory)Data modeling and delivering high-quality datasets for analytics across business areasAbout Our Team:We are passionate about delivering innovative...

  • Senior Data Pipeline Specialist

    5 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 2,00,00,000

    Data Engineer Role SummaryThe ideal candidate should have 4+ years of IT experience with a good exposure to diagnosis and troubleshooting complex issues.Key ResponsibilitiesDesign, develop, and deploy data ingestion & ETL pipelines using cloud-based technologies.Work on large-scale datasets using big data analytics platforms.Develop and maintain continuous...

  • Data Pipeline Architect

    2 weeks ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 18,00,000

    Job Title: Data Engineering SpecialistWe are seeking an accomplished professional to lead the design, development, and maintenance of scalable data pipelines.About the Role:As a key member of our team, you will collaborate with cross-functional stakeholders to deliver high-quality data assets that support business-critical analytics and AI/ML...

  • Cloud Data Pipeline Specialist

    5 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerAs a Cloud Data Engineer, you will play a key role in developing and maintaining large-scale data pipelines on the cloud.Key Responsibilities:Design and develop complex data pipelines using Python, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage.Utilize DevOps and CI/CD practices to ensure the...

  • Senior Backend Data Pipeline Specialist

    23 hours ago

    Bhavnagar, Gujarat, India beBeeBackend Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Backend Data Engineer RoleThis is a pivotal position within our organization, focused on building data pipelines to connect external systems and interfaces. The ideal candidate will possess expertise in developing crawling/fetch pipelines using API-first approaches.The responsibilities of this role include parsing/normalization of job postings & CVs,...

  • High-Performance Data Pipeline Developer

    3 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer Position OverviewWe are seeking a skilled data engineer to design, build, and maintain robust data pipelines. The successful candidate will play a critical role in ensuring data integrity, scalability, and real-time availability.

  • Data Pipeline Quality Assurance Specialist

    1 week ago

    Bhavnagar, Gujarat, India beBeeTest Full time ₹ 26,00,000 - ₹ 30,00,000

    Job OverviewAs a Senior ETL Tester, you will play a vital role in ensuring the quality of our data pipelines. This position requires a strong understanding of ETL concepts, data warehouse testing methodologies, and experience with various testing tools.Key Responsibilities:Develop and execute comprehensive test plans for ETL processes.Collaborate with...

  • Chief Data Pipeline Architect

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Engineering ExpertWe are seeking a seasoned Data Engineering Expert to join our team. As a key member of our data engineering team, you will design, build, and maintain complex systems that store, process, and retrieve data.Develop real-time and close-to-real-time data integrations using Kafka, MS Event Hubs, etc.Create Business Intelligence Dashboards...

  • Data Engineer for Large-Scale Data Pipelines

    3 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock Your Career PotentialMResult is a leading digital solutions partner trusted by global companies. Our expertise in data engineering, machine learning, AI, and automation helps businesses thrive.About This RoleAs a key contributor to our mission, you will design, develop, and deploy scalable data pipelines and ETL processes using Azure...