Data Pipeline Architect

1 week ago

Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 18,00,000

Job Title: Data Engineering Specialist

We are seeking an accomplished professional to lead the design, development, and maintenance of scalable data pipelines.

About the Role:

As a key member of our team, you will collaborate with cross-functional stakeholders to deliver high-quality data assets that support business-critical analytics and AI/ML initiatives.

Main Responsibilities:
  • Design, develop, and optimize ETL pipelines using IBM DataStage and AWS Glue/Lambda for ingestion from varied sources.
  • Build and maintain data flows for loading curated datasets into Snowflake, leveraging best practices for schema design, partitioning, and transformation logic.
  • Participate in code reviews, performance tuning, and defect triage sessions.
  • Ensure lineage, privacy tagging, and quality controls are embedded within pipelines.
  • Contribute to CI/CD integration of ETL components using Git, Jenkins, and parameterized job configurations.
Requirements:
  • 4+ years of experience in ETL development with at least 1–2 years in IBM DataStage.
  • Hands-on experience with AWS Glue (PySpark or Spark) and AWS Lambda for event-based processing.
  • Experience working with Snowflake: loading strategies, stream-task, zero-copy cloning, and performance tuning.
  • Proficiency in SQL, Unix scripting, and basic Python for data handling or automation.
  • Familiarity with S3, version control systems (Git), and job orchestration tools.
Benefits:

We offer a dynamic work environment, opportunities for growth and professional development, and a competitive compensation package.

  • Data Architect

    1 week ago

    Bhavnagar, Gujarat, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerSikich India is seeking an experienced Data Architect to join our team in designing and building end-to-end data solutions using Microsoft's data platforms, including Fabric, Azure Synapse Analytics, Databricks, and Power BI.This role involves implementing contemporary data architecture patterns, creating robust data pipelines, and...

  • Chief Data Pipeline Architect

    5 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000

    Data Engineering ExpertWe are seeking a seasoned Data Engineering Expert to join our team. As a key member of our data engineering team, you will design, build, and maintain complex systems that store, process, and retrieve data.Develop real-time and close-to-real-time data integrations using Kafka, MS Event Hubs, etc.Create Business Intelligence Dashboards...

  • Data Architect

    5 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time US$ 2,00,000 - US$ 2,50,000

    About us:We are a healthcare technology company that aims to make nutritious food accessible and affordable for everyone.We have a robust network of Registered Dietitians who provide personalized nutrition counseling and guidance to our members. Our platform integrates dietary assessments, nutrition counseling, online food ordering, and cost-effective meal...

  • Senior Data Architect

    7 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Big Data ArchitectWe are seeking a skilled Big Data Architect to design, build, and optimize scalable data architectures using Snowflake, AWS, and DBT. The ideal candidate will enable seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.Design, build, and maintain ETL/ELT pipelines using...

  • Enterprise Data Architect Specialist

    7 days ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 19,50,000 - ₹ 24,12,000

    Data Architect OpportunityWe are seeking an experienced Data Architect to design, develop and govern our data architecture and pipelines. Ideally someone who has worked on multiple projects with GCP-Big Query, Data Proc technologies.

  • Data And Solutions Architect

    4 weeks ago

    Bhavnagar, Gujarat, India CoffeeBeans Full time

    Coffee Beans Consulting is a tech consulting firm focused on making organizations AI-ready by structuring their data efficiently across various sources and enabling AI-driven solutions.We specialize in data architecture, pipelines, governance, MLOps, and Gen AI solutions, helping clients achieve faster go-to-market and cost efficiency.We are looking for a...

  • Data Solutions Architect

    5 hours ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    Job Title: Databricks EngineerWe are seeking a seasoned Data Solutions Architect to design, build and optimize scalable data solutions.The ideal candidate has hands-on experience in Databrick production environments and a deep understanding of modern data architecture. You will work with cross-functional teams to create robust data pipelines and ensure the...

  • Data Architect

    7 days ago

    Bhavnagar, Gujarat, India Pro5 Full time

    We are seeking a talented Data Architect to design, develop, and govern our data architecture and pipelines. to join as soon as possible. Ideally someone who has worked on multiple projects with GCP-Big Query, Data Proc technologies. The candidate will need to be collaborative, organised, think out-of-the-box, and be ready to pursue new opportunities. Most...

  • Cloud Data Pipeline Specialist

    5 hours ago

    Bhavnagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Data EngineerAs a Cloud Data Engineer, you will play a key role in developing and maintaining large-scale data pipelines on the cloud.Key Responsibilities:Design and develop complex data pipelines using Python, Data Flow, DataStream, CDC, Cloud Functions, Cloud Run, Pub Sub, BigQuery, and Cloud Storage.Utilize DevOps and CI/CD practices to ensure the...

  • Senior Big Data Solutions Architect

    7 days ago

    Bhavnagar, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data ArchitectWe are seeking a skilled Big Data Architect to lead our data-driven initiatives and design scalable data pipelines. This role involves collaborating with data scientists and business stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines and ETL workflows using Apache Spark, Python,...