Data Pipeline Specialist

3 hours ago

Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000
Job Description">

We seek a seasoned Data Engineer to optimize our data infrastructure and deliver robust data pipelines.

Key Responsibilities:
  • ">
  • Design, implement, and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.
  • Configure and maintain GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  • Enhance large-scale data processing Spark jobs in Databricks.
  • Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments ensuring reliability and consistency.
  • Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Maintain critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Collaborate with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Implement guardrails with data contracts, quality checks, and documentation to ensure long-term reliability.
Required Skills and Qualifications:
  • ">
  • Strong expertise in SQL, Databricks (Spark), and Python/R.
  • Knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Experience in implementing unit tests and quality checks in data workflows.
  • Familiarity with Databricks Asset Bundles (DABs) or similar automation tools.
  • Strong problem-solving and debugging skills in data engineering workflows.
  • Experience with Snowflake or another cloud data warehouse.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.
Benefits:

This role offers the opportunity to work on complex data engineering challenges, collaborate with a talented team, and contribute to the development of cutting-edge data solutions.

Others:

The ideal candidate will be able to balance technical expertise with effective communication and collaboration skills, ensuring seamless integration with cross-functional teams.

  • Senior Data Pipeline Specialist

    2 days ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 12,00,000 - ₹ 16,00,000

    About the RoleWe're looking for a highly skilled Data Engineering professional with expertise in building scalable data pipelines using AWS services.Key Responsibilities:Design and develop production-level data pipelines handling large volumes of structured and unstructured data.Own end-to-end ETL/ELT processes ensuring reliability, scalability, and high...

  • Senior Data Pipeline Specialist

    5 days ago

    Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary:Data Engineering PositionWe are seeking a highly skilled data engineer to fill this critical role. The ideal candidate will have a strong background in designing, developing, and maintaining data pipelines using ETL/ELT tools.

  • Pipeline Management Specialist

    4 days ago

    Jamnagar, Gujarat, India beBeePipelineManagement Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Pipeline Management Specialist">We are seeking a highly skilled Pipeline Management Specialist to join our team in Ahmedabad. This role will involve overseeing and executing on-site projects related to sewer rehabilitation, pipeline surveys, and wastewater management.">Key Responsibilities:">">Supervise and manage day-to-day activities at project...

  • Cloud Data Pipeline Architect

    2 days ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines. This role requires expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using cloud services.Implement data ingestion, transformation, and...

  • Chief Data Pipeline Architect

    3 days ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer OpportunityWe are seeking an experienced Senior Data Engineer to lead the design, development, and maintenance of our robust data pipelines. As a key member of our team, you will be responsible for architecting end-to-end data pipelines, integrating third-party APIs, building data ingestion, storage, and transformation workflows,...

  • Microsoft Fabric Data Pipeline Specialist

    1 week ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description:We are seeking a skilled Data Engineer to build end-to-end data pipelines using Microsoft Fabric and optimize data lake zones. The ideal candidate will have strong knowledge of Azure, Terraform, and be able to design scalable technical solutions.The successful candidate will collaborate with stakeholders to implement messaging via Azure...

  • Data Integration Specialist

    6 days ago

    Jamnagar, Gujarat, India beBeeDatabaseEngineer Full time ₹ 21,00,000 - ₹ 25,00,000

    Job Opportunity: Data Integration SpecialistWe are seeking a highly skilled Data Integration Specialist to join our team. In this role, you will be responsible for designing and implementing data pipelines that ensure seamless integration of data across various systems.The ideal candidate will have a strong understanding of ETL concepts, data warehouse...

  • Cloud Data Engineer

    3 hours ago

    Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    We are seeking a talented professional to lead the design and implementation of scalable data pipelines and ETL solutions in a cloud environment. The ideal candidate will have hands-on experience with AWS services, including EMR, Glue, PySpark, Airflow, and Python.Requirements:A minimum of 5 years of experience in data engineering or related roles.Strong...

  • ETL Specialist

    7 days ago

    Jamnagar, Gujarat, India beBeeDatastage Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior ETL Developer About the Role:We are seeking a highly skilled and experienced ETL developer to join our data engineering team. You will work on building scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake.The ideal candidate will collaborate with architects, business analysts, and data modelers to ensure...

  • SAP Data Specialist

    6 days ago

    Jamnagar, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:SAP Data SpecialistAbout the Role:This is an exciting opportunity to leverage your technical skills and expertise in data management to drive business growth. As a SAP Data Specialist, you will be responsible for designing and implementing end-to-end data models and pipelines in SAP Datasphere. You will work closely with stakeholders to understand...