Senior Data Pipeline Specialist

2 weeks ago

Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 16,00,000

Data Engineer Position

We are seeking an experienced data professional to design, implement, and manage large-scale data pipelines and deployments.

Key Responsibilities:

  • Design and implement continuous integration/continuous deployment (CI/CD) pipelines using modern tools.
  • Configure and maintain branch protection rules and workflows for smooth code integration and deployment.
  • Build, optimize, and debug Spark jobs in Databricks for efficient data processing.
  • Automate Databricks deployments using Asset Bundles or similar frameworks.
  • Develop, test, and maintain robust data pipelines using Python and SQL.
  • Implement unit testing, validation, and quality checks for data workflows.
  • Manage multi-environment deployments ensuring reliability and consistency.
  • Write and maintain configuration files for workflows, pipelines, and automation.
  • Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Migrate legacy reports into modern, self-serve dashboards.
  • Partner with cross-functional teams to deliver data models, insights, and reporting they can trust.

Requirements:

  • Strong skills in SQL, Databricks (Spark), and Python/R programming languages.
  • Experience in implementing unit tests and quality checks in data workflows.
  • Familiarity with CI/CD practices and modern DevOps tools.
  • Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.
  • Knowledge of cloud data warehouses and data engineering principles.

  • Senior Specialist, Global Commercial Pharma Pipeline Analytics, Hhdda

    2 weeks ago

    Pune, Maharashtra, India MSD Full time

    Senior Specialist Global Commercial Pharma Pipeline Analytics HHDDA Our Human Health Digital Data and Analytics HHDDA team is innovating how we understand our patients and their needs Working cross functionally we are inventing new ways of engaging interacting with our customers and patients leveraging digital data and analytics and measuring the...

  • Data Pipeline Quality Assurance Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeePipeline Full time ₹ 1,04,000 - ₹ 1,30,878

    We are seeking an experienced Data Pipeline Quality Assurance specialist to join our data team.The ideal candidate will be proficient in analyzing source data, understanding data structures and distributions, and identifying anomalies to ensure data quality and readiness for processing.Key Responsibilities:Analyzing data pipelines and identifying areas for...

  • Senior Developer

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Key Responsibilities:Support day-to-day incident and ticket resolution related to data pipelines.Create and maintain comprehensive documentation for data pipelines, configurations, and procedures.Utilize GCP services like BigQuery, Cloud Composer, Cloud Functions, etc.Develop and maintain SQL/Python scripts for data ingestion, transformation, and automation...

  • Chief Data Pipeline Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title:Senior Data Engineer Job Description: Develop and maintain large-scale data pipelines for diverse datasets.Build complex datasets based on business needs.Design a robust data pipeline architecture.Identify opportunities for data acquisition through stakeholder collaboration.Prioritize business requirements to technical specifications. Key...

  • Data Scientist Specialist

    22 hours ago

    Pune, Maharashtra, India Optimum Data Analytics Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role Overview:We are looking for a Data Scientist Specialist to join our growing AI & Data team. The ideal candidate will have hands-on experience designing and deploying AI/ML solutions with Azure Cloud, LLMOps, Containerized environments, and Generative AI technologies. This is an onsite role based in Pune, offering you the opportunity to collaborate...

  • Senior Data Analyst

    5 days ago

    Pune, Maharashtra, India Hevo Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About Hevo:Hevo ) is a simple, intuitive, and powerful No-code Data Pipeline platform that enables companies to consolidate data from multiple software for faster analytics.Hevo powers data analytics for 2000+ data-driven companies across multiple industry verticals, including , Postman, ThoughtSpot, Jawa Motorcycles. By automating complex data integration...

  • Data Pipeline Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeDataScience Full time ₹ 19,62,000 - ₹ 23,49,000

    Job Description:We are seeking a highly skilled Data Pipeline Architect to design, develop and optimize data ingestion pipelines for integrating multiple sources into Databricks.This role requires strong expertise in CI/CD and Kubernetes to ensure seamless integration and scalability.Required Skills & Qualifications:Proven experience in designing and...

  • Data Architecture Specialist

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000

    Data Architecture SpecialistWe are seeking a skilled Data Architecture Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing and building scalable data pipelines and architectures that meet the needs of our business.

  • Chief Data Pipeline Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Key Data Engineering RoleWe are seeking a skilled Data Engineer to lead the design and implementation of data pipelines, ensuring data quality and integrity.Design and implement data pipelines using Postgres SQL, including advanced query writing, CTEs, window functions, indexing, and optimization.Develop and maintain data models, including star schema,...

  • Python & ETL Engineer - Data Pipeline

    3 weeks ago

    Pune, Maharashtra, India Servhigh Global Services Private Limited Full time

    Role Overview : We are seeking a highly skilled Python + ETL Engineer with strong expertise in building data pipelines, automation workflows, and scalable ETL solutions. The ideal candidate will have hands-on experience with Python-based ETL frameworks, data ingestion pipelines, and cloud-native deployments (preferably AWS).The role involves designing and...