Senior Data Pipeline Specialist

1 week ago

Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

Unlock the full potential of your data career with this exciting opportunity.

Job Description

We are seeking a skilled Data Engineer to join our organization. As a key member of our team, you will be responsible for designing, developing, and maintaining large-scale data pipelines and systems.

Key Responsibilities:
  • Designing and implementing scalable data architectures using modern cloud and big data platforms.
  • Developing and maintaining ETL processes, data pipelines, and structured/unstructured data processing systems.
  • Working with Databricks, including Delta Lake, Workflows, CLI, Job Clusters, and Workspace.
  • Expertise in Cloud Data Warehousing, including Redshift, Snowflake, Databricks SQL, or equivalent.
  • Familiarity with REST APIs, Flask/FastAPI, containerization (Docker/Kubernetes), and ML lifecycle & libraries (scikit-learn, XGBoost).
  • Strong understanding of CI/CD, Git, and orchestration tools (Airflow/Prefect).

The ideal candidate will have 3–6 years of experience in building scalable data pipelines and working on modern cloud & big data platforms. Strong communication and collaboration skills are essential for success in this role.

Required Skills and Qualifications

Must-haves:

  • Experience with cloud-based data warehousing solutions.
  • Strong programming skills in Python, Java, or C++.
  • Knowledge of database management systems and data modeling concepts.
  • Ability to work in a fast-paced environment and prioritize tasks effectively.

Nice-to-haves:

  • Experience with machine learning algorithms and model deployment.
  • Familiarity with DevOps practices and automation tools.
  • Certification in data engineering or related field.
Benefits

This role offers a competitive salary, comprehensive benefits package, and opportunities for growth and development.

Others

As a Data Engineer at our organization, you will be part of a dynamic team that is passionate about innovation and excellence. We strive to create a work environment that is inclusive, respectful, and supportive of all employees. Apply now to take the first step towards an exciting data career

  • Senior Data Pipeline Specialist

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,80,00,000

    Data Engineering ProfessionalWe are seeking a highly skilled Data Engineer to join our team. The ideal candidate will have expertise in building, deploying, and managing data pipelines using Python and PySpark.

  • Advanced Data Pipelining Specialist

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDeveloper Full time ₹ 14,00,000 - ₹ 17,00,000

    Senior Data DeveloperAre you looking for a challenging opportunity to work with complex data pipelines and scalable architectures?This role is perfect for an experienced ETL developer who can design, develop, and maintain efficient, high-quality data integration solutions.Design and implement robust, scalable ETL processes using industry-leading tools and...

  • Senior Cloud Data Pipeline Specialist

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Cloud Data EngineerWe are seeking a skilled cloud data engineer to design, build and maintain scalable data pipelines and ETL solutions. The ideal candidate will have hands-on experience with AWS services, PySpark, Airflow and Python.Key Responsibilities:Design and develop scalable data pipelines using AWS services.Collaborate closely with data analysts,...

  • Data Pipeline Architect

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Data Pipeline ArchitectCreate and implement scalable, event-driven data pipelines that support real-time clinical workflows.Design and integrate systems with EHR/EMR platforms (e.g., Epic) using FHIR and HL7 standards.Develop high-quality systems to ingest, track, and update clinical events in real-timeEnsure downstream analytics systems receive...

  • Leading Edge Data Architectural Expert

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDataInfrastructure Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Data Infrastructure SpecialistAbout the Role:A senior data infrastructure specialist is needed to design, develop and maintain scalable data pipelines and ETL processes. The ideal candidate will have extensive proficiency in SQL, Python and other relevant programming languages.Main Responsibilities:Data Pipeline Development: Develop and maintain...

  • Senior Data Migration Specialist

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeMigration Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title: Senior ETL DeveloperWe are seeking a highly skilled Data Integration Specialist with expertise in Informatica to SSIS migration.Key Responsibilities:Leverage data warehousing and business intelligence solutions to drive business growth.

  • Expert Data Pipeline Architect

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering ExpertiseWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering group, you will play a vital role in designing and building scalable data pipelines and architectures.This position offers the chance to work closely with talented teams, solve real-world data challenges, and make a direct impact...

  • Data Pipelines Engineer

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeSoftware Full time ₹ 90,00,000 - ₹ 1,50,00,000

    Job Description">Overview:We are seeking a skilled Python Developer to join our team. This full-time position will involve building automated data pipelines, implementing analytical algorithms, and developing REST APIs.Key Responsibilities:Design and implement automated data pipelines using Google Cloud Platform.Develop analytical algorithms to drive...

  • Kafka Data Pipeline Specialist

    1 week ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job TitleSeeking an experienced technologist to manage large-scale data pipelines.Responsibilities include:Design, deploy and maintain scalable Kafka clusters on-premises and in the cloud.Develop and implement efficient cluster configurations for optimal performance.Collaborate with developers to provide expert-level support and guidance on Kafka...

  • Senior Data Engineering Specialist

    2 weeks ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 15,00,000

    We're seeking a seasoned Data Engineering Specialist to lead the design and implementation of scalable data solutions on Google Cloud Platform (GCP). This individual will have 5–10 years of experience in building efficient data pipelines using BigQuery, Dataflow, DataProc, and Cloud Composer.Key Responsibilities:Data Pipeline Development: Build optimized...