Senior Data Pipeline Engineer

22 hours ago

Mumbai, Maharashtra, India beBeeDataScientist Full time ₹ 18,00,000 - ₹ 25,00,000
Key Responsibilities

Our team is seeking a skilled Python Developer to design and implement automated data pipelines using Google Cloud Platform. The ideal candidate will have experience in developing analytical algorithms to drive business insights, creating REST APIs to facilitate data exchange, and working with SQL databases and Neo4j graph databases to store and retrieve data efficiently.

  • Develop innovative solutions for data processing and analysis.
  • Design and implement scalable data pipelines using GCP services.
  • Collaborate with cross-functional teams to integrate data-driven insights into business decision-making.
Required Skills and Qualifications

The following skills and qualifications are required:

  • 3+ years of experience in Python development.
  • Proficiency in data processing libraries (Pandas, NumPy).
  • Experience in API development (FastAPI, Flask, or Django REST).
  • Familiarity with Google Cloud Platform (BigQuery, Cloud Storage, Vertex AI).
  • Strong understanding of SQL and database design principles.
  • Knowledge of Git version control.
Preferred Qualifications

The following qualifications are preferred:

  • Experience with LLM integration (OpenAI API, Vertex AI).
  • Graph database experience (Neo4j).
  • Understanding of data visualization concepts.
  • Knowledge of ML concepts and time series analysis.
Technical Environment

The successful candidate will work in a fast-paced startup environment using the following tools and technologies:

  • Languages: Python, SQL.
  • Cloud: AWS OR Google Cloud Platform.
  • Databases: PostgreSQL/MySQL, Neo4j, BigQuery.
  • Tools: Git, Docker, PowerBI.
Requirements

The following requirements are necessary:

  • Bachelor's degree in Computer Science, Engineering, or related field.
  • Strong problem-solving skills.
  • Able to work in a collaborative team environment.

  • Senior Data Pipeline Engineer

    1 day ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a highly skilled professional to build and maintain secure, scalable data pipelines using Databricks and Azure.This role requires expertise in handling ingestion from diverse sources (files, APIs, streaming), data transformation, and quality validation.The ideal candidate will collaborate with subsystem data science and product...

  • Lead Data Pipeline Specialist

    1 day ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Senior Data EngineerWe are seeking a Senior Data Engineer to join our team. As a member of this team, you will be responsible for building data pipelines to ingest various source data from enterprise technologies and PitchBook Platform data.You will work with a range of data and reporting technologies (e.g. Python, Docker, Tableau, Power BI) to build upon a...

  • Data Pipeline Migration Specialist

    3 days ago

    Mumbai, Maharashtra, India beBeeDataGovernance Full time ₹ 1,75,00,000 - ₹ 2,50,00,000

    Technical Leadership OpportunityThis is a senior-level position that oversees the technical aspects of implementing data pipeline migration requirements, ensuring our platform is used to its full potential through designing and building applications around business stakeholder needs.Main ResponsibilitiesCollaborate directly with stakeholders to gather...

  • Senior Data Pipeline Architect

    3 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Transforming marketing data into actionable insights requires a unique blend of technical expertise and analytical thinking. As a key member of our data infrastructure team, you will design, develop, and maintain robust data pipelines, warehouses, and analytics platforms.Design and implement scalable data pipelines for marketing data ingestion and...

  • Senior Data Engineer

    4 hours ago

    Mumbai, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data Engineer - MumbaiDescription:We are seeking a highly skilled Senior Data Engineer to lead the development and implementation of scalable data pipelines using PySpark. The ideal candidate will have hands-on expertise in building, designing, and maintaining batch and streaming data pipelines.The successful candidate will leverage strong...

  • Data Pipeline Specialist

    5 days ago

    Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Data Engineer OpportunityWe are seeking a skilled Data Engineer to design and develop scalable data pipelines.This role involves working with streaming data, collaborating with data scientists, and delivering high-quality solutions.

  • Senior Data Engineer

    5 days ago

    Mumbai, Maharashtra, India HealthyMe Ai Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • Senior Data Engineer

    17 hours ago

    Mumbai, Maharashtra, India Kotak Life Full time US$ 1,00,000 - US$ 1,50,000 per year

    Role:Senior Data EngineerJob Title:Senior Manager / Chief ManagerWork Experience:4 years +Education:Engineering GraduateDepartment:Data ScienceWork location:Goregaon (East), MumbaiAbout the Role:We are seeking a highly skilled Data Engineer with 4 - 8 years of hands-on experience in designing and developing scalable, reliable, and efficient data solutions....

  • Senior Big Data Engineer

    1 day ago

    Mumbai, Maharashtra, India beBeeBigDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Big Data EngineerJob Summary:Data Engineers design, develop and maintain large-scale data processing systems. In this role, you will work with our team to build scalable data pipelines using PySpark and ensure the smooth operation of our data infrastructure.About the Role:The ideal candidate will have strong experience in building data...

  • Pipeline Design Engineer

    3 weeks ago

    Mumbai, Maharashtra, India Petro Manpower Engineering Consultant Full time

    We have an urgent requirement for the Pipeline Design Engineer - for OMAN Location OMAN based Client Duration - Client Payroll Long Term Experience 15 to 25 yrs in - Pipeline Design Engineering to Oil and Gas - Pipeline Qualification - Mechanical Engineering BE Job Profile - Hands-on Experience in the the following - 1 Pipeline Route Selection ...