Data Pipeline Specialist

1 day ago


Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000
Cloud Data Engineer

We are seeking a skilled and motivated cloud data engineer to join our team.

The ideal candidate will be proficient in designing, developing, and optimizing robust data ingestion pipelines using GCP services such as Pub/Sub, Dataflow, and Cloud Storage. They will also have experience in architecting and managing scalable BigQuery data warehouses to support analytics, reporting, and business intelligence needs.

Key Responsibilities:

  • Data Ingestion Pipelines: Design, develop, and optimize robust data ingestion pipelines using GCP services.
  • BigQuery Data Warehouses: Architect and manage scalable BigQuery data warehouses to support analytics, reporting, and business intelligence needs.
  • AI/ML Workflows: Collaborate with data scientists and ML engineers to support AI/ML workflows using Vertex AI.

Required Skills & Qualifications:

  • 3–6 years of experience in data engineering, with strong exposure to GCP.
  • Proficiency in GCP services: Pub/Sub, Dataflow, Cloud Storage, and BigQuery.
  • Solid understanding of data modeling, ETL/ELT processes, and performance optimization.
  • Experience with Python, SQL, and cloud-native development practices.
  • Familiarity with CI/CD pipelines and version control (e.g., Git).

Secondary Skills (Interview-Ready Knowledge):

  • BASIC UNDERSTANDING OF AI/ML WORKFLOWS AND TOOLS WITHIN VERTEX AI.
  • ABILITY TO DISCUSS MODEL LIFECYCLE, DEPLOYMENT STRATEGIES, AND INTEGRATION WITH DATA PIPELINES.
  • AWARENESS OF MLOPS PRINCIPLES AND CLOUD-BASED ML ORCHESTRATION.


  • Dombivli, Maharashtra, India beBeeAzure Full time ₹ 12,00,000 - ₹ 20,10,000

    Job DescriptionThreatXIntel, a cybersecurity company dedicated to protecting businesses from cyber threats, is seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure...


  • Dombivli, Maharashtra, India beBeeTalend Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Talend ETL DeveloperWe are seeking a qualified professional to take on the role of a Talend ETL Developer with expertise in Talend Open Studio for an immediate contractual position.Below are the key responsibilities and requirements for this job:Key Responsibilities:- Design and optimize complex ETL pipelines using Talend Data Integration- Debug...


  • Dombivli, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 15,00,000

    Job OverviewWe are seeking a skilled Data Engineer to design, develop and maintain large-scale data pipelines that can handle structured and unstructured data.This role involves key responsibilities such as implementing data pipelines, building ETL/ELT workflows and ensuring data quality across all pipelines.


  • Dombivli, Maharashtra, India beBeePipeline Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Pipeline ArchitectOverview:We are seeking a skilled data pipeline architect to design, develop, and manage data pipelines that drive business growth. The ideal candidate will have strong expertise in designing and developing data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a solid understanding of data patterns, Python,...


  • Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineering RoleJob OverviewThis is a key role within our organization, focusing on designing and developing data pipelines to ingest data from various sources into our data warehouse. The ideal candidate will have experience with AWS services such as Lambda, DMS, and Glue for data ingestion and transformation processes.Key ResponsibilitiesDesign and...


  • Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Overview:A Data Engineer at a top organization designs and develops scalable data pipelines using AWS services like Glue, S3, and Redshift. This role requires a strong understanding of Python, PySpark, and SQL to build robust ETL processes.Key ResponsibilitiesDesign and implement data pipelines using PySpark, focusing on performance, scalability, and...


  • Dombivli, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000

    Freelance Data Engineer OpportunityJoin a collaborative environment where you can utilize your expertise in designing and optimizing large-scale data pipelines.Role OverviewAs an experienced Freelance Data Engineer, you will work closely with internal teams to design, build, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks. The ideal...


  • Dombivli, Maharashtra, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Python EngineerWe are seeking a seasoned Senior Python Engineer to lead our engineering group. As a key member of the team, you will be responsible for designing and developing scalable data pipelines using Python and Pandas.You will work closely with Data Scientists, Analysts, and Engineering teams to support data-driven applications and reporting...


  • Dombivli, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job Opportunity:Seeking a seasoned Data Architect to lead the design and implementation of scalable data pipelines.Key Responsibilities:Develop and maintain robust ETL/ELT pipelines using Spark, PySpark, SQL, and PythonOptimize large-scale data processing workflows for performance and reliabilityCollaborate with cross-functional teams on AWS services such as...


  • Dombivli, Maharashtra, India beBeeIngestion Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Ingestion Engineer Job DescriptionWe are seeking a highly skilled Data Ingestion Specialist to join our team. The successful candidate will have expertise in data ingestion processes and pipelines, with a strong understanding of how to integrate multiple sources into Databricks.The ideal candidate will design, develop, and optimize data ingestion...