
Data Pipeline Specialist
1 day ago
We are seeking a skilled and motivated cloud data engineer to join our team.
The ideal candidate will be proficient in designing, developing, and optimizing robust data ingestion pipelines using GCP services such as Pub/Sub, Dataflow, and Cloud Storage. They will also have experience in architecting and managing scalable BigQuery data warehouses to support analytics, reporting, and business intelligence needs.
Key Responsibilities:
- Data Ingestion Pipelines: Design, develop, and optimize robust data ingestion pipelines using GCP services.
- BigQuery Data Warehouses: Architect and manage scalable BigQuery data warehouses to support analytics, reporting, and business intelligence needs.
- AI/ML Workflows: Collaborate with data scientists and ML engineers to support AI/ML workflows using Vertex AI.
Required Skills & Qualifications:
- 3–6 years of experience in data engineering, with strong exposure to GCP.
- Proficiency in GCP services: Pub/Sub, Dataflow, Cloud Storage, and BigQuery.
- Solid understanding of data modeling, ETL/ELT processes, and performance optimization.
- Experience with Python, SQL, and cloud-native development practices.
- Familiarity with CI/CD pipelines and version control (e.g., Git).
Secondary Skills (Interview-Ready Knowledge):
- BASIC UNDERSTANDING OF AI/ML WORKFLOWS AND TOOLS WITHIN VERTEX AI.
- ABILITY TO DISCUSS MODEL LIFECYCLE, DEPLOYMENT STRATEGIES, AND INTEGRATION WITH DATA PIPELINES.
- AWARENESS OF MLOPS PRINCIPLES AND CLOUD-BASED ML ORCHESTRATION.
-
Data Pipeline Architect
7 days ago
Dombivli, Maharashtra, India beBeeAzure Full time ₹ 12,00,000 - ₹ 20,10,000Job DescriptionThreatXIntel, a cybersecurity company dedicated to protecting businesses from cyber threats, is seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure...
-
Data Pipeline Specialist
1 week ago
Dombivli, Maharashtra, India beBeeTalend Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Talend ETL DeveloperWe are seeking a qualified professional to take on the role of a Talend ETL Developer with expertise in Talend Open Studio for an immediate contractual position.Below are the key responsibilities and requirements for this job:Key Responsibilities:- Design and optimize complex ETL pipelines using Talend Data Integration- Debug...
-
Expert Data Pipeline Specialist
1 week ago
Dombivli, Maharashtra, India beBeeData Full time ₹ 9,00,000 - ₹ 15,00,000Job OverviewWe are seeking a skilled Data Engineer to design, develop and maintain large-scale data pipelines that can handle structured and unstructured data.This role involves key responsibilities such as implementing data pipelines, building ETL/ELT workflows and ensuring data quality across all pipelines.
-
Data Pipeline Architect
4 days ago
Dombivli, Maharashtra, India beBeePipeline Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Data Pipeline ArchitectOverview:We are seeking a skilled data pipeline architect to design, develop, and manage data pipelines that drive business growth. The ideal candidate will have strong expertise in designing and developing data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a solid understanding of data patterns, Python,...
-
Senior Data Pipeline Specialist
1 week ago
Dombivli, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000Data Engineering RoleJob OverviewThis is a key role within our organization, focusing on designing and developing data pipelines to ingest data from various sources into our data warehouse. The ideal candidate will have experience with AWS services such as Lambda, DMS, and Glue for data ingestion and transformation processes.Key ResponsibilitiesDesign and...
-
AWS Cloud Data Pipeline Specialist
2 days ago
Dombivli, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Overview:A Data Engineer at a top organization designs and develops scalable data pipelines using AWS services like Glue, S3, and Redshift. This role requires a strong understanding of Python, PySpark, and SQL to build robust ETL processes.Key ResponsibilitiesDesign and implement data pipelines using PySpark, focusing on performance, scalability, and...
-
Data Pipeline Specialist – Cloud Engineering
1 week ago
Dombivli, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,50,000Freelance Data Engineer OpportunityJoin a collaborative environment where you can utilize your expertise in designing and optimizing large-scale data pipelines.Role OverviewAs an experienced Freelance Data Engineer, you will work closely with internal teams to design, build, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks. The ideal...
-
Data Pipeline Architect
7 days ago
Dombivli, Maharashtra, India beBeePython Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Python EngineerWe are seeking a seasoned Senior Python Engineer to lead our engineering group. As a key member of the team, you will be responsible for designing and developing scalable data pipelines using Python and Pandas.You will work closely with Data Scientists, Analysts, and Engineering teams to support data-driven applications and reporting...
-
Senior Data Pipeline Architect
1 day ago
Dombivli, Maharashtra, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000Job Opportunity:Seeking a seasoned Data Architect to lead the design and implementation of scalable data pipelines.Key Responsibilities:Develop and maintain robust ETL/ELT pipelines using Spark, PySpark, SQL, and PythonOptimize large-scale data processing workflows for performance and reliabilityCollaborate with cross-functional teams on AWS services such as...
-
Data Ingestion Specialist
2 weeks ago
Dombivli, Maharashtra, India beBeeIngestion Full time ₹ 20,00,000 - ₹ 25,00,000Data Ingestion Engineer Job DescriptionWe are seeking a highly skilled Data Ingestion Specialist to join our team. The successful candidate will have expertise in data ingestion processes and pipelines, with a strong understanding of how to integrate multiple sources into Databricks.The ideal candidate will design, develop, and optimize data ingestion...