
Data Pipeline Specialist
23 hours ago
Developing and Maintaining Scalable Data Pipelines:
The ideal candidate will be responsible for developing and maintaining scalable data pipelines to support increasing data volume and complexity.
Key Responsibilities:
- Design efficient ETL pipelines following business requirements and development standards.
- Perform integration testing of created pipelines in Cloud environments.
- Provide estimates for development, testing, and deployments on different environments.
- Participate in code peer reviews to ensure compliance with best practices.
- Collaborate with analytics and business teams to improve data models and foster data-driven decision making.
Mandatory Skills:
- Any Cloud Platform
- Python Programming
- SQL
- Pyspark
Benefits:
- Hands-on experience with cloud-based big data technologies.
- Orchestration with Airflow and job scheduler experience.
- Experience in migrating workloads from on-premises to cloud and cloud-to-cloud migrations.
Preferred Qualifications:
- 4 years of hands-on experience with Big Data technologies, including pySpark, Hadoop, Hive, SQL, and data warehouse concepts.
- Strong analytical, problem-solving, data analysis, and research skills.
- Excellent communication, presentation, and interpersonal skills.
-
Validating Complex Data Pipelines
22 hours ago
Jamnagar, Gujarat, India beBeeDataValidator Full time ₹ 15,00,000 - ₹ 24,00,000ETL Data Validation SpecialistAbout the RoleEvaluate and validate data pipelines and transformations using Databricks, Python scripting, and strong SQL skills.Develop expertise in ETL testing methodologies, debugging data issues, and working with large datasets in cloud environments.The ideal candidate will have hands-on experience with Databricks, Python,...
-
Data Pipeline Specialist
3 days ago
Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000Job Description">We seek a seasoned Data Engineer to optimize our data infrastructure and deliver robust data pipelines.Key Responsibilities:">Design, implement, and maintain Continuous Integration/Continuous Deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.Configure and maintain GitHub branch protection rules and workflows to ensure...
-
Senior Data Pipeline Specialist
5 days ago
Jamnagar, Gujarat, India beBeeData Full time ₹ 12,00,000 - ₹ 16,00,000About the RoleWe're looking for a highly skilled Data Engineering professional with expertise in building scalable data pipelines using AWS services.Key Responsibilities:Design and develop production-level data pipelines handling large volumes of structured and unstructured data.Own end-to-end ETL/ELT processes ensuring reliability, scalability, and high...
-
Data Pipeline Developer
6 hours ago
Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Data Pipeline DeveloperWe are seeking a skilled Data Pipeline Developer to join our team. The ideal candidate will have experience designing, developing, testing, and supporting data pipelines and applications using AWS services.The successful candidate will design and develop robust ETL pipelines using PySpark, focusing on performance,...
-
Senior Data Pipeline Specialist
7 days ago
Jamnagar, Gujarat, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Summary:Data Engineering PositionWe are seeking a highly skilled data engineer to fill this critical role. The ideal candidate will have a strong background in designing, developing, and maintaining data pipelines using ETL/ELT tools.
-
AWS Data Pipeline Specialist
22 hours ago
Jamnagar, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Job DescriptionWe are seeking a skilled Data Architect to design, develop, and maintain scalable data pipelines and ETL/ELT solutions using AWS cloud services.Ingest, process, and store structured/unstructured data from multiple sources (IoT devices, sensors, ERP systems, drilling logs, production data, etc.).The ideal candidate will implement data lake and...
-
Pipeline Management Specialist
6 days ago
Jamnagar, Gujarat, India beBeePipelineManagement Full time ₹ 8,00,000 - ₹ 12,00,000Job Title: Pipeline Management Specialist">We are seeking a highly skilled Pipeline Management Specialist to join our team in Ahmedabad. This role will involve overseeing and executing on-site projects related to sewer rehabilitation, pipeline surveys, and wastewater management.">Key Responsibilities:">">Supervise and manage day-to-day activities at project...
-
Cloud Data Pipeline Architect
4 days ago
Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000We are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines. This role requires expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines using cloud services.Implement data ingestion, transformation, and...
-
Chief Data Pipeline Architect
6 days ago
Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Senior Data Engineer OpportunityWe are seeking an experienced Senior Data Engineer to lead the design, development, and maintenance of our robust data pipelines. As a key member of our team, you will be responsible for architecting end-to-end data pipelines, integrating third-party APIs, building data ingestion, storage, and transformation workflows,...
-
Microsoft Fabric Data Pipeline Specialist
1 week ago
Jamnagar, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Description:We are seeking a skilled Data Engineer to build end-to-end data pipelines using Microsoft Fabric and optimize data lake zones. The ideal candidate will have strong knowledge of Azure, Terraform, and be able to design scalable technical solutions.The successful candidate will collaborate with stakeholders to implement messaging via Azure...