
Senior Data Pipeline Specialist
2 days ago
We are seeking an experienced professional to lead the development of scalable data pipelines using modern cloud and big data platforms. The ideal candidate will have a strong foundation in Python, SQL, PySpark, and Bash scripting, as well as expertise in ETL, structured/unstructured data, and Databricks (Delta Lake, Workflows, CLI, Job Clusters, Workspace).
The successful candidate will also have experience in Cloud Data Warehousing (Redshift, Snowflake or equivalent) and knowledge of REST APIs, Flask/FastAPI, and containerization (Docker/Kubernetes). Additionally, they will be familiar with ML lifecycle & libraries (scikit-learn, XGBoost) and strong in CI/CD (Jenkins), Git, and orchestration tools (Airflow/Prefect).
- Key Responsibilities:
- Design, build, and maintain scalable data pipelines using modern cloud and big data platforms.
- Develop high-quality code using Python, SQL, PySpark, and Bash scripting.
- Collaborate with cross-functional teams to identify and prioritize project requirements.
- Required Skills and Qualifications:
- Strong programming skills in Python, SQL, PySpark, and Bash scripting.
- Experience in ETL, structured/unstructured data, and Databricks (Delta Lake, Workflows, CLI, Job Clusters, Workspace).
- Expertise in Cloud Data Warehousing (Redshift, Snowflake or equivalent).
- Knowledge of REST APIs, Flask/FastAPI, and containerization (Docker/Kubernetes).
- Familiarity with ML lifecycle & libraries (scikit-learn, XGBoost).
- Strong CI/CD skills in Jenkins, Git, and orchestration tools (Airflow/Prefect).
- Desirable Qualifications:
- Excellent communication and collaboration skills.
-
Senior Data Pipeline Specialist
2 days ago
Surat, Gujarat, India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000Data Engineering RoleOur organization seeks a skilled Data Engineer to contribute to our growing data team. The ideal candidate will have experience in designing and implementing scalable data pipelines, as well as working with cloud-based data platforms.
-
Data Pipeline Specialist
2 days ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Cloud Data EngineerJob SummaryWe are seeking a highly skilled Cloud Data Engineer to join our team. The ideal candidate will have experience in designing and implementing scalable data pipelines using cloud-based technologies.Key Responsibilities:Design and implement cloud-based data pipelines using Azure Databricks, Snowflake, and Spark.Develop robust...
-
Data Pipeline Specialist
24 hours ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job OpportunityData Engineer Role SummaryWe are seeking a skilled Data Engineer to support the development and deployment of data pipelines, APIs, and internal tools for our e-commerce platform. This role involves building and maintaining ETL pipelines, collaborating with data scientists and product managers, and ensuring data quality and reliability across...
-
ETL Pipeline Specialist
1 week ago
Surat, Gujarat, India beBeeTestEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Senior Test EngineerAbout this role:We are seeking a skilled Senior Test Engineer to join our team and contribute to the development of reliable ETL pipelines in Azure cloud environments.You will be responsible for designing and developing comprehensive test cases using Python scripting and Pytest framework, ensuring accuracy, integrity, and performance of...
-
Data Pipeline Specialist
7 days ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000Job DescriptionWe are seeking a skilled Data Engineer with expertise in designing and implementing scalable, high-performance data pipelines. The role involves building and optimizing ETL/ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI/ML, and business intelligence use cases.
-
Senior Data Engineer
1 week ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Transforming Data into InsightsAbout This RoleWe are seeking an experienced data engineer to drive the development and maintenance of efficient data pipelines. The ideal candidate will possess a strong background in extract, transform, and load (ETL) processes, data engineering, and experience working with cloud-based data platforms.Data Pipeline...
-
Cloud Data Pipelines Specialist
6 days ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job Overview:We are seeking a highly motivated and experienced Data Engineer to design, build, and maintain robust data pipelines.About the RoleThe ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Create scalable data pipelines using cloud services (GCP, AWS, or Azure).Implement data ingestion,...
-
High-Performance Data Pipeline Specialist
1 week ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Senior Data EngineerJob Description:We are looking for a skilled Big Data Engineer to join our team. As a key member of the Professional Services department, you will design, build, and maintain high-performance data pipelines that process massive amounts of data.Key Responsibilities:Design and implement scalable batch processing systems using...
-
Senior Data Pipeline Developer
1 week ago
Surat, Gujarat, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Our team is seeking a highly skilled Data Engineer to join our ranks. As a key member of our organization, you will be responsible for designing, developing, and maintaining complex data pipelines using PySpark.Key Responsibilities:The ideal candidate will havea strong background in PySpark, with hands-on experience in building scalable data...
-
Big Data Specialist
1 week ago
Surat, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Senior Data Infrastructure SpecialistJob Overview:We are seeking a highly skilled Senior Data Infrastructure Specialist to design, develop, and maintain the infrastructure that enables data collection, storage, processing, and analysis. The ideal candidate will have experience in designing, developing, and maintaining ETL/ELT data pipelines, as well as...