
Senior Data Pipeline Specialist
1 week ago
We are currently seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and optimizing data processing pipelines using Azure Cloud technologies.
Key Responsibilities
- Design, develop, and maintain scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory, Databricks, and Spark.
- Implement data transformation workflows using PySpark and Scala Spark for high-performance data processing.
- Work extensively with Azure Cloud services including Azure Data Lake, Azure SQL Database, and related services.
- Troubleshoot, debug, and resolve job failures by identifying root causes.
- Optimize data processing jobs for performance and cost efficiency.
- Collaborate with business teams to gather requirements and translate them into effective data solutions.
Technical Skills Required
- Microsoft Certified: Azure Fundamentals (preferred)
- Strong programming skills in Python and Scala.
- Hands-on experience with Spark (PySpark & Scala Spark).
- Proficiency in SQL for data querying and transformation.
- Good knowledge of Azure Cloud, Azure Data Factory (ADF), and Azure Databricks.
Benefits:
This role offers a dynamic and challenging environment with opportunities for growth and professional development. We offer competitive compensation packages, comprehensive benefits, and a collaborative work environment.
If you are passionate about working with data and want to take your career to the next level, please submit your application today
-
Senior Data Pipeline Specialist
3 days ago
Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000Data Engineer PositionAs a senior data engineer, you will play a critical role in designing and implementing data pipelines that drive business growth. Your expertise in Python and AWS will enable you to develop scalable and efficient solutions for large datasets.The ideal candidate will have strong knowledge of ETL tools such as Glue and Talend, as well as...
-
Data Ingestion Pipeline Specialist
5 days ago
Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 15,00,000Highly skilled Data Engineers with a strong focus on data ingestion are sought after to develop scalable and efficient ingestion workflows.Data Ingestion EngineerWe are seeking an experienced professional to lead the design, development, and optimization of data pipelines for integrating multiple sources into Databricks.Design, implement, and maintain data...
-
Senior Data Pipeline Architect
3 days ago
Aligarh, Uttar Pradesh, India beBeeDataIntegrator Full time ₹ 60,00,000 - ₹ 1,00,00,000Key Data Integration RoleJob Summary:We are seeking a seasoned data integration professional to join our team. As an O9 Integration Consultant, you will be responsible for designing and building robust data pipelines to support business operations.The ideal candidate will have extensive experience in ETL processes, proficiency in databases, and strong...
-
Senior Data Pipeline Architect
2 days ago
Aligarh, Uttar Pradesh, India beBeeEngineer Full time ₹ 1,60,00,000 - ₹ 2,01,00,000Lead Python Platform EngineerYou will be responsible for designing and building scalable data pipelines using Apache Beam.Design and build a shared component library/SDK for ingestion, parsing/OCR, extraction, validation, enrichment, and publishing.Define patterns/templates for Apache Beam pipelines and Databricks jobs; standardize configuration, packaging,...
-
Senior Data Migration Specialist
7 days ago
Aligarh, Uttar Pradesh, India beBeeDataMigration Full time ₹ 15,00,000 - ₹ 20,00,000Senior Data Migration SpecialistWe are seeking an experienced data migration specialist to lead comprehensive data migration initiatives. The successful candidate will assess legacy systems, formulate effective migration strategies, and ensure seamless business continuity.
-
Machine Learning Data Pipeline Specialist
10 hours ago
Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Data Engineer PositionAbout us:We're a customer engagement platform empowering fitness, wellness, and service businesses.We are evolving into an AI-native platform where intelligent agents predict churn, upsell opportunities, and automate member engagement.Job Overview:We're looking for a data engineer who can bridge the gap between data engineering and...
-
Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 16,00,000 - ₹ 22,00,000Job Description:">As a Freelance Data Engineer with expertise in Python, you will play a pivotal role in designing and developing data pipelines using AWS services. Your primary objective will be to create efficient and scalable data workflows that cater to the evolving needs of our organization.">Key Responsibilities:">Develop robust data pipelines...
-
Senior Data Privacy Specialist
2 days ago
Aligarh, Uttar Pradesh, India beBeeDataPrivacy Full time ₹ 8,00,000 - ₹ 16,00,000Senior Data Privacy SpecialistWe are seeking a highly skilled Senior Data Privacy Specialist to join our team. The ideal candidate will be responsible for implementing privacy frameworks, managing data incidents, and ensuring compliance with legal and regulatory requirements.Key Responsibilities:Lead the implementation of privacy frameworks across business...
-
Aligarh, Uttar Pradesh, India beBeeDataIngestion Full time ₹ 1,50,00,000 - ₹ 2,00,00,000For a highly skilled Data Ingestion Expert, we are seeking an accomplished Data Pipeline Engineer to create and manage data ingestion pipelines. The successful candidate will design and develop scalable data ingestion workflows for integrating multiple sources into Databricks.The ideal candidate will have hands-on experience with CI/CD tools, such as GitHub...
-
Chief Data Pipeline Architect
14 hours ago
Aligarh, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 90,00,000 - ₹ 1,20,00,000Transform Data into InsightsWe're seeking a skilled Data Engineer to join our team. The ideal candidate has 1–2 years of experience in data engineering and is excited to solve tough data problems in a fast-paced environment.The RoleDesign, build, and maintain production-level data pipelines that handle terabytes of structured and unstructured data.Own...