Lead Data Pipeline Specialist
2 days ago
We seek an expert in designing and maintaining large-scale data pipelines on Azure using Databricks, ADF, and PySpark. This individual will ensure high-quality, secure, and reliable datasets for analytics and customer-facing applications.
Key Responsibilities- Design, build, and optimise large-scale data pipelines using Databricks, Delta Live Tables, ADF, and PySpark.
- Develop and maintain frameworks that integrate multiple sources into Azure-based platforms.
- Implement Unity Catalog for data governance, security, and lineage.
- Collaborate with teams to deliver high-quality, reliable datasets.
- Monitor and tune performance across Azure services.
- 8+ years of progressive data engineering experience, including leadership roles supporting products at scale.
- Deep expertise with Microsoft Azure architecture, including PaaS databases and Synapse stored procedures.
- Required 3+ years of experience working with Databricks (Delta Live Tables and Unity Catalog).
- Strong experience building and managing Azure Data Factory pipelines.
- Proficiency in Python and PySpark, with additional knowledge of Spark and Scala a plus.
- Strong understanding of dimensional modelling, ETL, data governance, warehousing, and structured/unstructured data.
This role offers opportunities for professional growth and development within a supportive environment that values employee well-being.
-
Data Pipeline Specialist
3 days ago
Hyderabad, Telangana, India beBeeDataPipeline Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job OverviewWe are seeking an accomplished Data Pipeline Specialist to join our team. The successful candidate will be responsible for creating and maintaining data pipelines that drive business growth.Main ResponsibilitiesCreate and implement new data pipelines to meet business needsEssential Skills and Qualifications4-6 years of experience in designing and...
-
Data Pipelines Expert
7 days ago
Hyderabad, Telangana, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job DescriptionWe are seeking a skilled Technical Data Specialist with expertise in designing, developing, and maintaining robust and scalable data pipelines. The ideal candidate will be responsible for implementing efficient data solutions, collaborating with cross-functional teams, and ensuring high-quality data delivery.The Technical Data Specialist will...
-
Lead Data Pipeline Architect
2 days ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,20,00,000About us:We're a leading provider of personalized digital solutions for healthier food choices, driving lasting behavior change and delivering long-term health outcomes.We guide individuals on a tailored journey to eating well while saving time and money through our platform.Our platform integrates dietary assessments and nutrition counseling with online...
-
Data Pipeline Specialist
4 days ago
Hyderabad, Telangana, India beBeeBusiness Full time ₹ 12,00,000 - ₹ 20,00,000Job Title: Business Intelligence ArchitectWe are seeking an experienced Business Intelligence Architect with a strong background in data engineering and a passion for designing, building, and optimizing scalable data pipelines.The ideal candidate will have hands-on experience in Snowflake, AWS Lambda, Glue, DBT, and SQL. They will be responsible for...
-
Data Pipeline Specialist
2 days ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Job Opportunity:We are seeking a highly skilled data professional to design and implement robust data pipelines using AWS, Python, and SQL to support business analytics and decision-making.A strong command of SQL for creating, managing, and optimizing data structures and complex queries is required.Expertise in AWS services such as S3, EC2, RDS, Redshift,...
-
Data Pipeline Expert
2 days ago
Hyderabad, Telangana, India beBeeetl Full time ₹ 10,00,000 - ₹ 15,00,000We are currently seeking a talented ETL Support Specialist to join our team. As an ETL Support Specialist, you will play a crucial role in ensuring the smooth operation of our data pipelines.
-
Data Architect
2 days ago
Hyderabad, Telangana, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Data Architect - ETL/ELT Pipeline SpecialistJob Summary:We are seeking a highly skilled Data Engineer with 4-7 years of experience to design, build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.The ideal candidate will have expertise in working across scrum teams to develop data solutions, ensuring data governance...
-
Senior Pipeline Development Lead
5 days ago
Hyderabad, Telangana, India beBeePipeline Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Senior Pipeline EngineerOverview: We are seeking a skilled and experienced pipeline engineer to lead the design and engineering of pipeline systems.This role involves the selection of routes, specification of materials, stress analysis, and hydraulics.The selected candidate will be responsible for preparing and reviewing pipeline technical...
-
Lead Data Engineer
2 days ago
Hyderabad, Telangana, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data EngineerOur organization seeks a highly skilled and experienced data engineer to lead the development of scalable data pipelines.Key Responsibilities:Design, develop, and maintain efficient and scalable data pipelines using PySpark technology.Implement complex business logic utilizing Spark SQL, DataFrame, and RDD APIs.Develop strong...
-
Senior Data Engineering Pipeline Specialist
4 days ago
Hyderabad, Telangana, India beBeeDataEngineering Full time ₹ 1,80,00,000 - ₹ 2,40,00,000Data Engineering Leadership PositionAbout the Role:We are seeking a skilled Data Engineering Tech Lead to join our team. As a key member of our data engineering organization, you will be responsible for designing, developing, and delivering pipeline solutions that address business needs.Key Responsibilities:- Develop expertise in Python, PySpark, Spark, and...
