
Senior Data Pipeline Specialist
22 hours ago
Deloitte presents a unique chance to work with cutting-edge leaders and organizations shaping the future of the region and beyond.
As a skilled Data Engineer, you will play a critical role in supporting analytics, reporting, and data science initiatives by delivering high-quality, reliable, and performant data systems.
Key Responsibilities:- Design, develop, and manage ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks for batch and real-time data processing.
- Integrate data from various structured and unstructured sources including SQL Server, Azure SQL Database, Azure Data Lake Storage (ADLS), and external APIs.
- Build and maintain data models, data marts, and data warehouses using SQL Server and Azure Synapse Analytics.
- Write efficient and optimized SQL queries, stored procedures, views, and triggers in SQL Server.
- Use Databricks (Spark with Python/Scala) to process large datasets for transformation and analytics.
- Ensure data quality, integrity, security, and compliance across the pipeline using data validation, monitoring, and auditing techniques.
- Collaborate with data analysts, data scientists, and business stakeholders to define and deliver data solutions.
- Implement CI/CD pipelines using Azure DevOps.
- Monitor and optimize the performance of data pipelines and queries across Azure and SQL Server environments.
- Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
- 5+ years of experience in data engineering or related roles.
- Proven experience with:
- Azure Data Services: Data Factory, ADLS, Azure SQL, Azure Synapse
- Databricks (Azure implementation), including experience with Spark (Python or Scala).
- Microsoft SQL Server: Writing advanced SQL, stored procedures, and performance tuning.
- Strong understanding of data warehousing concepts, ETL/ELT best practices, and data modelling (star/snowflake schema).
- Familiarity with data governance, RBAC, and data security practices in Azure.
- Experience with CI/CD tools like Azure DevOps and version control with Git.
- Excellent problem-solving skills and the ability to work collaboratively in a fast-paced environment.
At Deloitte, we value diversity, inclusion, and belonging. We believe that everyone has the right to contribute and succeed based on their abilities and potential. Our teams are committed to fostering an inclusive culture where everyone feels valued, respected, and empowered to make a meaningful impact.
We offer a dynamic and supportive work environment that encourages collaboration, creativity, and continuous learning. Our professionals have access to cutting-edge tools, technologies, and training programs that help them stay ahead of the curve in their careers.
If you're looking for a challenging and rewarding career opportunity that aligns with your passions and goals, we encourage you to apply today
-
Data Pipeline Engineer
3 hours ago
Nashik, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000Senior Data Pipeline EngineerThis role involves ensuring the accuracy, integrity, and performance of data pipelines deployed into cloud environments.The Senior Data Pipeline Engineer will be responsible for designing and developing comprehensive test cases to validate data transformations, mappings, and system behaviors using Python scripting and Pytest...
-
Data Pipeline Specialist
21 hours ago
Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000Job DescriptionWe are seeking a skilled professional to design and implement robust data pipelines using Python and SQL.Main Responsibilities:Design, implement, and manage continuous integration/continuous deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.Configure and maintain GitHub branch protection rules and workflows to ensure smooth...
-
High Performance Data Pipeline Specialist
22 hours ago
Nashik, Maharashtra, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer with strong hands-on experience in Databricks and AWS to join our dynamic data engineering team.Main Responsibilities:Designing, developing, and maintaining scalable and high-performance data pipelines using Databricks and PySparkImplementing and managing data solutions on AWS,...
-
Data Pipeline Specialist
3 hours ago
Nashik, Maharashtra, India beBeeDeveloper Full time ₹ 15,00,000 - ₹ 20,00,000ETL Developer PositionWe are seeking a skilled ETL developer to join our data engineering team.Job Description:The successful candidate will design, develop and maintain ETL pipelines using IBM Data Stage (CP4 D) and AWS Glue/Lambda for ingestion from various sources such as flat files, APIs, Oracle, DB2, etc.Key Responsibilities include:Designing scalable...
-
Expert Data Pipeline Specialist
2 days ago
Nashik, Maharashtra, India beBeeDatabricksEngineer Full time ₹ 1,20,00,000 - ₹ 2,50,00,000Job Title: Databricks EngineerWe are seeking a skilled Databricks Engineer to join our team.A successful candidate will have:7+ years of experience in data engineering, with a strong focus on designing and developing data pipelines and ETL processes on Databricks.Proven subject matter expertise in Databricks (including Databricks SQL, Delta Lake, and...
-
Nashik, Maharashtra, India beBeeEtlnetworker Full time ₹ 20,00,000 - ₹ 28,00,000We are seeking a skilled ETL Developer with expertise in Talend Open Studio and proficiency in Python, BigQuery, PostgreSQL, and GCP.Job Description:Talend ETL Developer will be responsible for designing and optimizing complex data pipelines using TMC, partitioning and clustering in BigQuery, and automating processes with Python. Additionally, the ideal...
-
Chief Data Pipeline Architect
7 hours ago
Nashik, Maharashtra, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Key Data Engineering Roles and ResponsibilitiesWe are seeking a highly skilled data engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining large-scale data pipelines using Python and AWS technologies.The data engineer will work closely with cross-functional teams to develop and implement efficient ETL...
-
Cloud Based Data Pipeline Architect
21 hours ago
Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job Title:Lead Data EngineerWe are seeking a skilled Lead Data Engineer to join our team. In this role, you will be responsible for designing, developing, and implementing large-scale data pipelines using Azure services such as Data Factory, Databricks, and Data Lake.Key Responsibilities:Develop complex data pipelines utilizing PySpark and SQL.Implement...
-
Cloud Data Specialist
3 hours ago
Nashik, Maharashtra, India beBeeData Full time ₹ 19,32,000 - ₹ 25,14,000Job Title: Cloud Data SpecialistAbout the Role:We are seeking an experienced data specialist with 4–7 years of experience to design and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.Collaborate with cross-functional teams to develop quality database programming requirements.Develop and deploy scalable ETL/ELT pipelines...
-
Senior Data Architect
4 hours ago
Nashik, Maharashtra, India beBeeDataEngineer Full time ₹ 1,86,00,000 - ₹ 2,61,00,000Job Title: Senior Data Engineer - Technical LeadAs a senior data engineer, you will lead the development of large-scale data engineering solutions. Your role encompasses designing and implementing sophisticated data pipelines while mentoring junior engineers.Design and implement data pipelines using Snowflake and other technologies to streamline business...