Azure Data Engineer
15 hours ago
Description:
About the Opportunity :
We are seeking an experienced Azure Data Engineer to design and implement large-scale, cloud-based data solutions leveraging the Microsoft Azure ecosystem. This role is ideal for a data professional with deep expertise in ETL/ELT pipelines, Spark-based processing, and data modeling, who can architect robust, scalable systems for analytics, AI, and business intelligence workloads.
The ideal candidate will have strong technical grounding in Azure Data Factory, Azure Databricks, and ADLS/Blob Storage, along with proven hands-on experience in optimizing distributed data pipelines. This position offers the opportunity to work on complex data challenges and collaborate with multidisciplinary teams that span analytics, data science, and engineering functions.
What Youll Do:
- Design, build, and manage scalable data ingestion and transformation pipelines using Azure Data Factory and Azure Databricks.
- Develop ETL/ELT frameworks for structured and unstructured data, ensuring reliability and maintainability across large-scale environments.
- Write efficient SQL and Python/Scala code for data processing, transformation, and aggregation in Spark.
- Implement Delta Lake architecture for reliable data lakehouse patterns with ACID compliance and schema evolution.
- Manage and optimize data storage solutions using Azure Data Lake Storage (ADLS) and Blob Storage.
- Tune and monitor Spark jobs for performance, cost efficiency, and fault tolerance.
- Support feature engineering, data enrichment, and model deployment workflows in collaboration with data science teams.
- Establish data quality validation, error handling, and automated monitoring mechanisms across data pipelines.
- Integrate data workflows into CI/CD pipelines for continuous delivery and version-controlled releases.
- Document system architecture, transformations, and data lineage to ensure maintainability and transparency.
What You Bring:
to 10 years of professional experience in data engineering or data platform development.
- Proven expertise in Azure Data Factory, Azure Databricks, and Azure Data Lake Storage (ADLS) or Blob Storage.
- Advanced knowledge of SQL and programming in Python or Scala.
- Strong experience with Apache Spark, Delta Lake, and Parquet for large-scale distributed data processing.
- Solid understanding of ETL/ELT pipeline architecture, data transformation, and workflow orchestration.
- Experience with performance tuning, query optimization, and data pipeline scalability in production environments.
- Familiarity with CI/CD processes and DevOps principles for data workloads.
- Strong problem-solving, debugging, and analytical thinking skills with a data-driven mindset.
- Excellent communication and documentation skills for effective collaboration across teams.
Preferred Skills:
- Knowledge of data governance, lineage tracking, and compliance standards in cloud or hybrid environments.
- Understanding of Azure Synapse Analytics, Power BI, or other Azure data services.
- Exposure to data security frameworks, access control, and encryption mechanisms for enterprise data systems.
-
Azure Databricks Engineer
16 hours ago
Others, India Neev Systems Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription : Azure Data Bricks SQL. Azure Data Bricks SQL. by HR Neev Systems. Experience : 5 Years. Location : Hyderabad. Job Description : We are seeking an experienced Azure Databricks SQL Developer / Big Data Engineer to design, develop, and maintain scalable data solutions on Azure. The role will focus on building efficient ETL/ELT...
-
Senior Data Engineer
5 days ago
Others, India ResourceTree Global Services Pvt Ltd Full time ₹ 5,00,000 - ₹ 15,00,000 per yearJob Name : Senior Data Engineer Azure Years of Experience : 5 Job Description : We are looking for a skilled and experienced Senior Azure Developer to join our team As part of the team, you will be involved in the implementation of the ongoing and new initiatives for our company. If you love learning, thinking strategically, innovating, and helping others,...
-
Data Engineer
4 days ago
Others, India Yo Hr Consultancy Full time ₹ 5,00,000 - ₹ 25,00,000 per yearExperience : 6 to 10 Years.Qualifications : Required Qualifications : - 5 to 8 years of experience in data engineering roles, with 3+ years of hands-on experience working with Snowflake and dbt in production environments. - Proven experience building and deploying dbt models in production. - Expert SQL skills and strong understanding of ELT...
-
Senior Data Engineer
3 days ago
Others, India ResourceTree Global Services Pvt Ltd Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany Description : ResourceTree Global Services Pvt Ltd. (ResourceTree) is a Talent Builder focused on offering careers to professionals across various industries such as IT, Manufacturing, Services, Banking, Agri-tech, Edu-tech, and more. With over 7 years of experience, ResourceTree has helped clients hire top-tier talent by utilizing multi-pronged...
-
Lead Data Engineer
5 days ago
Others, India ResourceTree Global Services Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Name : Lead Data Engineer - AWS RedShift Years of Experience : 8 Job Description : We are seeking a highly skilled and motivated Lead Data Engineer to join our Data Integration and Analytics team. The ideal candidate will bring deep expertise in AWS Redshift, with strong knowledge of Redshift architecture, query performance tuning, and workload...
-
Data Engineer
16 hours ago
Others, India VIPANY GLOBAL SOLUTIONS PRIVATE LIMITED Full time ₹ 65,00,000 - ₹ 2,00,00,000 per yearResponsibilities for Data Engineer : - Create and maintain optimal data pipeline architecture, assemble large, complex data sets that meet functional / non-functional business requirements using Python and SQL / AWS / Snowflakes. - Identify, design, and implement internal process improvements through: automating manual processes using Python, optimizing...
-
Senior Data Engineer
3 days ago
Others, India ResourceTree Global Services Pvt Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per yearYears of Experience : 6 Job Description : We are seeking an experienced and detail-oriented Senior Data Engineer with strong expertise in QA process automation for data validation and testing. The ideal candidate will bring hands-on experience with QuerySurge and a solid foundation in ETL/ELT processes, data integration, and data quality assurance. In this...
-
Softobiz - Data Engineer - Synapse Analytics
16 hours ago
Others, India softobiz technologies Pvt ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDescription : Job Title : Data Engineer. Experience : 8 years. Career-defining role available with Tier 1 Blue Chip Australian Client. As a Data Engineer, you will be involved in all phases of the software development life cycle, collecting and documenting business requirements, prototyping solutions, development, deployment, and ongoing...
-
Others, India I2K2 Networks (P) Limited Full time ₹ 15,00,000 - ₹ 25,00,000 per yearPosition : Azure DevOps Engineer Experience : 2 to 5 Years Must Have : Strong in-hand experience in Azure, DevOps, Linux, Windows, Active Directory, IIS, etc. Location : Noida Sector 63 (Work From Office) Working Days : 5 Notice Period : LOOKING FOR IMMEDIATE TO 15 DAYS JOINERS. Job Description : A technical L2 role wherein a...
-
Senior Data Platform Engineer
19 hours ago
Others, India Cognite Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Description : Function : Software Engineering Backend Development SparkSpark Streaming Cognite is revolutionising industrial data management through our flagship product, Cognite Data Fusion - a state-of-the-art SaaS platform that transforms how industrial companies leverage their data. We're seeking a Senior Data Platform Engineer who excels...