Affine - Lead Data Engineer - Azure Platform

3 months ago

Gurugram, India Affine Analytics Pvt Ltd Full time

Roles and Responsibilities :

- Resource and Project Timeline Estimation : Accurately estimate project timelines and resource allocation for Azure-based cloud projects.

- Defining Project and Program Management Process : Establish project and program management frameworks for Azure environments.

- Task Prioritization and Resource Management : Allocate tasks across resources by assessing skills and areas for improvement, with a focus on developing resource capabilities.

- Contribution to Organizational Initiatives : Involvement in sales collateral development, proposal design, leading Proof of Concepts, and training teams on Azure cloud technologies.

- Team Leadership : Recruit, train, develop, and supervise a team of Associates & Consultants, with a focus on cloud and data technologies.

- Specialization in Cloud Technologies : Expertise in Azure cloud and data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure-based data solutions.

- End-to-End Data Pipeline Design : Understanding upstream data and designing efficient data pipelines on Azure, building data marts in Synapse Analytics, and making transformed data accessible to downstream applications.

- Data Pipeline Optimization : Build and optimize high-performance data pipelines using Azure Databricks, with ingestion, cleansing, and curation into Azure Data Lake, Azure SQL, or other Azure data platforms using Spark with Python, Scala, or Java.

- Scalable Frameworks : Develop scalable, reusable frameworks for data ingestion and transformation, leveraging Azurenative services like Azure Data Factory and Azure Functions.

- Data Quality Assurance : Ensure data quality and integrity across the entire Azure data pipeline, implementing robust validation and cleansing mechanisms.

- Data Warehouse/Mart Design : Experience designing and building data warehouses or data marts using Azure Synapse or SQL Database.

- RDBMS Expertise : Strong knowledge of SQL Server, able to write and understand complex SQL queries.

- Documentation & Agile Delivery : Expertise in requirement gathering, technical design, and functional documentation, proven experience delivering projects using Agile frameworks (Scrum, Kanban).

- Client and Stakeholder Engagement : Lead discussions with clients and stakeholders, including on-site and remote engagements.

- Problem Solving and Adaptability: Strong analytical skills and the ability to quickly adapt to new challenges and technologies.

- Communication Skills : Excellent verbal and written communication skills.

Experience : 10 to 15 years of relevant experience in data engineering, with a focus on Azure-based cloud and data projects.

Technical Capabilities :

- Cloud Expertise : Experience managing projects on Azure Data Services, including Azure Data Lake, Azure Synapse Analytics, and Azure Databricks.

- Programming Languages : Expertise in Python, PySpark

- Databricks : Extensive experience working with Databricks on Azure.

- Database Expertise : Proficiency in SQL, with knowledge of SQL Server and Azure Cosmos DB (NoSQL).

- ETL/ELT Processes : Deep understanding of ETL/ELT processes and how to implement them using Azure Data Factory.

- DevOps & CI/CD Pipelines : Knowledge of CI/CD pipelines and DevOps practices using Azure DevOps or GitHub Actions.

- Agile Tools : Familiarity with Jira or similar tools used in agile environments.


Location : Gurugram - Hybrid Mode

(ref:hirist.tech)

  • Affine - Lead Data Engineer - Azure Platform

    1 month ago

    Gurgaon/Gurugram, India Affine Analytics Pvt Ltd Full time

    Roles and Responsibilities :- Resource and Project Timeline Estimation : Accurately estimate project timelines and resource allocation for Azure-based cloud projects.- Defining Project and Program Management Process : Establish project and program management frameworks for Azure environments.- Task Prioritization and Resource Management : Allocate tasks...

  • Lead Data Engineer

    1 month ago

    Gurugram, India Renovate Career Management Services Full time

    Key Responsibilities :1. Team Leadership :- Lead and mentor a team of Azure Data Engineers, providing technical guidance, support, and direction.- Foster a collaborative and innovative team environment.- Conduct regular performance reviews, setting development goals for team members.- Organize training sessions to enhance team skills and technical...

  • Data Engineer

    6 months ago

    Gurugram, India BayOne Solutions Full time

    Work from office - 3 days/Week Location: Bangalore/Gurgaon Job Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional...

  • Data Engineer

    3 months ago

    gurugram, India BayOne Solutions Full time

    Work from office- 3 days/WeekLocation: Bangalore/GurgaonJob Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional data...

  • Data Engineer

    1 month ago

    Gurugram, India Consultancy Full time

    We are looking for a talented Data Engineer to join our growing team. The ideal candidate will have experience working with large datasets, designing and implementing robust data pipelines, and leveraging modern data engineering technologies like PySpark, Azure, Azure Data Factory (ADF), Databricks, ETL processes, and SQL. You will be responsible for...

  • Lead Platform Engineer

    1 month ago

    Gurugram, India Mastek Full time

    Greetings from Mastek!We have an exciting opportunity for you!We are seeking a Lead Platform Engineer (Azure Kubernetes Services) to be part of our US ODC. Sharing below the JD, please apply if you are interested. Job Location : Gurgaon, Noida, Chennai, Mumbai, Pune and Bangalore Experience : 7-12 years Shift Timing : 3:30 PM - 12:30 AM IST What You'll...

  • Lead Platform Engineer

    1 month ago

    Gurugram, India Mastek Full time

    Greetings from Mastek! We have an exciting opportunity for you! We are seeking a Lead Platform Engineer (Azure Kubernetes Services) to be part of our US ODC. Sharing below the JD, please apply if you are interested. Job Location : Gurgaon, Noida, Chennai, Mumbai, Pune and Bangalore Experience : 7-12 years Shift Timing : 3:30 PM - 12:30 AM IST What...

  • Lead Platform Engineer

    1 month ago

    Gurugram, India Mastek Full time

    Greetings from Mastek!We have an exciting opportunity for you!We are seeking a Lead Platform Engineer (Azure Kubernetes Services) to be part of our US ODC. Sharing below the JD, please apply if you are interested. Job Location : Gurgaon, Noida, Chennai, Mumbai, Pune and Bangalore Experience : 7-12 years Shift Timing : 3:30 PM - 12:30 AM IST What You'll...

  • Azure Data Engineer

    4 days ago

    Gurugram, India RapidBrains Full time

    Job Title: Azure Data EngineerExperience: 5-6 YearsLocation: GurgaonContract Duration: 6+ MonthsWork Time: IST ShiftJob DescriptionWe are seeking an Azure Data Engineer with expertise in Databricks to join our team. The ideal candidate will manage and optimize data pipelines, build scalable data solutions, and leverage Azure services and Databricks for data...

  • Azure Data Engineer

    4 days ago

    Gurugram, India RapidBrains Full time

    Job Title: Azure Data EngineerExperience: 5-6 YearsLocation: GurgaonContract Duration: 6+ MonthsWork Time: IST ShiftJob DescriptionWe are seeking an Azure Data Engineer with expertise in Databricks to join our team. The ideal candidate will manage and optimize data pipelines, build scalable data solutions, and leverage Azure services and Databricks for data...

  • Azure Data Engineer

    4 days ago

    Gurugram, India RapidBrains Full time

    Job Title: Azure Data Engineer Experience: 5-6 Years Location: Gurgaon Contract Duration: 6+ Months Work Time: IST Shift Job Description We are seeking an Azure Data Engineer with expertise in Databricks to join our team. The ideal candidate will manage and optimize data pipelines, build scalable data solutions, and leverage Azure services and...

  • Azure Data Engineer

    2 months ago

    Gurugram, India Randstad Digital Full time

    Hiring for Data Engineer role with Randstad.Skills : Python, Pyspark, SQL, AzureExperience : 2-6 YearsLocation : Gurgaon (WFO)Need only Immediate Joiners.Job Description : As a Data Engineer at [Company Name], you will work closely with data scientists, analysts, and business teams to build robust, scalable, and efficient data pipelines. You will be...

  • Azure Data Engineer

    2 months ago

    gurugram, India ProcDNA Full time

    About ProcDNAProcDNA is a global consulting firm. We fuse design thinking with cutting-edge technology to create game-changing Commercial Analytics and Technology solutions for our clients. We're a passionate team of 200+ across 6 offices, all growing and learning together since our launch during the pandemic. Here, you won't be stuck in a cubicle - you'll...

  • Azure Data Engineer

    2 months ago

    gurugram, India ProcDNA Full time

    About ProcDNA ProcDNA is a global consulting firm. We fuse design thinking with cutting-edge technology to create game-changing Commercial Analytics and Technology solutions for our clients. We're a passionate team of 200+ across 6 offices, all growing and learning together since our launch during the pandemic. Here, you won't be stuck in a cubicle - you'll...

  • Azure Data Engineer

    2 months ago

    Gurugram, India ProcDNA Full time

    About ProcDNA ProcDNA is a global consulting firm. We fuse design thinking with cutting-edge technology to create game-changing Commercial Analytics and Technology solutions for our clients. We're a passionate team of 200+ across 6 offices, all growing and learning together since our launch during the pandemic. Here, you won't be stuck in a cubicle - you'll...

  • Data Engineer

    1 month ago

    Delhi NCR/Gurgaon/Gurugram, India Drimlite Full time

    Job Description :- Design and build data pipelines using Spark-SQL and PySpark in Azure DatabricksJob Description : - Design and build ETL pipelines using ADF- Build and maintain a Lakehouse architecture in ADLS / Databricks.- Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.- Work with DevOps team to...

  • Azure Power | Electrical Design Engineer

    2 days ago

    gurugram, India Azure Power Full time

    Perform PVsyst simulations to assess plant performance and energy output for the operational portfolio, bidding processes, resource assessments, and technology selection. Maintaining the Solar Resource Database of the company Conduct due diligence and evaluate various technologies for PV modules and inverters. Prepare DC calculations to optimize system...

  • Azure Power | Electrical Design Engineer

    2 days ago

    gurugram, India Azure Power Full time

    Perform PVsyst simulations to assess plant performance and energy output for the operational portfolio, bidding processes, resource assessments, and technology selection.Maintaining the Solar Resource Database of the companyConduct due diligence and evaluate various technologies for PV modules and inverters.Prepare DC calculations to optimize system...

  • Azure Data Engineer

    1 month ago

    Gurugram, India Status Neo Full time

    Roles and Responsibilities :Azure Data Engineering : - Design, develop, and maintain data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services. - Implement data storage solutions leveraging Azure SQL Database, Azure Data Lake, and other relevant Azure services. - Ensure data integration and ETL processes are optimized for...

  • RapidBrains | Azure Data Engineer

    2 days ago

    gurugram, India RapidBrains Full time

    Job Title: Azure Data Engineer Experience: 5-6 Years Location: Gurgaon Contract Duration: 6+ Months Work Time: IST Shift Job Description We are seeking an Azure Data Engineer with expertise in Databricks to join our team. The ideal candidate will manage and optimize data pipelines, build scalable data solutions, and leverage Azure services and...