Affine - Lead Data Engineer - Azure Platform

2 weeks ago

GurgaonGurugram, India Affine Analytics Pvt Ltd Full time

Roles and Responsibilities :

- Resource and Project Timeline Estimation : Accurately estimate project timelines and resource allocation for Azure-based cloud projects.

- Defining Project and Program Management Process : Establish project and program management frameworks for Azure environments.

- Task Prioritization and Resource Management : Allocate tasks across resources by assessing skills and areas for improvement, with a focus on developing resource capabilities.

- Contribution to Organizational Initiatives : Involvement in sales collateral development, proposal design, leading Proof of Concepts, and training teams on Azure cloud technologies.

- Team Leadership : Recruit, train, develop, and supervise a team of Associates & Consultants, with a focus on cloud and data technologies.

- Specialization in Cloud Technologies : Expertise in Azure cloud and data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure-based data solutions.

- End-to-End Data Pipeline Design : Understanding upstream data and designing efficient data pipelines on Azure, building data marts in Synapse Analytics, and making transformed data accessible to downstream applications.

- Data Pipeline Optimization : Build and optimize high-performance data pipelines using Azure Databricks, with ingestion, cleansing, and curation into Azure Data Lake, Azure SQL, or other Azure data platforms using Spark with Python, Scala, or Java.

- Scalable Frameworks : Develop scalable, reusable frameworks for data ingestion and transformation, leveraging Azurenative services like Azure Data Factory and Azure Functions.

- Data Quality Assurance : Ensure data quality and integrity across the entire Azure data pipeline, implementing robust validation and cleansing mechanisms.

- Data Warehouse/Mart Design : Experience designing and building data warehouses or data marts using Azure Synapse or SQL Database.

- RDBMS Expertise : Strong knowledge of SQL Server, able to write and understand complex SQL queries.

- Documentation & Agile Delivery : Expertise in requirement gathering, technical design, and functional documentation, proven experience delivering projects using Agile frameworks (Scrum, Kanban).

- Client and Stakeholder Engagement : Lead discussions with clients and stakeholders, including on-site and remote engagements.

- Problem Solving and Adaptability: Strong analytical skills and the ability to quickly adapt to new challenges and technologies.

- Communication Skills : Excellent verbal and written communication skills.

Experience : 10 to 15 years of relevant experience in data engineering, with a focus on Azure-based cloud and data projects.

Technical Capabilities :

- Cloud Expertise : Experience managing projects on Azure Data Services, including Azure Data Lake, Azure Synapse Analytics, and Azure Databricks.

- Programming Languages : Expertise in Python, PySpark

- Databricks : Extensive experience working with Databricks on Azure.

- Database Expertise : Proficiency in SQL, with knowledge of SQL Server and Azure Cosmos DB (NoSQL).

- ETL/ELT Processes : Deep understanding of ETL/ELT processes and how to implement them using Azure Data Factory.

- DevOps & CI/CD Pipelines : Knowledge of CI/CD pipelines and DevOps practices using Azure DevOps or GitHub Actions.

- Agile Tools : Familiarity with Jira or similar tools used in agile environments.


Location : Gurugram - Hybrid Mode

(ref:hirist.tech)

  • Affine - Lead Data Engineer - Azure Platform

    2 months ago

    Gurugram, India Affine Analytics Pvt Ltd Full time

    Roles and Responsibilities :- Resource and Project Timeline Estimation : Accurately estimate project timelines and resource allocation for Azure-based cloud projects.- Defining Project and Program Management Process : Establish project and program management frameworks for Azure environments.- Task Prioritization and Resource Management : Allocate tasks...

  • Cloud Data Engineer

    2 weeks ago

    Gurgaon, Haryana, India Affine Analytics Pvt Ltd Full time

    Job DescriptionRole SummaryAs a Cloud Data Engineer - Azure Platform Specialist at Affine Analytics Pvt Ltd, you will be responsible for designing, implementing, and maintaining large-scale data engineering solutions on the Azure platform.Key ResponsibilitiesDesign and develop data pipelines using Azure Data Factory, Azure Databricks, and Azure Synapse...

  • Data Engineer Lead for Azure Cloud Solutions

    4 days ago

    Gurgaon, Haryana, India Affine Analytics Pvt Ltd Full time

    About the RoleWe are seeking a seasoned Data Engineer Lead to spearhead our Azure cloud initiatives, driving innovation and excellence in data engineering. This role offers a unique opportunity to leverage your expertise in designing, building, and optimizing high-performance data pipelines on Azure.

  • Lead Data Engineer

    1 week ago

    Gurugram, India Renovate Career Management Services Full time

    Key Responsibilities :1. Team Leadership :- Lead and mentor a team of Azure Data Engineers, providing technical guidance, support, and direction.- Foster a collaborative and innovative team environment.- Conduct regular performance reviews, setting development goals for team members.- Organize training sessions to enhance team skills and technical...

  • Azure Cloud Platform Lead

    5 months ago

    Gurugram, India Virtusa Full time

    Azure Cloud Platform Lead - CREQ192960 Description JOB DESCRIPTION Skill: Lead Software Engineer Role / Tier: - Azure Cloud platform lead/Tier 2 Cloud Platform Specialist Onboard PaaS services into Client Cloud Service Catalogue Continuous involvement during application development lifecycle to ensure proper use of PaaS services that align...

  • Azure data engineer/ azure data bricks engineer

    1 month ago

    Gurgaon, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks Engineer Location: Gurgaon / Bangalore / Chennai / Pune Experience Level: 6 - 11 years Passport: Mandatory Notice Period: Immediate Joiners or 15-60 Days Job Description Damco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal...

  • Azure Data Engineer/ Azure Data bricks Engineer

    4 weeks ago

    gurgaon, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks EngineerLocation: Gurgaon / Bangalore / Chennai / PuneExperience Level: 6 - 11 yearsPassport: MandatoryNotice Period: Immediate Joiners or 15-60 DaysJob DescriptionDamco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal candidate should have...

  • Azure Data Engineer/ Azure Data bricks Engineer

    4 weeks ago

    gurgaon, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks Engineer Location: Gurgaon / Bangalore / Chennai / Pune Experience Level: 6 - 11 years Passport: Mandatory Notice Period: Immediate Joiners or 15-60 Days Job Description Damco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal candidate...

  • Azure Data Engineer/ Azure Data bricks Engineer

    1 month ago

    gurgaon, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks Engineer Location: Gurgaon / Bangalore / Chennai / Pune Experience Level: 6 - 11 years Passport: Mandatory Notice Period: Immediate Joiners or 15-60 Days Job Description Damco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal candidate should...

  • Azure Data Engineer/ Azure Data bricks Engineer

    1 month ago

    gurgaon, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks EngineerLocation: Gurgaon / Bangalore / Chennai / PuneExperience Level: 6 - 11 yearsPassport: MandatoryNotice Period: Immediate Joiners or 15-60 DaysJob DescriptionDamco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal candidate should have...

  • Azure data engineer/ azure data bricks engineer

    1 month ago

    Gurgaon, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks EngineerLocation: Gurgaon / Bangalore / Chennai / PuneExperience Level: 6 - 11 yearsPassport: MandatoryNotice Period: Immediate Joiners or 15-60 DaysJob DescriptionDamco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal candidate should have...

  • Azure Data Engineer/ Azure Data bricks Engineer

    1 month ago

    Gurgaon, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks EngineerLocation: Gurgaon / Bangalore / Chennai / PuneExperience Level: 6 - 11 yearsPassport: MandatoryNotice Period: Immediate Joiners or 15-60 DaysJob DescriptionDamco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal candidate should have...

  • Azure Data Engineer/ Azure Data bricks Engineer

    4 weeks ago

    gurgaon, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks EngineerLocation: Gurgaon / Bangalore / Chennai / PuneExperience Level: 6 - 11 yearsPassport: MandatoryNotice Period: Immediate Joiners or 15-60 DaysJob DescriptionDamco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal candidate should have...

  • Azure Data Engineer/ Azure Data bricks Engineer

    1 month ago

    Gurugram, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks EngineerLocation: Gurgaon / Bangalore / Chennai / Pune Experience Level: 6 - 11 yearsPassport: MandatoryNotice Period: Immediate Joiners or 15-60 DaysJob DescriptionDamco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal candidate should have...

  • Data Engineer

    2 weeks ago

    Delhi NCR/Gurgaon/Gurugram, India Drimlite Full time

    Job Description :- Design and build data pipelines using Spark-SQL and PySpark in Azure DatabricksJob Description : - Design and build ETL pipelines using ADF- Build and maintain a Lakehouse architecture in ADLS / Databricks.- Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.- Work with DevOps team to...

  • Data Engineer Lead for Azure Services

    2 weeks ago

    Gurgaon, Haryana, India MINDTEL GLOBAL PRIVATE LIMITED Full time

    Job DescriptionWe are seeking an experienced Data Engineer Lead to join our team at MINDTEL GLOBAL PRIVATE LIMITED. This role is responsible for designing, developing, and maintaining robust data pipelines using Azure Data Factory (ADF) to ingest, transform, and load data into data warehouses and data lakes.Key ResponsibilitiesDesign and develop efficient...

  • Data Engineer

    2 months ago

    Gurgaon, India BayOne Solutions Full time

    Work from office - 3 days/Week Location: Bangalore/Gurgaon Job Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional...

  • Data engineer

    2 months ago

    Gurgaon, India BayOne Solutions Full time

    Work from office - 3 days/Week Location: Bangalore/Gurgaon Job Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and...

  • Data Engineer

    1 month ago

    gurgaon, India BayOne Solutions Full time

    Work from office- 3 days/WeekLocation: Bangalore/GurgaonJob Description:Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc.Azure experience is preferred over other cloud platforms.5 years of proven experience with SQL, schema design and dimensional data...

  • Data Engineer

    4 weeks ago

    gurgaon, India BayOne Solutions Full time

    Work from office- 3 days/WeekLocation: Bangalore/GurgaonJob Description:Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc.Azure experience is preferred over other cloud platforms.5 years of proven experience with SQL, schema design and dimensional data...