Affine - Lead Data Engineer - Azure Platform

1 month ago

Gurugram, India Affine Analytics Pvt Ltd Full time

Roles and Responsibilities :

- Resource and Project Timeline Estimation : Accurately estimate project timelines and resource allocation for Azure-based cloud projects.

- Defining Project and Program Management Process : Establish project and program management frameworks for Azure environments.

- Task Prioritization and Resource Management : Allocate tasks across resources by assessing skills and areas for improvement, with a focus on developing resource capabilities.

- Contribution to Organizational Initiatives : Involvement in sales collateral development, proposal design, leading Proof of Concepts, and training teams on Azure cloud technologies.

- Team Leadership : Recruit, train, develop, and supervise a team of Associates & Consultants, with a focus on cloud and data technologies.

- Specialization in Cloud Technologies : Expertise in Azure cloud and data services such as Azure Data Factory, Azure Databricks, Azure Synapse Analytics, and other Azure-based data solutions.

- End-to-End Data Pipeline Design : Understanding upstream data and designing efficient data pipelines on Azure, building data marts in Synapse Analytics, and making transformed data accessible to downstream applications.

- Data Pipeline Optimization : Build and optimize high-performance data pipelines using Azure Databricks, with ingestion, cleansing, and curation into Azure Data Lake, Azure SQL, or other Azure data platforms using Spark with Python, Scala, or Java.

- Scalable Frameworks : Develop scalable, reusable frameworks for data ingestion and transformation, leveraging Azurenative services like Azure Data Factory and Azure Functions.

- Data Quality Assurance : Ensure data quality and integrity across the entire Azure data pipeline, implementing robust validation and cleansing mechanisms.

- Data Warehouse/Mart Design : Experience designing and building data warehouses or data marts using Azure Synapse or SQL Database.

- RDBMS Expertise : Strong knowledge of SQL Server, able to write and understand complex SQL queries.

- Documentation & Agile Delivery : Expertise in requirement gathering, technical design, and functional documentation, proven experience delivering projects using Agile frameworks (Scrum, Kanban).

- Client and Stakeholder Engagement : Lead discussions with clients and stakeholders, including on-site and remote engagements.

- Problem Solving and Adaptability: Strong analytical skills and the ability to quickly adapt to new challenges and technologies.

- Communication Skills : Excellent verbal and written communication skills.

Experience : 10 to 15 years of relevant experience in data engineering, with a focus on Azure-based cloud and data projects.

Technical Capabilities :

- Cloud Expertise : Experience managing projects on Azure Data Services, including Azure Data Lake, Azure Synapse Analytics, and Azure Databricks.

- Programming Languages : Expertise in Python, PySpark

- Databricks : Extensive experience working with Databricks on Azure.

- Database Expertise : Proficiency in SQL, with knowledge of SQL Server and Azure Cosmos DB (NoSQL).

- ETL/ELT Processes : Deep understanding of ETL/ELT processes and how to implement them using Azure Data Factory.

- DevOps & CI/CD Pipelines : Knowledge of CI/CD pipelines and DevOps practices using Azure DevOps or GitHub Actions.

- Agile Tools : Familiarity with Jira or similar tools used in agile environments.


Location : Gurugram - Hybrid Mode

(ref:hirist.tech)

  • Affine - Lead Data Engineer - Azure Platform

    1 month ago

    Gurgaon/Gurugram, IN Affine Analytics Pvt Ltd Full time

    Roles and Responsibilities :- Resource and Project Timeline Estimation : Accurately estimate project timelines and resource allocation for Azure-based cloud projects.- Defining Project and Program Management Process : Establish project and program management frameworks for Azure environments.- Task Prioritization and Resource Management : Allocate tasks...

  • Azure Cloud Platform Lead

    5 months ago

    Gurugram, India Virtusa Full time

    Azure Cloud Platform Lead - CREQ192960 Description JOB DESCRIPTION Skill: Lead Software Engineer Role / Tier: - Azure Cloud platform lead/Tier 2 Cloud Platform Specialist Onboard PaaS services into Client Cloud Service Catalogue Continuous involvement during application development lifecycle to ensure proper use of PaaS services that align...

  • Azure Data Engineer/ Azure Data bricks Engineer

    3 weeks ago

    Gurugram, India Damco Solutions Full time

    Job Title: Azure Data Engineer / Azure Data bricks EngineerLocation: Gurgaon / Bangalore / Chennai / Pune Experience Level: 6 - 11 yearsPassport: MandatoryNotice Period: Immediate Joiners or 15-60 DaysJob DescriptionDamco is looking for Data Engineers with expertise in Azure Data services, Python, and big data processing. The ideal candidate should have...

  • Lead Data Engineer

    2 months ago

    Gurgaon/Gurugram, India StorySideUp Full time

    Job Description : We are seeking a passionate, hands-on and experienced Lead Data Engineer to join our Databricks Center of Excellence. You will play a key role in helping customers understand and implement Databricks Lakehouse platform, and to achieve their business goals. The candidate will collaborate with client stakeholders on multiple projects in Big...

  • Data Engineer

    2 months ago

    gurugram, India BayOne Solutions Full time

    Work from office - 3 days/Week Location: Bangalore/Gurgaon Job Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional...

  • Data Engineer

    2 months ago

    gurugram, India BayOne Solutions Full time

    Work from office- 3 days/WeekLocation: Bangalore/GurgaonJob Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional data...

  • Data Engineer

    5 months ago

    Gurugram, India BayOne Solutions Full time

    Work from office - 3 days/Week Location: Bangalore/Gurgaon Job Description: Min 5 years of experience in modern data engineering/data warehousing/data lakes technologies on cloud platforms like Azure, AWS, GCP, Data Bricks etc. Azure experience is preferred over other cloud platforms. 5 years of proven experience with SQL, schema design and dimensional...

  • India Infoline

    2 months ago

    Gurugram, India India Infoline Full time

    Key Responsibilities :- Data Lakehouse Development : Lead the design and implementation of our data lakehouse architecture using Azure and Databricks.- Data Modeling : Develop conceptual, logical, and physical data models utilizing star schema methodologies.- Pipeline Optimization : Build and optimize data pipelines using PySpark and Databricks, ensuring...

  • Lead Platform Engineer

    4 days ago

    Gurugram, India Mastek Full time

    Greetings from Mastek!We have an exciting opportunity for you!We are seeking a Lead Platform Engineer (Azure Kubernetes Services) to be part of our US ODC. Sharing below the JD, please apply if you are interested. Job Location : Gurgaon, Noida, Chennai, Mumbai, Pune and Bangalore Experience : 7-12 years Shift Timing : 3:30 PM - 12:30 AM IST What You'll...

  • Lead Platform Engineer

    5 days ago

    Gurugram, India Mastek Full time

    Greetings from Mastek! We have an exciting opportunity for you! We are seeking a Lead Platform Engineer (Azure Kubernetes Services) to be part of our US ODC. Sharing below the JD, please apply if you are interested. Job Location : Gurgaon, Noida, Chennai, Mumbai, Pune and Bangalore Experience : 7-12 years Shift Timing : 3:30 PM - 12:30 AM IST What...

  • Lead Platform Engineer

    5 days ago

    Gurugram, India Mastek Full time

    Greetings from Mastek!We have an exciting opportunity for you!We are seeking a Lead Platform Engineer (Azure Kubernetes Services) to be part of our US ODC. Sharing below the JD, please apply if you are interested. Job Location : Gurgaon, Noida, Chennai, Mumbai, Pune and Bangalore Experience : 7-12 years Shift Timing : 3:30 PM - 12:30 AM IST What You'll...

  • Senior Azure Data Engineer

    2 months ago

    Gurugram, India Kool KodersOWOW Full time

    Key Responsibilities : Design and Development : - Design, develop, and optimize large-scale data processing pipelines using Databricks on Azure.- Implement ETL processes to ingest and transform data from various sources into our data platform.- Develop scalable and efficient data models to support analytics and reporting needs. Azure Integration : -...

  • Lead Data Engineer

    2 months ago

    Pune/Hyderabad/Gurgaon/Gurugram, India Www.Huquo.com Full time

    Position : Data Engineer / Managed ServiceWork Location : Pune/ Hyderabad / Gurgaon / HybridExperience : 8+ YearsMust have Skills :- Must have proven experience in leading and/or managing a team of data engineers previously.- Strong experience utilising the Microsoft Azure stack for data engineering that is Azure data factory, Data lakes.- Proven experience...

  • India Infoline

    2 months ago

    Gurgaon/Gurugram, IN India Infoline Full time

    Key Responsibilities :- Data Lakehouse Development : Lead the design and implementation of our data lakehouse architecture using Azure and Databricks.- Data Modeling : Develop conceptual, logical, and physical data models utilizing star schema methodologies.- Pipeline Optimization : Build and optimize data pipelines using PySpark and Databricks, ensuring...

  • Eucloid - Data Engineer - Azure Databricks

    6 months ago

    Gurgaon/Gurugram/Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Description - Data Engineer (Databricks)About Eucloid : Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for...

  • Azure Data Engineer

    6 days ago

    Gurugram, India Randstad Digital Full time

    Hiring for Data Engineer role with Randstad.Skills : Python, Pyspark, SQL, AzureExperience : 2-6 YearsLocation : Gurgaon (WFO)Need only Immediate Joiners.Job Description : As a Data Engineer at [Company Name], you will work closely with data scientists, analysts, and business teams to build robust, scalable, and efficient data pipelines. You will be...

  • Azure Data Engineer

    3 weeks ago

    gurugram, India IGT Solutions Full time

    Role: Senior Azure Data Engineer Primary Skills: Data Engineer, Azure, Python, Pyspark, Databrick, Datalake, Delta Table, Lake House. Experience: - 7- 10 Year Location: - Hybrid (Gurgaon) Job Description: 7+ years of experience in data engineering, with a focus on Azure Databricks and Spark. Proficiency in Python and PySpark for data processing and...

  • Lead Data Architect

    6 months ago

    Gurugram, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing!Role Overview:If you are an extraordinary developer and who loves to push the boundaries to solve complex business problems using creative solutions, then we wish to talk with you. As a Data Architect - Azure, you will work in the Technology team that helps deliver our Data...

  • Data Engineer

    2 months ago

    Delhi NCR/Gurgaon/Gurugram, IN Drimlite Full time

    Job Description :- Design and build data pipelines using Spark-SQL and PySpark in Azure DatabricksJob Description :- Design and build ETL pipelines using ADF- Build and maintain a Lakehouse architecture in ADLS / Databricks.- Perform data preparation tasks including data cleaning, normalization, deduplication, type conversion etc.- Work with DevOps team to...

  • Azure Data Engineer

    3 weeks ago

    gurugram, India ProcDNA Full time

    About ProcDNA ProcDNA is a global consulting firm. We fuse design thinking with cutting-edge technology to create game-changing Commercial Analytics and Technology solutions for our clients. We're a passionate team of 200+ across 6 offices, all growing and learning together since our launch during the pandemic. Here, you won't be stuck in a cubicle - you'll...