Azure Data Engineer Lead

9 hours ago

Any Location, India NOTIONMINDZ TECHNOLOGY LLP Full time ₹ 10,00,000 - ₹ 30,00,000 per year

Job Role: Azure Data Engineer (Lead) Mode: Remote Experience: 7 years Client: U.S.-based Digital Growth company Role Summary We are hiring an experienced Azure Data Engineer with deep hands-on expertise in building highvolume, production-grade data pipelines using Microsoft Azure technologies. This role is critical to supporting a large U.S.-based digital growth client's enterprise-scale data transformation initiatives. The candidate must demonstrate direct experience with Azure Data Factory (ADF) and Azure Synapse (formerly Azure SQL Data Warehouse), specifically handling data volumes exceeding 1TB. Strong skills in SQL (T-SQL), pipeline debugging, and Azure-native orchestration are mandatory. The role includes designing both full-load and incremental ETL/ELT strategies and contributing to real-world RCA/troubleshooting in production workflows. Candidates with exposure to PySpark, JSON/Parquet formats, CI/CD tools, and BFSI domain experience will be preferred. Must-Have Skills - Azure Data Factory (ADF): Independently built complex ADF pipelines handling >1TB data volumes. Used Lookup, If, Set Variable, ForEach, Copy activity. Designed pipelines with parameters, triggers, dynamic datasets, and implemented failover/retry strategies. - Azure Synapse (Dedicated SQL Pool / Azure SQL DW): Managed staging and transformation logic at multi-TB scale. Developed stored procedures, views, and handled large table ingestion in Synapse. Query optimization is not mandatory but scale-handling experience is a must. - Azure Data Lake Gen2 (ADLS): Used ADLS Gen2 as source/sink in ADF. Managed secure folder access, data layout design, and integration with Synapse/ADF pipelines. - SQL / T-SQL (Azure SQL, Synapse): Wrote complex joins, CTEs, indexing, stored procedures, including reconciliation and transformation layers. Hands-on across multiple staging/reporting layers. - ETL Debugging / RCA: Traced failures in ADF/Synapse/SQL. Provided RCA-ready inputs, including logs, failure reproduction steps, and issue isolation across layers. - CI/CD (Git, DevOps Boards): Comfortable with Git version control, branching, merge/pull requests, and Agile story tracking via Azure DevOps or Jira. YAML knowledge is a plus. - Data Format Handling (JSON, Parquet): Parsed and transformed nested JSON, converted to/from Parquet, using ADF dataflows or notebook-based tooling. Familiar with schema-on-read concepts. Nice-to-Have Skills - Azure Databricks / PySpark: Contributed to Spark jobs via notebooks or assisted in PySpark data transformation routines. - Power BI: Assisted in data modeling, report layer readiness, or dashboard support. - Azure Key Vault / Logic Apps: Configured secure secret access, or participated in pipeline orchestration using Logic Apps. SSIS / SAP BW / Teradata: Participated in legacy migration efforts or integrated these as source systems into Azure pipelines.

  • Azure Databricks Consultant

    2 days ago

    Any Location, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Description : Responsibilities : - Technical Leadership : Provide technical leadership, guide, and mentor data engineering teams in designing, developing, and implementing robust and scalable Databricks solutions. - Architecture & Design : Develop and implement scalable data pipelines and architectures using the Databricks Lakehouse platform,...

  • Lead Architect Engineer

    1 week ago

    Any Location, India Careerfit Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Description : Job Title : Lead Architect Engineer (Data). Location : Hybrid/Remote. Job Type : Full-time.About the Role : We are seeking a highly skilled and experienced Lead Architect Engineer (Data) to play a pivotal leadership role in the development, architecture, and engineering of data solutions that underpin key products and services. ...

  • Data Engineer

    7 hours ago

    Any Location, India Narwal Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Description : Position : Data Engineer (Snowflake & Looker Specialist) Experience : 5 - 8 Years of relevant experience Location : India Job Summary : We are seeking an experienced Data Engineer with 58 years of expertise, specializing in advanced data warehousing on Snowflake and delivering sophisticated business intelligence via Looker. This...

  • Data Engineer

    2 weeks ago

    Any Location, India NS Global Corporation Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    We are looking for an experienced GCP Data Engineer with a minimum of 5 years of professional experience in data engineering, cloud-based data solutions, and large-scale distributed systems. This role is fully remote and requires a hands-on professional who can design, build, and optimize data pipelines and solutions on Google Cloud Platform (GCP). Key...

  • Data Engineer

    1 week ago

    Any Location, India Insight Global Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Description : POSITION : GCP Data Engineer. LOCATION : 100% Remote in India. DURATION : 12-Month-Contract Plus Extensions. TARGET START DATE : 11/17/2025. REQUIRED SKILLS & EXPERIENCE : - 6+ Years of experience as a Data Engineer. - Experience with GCP Data (e.g., BigQuery, Cloud Storage, Bigtable, Airflow, Dataproc, Dataflow. - Strong SQL...

  • Generative AI Workflow Engineer

    2 days ago

    Any Location, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Description : Position : Gen AI Workflow Engineer - Power Platform Location : India Duration : 6 MonthsJob Summary : We are seeking a highly skilled and experienced Gen AI Workflow Engineer to design, develop, and deploy intelligent, agentic workflows using the Microsoft Power Platform, specifically integrating with Azure's Generative AI...

  • Data Engineer

    1 week ago

    Any Location, India SkillKart Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About the Role : We are seeking experienced Google Cloud Platform (GCP) Engineers to join our team in building a scalable and robust Model Monitoring Framework. This solution will integrate data from diverse sources including Excel files, SAS datasets, and GCP-native services, with the target architecture fully hosted on Google Cloud Platform.Key...

  • Senior Data Engineer

    4 days ago

    Any Location, India D2KSS Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : About The Role : Were looking for a seasoned Data Engineer to join our Engineering organization and take ownership of the systems that power our data-driven decisions. Youll architect and maintain high-performance data pipelines and databases across platforms like MSSQL, Redshift, and Snowflake - ensuring data is reliable, accessible,...

  • Senior Performance Test Engineer

    25 minutes ago

    Any Location, India FIVE DATA PRODUCTS AND SOLUTIONS PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : Key Responsibilities : - Design, develop, and execute performance, load, stress, and endurance tests using Apache JMeter. - Analyze test results, identify performance bottlenecks, and provide recommendations for tuning and optimization. - Collaborate with development, DevOps, and infrastructure teams to define performance test...

  • Informatica/IICS Engineer

    3 days ago

    Any Location, India HexaCorp Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Description : We are seeking a highly skilled Informatica IICS Engineer with strong technical and functional expertise in data integration, data quality, and cloud-based ETL design. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data workflows across cloud and on-premises environments. ...