Azure & Big Data - Lead

6 days ago

Delhi NCR Pune, India Iris Software Full time ₹ 1,80,000 - ₹ 3,60,000 per year

Job description:

Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application development engagements.

Title- Azure & Big Data - Lead

Location- Noida/Gurgaon/Pune

Notice: 15 Days OR Immediate joiners only

Mode- Hybrid

Shift: 1:00 PM- 10:00 PM IST

Job Summary:

We are seeking a highly skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have a strong background in designing and deploying scalable data pipelines using Azure technologies, Spark, Flink, and modern data lakehouse architectures. This role demands hands-on technical expertise, leadership in managing offshore teams, and a strategic mindset to drive data-driven decision-making across financial and regulatory domains.

Key Responsibilities:


•    Design, develop, and deploy scalable batch and streaming data pipelines using PySpark, Flink, Scala, SQL, and Redis.

•    Lead migration of complex on-premise workflows to Azure cloud ecosystem (Databricks, ADLS, Azure Data Factory), optimizing infrastructure and deployment processes.

•    Implement performance tuning strategies to reduce job runtimes and enhance data reliability, including optimization of Unity Catalog tables.

•    Collaborate with product stakeholders to deliver high-priority data features and ensure alignment with business goals.

•    Manage and mentor an 8-member offshore team, fostering best practices in data engineering and agile development.

•    Conduct internal training sessions on modern data architecture, cloud-native deployments, and data engineering best practices.

Certifications (Good to have):


•    Databricks Certified: Data Engineer Associate, Lakehouse Fundamentals

•    Microsoft Certified: Azure Fundamentals (AZ-900), Azure Data Fundamentals (DP-900)

Preferred Qualifications:

Sounds like you? Send your CV to me -

  • Engineering Manager – Big Data, Azure

    2 weeks ago

    Delhi, India DataE2E Technologies Full time

    Job Title: Engineering Manager – Big Data, Azure & DatabricksLocation: RemoteEmployment Type: Full-timeDepartment: Data Engineering / TechnologyExperience: 8+ years (3+ years in a managerial role)Salary - 30 LPAAbout the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure,...

  • Big Data

    6 days ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    3 days ago

    Pune, India Talent Worx Full time

    We’re hiring for one of the world’s leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate...

  • Azure Data Engineer

    2 days ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data FabricAzure Data Factory (Must Have)Azure Data Bricks (Must Have)Azure fabric (Good to have)Knowledge of Data Processing Flow with Gen AI applicationExperience working with Unstructured data (Must Have)Worked on production with more than 10000 file injection (Must...

  • Azure Data Bricks

    2 weeks ago

    Pune, India Chaitanya Placement Agency Full time

    **Company Overview**: Chaitanya Placement Agency is a renowned recruitment agency operating in the IT industry. We specialize in connecting highly skilled professionals with top-notch companies. Our client, a multinational IT firm, is currently seeking a Big Data Lead with at least 7 years of experience. This is a permanent role, and the position is...

  • Big Data Lead

    3 days ago

    Pune, India Populace World Solutions Full time

    Designation: Big Data Lead Location: Pune Experience: 8-10 years Reports To Product Engineering Head Job Overview We are looking to hire a talented big data engineer to develop and manage our companys Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate with...

  • Big Data Lead

    3 days ago

    Pune, India Populace World Solutions Full time

    Designation: Big Data Lead Location: Pune Experience: 8-10 years Reports To Product Engineering Head Job Overview We are looking to hire a talented big data engineer to develop and manage our companys Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes,...

  • Lead Data Engineer –Azure

    4 days ago

    Pune, Maharashtra, India Admin Looks Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...