Azure & Big Data - Lead

6 days ago

Delhi NCR Pune, India Iris Software Full time ₹ 1,04,000 - ₹ 1,30,878 per year

Job description:

Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application development engagements.

Title- Azure & Big Data - Lead

Location- Noida/Gurgaon/Pune

Notice: 15 Days OR Immediate joiners only

Mode- Hybrid

Shift: 1:00 PM- 10:00 PM IST

Job Summary:

We are seeking a highly skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have a strong background in designing and deploying scalable data pipelines using Azure technologies, Spark, Flink, and modern data lakehouse architectures. This role demands hands-on technical expertise, leadership in managing offshore teams, and a strategic mindset to drive data-driven decision-making across financial and regulatory domains.

Key Responsibilities:


•    Design, develop, and deploy scalable batch and streaming data pipelines using PySpark, Flink, Scala, SQL, and Redis.

•    Lead migration of complex on-premise workflows to Azure cloud ecosystem (Databricks, ADLS, Azure Data Factory), optimizing infrastructure and deployment processes.

•    Implement performance tuning strategies to reduce job runtimes and enhance data reliability, including optimization of Unity Catalog tables.

•    Collaborate with product stakeholders to deliver high-priority data features and ensure alignment with business goals.

•    Manage and mentor an 8-member offshore team, fostering best practices in data engineering and agile development.

•    Conduct internal training sessions on modern data architecture, cloud-native deployments, and data engineering best practices.

Certifications (Good to have):


•    Databricks Certified: Data Engineer Associate, Lakehouse Fundamentals

•    Microsoft Certified: Azure Fundamentals (AZ-900), Azure Data Fundamentals (DP-900)

Preferred Qualifications:

Sounds like you? Send your CV to me -

  • Azure Data Engineer

    2 days ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 5,00,000 - ₹ 8,00,000 per year

    Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data FabricAzure Data Factory (Must Have)Azure Data Bricks (Must Have)Azure fabric (Good to have)Knowledge of Data Processing Flow with Gen AI applicationExperience working with Unstructured data (Must Have)Worked on production with more than 10000 file injection (Must...

  • Big Data

    6 days ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Big Data Developer

    2 weeks ago

    Pune, Maharashtra, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We're hiring for one of the world's leading professional services firms, renowned for its commitment to innovation, excellence, and global impact. With a presence in over 150 countries, this organization provides services across consulting, audit, tax, risk advisory, and financial advisory — helping Fortune 500 companies and governments navigate complex...

  • Lead Big Data Engineer

    7 days ago

    Pune, Maharashtra, India beBeeDataScientist Full time ₹ 10,00,000 - ₹ 12,00,000

    Big Data Architect PositionWe are seeking a skilled Big Data Architect to lead our team's technical efforts.The ideal candidate will have hands-on experience in designing and developing applications using Big Data, DWH, Cloud technologies, ETL, SQL.Expertise in Spark, Hadoop ecosystem components, and cloud platforms (AWS/Azure/GCP)Good knowledge of Shell...

  • Big Data Engineer

    4 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Data ArchitectKey Responsibilities:Design and Implement Big Data Architecture: Develop scalable, secure, and efficient big data architecture in hybrid cloud environments.Collaborate with Cross-Functional Teams: Work with cross-functional teams to develop and maintain data management solutions that meet business requirements.Expertise in Azure...

  • Lead Data Engineer –Azure

    6 days ago

    Pune, Maharashtra, India Admin Looks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Urgently looking for highly experienced Lead Data Engineer with a proven track record in Azure data technologies and team leadership. The ideal candidate will have 12+ years of experience, including 7+ years of expertise in Azure Data Factory, Azure Databricks, Data Modeling, PySpark, SQL Queries, and Unity Catalog. This is a remote role requiring excellent...

  • Big Data Engineer

    1 week ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Data Engineer PositionWe are seeking a highly skilled data engineer to spearhead the development of robust data solutions using Azure Databricks. The ideal candidate will possess a strong background in data engineering and be proficient in leveraging Apache Spark to build efficient data pipelines.Responsibilities include:Data Pipeline Development: Design,...

  • Big Data Engineer

    2 weeks ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer">We are seeking a highly skilled Big Data Engineer to drive the design and implementation of scalable data pipelines using Apache Spark, Databricks, or equivalent big data frameworks. This is an excellent opportunity for experienced professionals to join our organization and leverage their expertise to drive business outcomes through...

  • Lead Data Scientist

    2 weeks ago

    Delhi, Delhi, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Title: Azure Data Engineer Role Overview:We are seeking a highly skilled and experienced Data Engineer to join our team. The successful candidate will be responsible for designing, implementing, and maintaining large-scale data pipelines using Azure Databricks.The ideal candidate will have excellent technical skills, strong problem-solving abilities,...