Azure & Big Data - Lead

2 weeks ago


Delhi NCR Pune, India Iris Software Full time ₹ 1,80,000 - ₹ 3,60,000 per year

Job description:

Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application development engagements.

Title- Azure & Big Data - Lead

Location- Noida/Gurgaon/Pune

Notice: 15 Days OR Immediate joiners only

Mode- Hybrid

Shift: 1:00 PM- 10:00 PM IST

Job Summary:

We are seeking a highly skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have a strong background in designing and deploying scalable data pipelines using Azure technologies, Spark, Flink, and modern data lakehouse architectures. This role demands hands-on technical expertise, leadership in managing offshore teams, and a strategic mindset to drive data-driven decision-making across financial and regulatory domains.

Key Responsibilities:


•    Design, develop, and deploy scalable batch and streaming data pipelines using PySpark, Flink, Scala, SQL, and Redis.

•    Lead migration of complex on-premise workflows to Azure cloud ecosystem (Databricks, ADLS, Azure Data Factory), optimizing infrastructure and deployment processes.

•    Implement performance tuning strategies to reduce job runtimes and enhance data reliability, including optimization of Unity Catalog tables.

•    Collaborate with product stakeholders to deliver high-priority data features and ensure alignment with business goals.

•    Manage and mentor an 8-member offshore team, fostering best practices in data engineering and agile development.

•    Conduct internal training sessions on modern data architecture, cloud-native deployments, and data engineering best practices.

Certifications (Good to have):


•    Databricks Certified: Data Engineer Associate, Lakehouse Fundamentals

•    Microsoft Certified: Azure Fundamentals (AZ-900), Azure Data Fundamentals (DP-900)

Preferred Qualifications:

Sounds like you? Send your CV to me -



  • Delhi, NCR, Pune, India Iris Software Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job description:Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application...


  • Pune, Maharashtra, India Recruin Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Big Data Cloud Architect with 8–12 years in designing and implementing scalable big data solutions on Azure and AWS. The ideal candidate will have deep hands-on expertise in cloud-based big data technologies, a strong background in the software development life cycle (SDLC), and experience in microservices and backend...

  • Big Data Lead

    5 days ago


    Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Designation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...

  • Azure Data Engineer

    1 week ago


    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Azure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data FabricAzure Data Factory (Must Have)Azure Data Bricks (Must Have)Azure fabric (Good to have)Knowledge of Data Processing Flow with Gen AI applicationExperience working with Unstructured data (Must Have)Worked on production with more than 10000 file injection (Must...

  • Azure Data Lead

    4 days ago


    New Delhi, India TVS Next Full time

    What you’ll do:- Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL). - Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) to drive optimal data transformation and organization. - Oversee data governance, access control, and lineage using...

  • Big Data

    1 day ago


    Pune, Maharashtra, India Atgeir Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required Skills:Work closely with customers, understand customer requirements and render those as architectural...

  • Big Data Developer

    2 weeks ago


    Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...

  • Big Data Engineer

    2 days ago


    Pune, India Information Technology Full time

    Big Data EngineerKey Responsibilities :- Build and manage highly scalable Big Data pipelines for large structured datasets.- Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.- Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks.- Develop...

  • Azure Big Data Lead

    3 days ago


    Chennai, Pune, India Hexaware Technologies Full time ₹ 15,00,000 - ₹ 30,00,000 per year

    Are you ready to design, build, and scale next-gen data solutions?Do you thrive on turning data into decisions and guiding teams toward success? What Were Looking For: 10+ years in Datawarehousing & ETL Hands-on with Azure, Databricks, ADF, Synapse, PySpark/Python Strong in STTM (Source-to-Target Mapping), design & documentationmentor at heart who can guide...

  • Big Data Engineer

    1 day ago


    Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...