Azure & Big Data - Lead
2 weeks ago
Job description:
Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application development engagements.
Title- Azure & Big Data - Lead
Location- Noida/Gurgaon/Pune
Notice: 15 Days OR Immediate joiners only
Mode- Hybrid
Shift: 1:00 PM- 10:00 PM IST
Job Summary:
We are seeking a highly skilled and experienced Lead Data Engineer to join our data engineering team. The ideal candidate will have a strong background in designing and deploying scalable data pipelines using Azure technologies, Spark, Flink, and modern data lakehouse architectures. This role demands hands-on technical expertise, leadership in managing offshore teams, and a strategic mindset to drive data-driven decision-making across financial and regulatory domains.
Key Responsibilities:
• Design, develop, and deploy scalable batch and streaming data pipelines using PySpark, Flink, Scala, SQL, and Redis.
• Lead migration of complex on-premise workflows to Azure cloud ecosystem (Databricks, ADLS, Azure Data Factory), optimizing infrastructure and deployment processes.
• Implement performance tuning strategies to reduce job runtimes and enhance data reliability, including optimization of Unity Catalog tables.
• Collaborate with product stakeholders to deliver high-priority data features and ensure alignment with business goals.
• Manage and mentor an 8-member offshore team, fostering best practices in data engineering and agile development.
• Conduct internal training sessions on modern data architecture, cloud-native deployments, and data engineering best practices.
Certifications (Good to have):
• Databricks Certified: Data Engineer Associate, Lakehouse Fundamentals
• Microsoft Certified: Azure Fundamentals (AZ-900), Azure Data Fundamentals (DP-900)
Preferred Qualifications:
Sounds like you? Send your CV to me -
-
Azure & Big Data Engineer
5 days ago
Delhi, NCR, Pune, India Iris Software Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob description:Iris Software has been a trusted software engineering partner to several Fortune 500 companies for over three decades. We help clients realize the full potential of technology-enabled transformation by bringing together a unique blend of domain knowledge, best-of-breed technologies, and experience executing essential and critical application...
-
Big Data Cloud Architect
7 days ago
Pune, Maharashtra, India Recruin Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are seeking an experienced Big Data Cloud Architect with 8–12 years in designing and implementing scalable big data solutions on Azure and AWS. The ideal candidate will have deep hands-on expertise in cloud-based big data technologies, a strong background in the software development life cycle (SDLC), and experience in microservices and backend...
-
Big Data Lead
5 days ago
Pune, Maharashtra, India Populace World Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDesignation: Big Data Lead/ArchitectLocation: PuneExperience: 8-10 yearsNP - immediate joiner/15-30 days' noticeJob OverviewWe are looking to hire a talented big data engineer to develop and manage our company's Big Data solutions. In this role, you will be required to design and implement Big Data tools and frameworks, implement ELT processes, collaborate...
-
Azure Data Engineer
1 week ago
Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per yearAzure Data Engineer with expertise in Azure Data Factory, Azure Databricks, and Azure Data FabricAzure Data Factory (Must Have)Azure Data Bricks (Must Have)Azure fabric (Good to have)Knowledge of Data Processing Flow with Gen AI applicationExperience working with Unstructured data (Must Have)Worked on production with more than 10000 file injection (Must...
-
Azure Data Lead
4 days ago
New Delhi, India TVS Next Full timeWhat you’ll do:- Lead the design, development, and maintenance of scalable data pipelines and lakehouse architectures using Azure Databricks (PySpark, SQL). - Architect and implement Medallion Architecture (Bronze, Silver, Gold layers) to drive optimal data transformation and organization. - Oversee data governance, access control, and lineage using...
-
Big Data
1 day ago
Pune, Maharashtra, India Atgeir Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMinimum Experience: 10 YearsWe are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team. The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required Skills:Work closely with customers, understand customer requirements and render those as architectural...
-
Big Data Developer
2 weeks ago
Pune, Maharashtra, India Wroots Global Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob Title: Big Data Engineer / Software EngineerLocation: Pune Kharadi (Client Location) | WFO 3 days a weekExperience: 6 to 10 yearsJob Description:We are hiring an experienced Software Engineer with strong expertise in big data and cloud technologies.Key Skills:Hands-on experience in Scala / Java / PythonStrong knowledge of Big Data technologies: Spark,...
-
Big Data Engineer
2 days ago
Pune, India Information Technology Full timeBig Data EngineerKey Responsibilities :- Build and manage highly scalable Big Data pipelines for large structured datasets.- Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.- Participate in design discussions and contribute to selecting, integrating, and maintaining Big Data frameworks.- Develop...
-
Azure Big Data Lead
3 days ago
Chennai, Pune, India Hexaware Technologies Full time ₹ 15,00,000 - ₹ 30,00,000 per yearAre you ready to design, build, and scale next-gen data solutions?Do you thrive on turning data into decisions and guiding teams toward success? What Were Looking For: 10+ years in Datawarehousing & ETL Hands-on with Azure, Databricks, ADF, Synapse, PySpark/Python Strong in STTM (Source-to-Target Mapping), design & documentationmentor at heart who can guide...
-
Big Data Engineer
1 day ago
Pune, Maharashtra, India Funic Tech Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Opening: Big Data EngineerLocation: Aundh, Pune (Work From Office)Job Type: Full-Time | General Shift | Monday – FridayKey ResponsibilitiesBuild and manage highly scalable Big Data pipelines for large structured datasets.Collaborate with Product Management & Engineering leadership to design and implement optimal solutions.Participate in design...