Databricks - Lead

2 days ago

Noida, Uttar Pradesh, India Iris Software Full time ₹ 20,00,000 - ₹ 25,00,000 per year

About Iris Software

Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Key Responsibilities

  • Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources.
  • Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems.
  • Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs.
  • Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery.
  • Data Strategy & Business Value: Articulate how data solutions create tangible business value, and collaborate with stakeholders to define data-driven strategies.
  • Technical Proficiency: Develop and maintain data solutions using Python and PySpark.
  • Modern Data Formats: Work with open data formats such as Parquet and Iceberg.
  • Resilient Architecture: Implement resilient architecture patterns to ensure high availability and fault tolerance of data systems.
  • Reporting & Analytics: Integrate with various reporting tools to provide business insights. (will be a plus)

Soft Skills

  • Communication & Collaboration: Excellent communication skills with the ability to articulate technical concepts and business value to both technical and non-technical audiences.
  • Personal Attributes: Curious and inquisitive mindset with a passion for continuous learning and problem-solving.

*Mandatory Competencies*

Data Science and Machine Learning - Data Science and Machine Learning - Databricks

DMS - Data Analysis Skills

Big Data - Big Data - Pyspark

Development Tools and Management - Development Tools and Management - CI/CD

Data Science and Machine Learning - Data Science and Machine Learning - Python

Beh - Communication and collaboration

  • Databricks Architect

    2 weeks ago

    Noida, Uttar Pradesh, India Jellyfish Technologies Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position - Databricks ArchitectExperience yearsPosition Summary:We are looking for a Databricks Architect with 8-10 years of experience in designing, building, and optimizing data solutions on the Databricks platform. The ideal candidate will have a deep understanding of Databricks and its core functionalities, including Apache Spark, Delta Lake, and MLflow....

  • Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,40,000 - ₹ 28,00,000

    Job Title: Data Engineer - Databricks ExpertWe are seeking an experienced data engineer to lead our Databricks team in designing and implementing scalable data solutions on the cloud. As a proactive and innovative professional, you will be responsible for architecting efficient data models, collaborating with cross-functional teams, and ensuring the...

  • Principal Consultant- Databricks Developer and ETL

    3 weeks ago

    Noida, Uttar Pradesh, India Genpact Full time

    Job DescriptionGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes thatshape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity,entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose -the relentless pursuit of a world that works better for...

  • Lead Data Operations Analyst

    2 weeks ago

    Noida, Uttar Pradesh, India Xylem Full time US$ 80,000 - US$ 1,50,000 per year

    Xylem is a Fortune 500 global water solutions company dedicated to advancing sustainable impact and empowering the people who make water work every day. As a leading water technology company with 23,000 employees operating in over 150 countries, Xylem is at the forefront of addressing the world's most critical water challenges. We invite passionate...

  • Lead Data Engineer

    2 days ago

    Noida, Uttar Pradesh, India Trantor Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    7+years experienceStrong experience in Azure services (Data Factory, Synapse, ADLS, Blob Storage, Event Hubs, Databricks)Proficiency in SQL (including performance tuning).Strong programming skills (Python / Scala / Java).Data Modeling, Metadata Management, and Data Quality expertise.Experience with Hadoop & Spark for distributed data processing.Experience in...

  • Lead Data Engineer

    2 days ago

    Noida, Uttar Pradesh, India Uplers Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Lead Data Engineer - Azure CloudExperience: Years Exp.Salary: CompetitivePreferred Notice Period: 30 DaysShift: 10:00 AM to 7:00 PM ISTOpportunity Type: Noida (Remote for 6 months, Later Hybrid)Placement Type: Permanent(*Note: This is a requirement for one of Uplers' Clients)Must have skills required :Engineering management, Data Engineering, Azure Data...

  • Azure & Big Data - Lead

    3 weeks ago

    Noida, Uttar Pradesh, India IRIS software Full time

    Job DescriptionWhy Join UsAre you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industryDo you want to do the best work of your life at one of thefastest growing IT services companies Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations It'shappening right hereat Iris...

  • Technical Lead

    2 weeks ago

    Noida, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Data EngineerKey Responsibilities Include Design, Development, And Maintenance Of Scalable Data Pipelines And Systems. Work Closely With Cross-Functional Teams To Understand Data Requirements And Deliver Solutions.The Ideal Candidate Will Have Strong Problem-Solving Skills, Excellent Communication Abilities, And A Bachelor's Degree In Computer...

  • Associate Data Engineering Manager

    2 weeks ago

    Noida, Uttar Pradesh, India UnitedHealth Group Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Optum is a global organization that delivers care, aided by technology to help millions of people live healthier lives. The work you do with our team will directly improve health outcomes by connecting people with the care, pharmacy benefits, data and resources they need to feel their best. Here, you will find a culture guided by inclusion, talented peers,...

  • Advisory Consultant

    2 days ago

    Noida, Uttar Pradesh, India Optum Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    As part of our strategic initiative to build a centralized capability around data and cloud engineering, we are establishing a dedicated Azure Cloud Data Engineering practice under RMI Optum Advisory umbrella. This team will be at the forefront of designing, developing, and deploying scalable data solutions on cloud primarily using Microsoft Azure platform....