Databricks - Lead

7 days ago

Noida, Uttar Pradesh, India Iris Software Full time US$ 1,20,000 - US$ 2,00,000 per year

Our employee value proposition (EVP) is about Being Your Best as a professional and person. It is about being challenged by work that inspires us, being empowered to excel and grow in your career, and being part of a culture where talent is valued. Were a place where everyone can discover and be their best version.

Key Responsibilities

  • Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources.
  • Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems.
  • Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs.
  • Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery.
  • Data Strategy & Business Value: Articulate how data solutions create tangible business value, and collaborate with stakeholders to define data-driven strategies.
  • Technical Proficiency: Develop and maintain data solutions using Python and PySpark.
  • Modern Data Formats: Work with open data formats such as Parquet and Iceberg.
  • Resilient Architecture: Implement resilient architecture patterns to ensure high availability and fault tolerance of data systems.
  • Reporting & Analytics: Integrate with various reporting tools to provide business insights. (will be a plus)

Soft Skills

  • Communication & Collaboration: Excellent communication skills with the ability to articulate technical concepts and business value to both technical and non-technical audiences.
  • Personal Attributes: Curious and inquisitive mindset with a passion for continuous learning and problem-solving.

*Mandatory Competencies*

Data Science and Machine Learning - Data Science and Machine Learning - Databricks

DMS - Data Analysis Skills

Big Data - Big Data - Pyspark

Development Tools and Management - Development Tools and Management - CI/CD

Data Science and Machine Learning - Data Science and Machine Learning - Python

Beh - Communication and collaboration

  • Data Engineer

    12 hours ago

    Noida, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,40,000 - ₹ 28,00,000

    Job Title: Data Engineer - Databricks ExpertWe are seeking an experienced data engineer to lead our Databricks team in designing and implementing scalable data solutions on the cloud. As a proactive and innovative professional, you will be responsible for architecting efficient data models, collaborating with cross-functional teams, and ensuring the...

  • Principal Consultant- Databricks Developer and ETL

    1 week ago

    Noida, Uttar Pradesh, India Genpact Full time

    Job DescriptionGenpact (NYSE: G) is a global professional services and solutions firm delivering outcomes thatshape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity,entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose -the relentless pursuit of a world that works better for...

  • Technical Data Engineering Lead

    7 days ago

    Noida, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Principal Consultant - Technical Project ManagerWe are seeking a seasoned professional to lead data engineering projects with a focus on Databricks and Agile methodologies.The ideal candidate will have strong leadership skills to inspire and motivate teams, excellent communication abilities for effective collaboration with stakeholders, and proficient...

  • Data Lead

    4 days ago

    Noida, Uttar Pradesh, India ShyftLabs Full time US$ 1,25,000 - US$ 1,75,000 per year

    Position Overview:We're looking for a hands-on Data Lead to architect and deliver end-to-end data features that power our booking and content management systems. You'll lead a team, own the data pipeline lifecycle, and play a critical role in shaping and scaling our data infrastructure — spanning batch, real-time, and NoSQL environments.ShyftLabs is a...

  • DE - Architect/Tech Lead

    6 days ago

    Noida, Uttar Pradesh, India R Systems Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Your Role and ImpactAzure Databricks, ADF, ADLS Gen2Strong SQL & PythonCloud-native ETL/ELT designData modelling & optimizationCI/CD, performance tuningYour ContributionArchitect end-to-end data platforms on AzureDefine frameworks for data ingestion, transformation, orchestrationLead data Lakehouse design (batch + streaming)Establish data quality &...

  • Lead Data Operations Analyst

    2 days ago

    Noida, Uttar Pradesh, India Xylem Full time US$ 80,000 - US$ 1,50,000 per year

    Xylem is a Fortune 500 global water solutions company dedicated to advancing sustainable impact and empowering the people who make water work every day. As a leading water technology company with 23,000 employees operating in over 150 countries, Xylem is at the forefront of addressing the world's most critical water challenges. We invite passionate...

  • Expert Cloud Data Architect

    1 week ago

    Noida, Uttar Pradesh, India beBeeDatabricksEngineer Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Senior Databricks Engineer","We are seeking a proactive Senior Databricks Engineer to design, implement, and optimize data processing pipelines on the Databricks platform. You will be responsible for architecting scalable data solutions, collaborating with cross-functional teams to migrate existing solutions, and ensuring the reliability and...

  • Azure & Big Data - Lead

    1 week ago

    Noida, Uttar Pradesh, India IRIS software Full time

    Job DescriptionWhy Join UsAre you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industryDo you want to do the best work of your life at one of thefastest growing IT services companies Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations It'shappening right hereat Iris...

  • Java - Lead

    7 days ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Why Join Iris?Are you ready to do the best work of your career at one ofIndia's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture thattruly values your talent and ambitions?Join Iris Software — one of thefastest-growing IT services companies— whereyou own and shape your success story.About UsAt Iris Software, our...

  • Data Architecture Specialist

    1 week ago

    Noida, Uttar Pradesh, India beBeeArchitecture Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Technical LeadWe are seeking a highly skilled technical professional to spearhead the development of our enterprise data architecture. As a key member of our organization, you will be responsible for designing and implementing scalable data solutions that drive business growth and improve operational efficiency.About the RoleThe ideal candidate will possess...