Databricks - Lead

1 week ago

Noida, Uttar Pradesh, India Iris Software Full time US$ 1,20,000 - US$ 2,00,000 per year

Our employee value proposition (EVP) is about Being Your Best as a professional and person. It is about being challenged by work that inspires us, being empowered to excel and grow in your career, and being part of a culture where talent is valued. Were a place where everyone can discover and be their best version.

Key Responsibilities

  • Architect and Develop Data Pipelines: Design and implement data pipelines that can handle the 4Vs of data (Volume, Variety, Velocity, Veracity) from diverse sources.
  • Implement CDC: Utilize Change Data Capture (CDC) to efficiently and reliably synchronize data between source and target systems.
  • Build a Medallion Architecture: Design and implement a data platform following the Medallion Architecture (Raw, Refined, Insights) to ensure data quality, manage transformations, and support analytical needs.
  • Orchestrate and Manage Workflows: Develop and manage data orchestration processes to automate data ingestion, transformation, and delivery.
  • Data Strategy & Business Value: Articulate how data solutions create tangible business value, and collaborate with stakeholders to define data-driven strategies.
  • Technical Proficiency: Develop and maintain data solutions using Python and PySpark.
  • Modern Data Formats: Work with open data formats such as Parquet and Iceberg.
  • Resilient Architecture: Implement resilient architecture patterns to ensure high availability and fault tolerance of data systems.
  • Reporting & Analytics: Integrate with various reporting tools to provide business insights. (will be a plus)

Soft Skills

  • Communication & Collaboration: Excellent communication skills with the ability to articulate technical concepts and business value to both technical and non-technical audiences.
  • Personal Attributes: Curious and inquisitive mindset with a passion for continuous learning and problem-solving.

*Mandatory Competencies*

Data Science and Machine Learning - Data Science and Machine Learning - Databricks

DMS - Data Analysis Skills

Big Data - Big Data - Pyspark

Development Tools and Management - Development Tools and Management - CI/CD

Data Science and Machine Learning - Data Science and Machine Learning - Python

Beh - Communication and collaboration

  • Databricks Architect

    2 days ago

    Noida, Uttar Pradesh, India Jellyfish Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position - Databricks ArchitectExperience yearsPosition Summary:We are looking for a Databricks Architect with 8-10 years of experience in designing, building, and optimizing data solutions on the Databricks platform. The ideal candidate will have a deep understanding of Databricks and its core functionalities, including Apache Spark, Delta Lake, and MLflow....

  • Data Engineer(Databricks)

    4 days ago

    Noida, Uttar Pradesh, India Topsoe Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Modern Cloud Data Engineer to enhance Enterprise Analytics Platform and Digital ProductsWe are offering an attractive position for a Data Engineer, to support the digital transformation of Topsoe , towards the strategic company vision of being recognized as a global leader in carbon emission reduction technologies. As part of this journey, we have built a...

  • Project Lead

    1 week ago

    Noida, Uttar Pradesh, India Axtria Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position Summary  The Project Lead will oversee end-to-end data pipeline delivery, manage a team of engineers and analysts, and ensure adherence to Eisai Japan's commercial data modernization objectives. This role is critical in orchestrating high-quality data engineering practices with governance adherence. Job Responsibilities - Lead design,...

  • Data Lead

    1 week ago

    Noida, Uttar Pradesh, India ShyftLabs Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Position Overview:We're looking for a hands-on Data Lead to architect and deliver end-to-end data features that power our booking and content management systems. You'll lead a team, own the data pipeline lifecycle, and play a critical role in shaping and scaling our data infrastructure — spanning batch, real-time, and NoSQL environments.ShyftLabs is a...

  • DE - Architect/Tech Lead

    1 week ago

    Noida, Uttar Pradesh, India R Systems Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Your Role and ImpactAzure Databricks, ADF, ADLS Gen2Strong SQL & PythonCloud-native ETL/ELT designData modelling & optimizationCI/CD, performance tuningYour ContributionArchitect end-to-end data platforms on AzureDefine frameworks for data ingestion, transformation, orchestrationLead data Lakehouse design (batch + streaming)Establish data quality &...

  • Data Engineer Lead

    6 days ago

    Noida, Uttar Pradesh, India Vserv Careers Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Profile - Data Engineer LeadExp- 7+ YearsLocation - NoidaWork Mode - HybridSkills - Data Engineering , Team Lead , Snowflake , AWS/Azure , Databricks , DBT , Data Warehousingfor applying you can share your CV on Key ResponsibilitiesData Engineering & Pipeline Development:·      Develop and maintain robust, scalable ETL pipelines to ingest, clean, and...

  • Senior Data Engineer

    1 week ago

    Noida, Uttar Pradesh, India Tekskills Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Job Title: Senior Data Engineer – Azure & DatabricksLocation:Noida (WFO)Skills Required: Digital : Microsoft AzureExperience Range Required: 8 to 10 Years(Rel 7+ yrs)Job Description:Must-HaveLead Back-end development maintenance of Data Quality ProductDesign and develop Data Pipeline using ADF, Databricks and integrate with other Azure ServicesExperience...

  • Java - Lead

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Why Join Iris?Are you ready to do the best work of your career at one ofIndia's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture thattruly values your talent and ambitions?Join Iris Software — one of thefastest-growing IT services companies— whereyou own and shape your success story.About UsAt Iris Software, our...

  • Senior Sales Consultant

    3 days ago

    Noida, Uttar Pradesh, India Jellyfish Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Experience yearsLocation - NoidaThe Role:Jellyfish Technologies is seeking a highly experienced and results-driven Senior Sales Manager to lead our Databricks Platform sales efforts. This individual will be a critical member of our sales team, responsible for developing and executing a strategic sales plan to drive revenue growth and expand our market share...

  • Azure & Big Data - Lead

    1 week ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Why Join Us?Are you inspired to grow your career at one ofIndia's Top 25 Best Workplaces in IT industry?Do you want to do the best work of your life at one of thefastest growing IT services companies? Do you aspire to thrive in an award-winning work culture thatvalues your talent and career aspirations? It'shappening right hereat Iris Software.About Iris...