Lead Engineer

1 day ago

Hyderabad, Telangana, India Rubis Software Solutions Pvt Ltd Full time ₹ 1,20,000 - ₹ 6,00,000 per year
  • Experience needed:
     6-9 years
  • Type:
     Full-Time
  • Mode:
     WFO (5 days office, no Hybrid/Remote possibility)
  • Shift:
    IST
  • Location:
     Hyderabad / Pune / Coimbatore
  • Notice Period:
     Immediate to 15 days or someone serving Notice under 30 days

About the Role

We are looking for a highly skilled
Lead Databricks Engineer
to lead the design, development, and optimization of modern
data engineering and analytics solutions
on the
Databricks Lakehouse platform
.

The ideal candidate will have strong expertise in
data architecture, ETL/ELT pipeline development, and performance optimization
using Databricks (SQL, PySpark, Delta Lake, MLflow), along with leadership experience guiding teams through solution design, implementation, and delivery.

Key Responsibilities

1. Databricks Project Leadership

  • Lead and manage end-to-end
    Databricks implementation projects
    — from requirement gathering, architecture design, and environment setup to deployment and operationalization.
  • Serve as the primary
    technical point of contact
    for stakeholders, data engineering teams, and cloud platform teams.
  • Ensure project alignment with organizational goals, data governance, and performance standards.

2. Architecture & Solution Design

  • Design scalable, secure, and high-performing
    data pipelines
    leveraging
    Databricks, Delta Lake
    , and
    cloud-native services
    (Azure, AWS, or GCP).
  • Define robust
    data ingestion, transformation, and consumption architectures
    integrating multiple data sources (databases, APIs, streams, files, etc.).
  • Establish
    CI/CD pipelines
    for Databricks notebooks and jobs (using Git, Azure DevOps, or similar tools).

3. Technical Implementation & Optimization

  • Develop and maintain
    ETL/ELT pipelines
    using
    PySpark, SQL, and Databricks workflows
    .
  • Configure clusters, optimize compute utilization, and fine-tune query performance for efficiency and cost optimization.
  • Implement
    data quality frameworks
    , monitoring solutions, and automated error-handling logic.

4. Data Governance & Operations

  • Set up
    role-based access control (RBAC)
    , security policies, and
    data lineage
    using
    Unity Catalog
    .
  • Collaborate with
    CloudOps
    and
    DevOps
    teams for environment setup, monitoring, and CI/CD integration.
  • Drive documentation, technical training, and best practices across engineering teams.

Requirements

Required Skills & Experience

  • 6–9 years of total experience in
    data engineering, data platform, or big data projects
    .
  • Minimum
    5 years of hands-on experience
    with
    Databricks (SQL, PySpark, Delta Lake, MLflow)
    .
  • Strong expertise in
    ETL/ELT pipeline design
    ,
    data modeling
    , and
    data warehousing concepts
    .
  • Experience with
    Azure Data Factory, AWS Glue, or similar orchestration tools
    .
  • Proficiency in
    Python, SQL
    , and
    Spark optimization techniques
    .
  • Experience implementing
    DevOps practices (CI/CD, Git, Databricks Repos)
    .
  • Working knowledge of
    data governance frameworks
    ,
    Unity Catalog
    , and
    RBAC
    .
  • Proven ability to
    lead technical teams
    and deliver complex projects successfully.

Preferred Qualifications

  • Databricks Certified Data Engineer Professional
    or
    Solution Architect certification
    .
  • Exposure to
    AI/ML workflows
    and
    model management
    using
    MLflow
    .
  • Experience integrating with
    Power BI, Tableau, or Looker
    for data visualization.
  • Strong communication and presentation skills, with experience in
    client-facing engagements
    .

Soft Skills

  • Excellent
    problem-solving, analytical, and leadership
    abilities.
  • Strong
    collaboration and mentoring
    mindset.
  • Ability to thrive in
    fast-paced, cross-functional environments
    .
  • Clear and structured
    documentation and reporting
    skills.

  • Software Engineer Fresher

    3 days ago

    Hyderabad, Telangana, India Lead Masters AI Full time ₹ 2,00,000 - ₹ 12,00,000 per year

    Internship Opportunity – LeadMasters AI (Dubai-Registered AI Company)About LeadMasters AILeadMasters AI is a Dubai-registered Company operating out of Hyderabad. We build solutions in AI-driven marketing automation, social media management, CRM workflows, and intelligent lead generation. Our mission is to help businesses scale with agentic AI-powered...

  • Tender Executive

    1 day ago

    Hyderabad, Telangana, India Lead feet Full time ₹ 1,50,000 - ₹ 3,00,000 per year

    Contact: Job Title: Tender Executive – Solar DivisionLocation: HyderabadDepartment: Tendering / Business DevelopmentExperience Required: 2–5 years (Preference to candidates from the Solar / Renewable Energy sector)Job Summary:The Tender Executive will be responsible for preparing, reviewing, and submitting tenders, bids, and proposals for solar projects...

  • Engineering Lead

    1 week ago

    Hyderabad, Telangana, India Wise Payments Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Heres how youll be contributing to the team:Lead the Engineering Team that develops Wises products that will be used by Wises Customers to service the Indian market. Disrupt the cross-border industry in India that is hugely dominated by Banks.Design onboarding and money movement solutions tailored to India markets by leveraging local KYC stack and payment...

  • Engineering Lead

    1 day ago

    Hyderabad, Telangana, India Iquest Management Consultants Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Delivery & Release Management: Plan and deliver product features and customer-specific releases on time with high quality, ensuring operational readiness and stability across environments.Technical Design & Architecture: Lead technical design and high-scale architecture for new and existing modules, ensuring scalability, performance, and...

  • Lead Engineer

    5 days ago

    Hyderabad, Telangana, India Edwisely Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    As the Lead Engineer at Edwisely, you will play a pivotal role in shaping the technological landscape of our organization. You will lead a dynamic team of engineers, fostering a culture of collaboration, innovation, and excellence. Your expertise will be crucial in driving the development of scalable and robust solutions.Key Responsibilities:Provide...

  • MERN Stack

    1 week ago

    Hyderabad, Telangana, India Lead Masters AI Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job DescriptionLeadMasters AI is hiring a talentedMERN Stack Software Engineerto join our on-site engineering team in Hyderabad. You'll be building and scaling AI-powered marketing automation platforms used by global businesses — helping industries like healthcare, hospitality, and retail simplify lead generation and advertising through automation and...

  • DV Lead Engineer

    1 week ago

    Hyderabad, Telangana, India Quest Global Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Requirements We are seeking a highly skilled and experienced DV Lead Engineer to join our team. As the DV Lead Engineer, you will be responsible for leading the design verification process for our projects. You will work closely with the engineering team to ensure the successful verification of complex digital designs.Key Responsibilities:- Lead the...

  • DV Lead Engineer

    1 week ago

    Hyderabad, Telangana, India Quest Global Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Requirements We are seeking a highly skilled and experienced DV Lead Engineer to join our team. As the DV Lead Engineer, you will be responsible for leading the design verification process for our projects. You will work closely with the engineering team to ensure the successful verification of complex digital designs. Key Responsibilities: Lead the...

  • Lead Engineer

    7 days ago

    Hyderabad, Telangana, India GE VERNOVA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    **Job Description Summary****We are seeking a dynamic, forward-thinking and results-driven Lead Engineer Embedded SW Development, who will be responsible for designing, developing, and testing Embedded Software (Firmware), platforms and systems that need to be tailored to the needs of the hardware that it controls and runs on. Typically requires a deep...

  • Engineering Lead

    1 week ago

    Hyderabad, Telangana, India Bizacuity Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Title : Engineering Lead Fintech Onboarding Platform. Team Building next-gen onboarding and underwriting tools for UK lenders. Role Type : Full-time, Hands-On Engineering Leadership.The Role :Were looking for a hands-on Engineering Lead who combines technical depth with product intuition.Youll guide a team of junior engineers (currently India-based), set...