Sr Data Engineer- Databricks

3 days ago


Bengaluru, Karnataka, India Aptus Data Labs Full time ₹ 15,00,000 - ₹ 20,00,000 per year
Exp- 5 yrs

Location- Remote (Preferred candidates to be in bangalore)

Notice- Looking candidates with to be joining within 30 Days

Key Responsibilities:
  • Design, implement, and optimize scalable data pipelines using Databricks and Apache Spark.

  • Architect data lakes using Delta Lake, ensuring reliable and efficient data storage.

  • Manage metadata, security, and lineage through Unity Catalog for governance and compliance.

  • Ingest and process streaming data using Apache Kafka and real-time frameworks.

  • Collaborate with ML engineers and data scientists on LLM-based AI/GenAI project pipelines.

  • Apply CI/CD and DevOps practices to automate data workflows and deployments (e.g., with GitHub Actions, Jenkins, Terraform).

  • Optimize query performance and data transformations using advanced SQL.

  • Implement and uphold data governance, quality, and access control policies.

  • Support production data pipelines and respond to issues and performance bottlenecks.

  • Contribute to architectural decisions around data strategy and platform scalability.


Requirements Required Skills & Experience:
  • 5 years of experience in data engineering roles.
  • Proven expertise in Databricks, Delta Lake, and Apache Spark (PySpark preferred).
  • Deep understanding of Unity Catalog for fine-grained data governance and lineage tracking.
  • Proficiency in SQL for large-scale data manipulation and analysis.
  • Hands-on experience with Kafka for real-time data streaming.
  • Solid understanding of CI/CD, infrastructure automation, and DevOps principles.
  • Experience contributing to or supporting Generative AI / LLM projects with structured or unstructured data.
  • Familiarity with cloud platforms (AWS, Azure, or GCP) and data services.
  • Strong problem-solving, debugging, and system design skills.
  • Excellent communication and collaboration abilities in cross-functional teams.


  • Sr. Strategy

    4 days ago


    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    FEQ326R387Databricks is looking for a motivated Sr. Strategy and Operations Manager to join our Field Engineering team that helps define Go-To-Market (GTM) strategy, provides strategic analyses and instills operational thoughtfulness to our successful & fast-growing GTM business.You will use data and qualitative information to help our Sales and Field...


  • Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-926At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...


  • Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-926At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...


  • Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    MKTQ326R8At Databricks our mission is to democratize data and AI. We are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure and making it...

  • Sr Recruiter

    1 week ago


    Bengaluru, Karnataka, India Databricks Full time US$ 1,20,000 - US$ 2,00,000 per year

    Databricks is experiencing record-breaking expansion, helping the world's leading enterprises harness the power of data, machine learning, and AI to transform their businesses. As we continue to scale our Professional Services organization in India, we are looking for a Senior Recruiter who will focus on building out high-caliber talent pipelines for roles...


  • Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    P-1407The Applied AI team at Databricks sits at the forefront of advancing AI/ML-powered products. Databricks' customers are continuously creating new assets (tables, notebooks, dashboards, datarooms, pipelines, sql queries, ml models etc.) on the platform. Some of them can have hundreds of millions of assets. Finding an asset is a critical user journey for...


  • Bengaluru, Karnataka, India Databricks Full time US$ 1,25,000 - US$ 1,75,000 per year

    RDQ226R536About The TeamThe Product Security Team at Databricks is responsible for embedding security throughout the Software Development Lifecycle (SDLC). Our mission is toleft-shiftsecurity—ensuring that all code, whether powering customer-facing features or supporting internal infrastructure, is developed with security in mind from the start. By...


  • Bengaluru, Karnataka, India Databricks Full time US$ 1,04,000 - US$ 1,30,878 per year

    SLSQ426R249We are looking for a Sr Manager of sales, Commercial & Mid-Market to join our sales organization. You will oversee and motivate a team of Account Executives, and you will be measured by your team's overall quota attainment, new business acquisition, and expansion into existing customer accounts. This is a team of motivated sellers, so we are...

  • Sr. Incident Manager

    2 weeks ago


    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    CSQ127R23At Databricks, an Incident Manager utilizes their technical experience and resourcefulness to lead urgent customer situations to resolution. Responsible for managing frequent, high-quality updates to all internal and external stakeholders, Incident Managers advocate with engineering and leadership, on behalf of their customers, to ensure that...


  • Bengaluru, Karnataka, India AV Technoserve Services Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Responsibilities:* Design, develop & maintain Azure Databricks solutions using ADF, SQL & PySpark.* Collaborate with cross-functional teams on data engineering projects.