15h Left Data Engineer-Databricks

4 weeks ago

Bengaluru, Karnataka, India Oracle Full time
Job Description

Location- Mumbai, Pune, Bangalore and Chennai

Senior Data Engineer Databricks (Azure/AWS)

Role Overview:

We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions.

Required Skills and Experience:

- 6+ years of hands-on data engineering experience, with 2+ years specifically working on Databricks in Azure or AWS.
- Proficiency in building and optimizing Spark pipelines (batch and streaming).
- Strong experience implementing bronze/silver/gold data models.
- Working knowledge of cloud storage systems (ADLS, S3) and compute services.
- Experience migrating data from RDBMS (Oracle, SQL Server) or Hadoop ecosystems.
- Familiarity with Airflow, Azure Data Factory, or AWS Glue for orchestration.
- Good scripting skills (Python, Scala, SQL) and version control (Git).

Preferred Qualifications:

- Databricks Certified Data Engineer Associate or Professional.
- Experience with Delta Live Tables (DLT) and Databricks SQL.
- Understanding of cloud security best practices (IAM roles, encryption, ACLs).

Key Responsibilities:

- Design, develop, and operationalize scalable data pipelines on Databricks following medallion architecture principles.
- Migrate and transform large data volumes from traditional on-prem systems (Oracle, Hadoop, Exadata) into cloud data platforms.
- Develop efficient Spark (PySpark/Scala) jobs for ingestion, transformation, aggregation, and publishing of data.
- Implement data quality checks, error handling, retries, and data validation frameworks.
- Build automation scripts and CI/CD pipelines for Databricks workflows and deployment.
- Tune Spark jobs and optimize cost and performance in cloud environments.
- Collaborate with data architects, product owners, and analytics teams

Attributes for Success:

- Strong analytical and problem-solving skills.
- Attention to scalability, resilience, and cost efficiency.
- Collaborative attitude and passion for clean, maintainable code.

  • Engineering Manager

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-995Companies are investing billions of dollars into developing and deploying AI and the data platforms that enable it. But do they know what is happening? At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical...

  • 15h Left) Databricks Architect

    1 day ago

    Bengaluru, Karnataka, India Genpact Full time

    Job descriptionRole: Senior Principal Consultant (Databricks Architect)In this role, the Databricks Architect is responsible for providing technical direction and lead a group of one or more developer to address a goal.Responsibilities- Architect and design solutions to meet functional and non-functional requirements.- Create and review architecture and...

  • Sr. Solutions Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionFEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our...

  • Sr. Solutions Engineer

    5 days ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,20,000 - US$ 2,00,000 per year

    FEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Director of Engineering

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI...

  • Director of Engineering

    22 hours ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...

  • Partner Solutions Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionFEQ125R56As a Partner Solutions Architect (PSA) for India, you will work with Databricks&apos Consulting and System Integrator (C&SI) partners, teammates, and with the technical and sales team members who work directly with our customers. You will develop &apostechnical champions&apos within our top C&SI Partners, providing enablement on...

  • Data Engineer-Databricks

    4 weeks ago

    Bengaluru, Karnataka, India Oracle Full time

    Location- Mumbai, Pune, Bangalore and ChennaiSenior Data Engineer Databricks (Azure/AWS)Role Overview:We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the ...

  • Staff Software Engineer

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-926At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Databricks Developer

    3 weeks ago

    Bengaluru, Karnataka, India ARA Resources Full time

    About The Company ARA s client is a leading IT solutions provider offering Applications Business Process Outsourcing BPO and Infrastructure services globally through a combination of technology know how domain and process expertise Over the years we have left an indelible impression in the IT solutions domain with an impressive clientele and an...