Data Engineer-Databricks

4 weeks ago

Bengaluru, Karnataka, India Oracle Full time
Location- Mumbai, Pune, Bangalore and Chennai
Senior Data Engineer Databricks (Azure/AWS)
Role Overview:
We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold data lakehouse model, and ensuring scalable and reliable data solutions.
Required Skills and Experience:
6+ years of hands-on data engineering experience, with 2+ years specifically working on Databricks in Azure or AWS.
Proficiency in building and optimizing Spark pipelines (batch and streaming).
Strong experience implementing bronze/silver/gold data models.
Working knowledge of cloud storage systems (ADLS, S3) and compute services.
Experience migrating data from RDBMS (Oracle, SQL Server) or Hadoop ecosystems.
Familiarity with Airflow, Azure Data Factory, or AWS Glue for orchestration.
Good scripting skills (Python, Scala, SQL) and version control (Git).
Preferred Qualifications:
Databricks Certified Data Engineer Associate or Professional.
Experience with Delta Live Tables (DLT) and Databricks SQL.
Understanding of cloud security best practices (IAM roles, encryption, ACLs).
Key Responsibilities:
Design, develop, and operationalize scalable data pipelines on Databricks following medallion architecture principles.
Migrate and transform large data volumes from traditional on-prem systems (Oracle, Hadoop, Exadata) into cloud data platforms.
Develop efficient Spark (PySpark/Scala) jobs for ingestion, transformation, aggregation, and publishing of data.
Implement data quality checks, error handling, retries, and data validation frameworks.
Build automation scripts and CI/CD pipelines for Databricks workflows and deployment.
Tune Spark jobs and optimize cost and performance in cloud environments.
Collaborate with data architects, product owners, and analytics teams
Attributes for Success:
Strong analytical and problem-solving skills.
Attention to scalability, resilience, and cost efficiency.
Collaborative attitude and passion for clean, maintainable code.

  • Engineering Manager

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-995Companies are investing billions of dollars into developing and deploying AI and the data platforms that enable it. But do they know what is happening? At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical...

  • Sr. Solutions Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionFEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our...

  • Sr. Solutions Engineer

    5 days ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,20,000 - US$ 2,00,000 per year

    FEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Director of Engineering

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI...

  • Director of Engineering

    24 hours ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...

  • Partner Solutions Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionFEQ125R56As a Partner Solutions Architect (PSA) for India, you will work with Databricks&apos Consulting and System Integrator (C&SI) partners, teammates, and with the technical and sales team members who work directly with our customers. You will develop &apostechnical champions&apos within our top C&SI Partners, providing enablement on...

  • Staff Software Engineer

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-926At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data insights to...

  • Databricks Data Engineer

    3 days ago

    Bengaluru, Karnataka, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    JD:Proficient in Databricks Data Engg.  Knowledge in ETL concepts. Proficient in writing SQL  queries, performance tuning. Knowledge in python script writing. Good Communication skill. Required Qualifications:1. Bachelor's degree in Computer Science, Information Technology, or a related field.2. 4 to 7 years of experience as a Data Engineer with a focus on...

  • Databricks Lead Urgent

    4 days ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Databricks Lead to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties: Wyndham Group of Hotels is...

  • Senior Databricks Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India CodeVyasa Full time

    Looking for Senior Databricks Data Engineer | Pan India to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience.About CodeVyasa: CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+ people...