Senior Databricks Data Engineer

3 weeks ago

Bengaluru, Karnataka, India CodeVyasa Full time
Looking for Senior Databricks Data Engineer | Pan India to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience.

About CodeVyasa: CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+ people strong and we cater to Product & Data Engineering use-cases around Agentic AI, RPA, Full-stack and various other GenAI areas.

Job Summary:

We are seeking a highly skilled Senior Databricks Data Engineer with strong hands-on experience in Databricks and AWS to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code. Experience with DAB (Data Access Broker) is highly preferred.

Key Responsibilities:

- Design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.
- Implement and manage data solutions on AWS, including services like S3, Glue, Lambda, EMR, and Redshift.
- Use CI/CD tools for automated deployment and testing of data workflows.
- Develop infrastructure as code using Terraform to provision and manage cloud resources.
- Collaborate with data scientists, analysts, and other engineering teams to support end-to-end data solutions.
- Monitor, troubleshoot, and optimize performance of data pipelines and cloud infrastructure.
- Work on data governance, security, and compliance practices, preferably leveraging DAB if applicable.

Must-Have Skills:

- Strong hands-on experience with Databricks (Mandatory)
- Solid experience with AWS cloud services (Mandatory)
- Proficiency in PySpark and distributed data processing
- Experience in CI/CD implementation for data workflows
- Hands-on with Terraform for infrastructure management

Why Join CodeVyasa?

- Work on innovative, high-impact projects with a team of top-tier professionals.
- Continuous learning opportunities and professional growth.
- Flexible work environment with a supportive company culture.
- Competitive salary and comprehensive benefits package.
- Free healthcare coverage.

  • Data Engineer-Databricks

    4 weeks ago

    Bengaluru, Karnataka, India Oracle Full time

    Location- Mumbai, Pune, Bangalore and ChennaiSenior Data Engineer Databricks (Azure/AWS)Role Overview:We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the ...

  • Data Engineer-Databricks

    3 weeks ago

    Bengaluru, Karnataka, India Oracle Full time

    Location- Mumbai, Pune, Bangalore and ChennaiSenior Data Engineer Databricks (Azure/AWS)Role Overview:We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the bronze-silver-gold...

  • Data Engineer-databricks

    7 hours ago

    Bengaluru, Karnataka, India Oracle Full time

    Location- Mumbai, Pune, Bangalore and Chennai Senior Data Engineer Databricks (Azure/AWS)Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms.The role will focus on implementing batch and streaming pipelines, applying the...

  • Senior Databricks Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India CodeVyasa Full time

    Looking for Senior Databricks Data Engineer | Pan India to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience. About CodeVyasa: CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy , and others. We are about 550+...

  • Data Engineer-Databricks

    2 weeks ago

    Bengaluru, Karnataka, India Oracle Full time

    Location- Mumbai, Pune, Bangalore and Chennai Senior Data Engineer Databricks (Azure/AWS) Role Overview: We are looking for a hands-on Senior Data Engineer experienced in migrating and building large-scale data pipelines on Databricks using Azure or AWS platforms. The role will focus on implementing batch and streaming pipelines, applying the...

  • Director of Engineering

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. Ingesting data into the Lakehouse is a strategic area of investment for Databricks and a key enabler for Data and AI...

  • Engineering Manager

    1 week ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    P-995Companies are investing billions of dollars into developing and deploying AI and the data platforms that enable it. But do they know what is happening? At Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical...

  • Sr. Solutions Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Databricks Full time

    Job DescriptionFEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our...

  • Sr. Solutions Engineer

    5 days ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,20,000 - US$ 2,00,000 per year

    FEQ426R153As a Sr. Solutions Engineer (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Director of Engineering

    1 day ago

    Bengaluru, Karnataka, India Databricks Full time US$ 1,50,000 - US$ 2,00,000 per year

    (P-1384)About the TeamAt Databricks, we are passionate about enabling data teams to solve the world's toughest problems — from making the next mode of transportation a reality to accelerating the development of medical breakthroughs. We do this by building and running the world's best data and AI infrastructure platform so our customers can use deep data...