Senior Databricks Data Engineer

16 hours ago

Madurai, Tamil Nadu, India CodeVyasa Full time

Looking for Senior Databricks Data Engineer | Pan India to join a team of rockstar developers. The candidate should have a minimum of 10+ yrs. of experience.

About CodeVyasa: CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+ people strong and we cater to Product & Data Engineering use-cases around Agentic AI, RPA, Full-stack and various other GenAI areas.

Job Summary:

We are seeking a highly skilled Senior Databricks Data Engineer with strong hands-on experience in Databricks and AWS to join our dynamic data engineering team. The ideal candidate will be well-versed in PySpark, CI/CD pipelines, and Terraform for infrastructure as code. Experience with DAB (Data Access Broker) is highly preferred.

Key Responsibilities:

  • Design, develop, and maintain scalable and high-performance data pipelines using Databricks and PySpark.
  • Implement and manage data solutions on AWS, including services like S3, Glue, Lambda, EMR, and Redshift.
  • Use CI/CD tools for automated deployment and testing of data workflows.
  • Develop infrastructure as code using Terraform to provision and manage cloud resources.
  • Collaborate with data scientists, analysts, and other engineering teams to support end-to-end data solutions.
  • Monitor, troubleshoot, and optimize performance of data pipelines and cloud infrastructure.
  • Work on data governance, security, and compliance practices, preferably leveraging DAB if applicable.

Must-Have Skills:

  • Strong hands-on experience with Databricks (Mandatory)
  • Solid experience with AWS cloud services (Mandatory)
  • Proficiency in PySpark and distributed data processing
  • Experience in CI/CD implementation for data workflows
  • Hands-on with Terraform for infrastructure management

Why Join CodeVyasa?

  • Work on innovative, high-impact projects with a team of top-tier professionals.
  • Continuous learning opportunities and professional growth.
  • Flexible work environment with a supportive company culture.
  • Competitive salary and comprehensive benefits package.
  • Free healthcare coverage.

  • Databricks Data Engineer

    4 hours ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 35,00,000

    Senior Databricks Data EngineerDeveloping high-performance data pipelines with Databricks and PySpark is a key responsibility of this role. The ideal candidate should have hands-on experience with Databricks, solid experience with AWS cloud services, and proficiency in PySpark.Key Responsibilities:Design scalable data pipelines using Databricks and...

  • Senior Azure Databricks Developer

    1 day ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Job OverviewA Data Engineer role is available for a skilled professional with experience in Azure Databricks and Python programming.

  • Senior Data Architect

    1 day ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Lead Data Engineer Job DescriptionWe are seeking a highly skilled Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines using Azure and Databricks.This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in...

  • Databricks Expert

    1 day ago

    Madurai, Tamil Nadu, India beBeeExpertise Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Unlock Your Career Potential as a Databricks ExpertJob Description:This is an exceptional opportunity to leverage your expertise in data ingestion and pipeline development to drive business growth and success. As a seasoned Databricks Engineer, you will be responsible for designing, developing, and optimizing data ingestion pipelines that seamlessly...

  • Senior Data Engineering Manager

    1 day ago

    Madurai, Tamil Nadu, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Summary:About the Role:We are seeking a highly experienced and strategic leader with deep expertise in data engineering platforms, cloud computing, and software development. The ideal candidate will oversee a team of talented engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and...

  • Cloud Data Engineer Position

    6 hours ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title:Big Data SpecialistKey Responsibilities:This role involves designing and implementing scalable data pipelines, ensuring high-quality data processing, and integrating governance metrics into data workflows.The ideal candidate will have hands-on experience with data engineering, strong expertise in Azure Databricks and data storage solutions, and...

  • Data Engineering Specialist

    1 day ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering SpecialistDesign, build, and maintain large-scale data pipelines using Spark and SQL. This role involves managing big data flows, collaborating with cross-functional teams, and driving business growth through data insights.About the Role:Create scalable data architectures using cloud-based platforms (AWS, Azure, GCP, Databricks).Analyze and...

  • Leading Data Engineer

    1 day ago

    Madurai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the RoleWe are seeking a seasoned Data Engineering professional to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining large-scale data processing systems that drive business intelligence and analytics.Your primary focus will be on architecting and implementing scalable and robust data pipelines...

  • Senior Data Specialist

    1 day ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Data Engineer RoleWe are seeking a seasoned Data Engineer to join our team. The ideal candidate will have experience in designing and maintaining scalable data pipelines using Databricks, Azure Data Factory, and ETL tools.Design and maintain efficient data pipelinesOngoing optimization of workflows for data ingestion, transformation, and deliveryKey...

  • Senior Data Pipeline Specialist

    2 hours ago

    Madurai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 18,00,000

    Unlock Your Potential in Data EngineeringTransform your career with a Data Engineer role that drives business success.As a critical member of our data engineering team, you will design, build, and manage scalable data pipelines and enterprise data solutions to support analytics, reporting, and data science initiatives. This high-impact role requires deep...