Databricks Data Engineer 6+ years

1 week ago

Chennai, Tamil Nadu, India Raah Techservices Full time ₹ 4,69,000 - ₹ 18,17,548 per year

Position Overview

We are looking for an experienced Databricks Data Engineer with 6+ years of expertise in building and managing large-scale data platforms. The ideal candidate will have strong hands-on experience with Databricks, Spark, and Cloud Data Engineering practices. This role involves designing, developing, and optimizing data pipelines, enabling advanced analytics, and ensuring scalable and efficient data solutions.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines on Databricks.
  • Work with Apache Spark, Delta Lake, and SQL to transform and optimize large datasets.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver reliable data solutions.
  • Implement best practices for data security, governance, and compliance.
  • Support migration, integration, and modernization of data platforms to cloud environments.
  • Troubleshoot performance bottlenecks and ensure high availability of data pipelines.
  • Work in an Agile/DevOps environment, supporting CI/CD pipelines and automation.

Skills Required

  • Strong hands-on experience in Databricks and Apache Spark.
  • Proficiency in SQL, Python, or Scala.
  • Experience with ETL development, data modeling, and data warehousing concepts.
  • Knowledge of cloud platforms (Azure, AWS, or GCP) with emphasis on data services.
  • Familiarity with Delta Lake, MLflow, and data pipeline orchestration tools (Airflow, ADF, etc.).
  • Strong understanding of data governance, performance tuning, and optimization.

Preferred Skills

  • Experience in Azure Databricks with integration of Azure Data Lake, Synapse, or Data Factory.
  • Knowledge of machine learning workflows within Databricks.
  • Exposure to DevOps practices and CI/CD for data engineering.
  • Professional certifications in Databricks or cloud platforms (Azure, AWS, GCP).

Job Types: Full-time, Permanent

Pay: ₹469, ₹1,817,548.30 per year

Experience:

  • Databricks data engineer: 6 years (Preferred)
  • ETL: 6 years (Preferred)
  • Cloud computing: 6 years (Preferred)
  • DevOps: 6 years (Preferred)

Work Location: In person

  • Databricks Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full time

    About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...

  • Data Engineer- Databricks

    7 days ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...

  • Senior Data Engineer – Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Zillion Technologies Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Data Engineer – DatabricksLocation: Hyderabad/ChennaiWork Schedule: Timings 2:30 PM to 11:30 PMRole Overview:We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks to design, build, and optimize scalable data pipelines and architectures. You will collaborate with cross-functional teams including data scientists,...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Data Engineer – Databricks

    6 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role Summary:We are looking for aData Engineerwith expertise inAzure Databricks,data transformation, andintegration pipelinesto support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS,...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer- Azure Databricks

    1 week ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Position: Data Engineer ? Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...

  • Data Architect- Databricks

    4 days ago

    Chennai, Tamil Nadu, India InfoCepts Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position: Data Architect (Databricks, Snowflake)Location: Nagpur, Pune, Chennai, BangaloreType of Employment: Full time EmploymentPurpose of the Position:Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs.Key...

  • Databricks

    7 days ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Job SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Azure Databricks, Data Factory and SQL

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Skill: DatabricksExperience: 6 to 13 yearsLocation: BhubaneswarJob descriptionResponsibilities:Designing, building, and deploying data pipelines and workflows using Databricks.Developing and optimizing Apache Spark applications for data processing and analytics.Integrating Databricks with various data sources and platforms.Implementing data quality checks...