Databricks SQL Engineer

4 weeks ago

Chennai, Tamil Nadu, India Mastek Ltd Full time

Job Title : Databricks SQL Engineer (with Pharma/Life Sciences background)

About the Role :

We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible for building scalable and efficient data models, queries, and pipelines that power analytical insights and business decisions.

Key Responsibilities :

- Design, develop, and optimize SQL-based data models and queries in Databricks for large-scale datasets.

- Work with Delta Lake, Unity Catalog, and Databricks Notebooks to manage and secure data assets.

- Implement and maintain ETL/ELT pipelines using Databricks workflows and SQL.

- Develop documentation and data dictionaries to promote self-service analytics.

- Ensure data quality and consistency through testing, validation, and monitoring.

- Optimize data lakehouse architecture for cost and performance, leveraging Spark SQL best practices.

- Support CI/CD practices for deploying notebooks and SQL jobs to production.

Required Qualifications:

- 5+ years of experience working with Databricks SQL, Pyspark, Spark SQL, or similar distributed SQL engines.

- Experience in the Pharma Domain

- Strong experience with Delta Lake, structured streaming, and data lakehouse paradigms.

- Proficiency in SQL development, query tuning, and working with large datasets.

- Experience with version control tools (Git) and collaborative development practices.

- Experience working in cloud environments (AWS, Azure, or GCP), preferably with Azure Databricks or Databricks on AWS.

- Understanding of data governance, access control, and tools like Unity Catalog or Purview.

- Familiarity with CI/CD for data pipelines and automation tools like Databricks Repos, Terraform, or dbx.

- Exposure to Python or PySpark for scripting and data manipulation.

(ref:hirist.tech)

  • Databricks SQL Engineer(Pharma Background)

    3 days ago

    Chennai, Tamil Nadu, India Mastek Full time

    Job Title: Databricks SQL Engineer (with Pharma/Life Sciences background)About the Role:We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible...

  • Databricks SQL Engineer(Pharma Background)

    4 weeks ago

    Chennai, Tamil Nadu, India Mastek Full time

    Job Title: Databricks SQL Engineer (with Pharma/Life Sciences background)About the Role:We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible...

  • Databricks SQL Engineer(Pharma Background)

    1 week ago

    Chennai, Tamil Nadu, India Mastek Full time

    Job Title: Databricks SQL Engineer (with Pharma/Life Sciences background) About the Role: We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be...

  • Databricks Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India HIMFLAX INFORMATION TECHNOLOGIES PRIVATE LIMITED Full time

    Job Description :We are seeking an experienced contractor with strong expertise in Databricks and Python to support data engineering and analytics initiatives. The role involves working on data pipelines, transformations, and integrations using Databricks, with Python as a supporting skill. The ideal candidate should have a minimum of 8 years of overall IT...

  • Databricks Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Databricks Architect

    1 day ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Databricks Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NRM Analytix Full time

    We are hiring a Databricks Data Engineer for a remote, full-time role. The ideal candidate should meet the following requirements:1 to 5 years of overall experience in data engineering.At least 1 year of hands-on experience with Databricks technology.Strong working knowledge of Databricks Delta Lake and PySpark.Experience on cloud platforms like AWS or...

  • Databricks Solutions Architect

    4 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Job Overview:Azure Databricks Engineer is a crucial role in our organization.We are seeking an experienced professional to design, develop, and optimize Azure Databricks solutions using SQL, Python, and other relevant technologies.Responsibilities include creating/modifying Azure Data Factory pipelines, working with file formats (Parquet, Delta, CSV), and...

  • Capability Leads- Databricks

    3 weeks ago

    Chennai, Tamil Nadu, India Mastech Digital Full time

    Position: Capability Lead – Databricks (Director/ Enterprise Architect)Location: Chennai, Hyderabad, Bangalore or Noida (Hybrid)- No remote option availableDuration: Full TimeReporting : Practice HeadBudget: 30- 65 LPA (Depending on level of expertise)Notice Period: Immediate Joiner/ Currently Serving/ Notice is less than 60 daysLevel of experience: 12+...

  • Data Engineering Expert

    18 hours ago

    Chennai, Tamil Nadu, India beBeeDatabrickssqlengineer Full time US$ 15,00,000 - US$ 25,00,000

    Databricks SQL Engineer PositionOur organization seeks a skilled Databricks SQL Engineer with experience in the pharmaceutical industry. The ideal candidate will have expertise in Databricks, Pyspark, SQL, Spark SQL, and data lakehouse architectures.Key Responsibilities: