Databricks Engineer

3 weeks ago

Chennai, Tamil Nadu, India HIMFLAX INFORMATION TECHNOLOGIES PRIVATE LIMITED Full time

Job Description :

We are seeking an experienced contractor with strong expertise in Databricks and Python to support data engineering and analytics initiatives. The role involves working on data pipelines, transformations, and integrations using Databricks, with Python as a supporting skill. The ideal candidate should have a minimum of 8 years of overall IT experience, including at least 3 years of hands-on work in Databricks.

Key Responsibilities :

- Design, develop, and optimize ETL/ELT processes using Databricks.

- Develop and maintain data pipelines for large-scale data processing and analytics.

- Implement data transformations, cleansing, and validation within Databricks.

- Write efficient, reusable, and maintainable Python scripts to support data workflows.

- Integrate data from various sources, ensuring quality and consistency.

- Work with stakeholders to understand business requirements and translate them into technical solutions.

- Optimize Databricks clusters, notebooks, and workflows for performance and cost efficiency.

- Ensure adherence to data governance, security, and compliance standards.

- Troubleshoot and resolve issues in data pipelines and workflows.

Required Qualifications :

- Overall Experience: Minimum 8 years in IT/software development.

- Databricks Experience: Minimum 3 years of hands-on experience in Databricks (data engineering, transformations, and analytics).

- Strong proficiency in Python for data processing and automation.

- Experience with Spark (PySpark) for distributed data processing.

- Good understanding of data warehousing concepts, SQL, and relational databases.

- Knowledge of cloud platforms (AWS/Azure/GCP) and integrating Databricks with them.

- Strong debugging and problem-solving skills.

- Good communication and collaboration skills.

Preferred Skills :

- Experience with Delta Lake and data lakehouse architecture.

- Familiarity with CI/CD pipelines for data workflows.

- Exposure to real-time data streaming tools like Kafka.

- Understanding of big data security and compliance practices.

(ref:hirist.tech)

  • Databricks SQL Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India Mastek Ltd Full time

    Job Title : Databricks SQL Engineer (with Pharma/Life Sciences background)About the Role :We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible...

  • Databricks Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NRM Analytix Full time

    We are hiring a Databricks Data Engineer for a remote, full-time role. The ideal candidate should meet the following requirements:1 to 5 years of overall experience in data engineering.At least 1 year of hands-on experience with Databricks technology.Strong working knowledge of Databricks Delta Lake and PySpark.Experience on cloud platforms like AWS or...

  • Databricks Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Databricks Architect

    2 days ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Databricks SQL Engineer(Pharma Background)

    3 days ago

    Chennai, Tamil Nadu, India Mastek Full time

    Job Title: Databricks SQL Engineer (with Pharma/Life Sciences background)About the Role:We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible...

  • Databricks SQL Engineer(Pharma Background)

    4 weeks ago

    Chennai, Tamil Nadu, India Mastek Full time

    Job Title: Databricks SQL Engineer (with Pharma/Life Sciences background)About the Role:We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible...

  • Databricks SQL Engineer(Pharma Background)

    1 week ago

    Chennai, Tamil Nadu, India Mastek Full time

    Job Title: Databricks SQL Engineer (with Pharma/Life Sciences background) About the Role: We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be...

  • Capability Leads- Databricks

    3 weeks ago

    Chennai, Tamil Nadu, India Mastech Digital Full time

    Position: Capability Lead – Databricks (Director/ Enterprise Architect)Location: Chennai, Hyderabad, Bangalore or Noida (Hybrid)- No remote option availableDuration: Full TimeReporting : Practice HeadBudget: 30- 65 LPA (Depending on level of expertise)Notice Period: Immediate Joiner/ Currently Serving/ Notice is less than 60 daysLevel of experience: 12+...

  • Databricks Solutions Architect

    4 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Job Overview:Azure Databricks Engineer is a crucial role in our organization.We are seeking an experienced professional to design, develop, and optimize Azure Databricks solutions using SQL, Python, and other relevant technologies.Responsibilities include creating/modifying Azure Data Factory pipelines, working with file formats (Parquet, Delta, CSV), and...

  • Urgent: Capability Leads- Databricks

    3 weeks ago

    Chennai, Tamil Nadu, India Mastech Digital Full time

    Job DescriptionPosition: Capability Lead Databricks (Director/ Enterprise Architect)Location: Chennai, Hyderabad, Bangalore or Noida (Hybrid)- No remote option availableDuration: Full TimeReporting : Practice HeadBudget: 30- 65 LPA (Depending on level of expertise)Notice Period: Immediate Joiner/ Currently Serving/ Notice is less than 60 daysLevel of...