Databricks Engineer

6 days ago

Chennai, India HIMFLAX INFORMATION TECHNOLOGIES PRIVATE LIMITED Full time

Job Description :


We are seeking an experienced contractor with strong expertise in Databricks and Python to support data engineering and analytics initiatives. The role involves working on data pipelines, transformations, and integrations using Databricks, with Python as a supporting skill. The ideal candidate should have a minimum of 8 years of overall IT experience, including at least 3 years of hands-on work in Databricks.


Key Responsibilities :


- Design, develop, and optimize ETL/ELT processes using Databricks.


- Develop and maintain data pipelines for large-scale data processing and analytics.


- Implement data transformations, cleansing, and validation within Databricks.


- Write efficient, reusable, and maintainable Python scripts to support data workflows.


- Integrate data from various sources, ensuring quality and consistency.


- Work with stakeholders to understand business requirements and translate them into technical solutions.


- Optimize Databricks clusters, notebooks, and workflows for performance and cost efficiency.


- Ensure adherence to data governance, security, and compliance standards.


- Troubleshoot and resolve issues in data pipelines and workflows.


Required Qualifications :


- Overall Experience: Minimum 8 years in IT/software development.


- Databricks Experience: Minimum 3 years of hands-on experience in Databricks (data engineering, transformations, and analytics).


- Strong proficiency in Python for data processing and automation.


- Experience with Spark (PySpark) for distributed data processing.


- Good understanding of data warehousing concepts, SQL, and relational databases.


- Knowledge of cloud platforms (AWS/Azure/GCP) and integrating Databricks with them.


- Strong debugging and problem-solving skills.


- Good communication and collaboration skills.


Preferred Skills :


- Experience with Delta Lake and data lakehouse architecture.


- Familiarity with CI/CD pipelines for data workflows.


- Exposure to real-time data streaming tools like Kafka.


- Understanding of big data security and compliance practices.


(ref:hirist.tech)

  • Databricks

    5 days ago

    Chennai, India Cognizant Technology Solutions Full time

    Job Summary Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...

  • Databricks SQL Engineer

    1 week ago

    Chennai, India Mastek Ltd Full time

    Job Title : Databricks SQL Engineer (with Pharma/Life Sciences background)About the Role :We are seeking a highly skilled Databricks SQL Engineer with Pharma background to join our Data Engineering team. The ideal candidate will have strong expertise in Databricks, Pyspark, SQL, Spark SQL, Delta Lake, and data lakehouse architectures, and will be responsible...

  • Databricks Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Datacrew Full time

    Job Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will...

  • Databricks

    2 weeks ago

    Chennai, Tamil Nadu, India Cognizant Full time

    **Job Summary** **Responsibilities** - Lead the design and implementation of data processing pipelines using Spark in Scala and PySpark - Oversee the administration of Databricks Unity Catalog and manage data governance - Provide expertise in Delta Sharing and ensure secure data sharing practices - Develop and maintain Databricks CLI scripts for automation...

  • Azure DataBricks

    6 days ago

    Chennai, India Hexaware Technologies Full time

    We're on the lookout for passionate Azure Data Engineers who want to redefine the future of data with Databricks & Azure. Role: ADB – Data Engineer (Azure, Databricks, ADF, PySpark/Python) Date: Saturday, 13/09/2025 Mode: F2F Discussion at Hexaware Technologies , Siruseri ,Chennai , Bring your expertise in: Datawarehousing & ETL (10+ yrs) Azure, ADF,...

  • Senior data engineer

    3 days ago

    Chennai, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect Experience: 6-12 years Location: Bangalore, Chennai, Delhi, Pune, Kolkata About Tredence: Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest...

  • Senior Data Engineer

    2 days ago

    Chennai, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 6-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Senior Data Engineer

    1 week ago

    Chennai, India Tredence Inc. Full time

    Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 6-12 yearsLocation: Bangalore, Chennai, Delhi, Pune, KolkataAbout Tredence:Tredence focuses on last-mile delivery of powerful insights into profitable actions by uniting its strengths in business analytics, data science and software engineering. The largest companies...

  • Databricks Data Engineer 6+ years

    5 days ago

    Chennai, India Raah Techservices Full time

    Position Overview We are looking for an experienced Databricks Data Engineer with 6+ years of expertise in building and managing large-scale data platforms. The ideal candidate will have strong hands-on experience with Databricks, Spark, and Cloud Data Engineering practices. This role involves designing, developing, and optimizing data pipelines, enabling...