Databricks Engineer

2 days ago

Multiple Locations, India Sheryl strategic solutions Pvt. LTD . Full time ₹ 12,00,000 - ₹ 36,00,000 per year

Job Summary :

We are seeking three skilled and motivated Databricks Engineers to significantly contribute to our data engineering initiatives within the pharmaceutical and life sciences domain.

This role demands strong, hands-on expertise in Databricks, Python, and SQL to design, build, and optimize scalable, robust data pipelines. The Engineer will be responsible for transforming complex, industry-specific datasets, ensuring data quality and accessibility, and enabling critical analytics that drive business intelligence and compliance efforts.


Core Responsibilities :


Databricks and Pipeline Development :

- Design, implement, and maintain high-performance, scalable ETL/ELT data pipelines primarily utilizing Databricks (Delta Lake, Databricks SQL, and Workspace features).

- Leverage strong hands-on experience with Databricks to manage large-scale data processing workloads using Spark clusters and optimizing job execution for efficiency and cost.

- Develop and maintain data transformation logic using Databricks Notebooks written in Python and/or SQL.


Programming and Data Management :

- Apply solid programming skills in Python (including libraries like Pandas and PySpark) for complex data manipulation, cleansing, validation, and automation of data ingestion workflows.

- Utilize proficiency in SQL for ad-hoc data querying, complex transformations, stored procedure logic, and effective troubleshooting of data discrepancies across the data lakehouse.

- Implement and enforce data governance and quality checks within the pipeline to ensure the accuracy and reliability of all downstream data assets.


Domain and Compliance Focus:

- Apply proven experience working with pharmaceutical or life sciences data, including familiarity with industry-specific data structures (e.g., clinical trials, patient data, R&D data) and standards.

- Ensure all data solutions adhere to relevant compliance considerations and regulatory standards specific to the pharmaceutical domain.


Collaboration and Support:

- Collaborate effectively with data scientists, BI developers, and cross-functional teams to understand data needs and ensure high data accessibility and performance.

- Participate in code reviews, contribute to technical documentation, and provide production support for data pipelines in a fast-paced environment.


Required Skills and Experience:

years of dedicated experience in data engineering or a closely related role.

- Strong hands-on expertise with Databricks for data processing, pipeline development, and managing Delta Lake architecture.

- Proficiency in SQL for complex querying, data transformation, and troubleshooting data issues.

- Solid programming skills in Python for data manipulation, scripting, and automation.

- Proven experience working with pharmaceutical or life sciences data, including familiarity with industry data structures and compliance considerations.

- Experience with cloud platforms (e.g., AWS, Azure) and associated data services.


Preferred Skills :

- Hands-on experience with Delta Live Tables (DLT) for declarative pipeline implementation.

- Familiarity with database version control and migration tools.

- Experience with CI/CD implementation for Databricks jobs.

- Knowledge of advanced data governance practices and tools.

- Understanding of statistical modeling and machine learning concepts in a life sciences context.

  • Databricks Engineer

    3 days ago

    Multiple Locations, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : We are a technology consulting firm operating in Cloud Data Engineering and Analytics, helping enterprise customers build reliable, scalable data platforms and analytics products. Our teams deliver end-to-end data lakes, real-time streaming pipelines, and production-grade ML feature stores using Databricks and modern cloud data tooling.Role...

  • Databricks Architect

    3 days ago

    Multiple Locations, India BL Consultants Full time ₹ 2,00,00,000 - ₹ 4,00,00,000 per year

    Databricks Architect : Key Responsibilities : 1. Databricks Solution Architecture: Design and implement scalable, secure, and efficient Databricks solutions that meet client requirements. 2. Data Engineering: Develop data pipelines, architect data lakes, and implement data warehousing solutions using Databricks. 3. Data Analytics: Collaborate...

  • Azure Data Engineer

    1 day ago

    Multiple Locations, India CROSSDEV TECHNOLOGIES PRIVATE LIMITED Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Description :Job Summary : We are looking for an experienced Data Engineer with around 3 years of hands-on experience, strong expertise in Azure Databricks and Azure Database services. The ideal candidate will be responsible for building and maintaining scalable data pipelines, ensuring data quality, and supporting analytical and operational use cases....

  • Databricks Developer

    5 days ago

    Anywhere in India/Multiple Locations Jigya Software Services (P) Ltd Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : Job Title : Senior Databricks Developer. Location : Remote. About Us : The Role : We are looking for a passionate Databricks Developer to architect and implement our next-generation data platform. You will be instrumental in building robust, scalable data pipelines, optimizing our cloud data warehouse, and creating powerful...

  • Senior Data Engineer

    4 days ago

    Multiple Locations, India Digihelic Solutions Private Limited Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Description : We are seeking a highly experienced and technically adept Senior Data Engineer to join our TAVS team in Pune. The ideal candidate will have a minimum of 12 years of relevant experience and a strong background in designing, developing, and optimizing large-scale data pipelines and data warehouse solutions. This role requires deep expertise...

  • Senior Data Engineer

    1 week ago

    Multiple Locations, India Eqaim Technology & Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Description : About the Project : We are developing a data-driven platform designed to help companies optimize promotional activities for maximum business impact. The solution collects and validates data, analyzes promotion effectiveness, plans promotional calendars, and integrates seamlessly with existing enterprise systems. By leveraging machine...

  • Senior Data Engineer

    2 weeks ago

    Multiple Locations, India Apidel Technology Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Key Responsibilities : - Design, build, and maintain data pipelines using Azure Data Factory, Databricks, and Data Lake. - Develop efficient, reusable, and scalable ETL/ELT processes in Python, PySpark, and SQL. - Implement and maintain data models, transformations, and integrations for large-scale data platforms. - Ensure data quality,...

  • Data Scientist

    1 day ago

    Multiple Locations, India CROSSDEV TECHNOLOGIES PRIVATE LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Description : We are seeking a talented Data Scientist with around 3 - 5 years of experience, preferably with strong expertise in Azure Databricks and Azure Database services. The ideal candidate will have hands-on experience in building and deploying data models, working with large datasets, and leveraging cloud platforms (Azure preferred; AWS is also...

  • Generative AI Data Engineer

    3 days ago

    Multiple Locations, India NS Global Corporation Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    About the Role : We are seeking a GenAI Data Engineer to design, build, and optimize data pipelines for unstructured and semi-structured content, integrating advanced AI/ML capabilities. This role combines modern ETL expertise with Vector Database & GenAI integration to support intelligent document processing and semantic search applications.Key...

  • Junior Data Engineer

    1 day ago

    Multiple Locations, India Sky Systems, Inc. Full time ₹ 40,00,000 - ₹ 1,20,00,000 per year

    Role : Junior Data Engineer. Position Type : Full-Time Contract (40hrs/week). Contract Duration : Long Term. Work Schedule : 8 hours/day (Mon-Fri). Work Hours : 9:30 AM 6:30 PM IST. Location : 100% Remote. We are looking for a Junior Data Engineer who is passionate about building robust, scalable, and efficient data pipelines on...