Databricks Developers
2 weeks ago
- Develop and optimize data pipelines in Databricks for transforming and processing data from various sources.
- Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.).
- Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures.
- Perform data analysis to identify quality issues, optimize pipelines, and enhance data processing for analytics.
- Collaborate on report generation and dashboard creation with front-end teams.
- Use GitLab for version control, CI/CD automation, and task management (Jira).
Requirements
- Master's or Bachelor's degree in Data Engineering or related field.
- 3+ years experience with Databricks and advanced SQL.
- Experience with ETL processes, views, and procedures.
- Strong experience with Databricks, Spark SQL, PySpark, and SQL.
- Expertise in creating and optimizing views and stored procedures in Databricks.
- Experience building ETL workflows and data models.
- Knowledge of cloud platforms (AWS, Azure) and version control tools (Git, GitLab).
- Experience with healthcare or clinical trial data.
- Familiarity with DevOps practices.
Requirements
DevOps, ETL, Databricks, Spark SQL, Pyspark, SQL, cloud platforms (AWS, Azure)
-
Databricks Developer
6 days ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full timeKey Responsibilities:Develop and optimize data pipelines in Databricks for transforming and processing data from various sources.Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.).Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures.Perform data analysis to identify...
-
Databricks Developer
3 weeks ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full timeKey Responsibilities:- Develop and optimize data pipelines in Databricks for transforming and processing data from various sources.- Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.).- Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures.- Perform data analysis to...
-
Databricks developer
5 days ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full timeKey Responsibilities:Develop and optimize data pipelines in Databricks for transforming and processing data from various sources.Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.).Write Spark SQL and Py Spark scripts for data transformations, optimizations, and creating views/procedures.Perform data analysis to identify...
-
Databricks Developer
3 weeks ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time- UK shiftKey Skills: DevOps, ETL, Databricks, Spark SQL, Pyspark, SQL, cloud platforms (AWS, Azure)We are seeking a highly motivated and experienced Databricks Developer to join our growing team. In this role, you will be responsible for designing, developing, and optimizing data pipelines within the Databricks environment. You will leverage your expertise...
-
Databricks Developer
2 weeks ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time- UK shiftKey Skills: DevOps, ETL, Databricks, Spark SQL, Pyspark, SQL, cloud platforms (AWS, Azure)We are seeking a highly motivated and experienced Databricks Developer to join our growing team. In this role, you will be responsible for designing, developing, and optimizing data pipelines within the Databricks environment. You will leverage your expertise...
-
Databricks Developers
2 weeks ago
Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full timeDevelop and optimize data pipelines in Databricks for transforming and processing data from various sources. Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.).Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures.Perform data analysis to identify quality issues, optimize...
-
Cloud Databricks Developer
6 days ago
Chennai, Tamil Nadu, India beBee Careers Full timeJob Title:Cloud Databricks DeveloperDescription:This position involves designing and developing distributed data pipeline solutions using Databricks, focusing on scalability, efficiency, and reliability. The successful candidate will have a solid understanding of cloud platforms, specifically AWS or Azure, and be proficient in Unity Catalog and PySpark.Main...
-
Databricks and Python Developer
1 day ago
Chennai, Tamil Nadu, India beBee Careers Full timeAbout the Opportunity:We are offering a unique opportunity for a skilled Data Engineer to work on innovative data engineering projects using Azure Data Factory, Azure Databricks, Delta Lake, and Python/PySpark. The successful candidate will have a strong background in data engineering, experience with Databricks and Python, and excellent problem-solving...
-
Databricks lead developer
6 days ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeTCS Virtual Drive -Greetings from Tata Consultancy Services TCS is hiring fo r Databricks Lead developerExperience : 7 - 15 yrsLocation: Pan IndiaRequired skills:5+ years of experience in data engineering or related fieldsAt least 2-3 years of hands-on experience with Databricks (using Apache Spark, Delta Lake, etc.)Solid experience in working with big data...
-
Databricks Developer Position
4 days ago
Chennai, Tamil Nadu, India beBee Careers Full timeJob Description:We are seeking a highly skilled professional to design, develop, and optimize data pipelines within the Databricks environment. As a key member of our data engineering team, you will leverage your expertise in Spark SQL, PySpark, and cloud platforms (AWS or Azure) to transform and process data from various sources.Data Pipelines:Design,...