
Databricks Developers
2 days ago
Key Responsibilities:
- Develop and optimize data pipelines in Databricks for transforming and processing data from various sources.
- Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.).
- Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures.
- Perform data analysis to identify quality issues, optimize pipelines, and enhance data processing for analytics.
- Collaborate on report generation and dashboard creation with front-end teams.
- Use GitLab for version control, CI/CD automation, and task management (Jira).
Required Skills and Qualifications:
- Masters or Bachelor's degree in Data Engineering or related field.
- 3+ years experience with Databricks and advanced SQL.
- Experience with ETL processes, views, and procedures.
- Strong experience with Databricks, Spark SQL, PySpark, and SQL.
- Expertise in creating and optimizing views and stored procedures in Databricks.
- Experience building ETL workflows and data models.
- Knowledge of cloud platforms (AWS, Azure) and version control tools (Git, GitLab).
- Experience with healthcare or clinical trial data.
- Familiarity with DevOps practices.
-
Databricks Developer
2 days ago
Chennai, Tamil Nadu, India Tekskills Full time ₹ 15,00,000 - ₹ 20,00,000 per yearJob Description:• Data Pipeline Design: Architect and implement scalable, reliable data pipelines using Databricks, Spark, and Delta Lake• Medallion Architecture Implementation: Ingest raw data into the Bronze layer, process and clean it in the Silver layer, and aggregate/transform it for analytics in the Gold layer• Data Modeling: Design and optimize...
-
Databricks Developer
2 days ago
Chennai, Tamil Nadu, India VySystems Full time ₹ 15,00,000 - ₹ 20,00,000 per yearJob Title: Databricks DeveloperNotice Period: Immediate to 15 DaysLocation: Pan India (Remote)Experiences: 5 to 9 YearsJob SummaryWe are seeking a highly skilledDatabricks Developerwith expertise inPython, PySpark, API Design, Azure, Airflow, and SQL. The ideal candidate will design, build, and optimize large-scale data processing solutions, ensuring high...
-
Databricks Developer
2 days ago
Chennai, Tamil Nadu, India Ignitho Full time US$ 90,000 - US$ 1,20,000 per yearJob Title: Databricks DeveloperExperience: 2 to 4 YearsJob SummaryWe are seeking a skilled Databricks Developer with 2 to 4 years of experience to design and implement scalable, high-performance data solutions across cloud and on-premise environments. The ideal candidate will have hands-on experience in data modeling, SQL development, and ETL processes, with...
-
Databricks Architect
3 weeks ago
Chennai, Tamil Nadu, India Datacrew Full timeJob Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...
-
Databricks Architect
1 week ago
Chennai, Tamil Nadu, India Datacrew Full timeJob Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...
-
Databricks Engineer
4 weeks ago
Chennai, Tamil Nadu, India HIMFLAX INFORMATION TECHNOLOGIES PRIVATE LIMITED Full timeJob Description :We are seeking an experienced contractor with strong expertise in Databricks and Python to support data engineering and analytics initiatives. The role involves working on data pipelines, transformations, and integrations using Databricks, with Python as a supporting skill. The ideal candidate should have a minimum of 8 years of overall IT...
-
Databrick Pyspark
2 days ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 9,00,000 - ₹ 12,00,000 per yearKey Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...
-
Databricks Business Intelligence Developer
3 days ago
Chennai, Tamil Nadu, India beBeeDataAnalysis Full time ₹ 12,00,000 - ₹ 20,00,000Job Title: Databricks Data AnalystAbout the RoleWe are seeking a skilled Data Analyst to support our production operations, including data ingestion from Databricks, stewardship console support, and downstream data consumption. The role involves monitoring, troubleshooting, and collaborating with business and engineering teams to ensure data quality and...
-
Databricks Solutions Architect
1 week ago
Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,50,00,000 - ₹ 3,00,00,000Job Overview:Azure Databricks Engineer is a crucial role in our organization.We are seeking an experienced professional to design, develop, and optimize Azure Databricks solutions using SQL, Python, and other relevant technologies.Responsibilities include creating/modifying Azure Data Factory pipelines, working with file formats (Parquet, Delta, CSV), and...
-
Azure Databricks Administrator
22 hours ago
Chennai, Tamil Nadu, India Randomtrees Full time ₹ 1,50,000 - ₹ 28,00,000 per yearRoles and ResponsibilitiesDesign, implement, and maintain Azure Databricks clusters for data engineering workloads.Configure and manage Azure DevOps pipelines for CI/CD processes using Python scripts.Migrate on-premises databases to Azure platforms using Data Bricks migration tools.Troubleshoot issues related to Azure Databricks cluster performance,...