
Databricks Developer
3 days ago
Job Title: Databricks Developer
Notice Period: Immediate to 15 Days
Location: Pan India (Remote)
Experiences: 5 to 9 Years
Job Summary
We are seeking a highly skilled
Databricks Developer
with expertise in
Python, PySpark, API Design, Azure, Airflow, and SQL
. The ideal candidate will design, build, and optimize large-scale data processing solutions, ensuring high performance, reliability, and scalability. You will collaborate with cross-functional teams to deliver modern data-driven solutions on the cloud.
Roles and Responsibilities
- Design, develop, and maintain
data pipelines
using
Databricks, PySpark, and SQL
. - Implement
ETL/ELT solutions
for large-scale structured and unstructured datasets. - Build and optimize
data workflows
leveraging
Airflow
for orchestration. - Design and develop
RESTful APIs
for data integration and consumption. - Collaborate with stakeholders to understand business requirements and translate them into technical solutions.
- Ensure performance tuning, data quality, and reliability across pipelines.
- Work with
Azure cloud services
(e.g., Data Lake, Synapse, Key Vault, Event Hub) to build scalable solutions. - Implement
CI/CD pipelines
and follow best practices in code management and deployment. - Troubleshoot, debug, and optimize workflows to improve efficiency and reduce costs.
- Document processes, design decisions, and solutions for future reference.
Required Skills & Experience
- 3–7 years
of hands-on experience as a
Data Engineer / Databricks Developer
. - Strong expertise in
Databricks, PySpark, and SQL
for data processing and transformation. - Proficiency in
Python programming
for data engineering and automation tasks. - Experience with
Airflow
(or similar orchestration tools) for scheduling and monitoring pipelines. - Solid understanding of
API design and development
(REST/GraphQL). - Proven experience with
Azure Cloud
data services (Azure Data Lake, Synapse, Data Factory, Event Hub). - Strong knowledge of
data modeling, performance tuning, and optimization techniques
. - Familiarity with
DevOps practices, CI/CD, Git, and containerization (Docker/Kubernetes)
is a plus. - Excellent problem-solving skills and ability to work in a fast-paced environment.
- Strong communication and collaboration skills to work with both technical and non-technical stakeholders.
-
Databricks Developer
3 days ago
Chennai, India Tekskills Full timeJob Description:• Data Pipeline Design: Architect and implement scalable, reliable data pipelines using Databricks, Spark, and Delta Lake• Medallion Architecture Implementation: Ingest raw data into the Bronze layer, process and clean it in the Silver layer, and aggregate/transform it for analytics in the Gold layer• Data Modeling: Design and optimize...
-
Databricks Developers
3 days ago
Chennai, India Cynosure Corporate Solutions Full timeKey Responsibilities: Develop and optimize data pipelines in Databricks for transforming and processing data from various sources. Integrate data using Unity Catalog and external data sources (data lakes, APIs, etc.). Write Spark SQL and PySpark scripts for data transformations, optimizations, and creating views/procedures. Perform data analysis to identify...
-
Databricks Developer
2 weeks ago
Chennai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000Senior Data Engineer RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a key contributor, you will be responsible for designing, developing, and deploying scalable data pipelines and ETL processes using Databricks.Key ResponsibilitiesDesign and develop efficient data pipelines and workflows in Databricks.Optimize Spark jobs to...
-
Databricks
2 weeks ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per yearJob SummaryJoin our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...
-
Databricks
3 days ago
Chennai, India Cognizant Technology Solutions Full timeJob Summary Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will directly...
-
Databricks Developer
3 days ago
Chennai, India Ignitho Full timeJob Title: Databricks Developer Experience: 2 to 4 Years Job Summary We are seeking a skilled Databricks Developer with 2 to 4 years of experience to design and implement scalable, high-performance data solutions across cloud and on-premise environments. The ideal candidate will have hands-on experience in data modeling, SQL development, and ETL processes,...
-
Databricks
2 weeks ago
Chennai, Tamil Nadu, India Cognizant Full time**Job Summary** **Responsibilities** - Lead the design and implementation of data processing pipelines using Spark in Scala and PySpark - Oversee the administration of Databricks Unity Catalog and manage data governance - Provide expertise in Delta Sharing and ensure secure data sharing practices - Develop and maintain Databricks CLI scripts for automation...
-
Databricks
2 weeks ago
Chennai, Tamil Nadu, India Cognizant Full time**Job Summary** Join our dynamic team as a Developer where you will leverage your expertise in Spark in Scala Databricks and Amazon technologies to drive innovative solutions. With a hybrid work model and day shifts you will collaborate with cross-functional teams to optimize data processes and enhance our data infrastructure. Your contributions will...
-
Databricks Architect
3 weeks ago
Chennai, Tamil Nadu, India Datacrew Full timeJob Title: Senior Databricks Data Engineer/Databricks ArchitectExperience: 5-8 yearsLocation: Chennai / Oman (Onsite)Note: Initial onsite for 3 months at Oman and back to Chennai to work from OffshoreEmployment Type: ContractRole Summary:The Databricks Architect will be responsible for designing, implementing, and optimizing scalable data architectures...
-
Azure Databricks Developer
1 week ago
Chennai, Coimbatore, Kolkata, India Ltimindtree Full time ₹ 15,00,000 - ₹ 28,00,000 per yearMandate Skills: Databricks, Datafactory, Pyspark, SQLResponsibility:5+ Years of experience using Azure.Strong proficiency in Databricks.Experience with Pyspark.Proficiency in SQL or TSQL.Experience in Azure service components like Azure data factory, Azure data lake, Databricks, SQL DB SQL Server.Databricks Jobs for efficient data processing ETL tasks and...