Databricks Data Engineer
11 hours ago
Job Title: Databricks Data Engineer
Location:
Kolkata, India (On-site)
Experience:
3–8 Years
Notice Period:
Immediate Joiners Preferred
Job Summary:
We are looking for a skilled
Databricks Data Engineer
with hands-on experience in
PySpark
and
SQL
to join our data engineering team in Kolkata. The ideal candidate will design, develop, and maintain scalable data pipelines and analytics solutions using Databricks, Azure, or AWS environments.
Key Responsibilities:
- Develop and maintain
ETL pipelines
on
Databricks
using
Python, SQL, and Spark
. - Integration of Databricks with external Data Sources including Azure
- Design and implement Medallion architecture based on the technical requirement
- Work with large datasets to build data models, transformations, and integrations.
- Optimize Spark jobs for performance and scalability.
- Collaborate with data scientists, analysts, BI developers and business stakeholders to deliver data-driven insights.
- Implement data quality checks, validations, and monitoring processes.
- Automate workflows using
Databricks Workflows
,
Airflow
, or similar tools. - Troubleshoot data issues and perform root cause analysis.
- Ensure adherence to best practices in
data security, version control, and CI/CD pipelines
.
Required Skills & Experience:
- 3–8 years of experience in
Data Engineering using Databricks
. - Strong programming skills in
Pyspark
. - Advanced
SQL
skills, including writing complex queries and optimization. - Hands-on experience with
Databricks
(including Delta Lake, Workflows, and MLflow). - Experience with
cloud platforms
(Azure, AWS, or GCP) and
data lake/data warehouse
concepts. - Familiarity with
Git
,
CI/CD tools
, and
Agile methodologies
. - Strong problem-solving skills and attention to detail.
Preferred Skills:
- Knowledge of
Azure Data Factory (ADF)
,
Snowflake
, or
Synapse Analytics
. - Experience in
data modeling
and
data governance
frameworks. - Exposure to
machine learning pipelines
or
data science integration
in Databricks.
Education:
- Bachelor's or Master's degree in
Computer Science, Information Technology, Data Engineering
, or a related field.
-
AWS Databricks Developer
9 hours ago
Kolkata, West Bengal, India Integrated Personnel Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJob role - DeveloperExperience - 6 to 10 yearsLocation - KolkataAWS Databricks Developer Experience More than 3 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS Databricks.Technical Skills Proficiency in Databricks platform, management, and optimization. Strong experience in AWS Cloud, particularly in data...
-
Databricks Technical Lead
8 hours ago
Kolkata, West Bengal, India Stanra Tech Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title : Databricks Tech Lead (Contract) Contract Duration : 4 Months (Extendable based on Performance) Job Location : Remote Job Timings : India Evening Shift (till 11 : 30 PM IST) Experience Required : 7+ Years Job Description : We are looking for an experienced Databricks Tech Lead to join our team on a 4-month extendable contract....
-
Data Engineer
2 weeks ago
Kolkata, West Bengal, India Nilasu Consulting Services Full time ₹ 12,00,000 - ₹ 36,00,000 per yearMandatory skill databricks + Python Overall Exp Years Databricks & Python years Location Kolkata , Vizag , Pune, Bangalore , Hyderabad ,Chennai , Coimbatore , Kochi , Delhi/NCR JOBCODE Role : Data Engineer (Sr) The Senior Data Engineer will be responsible for the build of Enterprise Data platform. Setting up the data pipelines that are scalable, robust...
-
Azure DataBricks
1 week ago
Kolkata, West Bengal, India Tata Consultancy Services Full time ₹ 8,00,000 - ₹ 12,00,000 per year• Design and implement scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks.• Develop and maintain ETL/ELT processes to ingest, transform, and integrate data from diverse sources.• Build and optimize data workflows using Databricks notebooks, PySpark, and SparkSQL for both batch and streaming data.•...
-
Azure Databricks
1 week ago
Kolkata, West Bengal, India Tata Consultancy Services (TCS) Full time ₹ 5,00,000 - ₹ 15,00,000 per year"• Design and implement scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks.Develop and maintain ETL/ELT processes to ingest, transform, and integrate data from diverse sources.Build and optimize data workflows using Databricks notebooks, PySpark, and SparkSQL for both batch and streaming data.Collaborate...
-
Senior Data Engineer
2 days ago
Kolkata, West Bengal, India Sundew Full time ₹ 8,00,000 - ₹ 24,00,000 per yearAbout the role :We are looking for a Data Engineer with strong Databricks expertise to join our team. This role will be pivotal in building robust ingestion pipelines, creating curated data views, and normalizing legacy datasets from sources like SharePoint, Excel, and other business systems. The ideal candidate will bring hands-on technical skills along...
-
Senior Data Engineer
2 days ago
Kolkata, West Bengal, India Tata Consultancy Services Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per yearGreetings from TCSJob Title: Senior Data EngineerRequired Skillset: Python, Spark, Databricks, AWS (S3, Glue, AirFlow, Cloudwatch, Lambda)Experience Range: 8+ yearsJob DescriptionROLE AND MISSION DESCRIPTIONMain tasksMaster Databricks tools (job creation, cluster, notebook) and be able to query efficiently with SQLMaintain the platform in operational...
-
Azure Data Engineer
2 days ago
Kolkata, West Bengal, India viraaj hr solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob Title: Azure Data EngineerIndustry & Sector: Cloud Data & Analytics services within Enterprise IT and Cloud Consulting. We design and deliver scalable Azure-native data platforms, ETL/ELT pipelines, and analytics solutions that power enterprise reporting, analytics, and ML workloads for customers across finance, retail, healthcare, and technology...
-
Azure Data Engineer
1 week ago
Kolkata, West Bengal, India CARBYNETECH Full time ₹ 15,00,000 - ₹ 25,00,000 per yearBuilding and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutionsAzure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. Experience in migrating on-premise data warehouses to data...
-
Azure Data Architect
2 days ago
Kolkata, West Bengal, India Tata Consultancy Services (TCS) Full time ₹ 12,00,000 - ₹ 36,00,000 per yearTCS Inviting Applications for Kolkata Walk-In Drive Role: Azure Data Architect Exp : 8- 12 yrsLocation : Kolkata Walk-In Drive (Date- 29th Nov'2025) Desired Competencies (Technical/Behavioral Competency)Experience with creating Data Models, Data Lineages and Data flow diagramExperience with performing Data Migration using native tools from Azure, third...