Senior Data Engineer – Databricks
19 hours ago
Senior Data Engineer – Databricks
Location: Hyderabad/Chennai
Work Schedule: Timings 2:30 PM to 11:30 PM
Role Overview:
We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks to design, build, and optimize scalable data pipelines and architectures. You will collaborate with cross-functional teams including data scientists, analysts, and platform engineers to deliver high-quality, reliable, and secure data solutions.
Key Responsibilities:
- Design, develop, and maintain robust batch and streaming data pipelines using Databricks, Apache Spark, Delta Lake, and PySpark.
- Build and optimize ETL/ELT workflows to transform and integrate data from diverse sources.
- Implement Delta Live Tables (DLT) and Databricks Workflows for pipeline orchestration and automation.
- Ensure data quality, observability, and monitoring across all pipelines.
- Collaborate with cloud platform teams (AWS/Azure) to ensure proper setup of storage, networking, and security.
- Work within Agile teams, participating in sprint planning, code reviews, and deployments.
- Document pipeline processes, technical specifications, and architectural decisions.
- Stay current with emerging technologies and best practices in data engineering and cloud-native solutions.
Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- Around 5 years of experience in data engineering, with 3+ years hands-on in Databricks.
- Strong proficiency in PySpark, SQL, and Apache Spark.
- Experience with cloud platforms (Azure or AWS) and big data technologies (e.g., Kafka, Hadoop).
- Solid understanding of data warehousing, data modeling, and ETL processes.
- Familiarity with data governance, security, and compliance frameworks.
Preferred Skills:
- Experience with Delta Live Tables (DLT) and Unity Catalog.
- Knowledge of CI/CD pipelines, Git, and DevOps practices.
- Certifications in Databricks, AWS, or Azure are an added advantage.
Soft Skills:
- Excellent communication and collaboration skills.
- Strong problem-solving and analytical mindset.
- Ability to work independently and lead initiatives.
Job Types: Full-time, Permanent
Work Location: In person
-
Data Engineer- Databricks
17 hours ago
Chennai, Tamil Nadu, India InfoCepts Full time ₹ 15,00,000 - ₹ 22,00,000 per yearPosition: Data Engineer- DatabricksPurpose of the Position:Develop, support and steer end-to-end business intelligence using Databricks.Location: Nagpur/ Pune/ Chennai/ BangaloreKey Responsibilities:Work with business analysts and data architects to translate requirements into technical implementations.Design, develop, implement, and maintain pyspark code...
-
Data Engineer
2 days ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...
-
Senior Data Engineer- Azure Databricks
23 hours ago
Chennai, Tamil Nadu, India InfoCepts Full time ₹ 12,00,000 - ₹ 36,00,000 per yearPosition: Data Engineer- Azure DatabricksPurpose of the Position:To design, build, and optimize scalable data pipelines and solutions using Azure Databricks and related technologies, enabling Zodiac Maritime to make faster, data-driven decisions as part of its data transformation journey.Proficiency in data integration techniques, ETL processes and data...
-
Data Engineer – Databricks
2 weeks ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full time ₹ 15,00,000 - ₹ 25,00,000 per yearRole Summary:We are looking for aData Engineerwith expertise inAzure Databricks,data transformation, andintegration pipelinesto support forecasting, scheduling, and analytics flows in the WFM Re-Platform program.Key ResponsibilitiesDesign and implement data pipelines in Azure Databricks for ingesting and transforming data from upstream systems (SAP, PIPS,...
-
Data Engineer
2 days ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 9,00,000 - ₹ 12,00,000 per yearHiRole - Azure Data engineerLocation - Chennai, GurugramWork from officeFull timeImmediate joiner Only (15days Notice period only)Candidates with Certification in Databricks is good to haveTechnical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o...
-
Senior Data Engineer
6 days ago
Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per yearRole: Senior Data Engineer (Scala Specialist)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and...
-
Senior Databricks Engineer
7 days ago
Chennai, Tamil Nadu, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience : 8-15 years. Primary Roles And Responsibilities : Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. Ability to provide solutions that are forward-thinking in data engineering and analytics space. Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in...
-
Senior Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Info Services Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title: Senior Data EngineerJob SummaryWe are looking for a highly skilledSenior Data Engineerwith expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience inbatch and near real-time data processingwithin theAWS ecosystem, with hands-on exposure toDatabricks,...
-
Databrick
17 hours ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.Key...
-
Senior AWS Data Engineer
4 days ago
Chennai, Tamil Nadu, India Innovatz Global Full time ₹ 12,00,000 - ₹ 36,00,000 per yearCompany DescriptionInnovatz Global is a leading Management Consulting and Technology Services company with headquarters in Malaysia and a strong presence across multiple countries, including the U.S., India, China, and Australia. With over 500 skilled professionals, the company specializes in delivering innovative IT solutions and staffing services to...