Senior Data Engineer – Databricks
2 days ago
Senior Data Engineer – Databricks
Location: Hyderabad/Chennai
Work Schedule: Timings 2:30 PM to 11:30 PM
Role Overview:
We are seeking a highly skilled Senior Data Engineer with deep expertise in Databricks to design, build, and optimize scalable data pipelines and architectures. You will collaborate with cross-functional teams including data scientists, analysts, and platform engineers to deliver high-quality, reliable, and secure data solutions.
Key Responsibilities:
- Design, develop, and maintain robust batch and streaming data pipelines using Databricks, Apache Spark, Delta Lake, and PySpark.
- Build and optimize ETL/ELT workflows to transform and integrate data from diverse sources.
- Implement Delta Live Tables (DLT) and Databricks Workflows for pipeline orchestration and automation.
- Ensure data quality, observability, and monitoring across all pipelines.
- Collaborate with cloud platform teams (AWS/Azure) to ensure proper setup of storage, networking, and security.
- Work within Agile teams, participating in sprint planning, code reviews, and deployments.
- Document pipeline processes, technical specifications, and architectural decisions.
- Stay current with emerging technologies and best practices in data engineering and cloud-native solutions.
Required Qualifications:
- Bachelor's or Master's degree in Computer Science, Engineering, or related field.
- Around 5 years of experience in data engineering, with 3+ years hands-on in Databricks.
- Strong proficiency in PySpark, SQL, and Apache Spark.
- Experience with cloud platforms (Azure or AWS) and big data technologies (e.g., Kafka, Hadoop).
- Solid understanding of data warehousing, data modeling, and ETL processes.
- Familiarity with data governance, security, and compliance frameworks.
Preferred Skills:
- Experience with Delta Live Tables (DLT) and Unity Catalog.
- Knowledge of CI/CD pipelines, Git, and DevOps practices.
- Certifications in Databricks, AWS, or Azure are an added advantage.
Soft Skills:
- Excellent communication and collaboration skills.
- Strong problem-solving and analytical mindset.
- Ability to work independently and lead initiatives.
Job Types: Full-time, Permanent
Work Location: In person
-
Databricks Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India, Tamil Nadu Tata Consultancy Services Full timeAbout the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...
-
Data Engineer
2 days ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...
-
Senior Data Engineer
2 days ago
Chennai, Tamil Nadu, India Grethena Full time ₹ 20,00,000 - ₹ 25,00,000 per yearCompany Description:Company: Grethena Private LimitedLocation: ChennaiExperience:5+ yearsSalary: As per market standardsJob Title:Senior Data EngineerAbout us:Grethena - Shaping The Digital Landspace Our team of experts has years of experience in App, AI, OTT Platform and Booking App Development. We are passionate about helping our clients succeed...
-
Senior Data Engineer
1 week ago
Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per yearRole: Senior Data Engineer (Scala Specialist)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and...
-
Senior Databricks Engineer
1 week ago
Chennai, Tamil Nadu, India Zorba Consulting Full time ₹ 12,00,000 - ₹ 36,00,000 per yearExperience : 8-15 years. Primary Roles And Responsibilities : Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack. Ability to provide solutions that are forward-thinking in data engineering and analytics space. Collaborate with DW/BI leads to understand new ETL pipeline development requirements. Triage issues to find gaps in...
-
Senior Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India Info Services Full time ₹ 8,00,000 - ₹ 24,00,000 per yearJob Title: Senior Data EngineerJob SummaryWe are looking for a highly skilledSenior Data Engineerwith expertise in designing, building, and optimizing large-scale data pipelines and integration frameworks. The ideal candidate will have strong experience inbatch and near real-time data processingwithin theAWS ecosystem, with hands-on exposure toDatabricks,...
-
Senior Data Engineer
2 days ago
Chennai, Tamil Nadu, India SGS & Co Full time ₹ 12,00,000 - ₹ 36,00,000 per yearPosition Title : Senior Data Engineer Experience Required : 8 to 12 Years Location : Remote Job Summary : We are looking for a highly skilled and experienced Data Engineer with strong expertise in Databricks, PySpark, and big data technologies. The ideal candidate will play a key role in designing, building, and optimizing scalable data pipelines...
-
Data Architect- Databricks
2 weeks ago
Chennai, Tamil Nadu, India InfoCepts Full time ₹ 12,00,000 - ₹ 36,00,000 per yearPosition: Data Architect (Databricks, Snowflake)Location: Nagpur, Pune, Chennai, BangaloreType of Employment: Full time EmploymentPurpose of the Position:Design and optimize cloud-native data architectures on platforms like Databricks and Snowflake, enabling scalable data engineering, advanced analytics, and AI/ML solutions aligned with business needs.Key...
-
Databrick
2 days ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 12,00,000 - ₹ 36,00,000 per yearWe are seeking an experienced Databricks Developer with 5 to 7 years of expertise in big data engineering and analytics platforms. The ideal candidate will have deep experience in Apache Spark Databricks PySpark and cloud platforms such as Azure or AWS and a strong background in data pipeline development performance optimization and data governance.Key...
-
Senior Data Engineer
1 week ago
Chennai, Tamil Nadu, India Sightspectrum Full time ₹ 1,04,000 - ₹ 1,30,878 per yearHi All,We are hiring for Sr Data Engineer position, who can join immediately. If you are interested, drop your resume at Primary Skills: Advanced SQL Server, ETL development using SSIS, Azure Data Factory, and Databricks, Power BI, Data warehousing, Data quality and validation, General Microsoft technology stackJob Summary:We are seeking a highly skilled and...