Spark & Delta Lake

Client Name : Nishant Jain ; JD: Spark & Delta Lake Understanding of Spark core concepts like RDDs DataFrames DataSets SparkSQL and Spark Streaming. Experience with Spark optimization techniques. Deep knowledge of Delta Lake features like time travel schema evolution data partitioning. Ability to design and implement data pipelines using Spark and Delta Lake...

Job Title : Senior-Level Data Engineer – Healthcare DomainLocation: HyderabadExperience: 5+ YearsEmployment Type: Full-TimeAbout the RoleWe are looking for a Senior Data Engineer with extensive experience in healthcare data ecosystems and Databricks-based pipelines. The ideal candidate brings deep technical expertise in building large-scale data platforms,...

Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. Experience in Sales & Marketing domains is a plus. The role involves developing and optimizing data solutions to...

Design, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...

Roles and ResponsibilitiesDesign, develop, test, deploy, and maintain large-scale data pipelines using Apache Spark, Delta Lake, ETL processes.Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time.Develop complex SQL queries to optimize database performance and troubleshoot issues.Ensure scalability,...

Develop Spark Applications: Design and develop Spark applications using Java to process and analyze large data sets. Data Integration: Integrate various data sources such as databases, data lakes, and cloud storage into Spark applications. Optimize Performance: Optimize Spark jobs for performance, ensuring efficient execution of tasks and minimizing resource...

At Backbase, we're reimagining the future of banking through data and intelligence. Our Engagement Banking Platform enables financial institutions to deliver seamless, personalized customer experiences—and data is at the core of that transformation.As a Senior Data Engineer – Consultant, you'll play a key role in building scalable, secure, and...

Skills   • years of relevant IT experience in the BI/DW domain with minimum of hands-on experience on Azure modern data platform that includes Data Factory, Databricks, Synapse (Azure SQL DW) and Azure Data Lake • Meaningful experience of data analysis and transformation using Python/R/Scala on Azure Databricks or Apache Spark • Well versed NoSQL...

About the Role We are seeking a highly skilled and experienced Senior Azure Databricks Engineer to join our dynamic data engineering team. As a Senior Azure Databricks Engineer, you will play a critical role in designing, developing, and implementing data solutions on the Azure Databricks platform. You will be responsible for building and maintaining...

Were seeking a passionate and experienced Senior Python & Machine Learning Engineer to join our Data domain team. Youll work on unique, one-of-a-kind problem statements using advanced GenAI, large language models (LLMs), and modern data engineering frameworks. You will help conceptualize and deliver impactful solutions that push the boundaries of data...