Spark & Delta Lake Professional

We are currently seeking an experienced professional to join our team in the role of Senior Software Engineer.In this role you will:Understanding of Spark core concepts like RDDs, DataFrames, DataSets, SparkSQL and Spark Streaming.Experience with Spark optimization techniques.Deep knowledge of Delta Lake features like time travel, schema evolution, data...

Key Skills: Spark, Azure Databricks, Apache Spark, Python, Delta Lake, Kafka, Snowflake, Qlik, CI/CD, AzureRoles & Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Databricks and Spark.Implement data processing solutions with Delta Lakes and manage multiple file formats.Collaborate with cross-functional teams to ensure data...

Greetings from TCSTCS is Hiring for Senior Data Consultant Interview Mode: Virtual Required Experience: 10-16 years Work location: PAN INDIAMust-Have Databricks (including Py Spark, Delta Lake, MLflow)Snowflake (data warehousing, performance tuning, data sharing)Data Lake architecture Cloud platforms: Azure, AWS, GCPCI/CD and Data Ops practices Legacy system...

Data Architect - ETL/ELT Pipeline SpecialistJob Summary:We are seeking a highly skilled Data Engineer with 4-7 years of experience to design, build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.The ideal candidate will have expertise in working across scrum teams to develop data solutions, ensuring data governance...

Job descriptionSome careers shine brighter than others.If you're looking for a career that will help you stand out, join HSBC and fulfil your potential. Whether you want a career that could take you to the top, or simply take you in an exciting new direction, HSBC offers opportunities, support and rewards that will take you further.HSBC is one of the largest...

Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

Greetings from TCSTCS is hiring Data Engineer (Databricks)Location – PAN INDIAYears of Experience – 10-16 yearsJob DescriptionRole - Senior Data Engineer – DatabricksRequired Technical Skill SetDatabricks, PySpark, Delta Lake, MLflow, Azure/AWS/GCP, Data Lakehouse architecture, CI/CD, DataOpsDesired CompetenciesMust-HaveExpertise in building scalable...

Data Engineer RoleJob Overview:We are seeking an experienced Data Engineer to join our team in designing and implementing advanced analytics solutions using Azure technologies.Key Responsibilities:Design and Develop Data PipelinesBuild and Maintain Data WarehousesDevelop and Implement Data ModelsEnsure Data Security and GovernanceRequirements:Proficiency in...

Senior Data Consultant Job OverviewWe are seeking a seasoned Senior Data Consultant to spearhead our data strategy. This is an exciting opportunity to leverage your skills in data architecture, engineering, and analytics to drive business growth.Design and implement scalable data lake architectures on cloud platforms (Databricks, Snowflake)Migrate legacy...

Job Overview This role involves designing, implementing and optimizing scalable big data solutions using Databricks. The goal is to build high-performance, cost-efficient data architectures that drive strategic decision-making. As a Databricks Engineer, you will collaborate with data scientists, ML engineers and business stakeholders to architect robust...