Spark & Delta Lake developer

Understanding of Spark core concepts like RDDs, DataFrames, DataSets, SparkSQL and Spark Streaming.Experience with Spark optimization techniques.Deep knowledge of Delta Lake features like time travel, schema evolution, data partitioning.Ability to design and implement data pipelines using Spark and Delta Lake as the data storage layer.Proficiency in...

Key Skills: Spark, Azure Databricks, Apache Spark, Python, Delta Lake, Kafka, Snowflake, Qlik, CI/CD, AzureRoles & Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Databricks and Spark.Implement data processing solutions with Delta Lakes and manage multiple file formats.Collaborate with cross-functional teams to ensure data...

Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

Data Architect - ETL/ELT Pipeline SpecialistJob Summary:We are seeking a highly skilled Data Engineer with 4-7 years of experience to design, build and optimize scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.The ideal candidate will have expertise in working across scrum teams to develop data solutions, ensuring data governance...

Greetings from TCSTCS is Hiring for Senior Data Consultant Interview Mode: Virtual Required Experience: 10-16 years Work location: PAN INDIAMust-Have Databricks (including Py Spark, Delta Lake, MLflow)Snowflake (data warehousing, performance tuning, data sharing)Data Lake architecture Cloud platforms: Azure, AWS, GCPCI/CD and Data Ops practices Legacy system...

Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team. The ideal candidate will have extensive experience in Spark in Scala Delta Sharing Databricks Unity Catalog Admin Databricks CLI Delta Live Pipelines Structured Streaming Risk Management Apache Airflow Amazon S3 Amazon Redshift Python Databricks SQL...

Greetings from TCSTCS is hiring Data Engineer (Databricks)Location – PAN INDIAYears of Experience – 10-16 yearsJob DescriptionRole - Senior Data Engineer – DatabricksRequired Technical Skill SetDatabricks, PySpark, Delta Lake, MLflow, Azure/AWS/GCP, Data Lakehouse architecture, CI/CD, DataOpsDesired CompetenciesMust-HaveExpertise in building scalable...

We are seeking a highly experienced Lead Data Engineer to spearhead the development of a self-service data platform for reporting and analytics.Key Responsibilities:Lead the development of scalable data solutions with Databricks, SQL, Python, Spark, and Delta Lake on Azure.Ensure adherence to best practices for ETL/ELT and data quality.Collaborate with teams...

Senior Data Consultant Job OverviewWe are seeking a seasoned Senior Data Consultant to spearhead our data strategy. This is an exciting opportunity to leverage your skills in data architecture, engineering, and analytics to drive business growth.Design and implement scalable data lake architectures on cloud platforms (Databricks, Snowflake)Migrate legacy...

Effective Big Data Engineers drive business growth by leveraging cutting-edge technologies to process and analyze large datasets. We are seeking an experienced Databricks Developer to join our organization.Key Responsibilities:We design, develop, and maintain scalable data pipelines using Databricks, Apache Spark, and other relevant technologies.Our team...