Spark & Delta Lake

Key Skills: Spark, Azure Databricks, Apache Spark, Python, Delta Lake, Kafka, Snowflake, Qlik, CI/CD, AzureRoles & Responsibilities:Design, develop, and maintain scalable data pipelines using Azure Databricks and Spark.Implement data processing solutions with Delta Lakes and manage multiple file formats.Collaborate with cross-functional teams to ensure data...

Roles and ResponsibilitiesDesign, develop, test, deploy, and maintain large-scale data pipelines using Apache Spark, Delta Lake, ETL processes.Collaborate with cross-functional teams to gather requirements and deliver high-quality solutions on time.Develop complex SQL queries to optimize database performance and troubleshoot issues.Ensure scalability,...

Job Title:Databricks DeveloperLocation:Bangalore, Chennai, Hyderabad, PuneExperience:5–7 YearsAbout the RoleWe are seeking an experiencedDatabricks Developerwith 5–7 years of expertise in Big Data engineering and analytics platforms. The ideal candidate will have strong hands-on experience inApache Spark, Databricks, PySpark, and cloud platforms such...

Senior AWS Data EngineerOverview:We are seeking experienced AWS Data Engineers to design, implement, and maintain robust data pipelines and analytics solutions using AWS services. The ideal candidate will have a strong background in AWS data services, big data technologies, and programming languages.Exp- 3 to 7 years Location- Bangalore, Pune, Hyderabad,...

Greetings from TCSTCS is hiring Data Engineer (Databricks)Location – PAN INDIAYears of Experience – 10-16 yearsJob DescriptionRole- Senior Data Engineer – DatabricksRequired Technical Skill SetDatabricks, PySpark, Delta Lake, MLflow, Azure/AWS/GCP, Data Lakehouse architecture, CI/CD, DataOpsDesired CompetenciesMust-HaveExpertise in building scalable...

Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...

Notice Period : Immediate to 30 daysMandatoryScala and PythonApache Spark (batch & streaming) mustDeep knowledge of HDFS internals and migration strategies.Experience with Apache Iceberg (or similar table formats like Delta Lake / Apache Hudi) for schema evolution, ACID transactions, and time travel.Running Spark and/or Flink jobs on Kubernetes (e.g.,...

Were seeking a passionate and experienced Senior Python & Machine Learning Engineer to join our Data domain team. Youll work on unique, one-of-a-kind problem statements using advanced GenAI, large language models (LLMs), and modern data engineering frameworks. You will help conceptualize and deliver impactful solutions that push the boundaries of data...

Title: PySpark Data EngineerExp: 6+Hyderabad, India____Required QualificationsBachelor's or Master's degree in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a strong background in PySpark and Apache Spark .Extensive experience in building and optimizing data pipelines and ETL processes.Proficiency...

Skills And DevelopmentBuild Azure data factory pipeline, Azure Data Lake, DatawarehouseDesign, develop, and maintain data pipelines and ETL processes to extract, transform, and load data from various sources into data warehouseOptimize and fine-tune data processes to ensure high performance and reliabilityImplement data validation, testing, and quality...