Databricks +Hadoop+ Python + SQL+Pyspark Professional

We are looking for a skilled professional with 6 to 11 years of experience in Databricks and Snowflake to join our team in Pune, Bangalore, Chennai, and Coimbatore. The ideal candidate will have a strong background in data processing and analytics.Roles and ResponsibilityDesign and develop scalable data pipelines using Azure Data Factory and Azure Data...

Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. InsureMO rating engine experience required. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming). Develop and maintain robust data pipelines...

Job Description ROLE RESPONSIBILITIES Data Engineering and Processing: Develop and manage data pipelines using PySpark on Databricks. Implement ETL/ELT processes to process structured and unstructured data at scale. Optimize data pipelines for performance, scalability, and cost-efficiency in Databricks. Databricks Platform Expertise: Experience in...

Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue.Collaborate with domain experts...

Experience with Azure datafactory,Azure ,Python, Pyspark, Databricks, SQL Key ResponsibilitiesDesign and build ETL/ELT pipelines to ingest, transform, and load data from clinical, omics, research, and operational sources.Optimize performance and scalability of data flows using tools like Apache Spark, Databricks, or AWS Glue.Collaborate with domain experts...

Python, Pyspark 5 Technology Lead (Data Engineer) BE - 8+ years of industry experience as Lead Developer - Experience in implementing ETL and ELT data pipelines with PySpark - Spark Structured API, SPARK SQL & Spark Performance tuning are highly preferred. - Experience in building data pipelines on data lake or Lakehouse(AWS Databricks) & handling...

About the Job :We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark. - Work with Databricks platform using Spark for big data processing and analytics. - Write optimized and efficient code using PySpark, Spark SQL and Python. - Develop and maintain ETL processes using Databricks notebooks and workflows. - Implement and...

We are looking for a skilled professional with 5-10 years of experience to join our team as a Databricks expert in Pune, Chennai, Coimbatore, and Bangalore.Roles and ResponsibilityDesign and develop data pipelines using Azure Data Bricks and Azure Data Factory.Collaborate with cross-functional teams to integrate data from various sources into a unified data...

JOB ROLE : Data engineer Work mode : On-site /Hybrid Location : Bangalore Experience : 6+ years We are looking for a self-driven and technically strong Data Engineer with 46 years of experience to join our growing team. The ideal candidate will be proficient in SQL, Databricks,Kafka and PySpark, and capable of managing end-to-end (E2E) data deliverables...

Key Responsibilities: Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...