AWS, Databricks, Python, Pyspark

Job DescriptionJob Description:- Lead Data Engineer AWS Databricks Python PysparkKey Responsibilities:- A day in the life of an Infoscion- As part of the Infosys consulting team your primary role would be to lead the engagement effort of providing high quality and value adding consulting solutions to customers at different stages from problem definition to...

Role Overview:We're seeking a Senior Databricks Developer to build scalable and performant data workflows using modern data stack tools. This role will focus on engineering robust pipelines to transform raw data into reliable datasets for analytics and business use.Responsibilities:Build and maintain production-grade Python,  PySpark, Databricks, API...

Exp - 10 yearsLocation - PAN IndiaProven experience with Databricks Python Spark SparkSQL and AWSxc2xb7 Databricks Certification Data Engineer Associate preferredxc2xb7 Experience of Migration to Databricks from traditional cloud warehousesxc2xb7 Take Ownership and can perform as an individual contributorxc2xb7 Good understanding on Databricks Setup will...

Job Title: Databricks Engieer- LeadPrimary skills: Databricks, PySpark, SQLSecondary skills: Advanced SQL, Azure Data Factory, and Azure Datalake.Mode of Work: Work from OfficeLocation: HyderabadExperience: 7 to 10 YearsResponsibilities· Design and develop ETL pipelines using ADF for data ingestion and transformation.· Collaborate with Azure stack modules...

Job Title: Databricks Engieer- LeadPrimary skills: Databricks, PySpark, SQLSecondary skills: Advanced SQL, Azure Data Factory, and Azure Datalake.Mode of Work: Work from OfficeLocation: HyderabadExperience: 7 to 10 YearsResponsibilities· Design and develop ETL pipelines using ADF for data ingestion and transformation. · Collaborate with Azure stack modules...

Job Title: Freelance Data EngineerRole SummaryWe are seeking a seasoned data professional with deep expertise in Python and AWS services (S3, Glue, Step Functions, PySpark) to design, develop, and optimize data pipelines for efficient data management.Key Responsibilities:Design and develop scalable data pipelines using AWS Glue, PySpark, and Step...

Job Description- Develop modern data solutions and architecture for cloud-native data platforms.- Build cost-effective infrastructure in Databricks and orchestrate workflows using Databricks/ADF.- Lead data strategy sessions focused on scalability, performance, and flexibility.- Build CI/CD pipelines for Databricks in Azure DevOps.- Collaborate with...

Job Description Choosing Capgemini means choosing a company where you will be empowered to shape your career in the way you'd like, where you'll be supported and inspired by a collaborative community of colleagues around the world, and where you'll be able to reimagine what's possible. Join us and help the world's leading organizations unlock the value of...

Job Description- Design, develop, and maintain scalable data pipelines using PySpark and related big data technologies.- Work with large datasets and develop data models for consumption by data scientists and analysts.- Optimize Spark jobs for better performance and resource management.- Design and implement data integration workflows between various data...

Lead Data Engineer - Databricks SpecialistJob Summary:We are seeking a seasoned data engineering expert with expertise in Databricks, PySpark, and SQL to spearhead our data engineering initiatives.Main Responsibilities:Design and develop end-to-end data pipelines using Azure Data Factory for seamless data ingestion and transformation.Collaborate closely with...