PySpark, Azure Databricks, ADF, Azure Synapse
3 weeks ago
Detailed JD (Roles and Responsibilities) Design and develop scalable ETL pipelines using Azure Databricks, PySpark, and Azure Data Factory to ingest, transform, and integrate data from multiple internal and external sources.Ensure data quality, consistency, and reliability across complex data workflows and large-scale datasets.Collaborate with data architects, analysts, and business stakeholders to understand data requirements and deliver efficient data solutions.Optimize data processing performance and implement best practices for data engineering in cloud environments.Work in Agile development environments, contributing to sprint planning, reviews, and continuous integration and delivery cycles.Good understanding of retail or consumer business process will be a plusExperience in working in Agile project developmentVery strong communication skills and client management skills.Total Experience 6+ YearsRelevant Experience 5+ YearsMandatory skills PySpark, Azure Databricks, ADF, Azure Synapse.Desired skills SQLDomain (Industry) Retail – Media Campaign data Analytics
-
Azure Data Migration Specialist
2 days ago
mangalore, India beBeeDataMigration Full timeJob OverviewWe are seeking a seasoned Data Migration Specialist to join our team and lead the migration of large-scale SQL workloads from on-premise environments to Azure. As an experienced professional in data engineering, you will design, develop, and manage end-to-end data pipelines using Azure Data Factory or Synapse Data Factory to orchestrate migration...
-
Azure Platform Specialist
2 days ago
mangalore, India beBeeDataEngineer Full timeKey Azure Data Engineer RoleThis critical role involves the design, development and maintenance of data platforms utilizing Azure services. Key responsibilities include designing efficient data pipelines, collaborating with stakeholders to meet business objectives, ensuring data security and compliance, and staying up-to-date with the latest Azure...
-
AVP - Databricks Architect
3 weeks ago
Mangalore, India Impetus Career Consultants Full timeAssistant Vice President – Lead Databricks ArchitectShift Type: UK ShiftWork Model: 5 Days Work From OfficeLead the design and delivery of large-scale data engineering solutions on Azure and Databricks Lakehouse. This role focuses on scalable data pipelines, Unity Catalog governance, ML/LLM enablement, and driving engineering excellence.Key...
-
Lead data engineer
2 weeks ago
Mangalore, India Prophecy Technologies Full time???? We’re Hiring: LEAD DATA ENGINEER ???? Location: HYDERABAD(HYBRID) ???? ???? Experience: 7+ Years ⏳ Notice Period: Immediate to 30 Days Responsibilities Design, build, and optimize scalable data pipelines on Azure Data Lake, Azure Databricks, and Azure Synapse. Develop ETL/ELT workflows using Py Spark, Python, and Databricks notebooks. Implement and...
-
Microsoft Azure Data Architect Leader
2 days ago
mangalore, India beBeeDataLeader Full timeJob OverviewWe are seeking a seasoned data architect to spearhead the development of Microsoft Azure-based data solutions.This role demands expertise in CI-CD, PySpark, SQL, ADF, ADLS & ADB, and Azure Services. Additionally, experience with GIT, Jenkins, and Azure DevOps is required.As a key member of our team, you will lead and architect data solutions,...
-
Experienced Cloud Data Engineer
2 days ago
mangalore, India beBeeDataEngineer Full timeJob OpportunityWe are seeking a seasoned Data Engineering professional to join our team.Key Responsibilities:Design and implement efficient ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks (PySpark).Develop API integrations for seamless data exchange between systems.Write and optimize SQL queries and stored procedures for data transformation,...
-
Azure Data Engineer
2 weeks ago
Mangalore, India Capgemini Invent Full timeAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...
-
Azure Data Engineer
2 weeks ago
Mangalore, India Capgemini Invent Full timeAt Capgemini Invent, we believe difference drives change. As inventive transformation consultants, we blend our strategic, creative and scientific capabilities, collaborating closely with clients to deliver cutting-edge solutions. Join us to drive transformation tailored to our client's challenges of today and tomorrow. Informed and validated by science and...
-
Data Platform Specialist
4 days ago
mangalore, India beBeeDataSupport Full timeData Support Engineer Job DescriptionOur team is seeking an experienced Data Support Engineer to join our growing organization. This role requires a strong background in data engineering and technical expertise in SQL, Python, ETL/ELT pipelines, and cloud technologies.We are looking for someone with 8+ years of experience in data support engineering and a...
-
Big Data Analytics Expert
4 days ago
mangalore, India beBeeDatabrick Full timeThe role of an Azure Databricks professional involves working with strong hands-on experience in Microsoft Azure services like Data Factory, Storage, Synapse, and Key Vault. Proficiency in Databricks is essential, including cluster management, job execution, and troubleshooting.Key responsibilities include managing data ingestion pipelines, handling ETL/ELT...