Azure Databricks Engineer
1 month ago
We are hiring for Azure Databricks Engineer Data Engineering experience on AWS/Azure and Databricks Strong Experience in Databricks, AWS/Azure, and SQL , creation of jobs using Pyspark. good exposure to Python.
For one of the Fortune 500 Clients.
Company Name : Hum Technologies
Client : One of the Fortune 500 Companies
Location : Remote/ Hybrid
Role : Azure Databricks Engineer
Must-Have :
- 2+ years of strong experience in Data Engineering experience on AWS/Azure and Databricks
- Strong Experience in Databricks, AWS/Azure, and SQL is required.
- Should have experience in the creation of jobs using Pyspark.
- Should be extremely good with SQL and possess good exposure to Python.
- Experience Developing and tuning Spark Applications and Spark SQL queries.
- Should have experience in EMR, Glue Catalog
- Expertise in Implementing Data warehousing Solutions Good understanding of Databricks platform and can build data analytics solutions to support the required performance & scale.
- Should be able to create New Clusters and cluster Pools and attach existing clusters to the pool in DB.
- Should have some pool management experience.
- Should be good in Datawarehouse concepts.
- Should have good experience in Data Engineering in Databricks Batch process, Streaming is
Good to have :
- Should have good experience in creating Workflows & scheduling the pipelines.
- Should have good exposure to how to make packages or libraries available in DB.
- Should have good experience in Databricks default runtimes, Photon & Light is good to have.
- Some experience in Databricks SQL / DW in Databricks.
- Excellent communication and coordination skills and client-facing experience
- Good understanding of Delta file format, how to work with it using Apache Spark, and the benefits it provides to ETL workloads.
- Strong Analytical skills working with a large store of Databases and Tables.
- Knowledge of working with PagerDuty for alerting.
- Experience working directly with a customer to identify problems and solve problems.
- Excellent Problem-Solving Skills.
- Excellent Communication Skills.
Skill set :
- AWS/Azure, EMR, Glue Catalog, Pyspark, DataBricks
-
Azure Databricks Engineer
1 month ago
Anywhere in India/Multiple Locations, IN IT Source Global Full timeWe have Immediate Openings on Azure Databricks EngineerJob Description :- Design, develop, and maintain scalable data processing solutions using Azure Databricks and Azure Data Factory.- Build and optimize end-to-end data pipelines for batch and real-time data ingestion, transformation, and loading.- Develop complex ETL processes using PySpark on Databricks,...
-
Azure Databricks Engineer
1 month ago
Anywhere in India/Multiple Locations, IN SAN Engineering Solutions Full timeJob Description : Position : Azure Databricks EngineerExperience Level : 5 - 9 YearsLocation : Pan India (Remote Work Available)Job Type : Full-TimeAvailability : Immediate / Early Joiners PreferredAbout the Role :We are seeking a skilled Azure Databricks Engineer to join our dynamic team. The ideal candidate will have extensive experience in Azure services,...
-
Azure Databricks/Python Developer
1 month ago
Anywhere in India/Multiple Locations, IN AIMDek Technologies Pvt. Ltd. Full timeJob Title : Azure Databricks + Python Developer for FHIR Interface DevelopmentLocation : India (Remote)Employment Type : Full-timeJob Overview :We are seeking a highly skilled and motivated Azure Databricks + Python Developer to join our team. This role will focus on designing, developing, and implementing healthcare data integration interfaces using FHIR...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN Vysystems Full timeData Engineer Need short joinersJob Location : Bangalore - Manyata Tech ParkMode : Hybrid.Experience : 4-8 yearsJob Description : We are looking for a skilled Data Engineer with expertise in Azure Data Factory, Azure Databricks, PySpark, Snowflake, and SQL. The ideal candidate will play a key role in designing, building, and maintaining scalable data...
-
Azure Data Lead
6 months ago
Anywhere in India/Multiple Locations, IN Etaash Consulting Full timeYears of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...
-
Data Engineer/Architect/Manager
1 month ago
Anywhere in India/Multiple Locations, IN Spectrum Consulting Full timeJob Description Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines...
-
Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN PureSoftware Pvt Ltd. Full timeWe are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure Data Engineer,Mandatory Skills :- Databricks(PySpark, Scala)- Data Factory/Synapse- SQL DB and DW- Working knowledge on Git Roles and Responsibilities :Requirements :- 4+ years of experience working as a Data Engineer, with a focus on Azure cloud platform.- Good...
-
Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations, IN Apidel Technologies Full timeData Engineer | 100% Remote | 12-Month Contract. We are looking for an experienced Data Engineer to join our team on a 12-month remote contract. This role offers a great opportunity to work with Azure services, including Azure Databricks, Azure DataFactory, and Azure DevOps, to build secure, scalable data pipelines. What You'll Do :- Develop data...
-
Prep.Study - Azure Data Engineer - ETL
1 month ago
Anywhere in India/Multiple Locations, IN Prep.Study Full timeJob Description : - Design, architect, and develop end-to-end data solutions on the Azure Stack platform. - Implement and optimize data pipelines, ETL processes, and data integration solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and other relevant Azure services. - Collaborate with data scientists, analysts, and...
-
Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN Scaling Theory Technologies Pvt Ltd Full timeRoles and Responsibilities :- Information Model object build/enhancements (PO, Invoice, SES, RO, Vendor, etc) based on functional design- Technical/Functional validation of IM objects- Troubleshooting issues with code and implementing fixes- Support daily data loads from SAP/NonSAP systems into Information ModelTechnical Skills :- SQL Expert - Build [must...
-
Big Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN Stratosphere IT Services PVT Ltd Full timeJob Description : - Azure data Engineer - Azure Data Factory - azure databricks- python - sql- Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database- Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview.- Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java.- Some experience...
-
Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN Naukari Wale Full timeJob Description :Requirement : - Python : They should have good experience in Python Coding, Array handling.- SQL Expert - Build [must have]- Azure / Databrick / Cloud Certifications- Azure Synapse, Azure Logic apps- Data Modelling - Data structures & common algorithms. - Understand E2E Data Flow from - Ingestion to Exploitation [must have]- Azure Databricks...
-
Excelra - Data Engineer - Python/AWS/Azure
1 month ago
Anywhere in India/Multiple Locations, IN Excelra Knowledge Solutions Full timeData Engineer (Cloud & Ontologies)Job Description : Excelra is hiring for experienced Data Engineer with expertise in ontologies, AWS, Azure, and various data technologies. The role involves building and maintaining scalable data pipelines, working with cloud platforms, and supporting server and application deployment.Roles and Responsibilities : - Cloud...
-
Azure Technical Lead
1 month ago
Anywhere in India/Multiple Locations, IN D-TechWorks Pvt Ltd Full timeWe are looking for Azure Tech Lead for migration projectsLocation : RemoteExp : 8 to 10 yrsMandatory Skills : ETL ARCHITECTURE, Azure, DataStage, Azure data, ETL, Azure Data Factory , Azure Tech Lead with good understanding of Azure data factory, databricks and other Azure services Datastage/SSIS or any other ETL tool background will be nice to have...
-
Azure Data Engineer
4 weeks ago
Anywhere in India/Multiple Locations, IN estrel.ai Full timeJob Description :- 5 - 8 years of experience in IT Industry- - 4/5+ years of experience with Azure Data Engineering Stack (Event Hub, Data Factory , Cosmos DB, Synapse, SQL DB, Databricks, Data Explorer) - 3+ years of experience with Python / Pyspark, Spark, Scala, Hive, Impala - Excellent knowledge of SQL and coding skills - Good understanding of other...
-
Genpact - Databricks Developer - Python/Scala
1 month ago
Anywhere in India/Multiple Locations, IN GENPACT India Private Limited Full timeJob Description :Inviting applications for the role of Principal Consultant- Databricks Developer AWS!In this role, the Databricks Developer is responsible for- solving the real world cutting edge problem to meet both functional and non-functional requirements.Responsibilities :- Maintains close awareness of new and emerging technologies and their potential...
-
Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations, IN Pyramid Consulting Full timeRole and Accountabilities : Title: Azure Data Engineer with Azure Machine Learning Expertise Job Description : Key Responsibilities :Data Engineering and Management :- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.- Implement data warehousing solutions and ensure data quality and...
-
Data Architect
1 month ago
Anywhere in India/Multiple Locations, IN RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full timePosition Overview :We are looking for an experienced Data Architect with expertise in Databricks, Apache Spark, and ETL processes. The ideal candidate will have a proven track record of designing and building robust data applications from the ground up. You will play a key role in shaping our data strategy and ensuring our data solutions meet business needs...
-
Azure Data Engineer
4 weeks ago
Remote/Anywhere in India/Multiple Locations, IN SMARTWORK IT SERVICES Full timeJob Title : Azure Data Engineer. Experience : 10-14 years. Availability : Immediate Joiners. Job Type : Contract position. Work Mode : Remote (India). Job Description :- We are seeking an experienced Azure Data Engineer to join our team for a short-term project.- The ideal candidate will have extensive experience in data engineering, with a strong emphasis...
-
Azure Data Engineer
1 month ago
Anywhere in India/Multiple Locations/Mumbai/Bangalore/Hyderabad/Kolkata/Chennai/Pune/Bhubaneshwar/Na, IN Talpro Full timeJob Description : We are looking for a skilled and experienced Azure Data Engineer with expertise in ADF (Azure Data Factory), strong RDBMS and SQL skills, and familiarity with Informatica PWC and Oracle PL/SQL. As an Azure Data Engineer, you will be responsible for understanding and converting Informatica PWC and Oracle PL/SQL code into ADF and Azure SQL....