Azure Databricks Engineer

3 weeks ago


Anywhere in IndiaMultiple Locations, IN Hum Technologies Full time

We are hiring for Azure Databricks Engineer Data Engineering experience on AWS/Azure and Databricks Strong Experience in Databricks, AWS/Azure, and SQL , creation of jobs using Pyspark. good exposure to Python.

For one of the Fortune 500 Clients.

Company Name : Hum Technologies

Client : One of the Fortune 500 Companies

Location : Remote/ Hybrid

Role : Azure Databricks Engineer

Must-Have :

- 2+ years of strong experience in Data Engineering experience on AWS/Azure and Databricks

- Strong Experience in Databricks, AWS/Azure, and SQL is required.

- Should have experience in the creation of jobs using Pyspark.

- Should be extremely good with SQL and possess good exposure to Python.

- Experience Developing and tuning Spark Applications and Spark SQL queries.

- Should have experience in EMR, Glue Catalog

- Expertise in Implementing Data warehousing Solutions Good understanding of Databricks platform and can build data analytics solutions to support the required performance & scale.

- Should be able to create New Clusters and cluster Pools and attach existing clusters to the pool in DB.

- Should have some pool management experience.

- Should be good in Datawarehouse concepts.

- Should have good experience in Data Engineering in Databricks Batch process, Streaming is

Good to have :

- Should have good experience in creating Workflows & scheduling the pipelines.

- Should have good exposure to how to make packages or libraries available in DB.

- Should have good experience in Databricks default runtimes, Photon & Light is good to have.

- Some experience in Databricks SQL / DW in Databricks.

- Excellent communication and coordination skills and client-facing experience

- Good understanding of Delta file format, how to work with it using Apache Spark, and the benefits it provides to ETL workloads.

- Strong Analytical skills working with a large store of Databases and Tables.

- Knowledge of working with PagerDuty for alerting.

- Experience working directly with a customer to identify problems and solve problems.

- Excellent Problem-Solving Skills.

- Excellent Communication Skills.

Skill set :

- AWS/Azure, EMR, Glue Catalog, Pyspark, DataBricks

(ref:hirist.tech)

  • Anywhere in India/Multiple Locations, IN IT Source Global Full time

    We have Immediate Openings on Azure Databricks EngineerJob Description :- Design, develop, and maintain scalable data processing solutions using Azure Databricks and Azure Data Factory.- Build and optimize end-to-end data pipelines for batch and real-time data ingestion, transformation, and loading.- Develop complex ETL processes using PySpark on Databricks,...


  • Anywhere in India/Multiple Locations, IN SAN Engineering Solutions Full time

    Job Description : Position : Azure Databricks EngineerExperience Level : 5 - 9 YearsLocation : Pan India (Remote Work Available)Job Type : Full-TimeAvailability : Immediate / Early Joiners PreferredAbout the Role :We are seeking a skilled Azure Databricks Engineer to join our dynamic team. The ideal candidate will have extensive experience in Azure services,...


  • Anywhere in India/Multiple Locations, IN AIMDek Technologies Pvt. Ltd. Full time

    Job Title : Azure Databricks + Python Developer for FHIR Interface DevelopmentLocation : India (Remote)Employment Type : Full-timeJob Overview :We are seeking a highly skilled and motivated Azure Databricks + Python Developer to join our team. This role will focus on designing, developing, and implementing healthcare data integration interfaces using FHIR...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Vysystems Full time

    Data Engineer Need short joinersJob Location : Bangalore - Manyata Tech ParkMode : Hybrid.Experience : 4-8 yearsJob Description : We are looking for a skilled Data Engineer with expertise in Azure Data Factory, Azure Databricks, PySpark, Snowflake, and SQL. The ideal candidate will play a key role in designing, building, and maintaining scalable data...

  • Azure Data Lead

    5 months ago


    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...


  • Anywhere in India/Multiple Locations, IN Spectrum Consulting Full time

    Job Description Roles and Responsibilities :- Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack- Ability to provide solutions that are forward-thinking in data engineering and analytics space- Collaborate with DW/BI leads to understand new ETL pipeline development requirements.- Triage issues to find gaps in existing pipelines...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN PureSoftware Pvt Ltd. Full time

    We are seeking a talented and experienced Azure Data Engineer to join our team. As an Azure Data Engineer,Mandatory Skills :- Databricks(PySpark, Scala)- Data Factory/Synapse- SQL DB and DW- Working knowledge on Git Roles and Responsibilities :Requirements :- 4+ years of experience working as a Data Engineer, with a focus on Azure cloud platform.- Good...


  • Anywhere in India/Multiple Locations, IN Prep.Study Full time

    Job Description : - Design, architect, and develop end-to-end data solutions on the Azure Stack platform. - Implement and optimize data pipelines, ETL processes, and data integration solutions using Azure Data Factory, Azure Data Lake, Azure Databricks, Azure SQL Database, and other relevant Azure services. - Collaborate with data scientists, analysts, and...

  • Azure Data Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations, IN Scaling Theory Technologies Pvt Ltd Full time

    Roles and Responsibilities :- Information Model object build/enhancements (PO, Invoice, SES, RO, Vendor, etc) based on functional design- Technical/Functional validation of IM objects- Troubleshooting issues with code and implementing fixes- Support daily data loads from SAP/NonSAP systems into Information ModelTechnical Skills :- SQL Expert - Build [must...

  • Big Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Stratosphere IT Services PVT Ltd Full time

    Job Description : - Azure data Engineer - Azure Data Factory - azure databricks- python - sql- Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database- Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview.- Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java.- Some experience...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Naukari Wale Full time

    Job Description :Requirement : - Python : They should have good experience in Python Coding, Array handling.- SQL Expert - Build [must have]- Azure / Databrick / Cloud Certifications- Azure Synapse, Azure Logic apps- Data Modelling - Data structures & common algorithms. - Understand E2E Data Flow from - Ingestion to Exploitation [must have]- Azure Databricks...


  • Anywhere in India/Multiple Locations, IN Excelra Knowledge Solutions Full time

    Data Engineer (Cloud & Ontologies)Job Description : Excelra is hiring for experienced Data Engineer with expertise in ontologies, AWS, Azure, and various data technologies. The role involves building and maintaining scalable data pipelines, working with cloud platforms, and supporting server and application deployment.Roles and Responsibilities : - Cloud...

  • Azure Technical Lead

    3 weeks ago


    Anywhere in India/Multiple Locations, IN D-TechWorks Pvt Ltd Full time

    We are looking for Azure Tech Lead for migration projectsLocation : RemoteExp : 8 to 10 yrsMandatory Skills : ETL ARCHITECTURE, Azure, DataStage, Azure data, ETL, Azure Data Factory , Azure Tech Lead with good understanding of Azure data factory, databricks and other Azure services Datastage/SSIS or any other ETL tool background will be nice to have...

  • Azure Data Engineer

    3 days ago


    Anywhere in India/Multiple Locations, IN estrel.ai Full time

    Job Description :- 5 - 8 years of experience in IT Industry- - 4/5+ years of experience with Azure Data Engineering Stack (Event Hub, Data Factory , Cosmos DB, Synapse, SQL DB, Databricks, Data Explorer) - 3+ years of experience with Python / Pyspark, Spark, Scala, Hive, Impala - Excellent knowledge of SQL and coding skills - Good understanding of other...


  • Anywhere in India/Multiple Locations, IN GENPACT India Private Limited Full time

    Job Description :Inviting applications for the role of Principal Consultant- Databricks Developer AWS!In this role, the Databricks Developer is responsible for- solving the real world cutting edge problem to meet both functional and non-functional requirements.Responsibilities :- Maintains close awareness of new and emerging technologies and their potential...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Pyramid Consulting Full time

    Role and Accountabilities : Title: Azure Data Engineer with Azure Machine Learning Expertise Job Description : Key Responsibilities :Data Engineering and Management :- Design, develop, and maintain scalable data pipelines using Azure Data Factory, Azure Synapse Analytics, and Azure Databricks.- Implement data warehousing solutions and ensure data quality and...

  • Robosoft Technologies

    2 weeks ago


    Anywhere in India/Multiple Locations, IN Robosoft Technologies Full time

    Position Title : DataOps EngineerLocation : RemoteJob Type : Contract - 3 months only. Please apply only if you are interested.Experience Required : 7+ YearsJob Summary :We are seeking a highly skilled and experienced DataOps Engineer to join our dynamic team. The ideal candidate will have a strong background in DataOps practices with a focus on Azure...


  • Bangalore/Anywhere in India/Multiple Locations, IN Qualite Manpower Full time

    Profile : Azure Data Ingestion Engineer. Experience : 6 to 11 years. Location : PAN India. Notice Period : 30 days. Job Description : - 4+ years of software development experience and azure cloud computing Proficiency) Scala, Spark,- Python. - Experience working in an Agile environment. - Experience with- Python script development. - 3+ years of Exp of Data...

  • Data Architect

    3 weeks ago


    Anywhere in India/Multiple Locations, IN RAPINNO TECH SOLUTIONS PRIVATE LIMITED Full time

    Position Overview :We are looking for an experienced Data Architect with expertise in Databricks, Apache Spark, and ETL processes. The ideal candidate will have a proven track record of designing and building robust data applications from the ground up. You will play a key role in shaping our data strategy and ensuring our data solutions meet business needs...

  • Azure Data Engineer

    3 days ago


    Remote/Anywhere in India/Multiple Locations, IN SMARTWORK IT SERVICES Full time

    Job Title : Azure Data Engineer. Experience : 10-14 years. Availability : Immediate Joiners. Job Type : Contract position. Work Mode : Remote (India). Job Description :- We are seeking an experienced Azure Data Engineer to join our team for a short-term project.- The ideal candidate will have extensive experience in data engineering, with a strong emphasis...