Azure Data Engineer

4 weeks ago

Anywhere in IndiaMultiple Locations Innover Digital Inc. Full time

Job Description :


We are actively seeking a highly skilled Senior Cloud data engineer + Databricks with expertise in other databases like Oracle, significant experience in data warehousing implementation projects, and proficiency in leveraging Azure services along with databricks/ADLS Gen2 for efficient ETL design thinking and :

- Design, develop, and implement complex ETL processes using Databricks to ensure streamlined and efficient data extraction, transformation, and loading in azure databricks/ADLS Gen2.

- Monitor and analyze data integration job performance with Databricks /ADLS Gen2 , identifying and resolving bottlenecks for optimal system efficiency.

- Implement best practices to ensure high-performance data warehousing solutions.

- Apply innovative and efficient ETL design thinking principles within Azure databricks/ADLS Gen2 to create scalable and maintainable solutions.

- Utilize best practices for modular and reusable ETL components, ensuring flexibility in adapting to evolving business needs.

- Implement strategies to handle incremental data updates and ensure synchronization between source and target systems.

- Design, implement, and manage data lake solutions on Azure Data Lake Storage.

- Experience working with Delta tables, Unity Catalog

- Define storage structures and access policies for raw, processed, and curated data.

- Implement checkpoints and error-handling mechanisms to minimize downtime and data loss in case of job interruptions.

- Perform database tuning, query optimization, and ensure data integrity within Azure environments.

- Work closely with DevOps teams to ensure the smooth deployment and operation of data solutions.

- Collaborate on infrastructure as code (IaC) and version control.

Technical and Required Skills :

- Bachelor's degree in Computer Science/Information Systems/ a related field (or equivalent experience).

- Strong 7+ years of experience in data engineering, including designing and implementing data pipelines, ETL processes, and data integration solutions .

- Proficiency in Azure services like Azure databricks/ADLS Gen2, Azure function and Oracle services like Oracle EBS.

- Experience with Large data set pipe lines by using the parallel processing .

- Experience with data batch processing.

- Experience with SCD1 and SCD2 implemention.

- Experience with Delta and Full loads.

- Experience with SQL and NoSQL databases, data warehousing concepts, and big data technologies.

- Proficiency in programming languages such as SQL/PL SQL and JAVA.

- Familiarity with data governance, data security, and compliance practices.

- Strong problem-solving and troubleshooting skills.

- Excellent communication and collaboration abilities.

- Ability to work effectively in a fast-paced and dynamic environment.

- Familiarity in on premise Talend (Any ETL tool) services with Azure infrastructure.

Preferred Skills (not a must but value-added) :

- Experience with Azure services.

- Familiarity with DevOps practices and tools for continuous integration and deployment of data solutions

(ref:hirist.tech)

  • Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations Talent join Full time

    Job Title : Azure Data EngineerJob Description :We are seeking a talented and experienced Azure Data Engineer to join our dynamic team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions on the Azure platform. The ideal candidate should have a strong background in data engineering, experience with...

  • Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations Vikisol Technologies Full time

    Azure Data Engineer Opportunity : Remote Exp : 5+ years Location : Remote Skills : - Azure Databricks- Azure ADF- PySpark- Python- SQL Responsibilities : - Collaborate on ETL data requirements.- Design and optimize data pipelines (Azure Databricks, ADF).- Develop PySpark scripts for efficient data processing.- Ensure ETL tasks' performance and...

  • Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is must Location : Pan IndiaFulltime role Immediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure...

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...

  • Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations Innover Digital Inc. Full time

    Job Description : We are actively seeking a highly skilled Senior Cloud data engineer + Databricks with expertise in other databases like Oracle, significant experience in data warehousing implementation projects, and proficiency in leveraging Azure services along with databricks/ADLS Gen2 for efficient ETL design thinking and : - Design, develop, and...

  • Azure Data Engineer

    2 weeks ago

    Anywhere in India/Multiple Locations Live Connections Full time

    Azure Data Engineer - Python/PySpark We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment. Key Responsibilities : - PySpark...

  • Azure Data Engineer

    3 weeks ago

    Anywhere in India/Multiple Locations, IN Live Connections Full time

    Azure Data Engineer - Python/PySpark We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment.Key Responsibilities :- PySpark...

  • Data Engineer

    2 weeks ago

    Bangalore/Anywhere in India/Multiple Locations Swift Strategic Staff Solutions INC Full time

    Notice Period : Immediate Joiner to 30 daysMandatory Skills : Azure Data Bricks, Azure Data Factory (ADF), PySpark, Data Flows, Azure DevOpsJob Description :We are seeking a talented and experienced Data Engineer to join our team. The ideal candidate will have strong expertise in building and optimizing data pipelines and data sets using Azure Data Bricks,...

  • Data Engineer

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full time

    Notice Period : Immediate Joiner to 30 daysMandatory Skills : Azure Data Bricks, Azure Data Factory (ADF), PySpark, Data Flows, Azure DevOpsJob Description :We are seeking a talented and experienced Data Engineer to join our team. The ideal candidate will have strong expertise in building and optimizing data pipelines and data sets using Azure Data Bricks,...

  • Xebia - Azure Data Engineer - Python/Spark/PySpark

    4 weeks ago

    Anywhere in India,Multiple Locations Xebia IT Architects India Pvt Ltd Full time

    Role - Azure Data Engineer - 4+ years of experience in IT Industry - 2+ years of experience with Azure Data Engineering Stack (Event Hub, Data Factory, Cosmos DB, Synapse, SQL DB, Databricks)- 2+ years of experience with Python/Spark/Pyspark- Excellent knowledge of SQL and coding skills- Good understanding of other Azure services like Azure Data Lake...

  • Azure Data Engineer

    4 weeks ago

    Anywhere in India,Multiple Locations,Bangalore Arting Digital Full time

    Position Title : Azure Data Engineer Exp : 5+ years Location : Remote Primary Skills :- Azure Databricks, Azure ADF, Pyspark, Python & SQL Qualification : AnyRoles and responsibilities : - An offshore Data Engineer to work with the Investment Analytics team. - This person needs to have a strong exp of - Azure Data bricks, Azure ADF, Pyspark Python & SQL...

  • Data Engineer

    4 weeks ago

    Bangalore,Anywhere in India,Multiple Locations Creencia esearch Full time

    Job Description: Do you thrive on transforming complex data into clear, actionable insights? Are you passionate about optimizing data solutions in the cloud ? If you have a flair for making sense of data chaos and are skilled in Azure data services, We are looking for someone like you to join our innovative team as a Data Engineer.Your Mission :- Elevate...

  • Data Engineer

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Creencia esearch Full time

    Job Description: Do you thrive on transforming complex data into clear, actionable insights? Are you passionate about optimizing data solutions in the cloud ? If you have a flair for making sense of data chaos and are skilled in Azure data services, We are looking for someone like you to join our innovative team as a Data Engineer.Your Mission :- Elevate...

  • SyngyMAXIM Solutions

    2 weeks ago

    Anywhere in India/Multiple Locations SyngyMAXIM Solutions Private Limited Full time

    Mandatory Skills: " Data Centric Engineer to Support backend integration development: .NET, Azure Data Factory (ADF), ETL tools, Kafka, GraphQL, Rest. AzureChief data pipeline 'engineer' -Very familiar with ADF, primarily on the pipelinesNeeds C#, or .net skills - MAY need to do some development, needs to have a foundation in it at least"Detailed...

  • SyngyMAXIM Solutions

    3 weeks ago

    Anywhere in India/Multiple Locations, IN SyngyMAXIM Solutions Private Limited Full time

    Mandatory Skills:" Data Centric Engineer to Support backend integration development: .NET, Azure Data Factory (ADF), ETL tools, Kafka, GraphQL, Rest. AzureChief data pipeline 'engineer' -Very familiar with ADF, primarily on the pipelinesNeeds C#, or .net skills - MAY need to do some development, needs to have a foundation in it at least"Detailed...

  • Vsquare Systems

    4 weeks ago

    Bangalore,Anywhere in India,Multiple Locations Vsquare Systems Pvt. Ltd. Full time

    Data Engineer (Azure Databricks) Job Title : Data Engineer (Azure Databricks). Location : Bangalore / Hybrid. Job Type : Full-time. Job Description : .- Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud...

  • Vsquare Systems

    3 weeks ago

    Bangalore/Anywhere in India/Multiple Locations, IN Vsquare Systems Pvt. Ltd. Full time

    Data Engineer (Azure Databricks)Job Title : Data Engineer (Azure Databricks). Location : Bangalore / Hybrid. Job Type : Full-time. Job Description : .- Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations,...

  • Dimiour - Azure Data Engineer - ETL

    15 hours ago

    Anywhere in India/Multiple Locations, IN Dimiour Full time

    Responsibilities:- Design and implement optimal data pipeline architecture for scalable and reliable data processing.- Develop and maintain complex data pipelines to extract, transform, and load data from various sources, including Snowflake, utilizing SQL and Azure Big Data technologies (e.g., Data Factory, Databricks, Data Lake).- Collaborate with business...

  • Dimiour - Azure Data Engineer - ETL

    8 hours ago

    Anywhere in India/Multiple Locations Dimiour Full time

    Responsibilities:- Design and implement optimal data pipeline architecture for scalable and reliable data processing.- Develop and maintain complex data pipelines to extract, transform, and load data from various sources, including Snowflake, utilizing SQL and Azure Big Data technologies (e.g., Data Factory, Databricks, Data Lake).- Collaborate with business...

  • Moback - Azure Synapse Data Engineer

    2 weeks ago

    Bangalore/Anywhere in India/Multiple Locations Moback Technologies India Pvt Ltd Full time

    SKILLS/QUALIFICATIONS : Will likely have a degree in Computer Science, Statistics, Informatics, Information Technology or quantitative field.Critical skills/experience :- Microsoft Azure Synapse Analytics experience is essential. (Dedicated SQL Pool, Azure Data Factory, Azure Storage) - Excellent communication skills with the ability to work within a team,...