Azure Data Engineer

3 weeks ago


Anywhere in IndiaMultiple Locations, IN Orbiz.one Full time

Job Description :


We are seeking a skilled Azure Data Engineer to join our team on a contract basis. This position is for one of our clients based out of UK who is working in Telecom & Insurance domains.

The Role :

This is a typical Data Engineering role. Day to day you will be ingesting large data sets for our clients, which involves designing data pipelines, data integration and transforming data into models for downstream consumption. Clients will be in a variety of industries such as telecoms, insurance and mortgages.

Required Skills and Experience :

- Solid experience in Azure, specifically Azure Databricks and Azure SQL/SQL Server.

- Proficiency in SQL and Python languages.

- Hands-on experience in designing and building data pipelines using Azure Data Factory (ADF).

- Familiarity with building metadata driven pipelines.

- Knowledge of Azure Storage, Medallion Architecture, and working with data formats such as JSON, CSV, and Parquet.

- Strong understanding of IT concepts, including security, IAM, Key Vault, and networking.

- Exposure to Apache Airflow and DBT is a bonus.

- Familiarity with agile principles and practices.

- Experience with Azure DevOps pipelines.

Nice to Have :

- Certification in Azure or related technologies.

- Experience with other cloud platforms (e.g., AWS, Google Cloud).

- Knowledge of big data technologies

- Familiarity with data governance and compliance frameworks.

- Key outputs for the role

- Develop and maintain data pipelines using Azure Data Factory (ADF), ensuring efficient and reliable data movement and transformation.

- Data Modelling using Kimball, 3NF or Dimensional methodologies

- Utilize SQL and Python languages to extract, transform, and load data from various sources into Azure Databricks and Azure SQL/SQL Server.

- Design and implement metadata driven pipelines to automate data processing tasks.


- Collaborate with cross-functional teams to understand data requirements and implement appropriate solutions.

- Ensure data quality, integrity, and security throughout the data pipeline.

- Troubleshoot and resolve any issues or errors in the data pipelines.

- Stay updated with the latest Azure technologies and industry best practices to continuously enhance data engineering capabilities.

Required Characteristics :

- Driven by delivering quality work, with a great eye for detail

- Takes accountability and ownership of tasks, and finds the best way to solve problems

- Excellent communicator who can make sense of and communicate complex ideas to audiences of differing levels of seniority and technical ability

- Ability to quickly understand client context and demonstrate expertise in their business

- Relationship builder, with the ability to motivate and engage effectively to build trust with clients and colleagues.

- An interest in industry trends, emerging technologies, and client's businesses

- Ability to take the lead and drive initiatives independently

(ref:hirist.tech)
  • MLOps Engineer

    2 hours ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...

  • Azure Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Live Connections Full time

    Azure Data Engineer - Python/PySpark We are seeking a skilled and experienced Azure Data Engineer with expertise in PySpark and Python coding. The ideal candidate should have a strong background in data engineering, with a focus on developing solutions using PySpark and Python within the Azure Databricks environment.Key Responsibilities :- PySpark...

  • Data Engineer

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Swift Strategic Staff Solutions INC Full time

    Notice Period : Immediate Joiner to 30 daysMandatory Skills : Azure Data Bricks, Azure Data Factory (ADF), PySpark, Data Flows, Azure DevOpsJob Description :We are seeking a talented and experienced Data Engineer to join our team. The ideal candidate will have strong expertise in building and optimizing data pipelines and data sets using Azure Data Bricks,...

  • Data Engineer

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Creencia esearch Full time

    Job Description: Do you thrive on transforming complex data into clear, actionable insights? Are you passionate about optimizing data solutions in the cloud ? If you have a flair for making sense of data chaos and are skilled in Azure data services, We are looking for someone like you to join our innovative team as a Data Engineer.Your Mission :- Elevate...

  • SyngyMAXIM Solutions

    3 weeks ago


    Anywhere in India/Multiple Locations, IN SyngyMAXIM Solutions Private Limited Full time

    Mandatory Skills:" Data Centric Engineer to Support backend integration development: .NET, Azure Data Factory (ADF), ETL tools, Kafka, GraphQL, Rest. AzureChief data pipeline 'engineer' -Very familiar with ADF, primarily on the pipelinesNeeds C#, or .net skills - MAY need to do some development, needs to have a foundation in it at least"Detailed...

  • Vsquare Systems

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Vsquare Systems Pvt. Ltd. Full time

    Data Engineer (Azure Databricks)Job Title : Data Engineer (Azure Databricks). Location : Bangalore / Hybrid. Job Type : Full-time. Job Description : .- Experienced Data engineer & Solutions designer with a deep understanding of data solution design and implementation, seeking a challenging role to leverage my expertise in data architecture, cloud migrations,...


  • Anywhere in India/Multiple Locations, IN Dimiour Full time

    Responsibilities:- Design and implement optimal data pipeline architecture for scalable and reliable data processing.- Develop and maintain complex data pipelines to extract, transform, and load data from various sources, including Snowflake, utilizing SQL and Azure Big Data technologies (e.g., Data Factory, Databricks, Data Lake).- Collaborate with business...


  • Bangalore/Anywhere in India/Multiple Locations, IN Moback Technologies India Pvt Ltd Full time

    SKILLS/QUALIFICATIONS : Will likely have a degree in Computer Science, Statistics, Informatics, Information Technology or quantitative field.Critical skills/experience :- Microsoft Azure Synapse Analytics experience is essential. (Dedicated SQL Pool, Azure Data Factory, Azure Storage) - Excellent communication skills with the ability to work within a team,...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN TechFabric Full time

    Job Description :Candidate should have minimum 7Yrs working/hands-on experience in the below skills :- With proficiency in Azure services , ADF, Data bricks, Synapse Analytics and Azure Storage - Hands on experience in data modelling, batch and real time pipelines using Python Java or Java script and experience in Restful API - Experience in Devops and CI/CD...

  • Lead Data Engineer

    4 days ago


    Anywhere in India/Multiple Locations, IN Vista Full time

    About you :- Passionate about both Data Engineering and Machine Learning Engineering, you can likewise wear one or the other hat according to what you need to accomplish- Passionate about GenAI an excited to join a Team working on state of the art GenAI topics- Ideate and build data products that drive value for internal and external customers- Write quality...

  • Azure Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN IFLOWTECH SOLUTIONS PRIVATE LIMITED Full time

    Azure OPEN AI with Azure Security skills.Position : 1Location : RemoteExperience: 5+yrsPrimary Skills : Azure Open AI, Azure Security Responsibilities : Architect AI Solutions: Design end-to-end AI solutions that leverage Azure cloud services and OpenAI technologies to address complex business challenges and opportunities.Technical Leadership: Provide...


  • Anywhere in India/Multiple Locations/Bangalore, IN Marktine Technology Solutions Full time

    Position : Azure Data Engineer. Experience : 6+ years. Location Remote. Skills: Snowflake, ADF, python and ETL, spark, scala, SQL.- An offshore Data Engineer to work with the Investment Analytics team.- This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and Python.- A strong candidate to work with the Data Science...

  • Cloud Data Architect

    3 weeks ago


    Anywhere in India/Multiple Locations, IN LIVE CONNECTIONS PLACEMENTS PRIVATE LIMITED Full time

    Job Description : Cloud Data ArchitectWe are seeking a highly skilled Cloud Data Architect with extensive experience in managing the complete data landscape, including data ingestion, transformation, processing, and consumption. The ideal candidate will have a strong background in program management and technical governance, along with deep expertise in data...

  • Colan Infotech

    2 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Colan Infotech Pvt Ltd Full time

    Skill Set : Pyspark / Scala Spark, Data Factory, Databricks, Python, SQL.Job Description :Roles And Responsibilities :- Must have cloud knowledge in Azure- Should have programming skills with the ability to write optimized and reusable high-quality code.- Design, develop and maintain scalable data pipelines using Pyspark / Scala Spark, Databricks, Python,...

  • Cloud Data Engineer

    3 weeks ago


    Bangalore/Hyderabad/Chennai/Pune/Anywhere in India/Multiple Locations, IN Amk technologies Full time

    Job Description :We are seeking a talented and motivated Cloud Data Engineer to join our dynamic team.As a Cloud Data Engineer, you will be responsible for designing, implementing, and maintaining data pipelines and infrastructure on Azure Cloud Platform. You will work closely with cross-functional teams to ensure efficient data flow and integration across...


  • Anywhere in India/Multiple Locations, IN ASPIRE NXT PRIVATE LIMITED Full time

    Experience : 5 - 8 yrs Employment Type : Permanent with AspireNxtJob Title : Senior Azure Cloud Engineer The Cloud Engineer under moderate supervision is responsible for designing, developing, implementing, and supporting the recommended infrastructure. This involves analysing, configuring, testing, and implementing the infrastructure. This may also involve...

  • Azure Data Lead

    1 week ago


    Anywhere in India/Multiple Locations, IN Etaash Consulting Full time

    Years of experience : 7 to 15 Years Role : Sr. Tech LeadJob Description :- Experience in Perform Design, Development & Deployment using Azure Services (Databricks, PySpark, SQL, Data Factory,)- Develop and maintain scalable data pipelines and build new Data Source integrations to support increasing data volume and complexity.- Experience in creating...


  • Bangalore/Anywhere in India/Multiple Locations, IN Marktine Technology Solutions Full time

    Job Description :- Proficiency in Data Engineering, including Data Modeling, ETL (Extract Transform Load) processes.- Strong understanding of Data Warehousing and Data Analytics concepts and techniques.- Experience with Azure and cloud technologies, with a focus on data-related services.- Excellent problem-solving and analytical skills, with the ability to...

  • Lead Data Engineer

    3 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Lorven Technologies Full time

    Job Description :- Primary skills as Azure ADF, Databricks- Secondary skills as Snowflake and other data engineering technologies.- Proficient in basic and advanced SQL programming concepts (Procedures, Analytical functions etc.)- Good Knowledge and Understanding of Data warehouse concepts (Dimensional Modeling, change data capture, slowly changing...