Azure Data Engineer

3 months ago

Hyderabad, India VidPro Consultancy Services Full time
Role: Senior Databricks Engineer / Databricks Technical Lead/ Data ArchitectExperience: 3-15 yearsLocation: Bangalore, Chennai, Delhi, Pune, Kolkata and GurgaonMandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / Azure DataFactory

Primary Roles and Responsibilities:

●

Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack● Ability to provide solutions that are forward-thinking in data engineering and analytics space● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.● Triage issues to find gaps in existing pipelines and fix the issues● Work with business to understand the need in reporting layer and develop

data model

to fulfill reporting needs● Help joiner team members to resolve issues and technical challenges.● Drive technical discussion with client architect and team members● Orchestrate the data pipelines in scheduler via

Airflow

Skills and Qualifications:

● Bachelor's and/or master’s degree in computer science or equivalent experience.● Must have total 3+ yrs. of experience in Data warehouse/ETL projects .● Deep understanding of Star and Snowflake dimensional modelling.● Strong knowledge of Data Management principles● Good understanding of

Databricks

Data & AI platform and Databricks Delta Lake Architecture● Should have hands-on experience in

SQL, Python and Spark (PySpark)● Candidate must have experience in AWS/ Azure stack● Desirable to have ETL with batch and streaming (Kinesis).● Experience in building ETL / data warehouse transformation processes● Experience with Apache Kafka

for use with streaming data / event-based data● Experience with other Open-Source

big data products Hadoop

(incl. Hive, Pig, Impala)● Experience with Open Source non-relational / NoSQL data repositories (incl.

MongoDB, Cassandra, Neo4J )● Experience working with structured and unstructured data including imaging & geospatial data.● Experience working in a Dev/Ops environment with tools such as

Terraform, CircleCI, GIT.● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting,

performance tuning and troubleshoot● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects● Should have experience working in Agile methodology● Strong verbal and written communication skills.● Strong analytical and problem-solving skills with a high attention to detail.

  • Azure data engineer

    3 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    3 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    3 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    2 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    7 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data EngineerExperience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Data Engineer

    2 months ago

    Hyderabad, India Madhees Techno Full time

    Job Title : Azure Data EngineerExperience : 5+ years as Azure Data EngineerLocation : HyderabadAt our company, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. This role involves working with various data storage options offered by...

  • Data Engineer

    1 day ago

    Hyderabad, India Madhees Techno Full time

    Job Title : Azure Data EngineerExperience : 5+ years as Azure Data EngineerLocation : HyderabadAt our company, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing, implementing, and managing data solutions on the Microsoft Azure cloud platform. This role involves working with various data storage options offered by...

  • Azure Data Engineer

    6 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure Data Engineer

    7 months ago

    hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data Engineer Location: Hyderabad, Work from Office on Hybrid Working Hours: 12.00pm to 9.00pm Required Skills: #Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbi At Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for...

  • Azure Data Engineer

    7 months ago

    Hyderabad, India Clean Harbors Full time

    Job Title: Azure Data Engineer Experience: 5+ Years as Azure Data EngineerLocation: Hyderabad, Work from Office on HybridWorking Hours: 12.00pm to 9.00pmRequired Skills:#Azuredataengineer #Azuredatafactory #Azuredatalakes #python #SQL #powerbiAt Clean Harbors, we are seeking Azure Data Engineers. The Data Engineer will be responsible for designing,...

  • Azure data engineer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!! **TCS is Hiring for Azure Databricks Data Engineer ** Role: Azure Databricks Data Engineer Desired Experience: 5- 10 Years Job Location: Hyderabad/Bengaluru Job Description: Technical Requirements Gathering and Development of Functional Specifications. Design, develop, and maintain scalable data pipelines and...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    Greetings from TCS!!!**TCS is Hiring for Azure Databricks Data Engineer **Role: Azure Databricks Data EngineerDesired Experience: 5- 10 YearsJob Location: Hyderabad/BengaluruJob Description:Technical Requirements Gathering and Development of Functional Specifications.Design, develop, and maintain scalable data pipelines and ETL processes using Azure...

  • Azure data engineer

    1 day ago

    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....

  • Azure Data Engineer

    3 months ago

    Hyderabad, India Madhees Techno Full time

    Job Description :- Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.- Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.- Develop and implement data integration processes, frequently using Azure Data Factory, to...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, India Madhees Techno Consulting Pvt. Ltd. Full time

    Job Description : - Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner.- Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements.- Develop and implement data integration processes, frequently using Azure Data Factory, to...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, India Madhees Techno Full time

    Job Description : - Ensure that Health and Safety is the number one goal by following policies, processes, and always acting in a safe manner. - Design data storage systems that scale, perform, and are economical enough to satisfy the organization's requirements. - Develop and implement data integration processes, frequently using Azure Data Factory,...

  • Azure Data Engineer

    5 days ago

    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration) Position Overview: We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based...

  • Azure Data Engineer

    5 days ago

    Hyderabad, India Acunor Full time

    Job Description: Lead Data Engineer (Migration)Position Overview:We are looking for a Lead Data Engineer with a strong focus on data migration from Teradata to Snowflake and Databricks on Azure Cloud. In this key leadership role, you will drive the migration strategy, ensuring the successful transition of data systems and pipelines to cloud-based platforms....