Azure Data Engineer

6 days ago

hyderabad, India VidPro Consultancy Services Full time
Role: Senior Databricks Engineer / Databricks Technical Lead/ Data Architect
Experience: 3-15 years
Location: Bangalore, Chennai, Delhi, Pune, Kolkata and Gurgaon
Mandatory Skills: Python/ PySpark / Spark with Azure/ Azure Databricks / Azure DataFactory
Primary Roles and Responsibilities:
● Developing Modern Data Warehouse solutions using Databricks and AWS/ Azure Stack
● Ability to provide solutions that are forward-thinking in data engineering and analytics space
● Collaborate with DW/BI leads to understand new ETL pipeline development requirements.
● Triage issues to find gaps in existing pipelines and fix the issues
● Work with business to understand the need in reporting layer and develop data model to fulfill reporting needs
● Help joiner team members to resolve issues and technical challenges.
● Drive technical discussion with client architect and team members
● Orchestrate the data pipelines in scheduler via Airflow
Skills and Qualifications:
● Bachelor's and/or master’s degree in computer science or equivalent experience.
● Must have total 3+ yrs. of experience in Data warehouse/ETL projects .
● Deep understanding of Star and Snowflake dimensional modelling.
● Strong knowledge of Data Management principles
● Good understanding of Databricks Data & AI platform and Databricks Delta Lake Architecture
● Should have hands-on experience in SQL, Python and Spark (PySpark)
● Candidate must have experience in AWS/ Azure stack
● Desirable to have ETL with batch and streaming (Kinesis).
● Experience in building ETL / data warehouse transformation processes
● Experience with Apache Kafka for use with streaming data / event-based data
● Experience with other Open-Source big data products Hadoop (incl. Hive, Pig, Impala)
● Experience with Open Source non-relational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J )
● Experience working with structured and unstructured data including imaging & geospatial data.
● Experience working in a Dev/Ops environment with tools such as Terraform, CircleCI, GIT.
● Proficiency in RDBMS, complex SQL, PL/SQL, Unix Shell Scripting, performance tuning and troubleshoot
● Databricks Certified Data Engineer Associate/Professional Certification (Desirable).
● Comfortable working in a dynamic, fast-paced, innovative environment with several ongoing concurrent projects
● Should have experience working in Agile methodology
● Strong verbal and written communication skills.
● Strong analytical and problem-solving skills with a high attention to detail.

  • Azure Consultant-Data Engineer/Architect

    2 weeks ago

    Hyderabad, India Aptus Data Labs Full time

    Role : Azure Sr Consultant Experience : 8+ yrs Location : Hyderabad/Mumbai (Onsite)Notice- Need resource who can join within 30 days Skill : Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data factory, Databricks, Pyspark), Azure Cloud, Databases (SQL database), python, infrastructure, network & security You can also...

  • Azure Data Engineer

    3 days ago

    Hyderabad, India DATAECONOMY Full time

    Job Summary:Responsible for designing building and deploying scalable and reliable data solutions on the Microsoft Azure with focus on Azure Data Analytics services. The ideal candidate should have extensive experience with Azure data technologies such as Azure Data Factory Azure SQL Database Azure Data Lake Storage Azure Synapse Analytics Azure Data...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, India ProArch Full time

    ProArch is hiring a skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data processing systems using Azure technologies. Additionally, you will collaborate with cross-functional teams to understand business requirements, identify opportunities for data-driven...

  • Azure Data Engineer

    2 days ago

    hyderabad, India Tata Consultancy Services Full time

    *******Greetings From The TCS ******* Job Role: Azure Data Engineer Job Location: Hyderabad Only Experience Range: 5 - 10 yrs Desired Competencies (Technical/Behavioral Competency): Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer Proficient in creating Data Factory...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India DATAECONOMY Full time

    JobSummary:Responsiblefor designing building and deploying scalable and reliable datasolutions on the Microsoft Azure with focus on Azure Data Analyticsservices.Theideal candidate should have extensive experience with Azure datatechnologies such as Azure Data Factory Azure SQL Database AzureData Lake Storage Azure Synapse Analytics Azure...

  • Azure Data Engineer

    6 days ago

    hyderabad, India Tata Consultancy Services Full time

    *******Greetings From The TCS *******Job Role: Azure Data EngineerJob Location: Hyderabad OnlyExperience Range: 5 - 10 yrsDesired Competencies (Technical/Behavioral Competency):Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for...

  • Data Engineer

    3 days ago

    hyderabad, India NTT DATA Services Full time

    Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Data Engineer

    2 days ago

    hyderabad, India NTT DATA Services Full time

    Role Definition: Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Data Engineer

    4 days ago

    Hyderabad, India NTT DATA Services Full time

    Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Data Engineer

    1 day ago

    Hyderabad, India NTT DATA Services Full time

    Role Definition: Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Azure Data Engineer

    7 days ago

    Hyderabad, India Tata Consultancy Services Full time

    *******Greetings From The TCS *******Job Role: Azure Data EngineerJob Location: Hyderabad OnlyExperience Range: 5 - 10 yrsDesired Competencies (Technical/Behavioral Competency):Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for...

  • Azure Data Engineer

    6 days ago

    Hyderabad, India Tata Consultancy Services Full time

    *******Greetings From The TCS ******* Job Role: Azure Data Engineer Job Location: Hyderabad Only Experience Range: 5 - 10 yrs Desired Competencies (Technical/Behavioral Competency): Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer Proficient in creating Data Factory...

  • Azure Data Engineer

    3 weeks ago

    hyderabad, India 2COMS Consulting Pvt. Ltd. Full time

    As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.On a typical day, you might● Design and build scalable & metadata-driven data ingestion pipelines (For...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, India TekOne IT Services Pvt. Ltd. Full time

    Lead Azure Data EngineerExperience: 12+ YearsLocation : HyderabadShift time: 2:00 pm to 11:00 pmResponsibilities:Design and implement data pipelines with Azure Data Factory and Azure Databricks.Integrate data from Azure SQL, MySQL, Azure Data Lake, and Azure Blob Storage.Develop AI models and solutions using Azure Machine Learning and Cognitive...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad, India TekOne IT Services Pvt. Ltd. Full time

    Lead Azure Data EngineerExperience: 12+ YearsLocation : HyderabadShift time: 2:00 pm to 11:00 pmResponsibilities:Design and implement data pipelines with Azure Data Factory and Azure Databricks.Integrate data from Azure SQL, MySQL, Azure Data Lake, and Azure Blob Storage.Develop AI models and solutions using Azure Machine Learning and Cognitive...

  • Azure Data Engineer

    2 days ago

    Hyderabad, India Tata Consultancy Services Full time

    Required Skills: ADF,ADB, PySpark, Scala,MS Azure, SQL Atleast 6+ years of Experience in Data Analytics as Azure Data engineer. Extensive experience on Design and Development of solutions in Azure Data Factory, Databricks, SQL, Synapse, Snowflake, Python, pySparkGood understanding of Data ware house concepts and ETL process'sExperience in building pipelines...

  • Azure Data Engineer

    6 months ago

    Hyderabad, India Anblicks Full time

    Azure Data EngineerExperience of building & implementing robust data pipelines using Microsoft Stack. Development & ImplementationSound skills and hands on experience with Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse, Azure Analysis Services.Proficient in creating Data Factory Pipelines for on-cloud ETL processing.Hands on experience...

  • Azure Data Engineer

    2 days ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of Azure Data Engineer position with HTC Global Services Please share your updated resume on devanshi.nigam@htcinc.com with below details - We are Looking for Immediate joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Azure Data Engineer) - Rel. Exp. (in Azure Data Bricks, ETL, Python)...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, India 2COMS Consulting Pvt. Ltd. Full time

    As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.On a typical day, you might● Design and build scalable & metadata-driven data ingestion pipelines (For...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, India 2COMS Consulting Pvt. Ltd. Full time

    As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might ● Design and build scalable & metadata-driven data ingestion pipelines (For...