Azure Data Engineering

1 day ago

hyderabad, India BILVANTIS TECHNOLOGIES Full time

We are looking for a skilled and experienced Azure Data Engineering - Senior/Lead Programmer Analyst to join our Data team in Hyderabad location.

About the job

Position: Azure Data Engineering - Senior/Lead Programmer Analyst
Total Experience: Minimum 3+ years to 7 years.
Notice Period: Immediate
Location : Hyderabad
Work Mode: Work From Office (WFO) only
Must have skills: ADF, Synapse, Azure SQL, Snowflake, DW Concepts, SQL, ETL tool, Python

Job Description: Azure Data Engineering - Senior/Lead Programmer Analyst

We are seeking a highly skilled and motivated Azure Data Engineer with over 3+ years of experience to join our dynamic data engineering team. In this role, you will play a crucial part in designing, building, and maintaining data pipelines, data warehouses, and data lakes using Azure Data Factory, Snowflake, Azure Synapse Analytics, and DataBricks. Your expertise in these technologies will drive the effective extraction, transformation, loading, and analysis of our organization's data assets.

Technical Skills:
Experience should have 3+ years to 7 years as a Data engineer.
Bachelor's degree in Computer Science, Engineering, or a related field.
Proven experience as an Azure Data Engineer, with hands-on expertise in Azure Data Factory, Snowflake, Synapse Analytics, and DataBricks.
Strong understanding of data warehousing concepts, data modeling, and ETL processes.
Proficiency in SQL and T-SQL for data manipulation, query optimization, and performance tuning.
Hands-on experience in data integration, data transformation, and data loading using Azure services.
Experience with building and managing data lakes and data warehouses in Snowflake and Azure Synapse Analytics.
Proficiency in PySpark and DataBricks for advanced data processing and analysis.
Familiarity with cloud architecture, security, and best practices within the Azure ecosystem.
Strong problem-solving skills and the ability to troubleshoot complex data engineering issues.
Excellent communication skills and the ability to collaborate effectively within cross-functional teams.

Responsibilities:
Collaborate with data architects, analysts, and business stakeholders to understand data requirements and translate them into scalable data engineering solutions.
Design, develop, and manage end-to-end data pipelines using Azure Data Factory, ensuring the reliable extraction, transformation, and loading of data from diverse sources.
Create and maintain data models, schemas, and data structures in Snowflake and Azure Synapse Analytics to support reporting, analytics, and business intelligence needs.
Utilize DataBricks and PySpark to develop advanced data processing pipelines for batch and real-time data processing.
Optimize and fine-tune data pipelines and ETL processes to ensure efficient data movement and transformation.
Implement data quality checks, data validation, and data profiling to ensure data accuracy and reliability.
Work closely with DevOps teams to deploy, monitor, and troubleshoot data pipelines and data engineering solutions in production environments.
Collaborate with data scientists, machine learning engineers, and analysts to enable data-driven decision-making and predictive analytics.
Stay updated with the latest advancements in Azure data technologies, industry best practices, and emerging trends in data engineering.
Provide guidance and mentorship to junior team members, promoting technical excellence and continuous learning.

  • Azure Consultant-Data Engineer/Architect

    3 weeks ago

    Hyderabad, India Aptus Data Labs Full time

    Role : Azure Sr Consultant Experience : 8+ yrs Location : Hyderabad/Mumbai (Onsite)Notice- Need resource who can join within 30 days Skill : Azure Cloud, Databricks, Data Quality, Data Governance & Modelling, ETL (Azure data factory, Databricks, Pyspark), Azure Cloud, Databases (SQL database), python, infrastructure, network & security You can also...

  • Data Engineer

    50 minutes ago

    Hyderabad, India NTT DATA Services Full time

    Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Azure Data Engineer

    1 week ago

    Hyderabad, India DATAECONOMY Full time

    Job Summary:Responsible for designing building and deploying scalable and reliable data solutions on the Microsoft Azure with focus on Azure Data Analytics services. The ideal candidate should have extensive experience with Azure data technologies such as Azure Data Factory Azure SQL Database Azure Data Lake Storage Azure Synapse Analytics Azure Data...

  • Azure Data Engineer

    3 weeks ago

    Hyderabad, India ProArch Full time

    ProArch is hiring a skilled Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data processing systems using Azure technologies. Additionally, you will collaborate with cross-functional teams to understand business requirements, identify opportunities for data-driven...

  • Azure Data Engineer

    1 week ago

    hyderabad, India Tata Consultancy Services Full time

    *******Greetings From The TCS ******* Job Role: Azure Data Engineer Job Location: Hyderabad Only Experience Range: 5 - 10 yrs Desired Competencies (Technical/Behavioral Competency): Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer Proficient in creating Data Factory...

  • Azure Data Engineer

    2 months ago

    Hyderabad, India DATAECONOMY Full time

    JobSummary:Responsiblefor designing building and deploying scalable and reliable datasolutions on the Microsoft Azure with focus on Azure Data Analyticsservices.Theideal candidate should have extensive experience with Azure datatechnologies such as Azure Data Factory Azure SQL Database AzureData Lake Storage Azure Synapse Analytics Azure...

  • Data Engineer

    7 days ago

    Hyderabad, India NTT DATA Services Full time

    Role Definition: Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Data Engineer

    7 days ago

    hyderabad, India NTT DATA Services Full time

    Role Definition: Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Data Engineer

    1 week ago

    hyderabad, India NTT DATA Services Full time

    Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Data Engineer

    1 week ago

    Hyderabad, India NTT DATA Services Full time

    Role Definition:Data engineers build and test scalable Big Data ecosystems for the businesses and help build data systems that are stable and highly optimized. Data engineers also update the existing systems with newer or upgraded versions of the current technologies to improve the efficiency of the databases, data storage layers and process the data...

  • Azure Data Engineer

    2 weeks ago

    hyderabad, India Tata Consultancy Services Full time

    *******Greetings From The TCS *******Job Role: Azure Data EngineerJob Location: Hyderabad OnlyExperience Range: 5 - 10 yrsDesired Competencies (Technical/Behavioral Competency):Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    *******Greetings From The TCS ******* Job Role: Azure Data Engineer Job Location: Hyderabad Only Experience Range: 5 - 10 yrs Desired Competencies (Technical/Behavioral Competency): Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage Explorer Proficient in creating Data Factory...

  • Azure Data Engineer

    2 weeks ago

    Hyderabad, India Tata Consultancy Services Full time

    *******Greetings From The TCS *******Job Role: Azure Data EngineerJob Location: Hyderabad OnlyExperience Range: 5 - 10 yrsDesired Competencies (Technical/Behavioral Competency):Sound skills and hands on experience with Azure Data Lake, Azure Data Factory, SQL Data Warehouse Azure Blob, Azure Storage ExplorerProficient in creating Data Factory pipelines for...

  • Azure Data Engineer

    3 weeks ago

    hyderabad, India 2COMS Consulting Pvt. Ltd. Full time

    As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure.On a typical day, you might● Design and build scalable & metadata-driven data ingestion pipelines (For...

  • Azure Data Engineer

    1 hour ago

    Hyderabad, India Baadalsoft LLC Full time

    Responsibilities:Design, develop, and deploy data solutions on the Azure cloud platform, leveraging services such as Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics.Collaborate with analysts, and other stakeholders to understand business requirements and translate them into technical solutions.Build and maintain scalable...

  • Azure Data Engineer

    4 minutes ago

    Hyderabad, India Tata Consultancy Services Full time

    Required Skills: ADF,ADB, PySpark, Scala,MS Azure, SQL Atleast 6+ years of Experience in Data Analytics as Azure Data engineer. Extensive experience on Design and Development of solutions in Azure Data Factory, Databricks, SQL, Synapse, Snowflake, Python, pySpark Good understanding of Data ware house concepts and ETL process's Experience in building...

  • Azure Data Engineer

    1 month ago

    Hyderabad, India TekOne IT Services Pvt. Ltd. Full time

    Lead Azure Data EngineerExperience: 12+ YearsLocation : HyderabadShift time: 2:00 pm to 11:00 pmResponsibilities:Design and implement data pipelines with Azure Data Factory and Azure Databricks.Integrate data from Azure SQL, MySQL, Azure Data Lake, and Azure Blob Storage.Develop AI models and solutions using Azure Machine Learning and Cognitive...

  • Azure Data Engineer

    1 week ago

    Hyderabad, India Tata Consultancy Services Full time

    Required Skills: ADF,ADB, PySpark, Scala,MS Azure, SQL Atleast 6+ years of Experience in Data Analytics as Azure Data engineer. Extensive experience on Design and Development of solutions in Azure Data Factory, Databricks, SQL, Synapse, Snowflake, Python, pySparkGood understanding of Data ware house concepts and ETL process'sExperience in building pipelines...

  • Azure Data Engineer

    2 days ago

    Hyderabad, India Baadalsoft LLC Full time

    Responsibilities: Design, develop, and deploy data solutions on the Azure cloud platform, leveraging services such as Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. Collaborate with analysts, and other stakeholders to understand business requirements and translate them into technical solutions. Build and maintain...

  • Azure Data Engineer

    2 days ago

    Hyderabad, India Baadalsoft LLC Full time

    Responsibilities: Design, develop, and deploy data solutions on the Azure cloud platform, leveraging services such as Azure Data Factory, Azure Databricks, Azure SQL Database, and Azure Synapse Analytics. Collaborate with analysts, and other stakeholders to understand business requirements and translate them into technical solutions. Build and maintain...