Senior Azure Data Engineer

Found in: Whatjobs IN C2 - 2 weeks ago

hyderabad, India Enable Data Incorporated Full time

Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects of our clients' Spark data processing pipelines, including development, implementation, and testing. In addition, you will work closely with our clients to identify opportunities to optimize their data processing pipelines and leverage Spark to achieve their goals. This is an excellent opportunity for a talented Spark Engineer who is looking to advance their skills and work with cutting-edge technologies in the Information Technology and Services industry.

Responsibilities
  • Design, implement, and maintain cloud-based data pipelines to enable efficient storage, processing, and analysis of large volumes of data.
  • Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data platform architectures.
  • Evaluate and select appropriate cloud infrastructure and services to support data storage, processing, and analytics needs, considering factors such as scalability, performance, cost, and security.
  • Implement data ingestion pipelines, integrating various data sources and ensuring data quality, integrity, and timeliness.
  • Design and optimize data storage solutions, including data lakes, data warehouses, and data marts, to support different types of data processing and analysis.
  • Implement data processing workflows using technologies such as Apache Spark, Apache Hadoop, or cloud-native data processing services.
  • Develop and maintain data governance and security policies, ensuring compliance with data protection regulations and industry best practices.
  • Monitor and optimize the performance of data platforms, identifying bottlenecks and implementing optimizations to improve data processing speed and efficiency.
  • Collaborate with DevOps teams to automate deployment, monitoring, and management of data platforms using infrastructure-as-code and CI/CD practices.
  • Stay up-to-date with emerging technologies and industry trends in cloud computing, big data processing, and data engineering.
  • Provide guidance and mentorship to junior team members, fostering a culture of learning and innovation.

Requirements

  • Bachelor's or Master's degree in computer science, engineering, or a related field.
  • 8+ years of proven experience as a Data Engineer, Software Engineer, or similar role, with a focus on building cloud-based data platforms.
  • Strong experience in Microsoft Azure
  • Proficiency in the latest Big Data tools/technologies like Hive, Hadoop, Yarn, Kafka, Spark Stream.
  • Proficiency in data processing frameworks such as Apache Spark, Apache Hadoop, or cloud-native data processing services (Azure Data Lake, Azure Data factory, Azure Databricks, Azure Synapse, Snowflake, CosmosDB)
  • Experience with data integration and ETL (Extract, Transform, Load) processes, including tools like Apache Airflow or cloud-native orchestration services.
  • Experience with workload and job optimization for cost reduction
  • Knowledge of database systems (relational and NoSQL) and data modeling principles.
  • Familiarity with data governance, data security, and compliance frameworks.
  • Understanding of distributed computing principles and scalable architectures.
  • Experience with infrastructure-as-code tools like Terraform
  • Excellent problem-solving and troubleshooting skills, with the ability to address complex data platform challenges.
  • Strong communication and collaboration skills to work effectively with cross-functional teams

  • Senior Azure Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • Senior Azure Data Engineer

    Found in: Talent IN C2 - 2 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is seeking a highly skilled Senior Spark Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, we leverage modern solutions to drive increased value across our clients' business ecosystem. As a Senior Spark Engineer, you will be responsible for overseeing all aspects...

  • AMAZATIC - Data Engineer/Senior Engineer - Azure

    Found in: Whatjobs IN C2 - 2 weeks ago

    Hyderabad,Pune, India AMAZATIC SOLUTIONS LLP Full time

    Senior AZURE DE Our Values : Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, ReliabilityPosition : Data Engineer / Senior Data EngineerExperience : 8+ YearsKey Skills :- Minimum 5Y+ on Azure cloud services.- Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.- Strong...

  • AMAZATIC - Data Engineer/Senior Engineer - Azure

    Found in: Whatjobs IN C2 - 14 hours ago

    Hyderabad/Pune, India AMAZATIC SOLUTIONS LLP Full time

    Senior AZURE DE Our Values : Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, ReliabilityPosition : Data Engineer / Senior Data EngineerExperience : 8+ YearsKey Skills :- Minimum 5Y+ on Azure cloud services.- Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.- Strong...

  • AMAZATIC - Data Engineer/Senior Engineer - Azure

    Found in: Adzuna IN C2 - 1 week ago

    Hyderabad/Pune, IN AMAZATIC SOLUTIONS LLP Full time

    Senior AZURE DE Our Values : Passion, Continuous Learning, Adaptability, Teamwork, Customer Centricity, ReliabilityPosition : Data Engineer / Senior Data EngineerExperience : 8+ YearsKey Skills :- Minimum 5Y+ on Azure cloud services.- Proficiency in using Azure Synapse, Azure Storage, and Azure Data Factory for building data solutions.- Strong understanding...

  • Senior Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Hyderabad, India CogentIBS Full time

    Senior Data Engineer Location - HyderabadWe are recruiting for an experienced Senior Data Engineer and we'll give you the opportunity to grow and develop your capabilities as well as supporting you through Microsoft certifications. You'll have experience in :- Developing low to high complexity, secure, governed, high quality and efficient data...

  • Azure Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Hyderabad, India ProArch Full time

    ProArch is looking for a highly skilled and experienced Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions using the Azure data platform.Responsibilities:Design, develop, and implement data engineering solutions on the Azure platformCreate and maintain data...

  • Azure Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    hyderabad, India ProArch Full time

    ProArch is looking for a highly skilled and experienced Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions using the Azure data platform. Responsibilities: Design, develop, and implement data engineering solutions on the Azure platform Create and maintain...

  • Azure Data Engineer

    Found in: Talent IN C2 - 2 weeks ago

    Hyderabad, India ProArch Full time

    ProArch is looking for a highly skilled and experienced Azure Data Engineer to join our team. As an Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data solutions using the Azure data platform.Responsibilities: Design, develop, and implement data engineering solutions on the Azure platform Create and maintain data...

  • Azure Solution Architect

    Found in: Whatjobs IN C2 - 2 weeks ago

    hyderabad, India Enable Data Incorporated Full time

    Responsibilities ·Serves as Azure Solutions Architect for large, complex and highly visible technology programs providing technical oversight for mission critical applications. ·Design and implement large-scale enterprise applications using Microsoft Azure technologies, including Azure Databricks, Data Factory, Azure SQL and Synapse, Azure Cosmos DB, and...

  • Azure Solution Architect

    Found in: Talent IN C2 - 2 weeks ago

    Hyderabad, India Enable Data Incorporated Full time

    Responsibilities·Serves as Azure Solutions Architect for large, complex and highly visible technology programs providing technical oversight for mission critical applications.·Design and implement large-scale enterprise applications using Microsoft Azure technologies, including Azure Databricks, Data Factory, Azure SQL and Synapse, Azure Cosmos DB, and...

  • Azure Data engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Hyderabad, India Trigyn Technologies Full time

    Job Description:Trigyn has an opportunity Azure Data Engineer. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad.Job Responsibilities:Azure Data engineer to deliver the new Data Strategy and Data Governance projects. The resource must have experience in Incorta and Oracle Cloud and be highly skilled in SQL and ETL data...

  • Azure Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Hyderabad, India Axiom Full time

    Roles and Responsibilities:8+ years of experience in creating Data Platform Solutions5+ years of experience in implementing Data bricks, Data bricks Note book, Data Lakes, Data warehouse and Data Lake Architectures best practices for data storage, loading, retrieving data from data lakes.3+ years of Azure Cloud Technologies building pipelines using...

  • Azure Data engineer

    Found in: Talent IN C2 - 2 weeks ago

    Hyderabad, India Trigyn Technologies Full time

    Job Description: Trigyn has an opportunity Azure Data Engineer. This resource will work at our client sites in Mumbai/Pune/Chennai/Bangalore/Hyderabad. Job Responsibilities: Azure Data engineer to deliver the new Data Strategy and Data Governance projects. The resource must have experience in Incorta and Oracle Cloud and be highly skilled in SQL and...

  • Senior Azure Technical Engineering Lead

    Found in: Talent IN C2 - 3 weeks ago

    Hyderabad, India Carnation Infotech Pvt Ltd Full time

    Position:SeniorAzure Technical EngineeringLeadLocation:HyderabadSeniorAzure Technical Engineering lead providing engineering support toMunich Re business stakeholders Deepexperience in delivering Azure data pipelines and developing Azuredata lakes o More than 1 project delivering Azure data solutionsUnderstanding of data architecturesUnderstanding of data...

  • Azure Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Hyderabad, India Anblicks Full time

    Azure Data EngineerExperience of building & implementing robust data pipelines using Microsoft Stack. Development & ImplementationSound skills and hands on experience with Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse, Azure Analysis Services.Proficient in creating Data Factory Pipelines for on-cloud ETL processing.Hands on experience...

  • Azure Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    hyderabad, India Axiom Full time

    Roles and Responsibilities: 8+ years of experience in creating Data Platform Solutions 5+ years of experience in implementing Data bricks, Data bricks Note book, Data Lakes, Data warehouse and Data Lake Architectures best practices for data storage, loading, retrieving data from data lakes. 3+ years of Azure Cloud Technologies building pipelines using...

  • Azure Data Engineer

    Found in: Talent IN C2 - 2 weeks ago

    Hyderabad, India Axiom Full time

    Roles and Responsibilities:8+ years of experience in creating Data Platform Solutions5+ years of experience in implementing Data bricks, Data bricks Note book, Data Lakes, Data warehouse and Data Lake Architectures best practices for data storage, loading, retrieving data from data lakes.3+ years of Azure Cloud Technologies building pipelines using...

  • Azure Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    hyderabad, India Anblicks Full time

    Azure Data Engineer Experience of building & implementing robust data pipelines using Microsoft Stack. Development & Implementation Sound skills and hands on experience with Azure Data Factory, Azure Data Lake, Azure Databricks, Azure Synapse, Azure Analysis Services. Proficient in creating Data Factory Pipelines for on-cloud ETL processing. Hands on...

  • Trainee Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Hyderabad, India ProArch Full time

    ProArch is seeking a Trainee Data Engineer with a focus on Azure to join our dynamic team. As a Trainee Data Engineer - Azure, you will work on building and managing data solutions on the Azure platform. You will collaborate with cross-functional teams to develop and implement data pipelines, conduct data modeling, and perform data analysis. We are looking...