Azure Data Engineer

3 days ago

Tirupati, Andhra Pradesh, India DevOn Full time

Azure Data Engineer: 5+ years

Data Management and Storage:

  • Design and implement data storage solutions using Azure SQL Database, Azure Data Lake Storage and Azure Blob Storage.
  • Ensure data storage systems are scalable, performant, and cost-effective.

Data Integration and ETL:

  • Develop and manage ETL (Extract, Transform, Load) processes using Azure Data Factory.
  • Ensure efficient data cleaning, transformation, and loading into Data Lakes.

Big Data and Analytics:

  • Utilize big data technologies like Azure Databricks and Apache Spark for data processing and analytics.
  • Create data processing workflows and pipelines to support data analytics and machine learning applications.

Data Pipeline Architecture:

  • Design, construct, and maintain data pipelines and combine large, complex datasets that meet business requirements.

Optimization and Monitoring:

  • Implement effective metrics and monitoring processes to ensure data quality and system performance.
  • Identify and implement internal process improvements, such as automating manual processes and optimizing data delivery.

Collaboration and Support:

  • Work with stakeholders to address data-related technical issues and support data-driven decision-making.
  • Collaborate with data and analytics experts to enhance data system functionality.

ML Use Cases:

  • Collaborate with data scientists to create datasets for variety of use cases .
  • Implement data annotations, curation techniques to enhance data readiness for ML Applications.

  • Azure Data Engineering Professional

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 17,50,000

    Azure Data Engineer OpportunityWe are seeking a skilled data professional to work on multiple projects based on Azure Data Factory, Azure Database Services, PySpark, and SQL.Key responsibilities include designing and developing data architectures using Azure services, implementing data transformations using PySpark and SQL, ensuring data quality and...

  • Azure Data Engineer Leader

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Unlock your expertise as a Lead Azure Data Engineer and propel our organization forward.We seek a seasoned professional with hands-on experience in Azure and Databricks to spearhead our data engineering efforts.This is a senior technical role that demands exceptional skills, strategic thinking, and the ability to deliver high-quality solutions...

  • Azure Data Engineering Specialist

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled professional with 4+ years of experience in Azure Data Engineering, who has strong expertise in Python, Scala, Spark (PySpark & Scala Spark), and Azure Cloud technologies.Key ResponsibilitiesData Ingestion and ETL PipelinesData Transformation WorkflowsAzure Cloud ServicesTroubleshooting and DebuggingPerformance...

  • Azure Data Engineering Solutions Architect

    22 hours ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Azure Data Engineering Specialist">Design and implement large-scale data engineering solutions on the Azure platform using a combination of technologies, including Azure Data Factory, Azure Databricks, and others.Develop and maintain scalable, secure, and highly available data storage solutions using Azure Blob Storage, Azure Data Lake Storage, and Azure SQL...

  • Azure Data Engineering Specialist

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering group, you will design, develop, and maintain large-scale data processing systems.In this role, you will work closely with cross-functional teams to identify business requirements and develop scalable solutions using Azure Databricks,...

  • Engineering Manager – Big Data, Azure

    1 week ago

    Tirupati, Andhra Pradesh, India DataE2E Technologies Full time

    Technical Manager – AzureLocation: 100% RemoteEmployment Type: Full-timeShift Timing : 3 pm – 11 pm ISTJob Summary:About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The ideal candidate will lead a team of talented data engineers to design and...

  • Azure Data Engineer

    1 day ago

    Tirupati, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Engineering OpportunitiesWe are seeking a skilled data engineer to join our team and contribute to the development of innovative data solutions. The successful candidate will be responsible for designing, building, and maintaining robust data pipelines, as well as working with cross-functional teams to deliver high-quality data products.

  • Azure Databricks Data Ingestion Specialist

    1 week ago

    Tirupati, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Opportunity: Azure Databricks EngineerWe are seeking a highly skilled Azure Databricks Engineer with expertise in data ingestion and pipeline development. As an Ingestion Engineer, you will play a crucial role in designing, developing, and optimizing data ingestion pipelines for integrating multiple sources into Databricks.Key Responsibilities:Design and...

  • Data engineer

    2 weeks ago

    Tirupati, Andhra Pradesh, India Firstsource Full time

    Key Skills and Responsibilities:We are seeking a Senior Data Engineer with a strong background in cloud-native data engineering, primarily on Microsoft Azure, and familiarity with AWS and GCP. The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering...

  • Data Engineering Strategist

    4 days ago

    Tirupati, Andhra Pradesh, India beBeeEngineering Full time ₹ 15,00,000 - ₹ 25,20,000

    Job DescriptionWe are seeking a highly skilled Data Engineering Strategist to lead our data migration efforts within the Azure ecosystem.The ideal candidate will have hands-on experience in modern data engineering tools and platforms, with a strong focus on SQL workload migration to Azure.Lead large-scale SQL workload migration from on-premise environments...