Data Engineer

3 weeks ago


MetrosAnywhere in IndiaMultiple Locations WEN Full time

Role : Data Engineer - Spark Streaming

Experience : 5+ years

Responsibilities :

- Develop and maintain real-time data pipelines using Spark Streaming.

- Collaborate with cross-functional teams to understand and define data requirements for streaming applications.

- Design and implement scalable and efficient data processing solutions using Python and Pyspark.

- Perform data ingestion, transformation, and aggregation to ensure data quality and integrity.

- Optimize Spark Streaming jobs to improve performance and latency.

- Troubleshoot and debug issues with data pipelines and streaming applications.

- Monitor and manage Spark clusters to ensure high availability and performance.

- Develop and maintain documentation including technical specifications, data mappings, and workflows.

- Stay updated with industry best practices and emerging technologies in the field of data engineering and streaming.

(ref:hirist.tech)
  • Data Architect

    1 week ago


    Anywhere In India/multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ Years Location - Remote Skills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS Cloud We are seeking a highly skilled and experienced Data Architect to join our team.The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS...

  • Data Engineer

    1 week ago


    Metros/Anywhere in India/Multiple Locations WEN Full time

    Role : Data Engineer - Spark StreamingExperience : 5+ yearsResponsibilities : Develop and maintain realtime data pipelines using Spark Streaming. Collaborate with crossfunctional teams to understand and define data requirements for streaming applications. Design and implement scalable and efficient data processing solutions using Python and Pyspark. Perform...

  • Sigmoid Analytics

    3 weeks ago


    Anywhere in India/Multiple Locations ASTAR DATA LLP Full time

    Job Description : This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Sigmoid Analytics

    2 months ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    Job Description : This position will be part of a growing team working towards building world-class large scale Big Data architectures.Responsibilities : Good Development Practices :- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy,...

  • Aptus Data Labs

    3 weeks ago


    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    1 month ago


    Anywhere in India/Multiple Locations Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    1 month ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Aptus Data Labs

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • Sigmoid Analytics

    3 weeks ago


    Anywhere in India/Multiple Locations ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • Sigmoid Analytics

    2 months ago


    Anywhere in India,Multiple Locations ASTAR DATA LLP Full time

    This position will be part of a growing team working towards building world-class large scale Big Data Good Development Practices:- Hands-on coder with good experience in programming languages like Python or Scala.- Good Understanding of programming principles and development practices like checkin policy, unit testing, code deployment- Self-starter to be...

  • MLOps Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    1 month ago


    Anywhere in India/Multiple Locations GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • MLOps Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Data Engineer

    3 weeks ago


    Metros/Anywhere in India/Multiple Locations, IN WEN Full time

    Role : Data Engineer - Spark StreamingExperience : 5+ yearsResponsibilities :- Develop and maintain real-time data pipelines using Spark Streaming.- Collaborate with cross-functional teams to understand and define data requirements for streaming applications.- Design and implement scalable and efficient data processing solutions using Python and Pyspark.-...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations BlueByte Technologies Full time

    Position : Data engineerLocation : Remote/ HybridMust have - AKS, Python and SQLGood to have - Erwin toolJob Description :seeking a skilled and motivated AKS (Azure Kubernetes Service) Data Engineer to join our dynamic team (can be open for GKS exp in place of AKS too). The ideal candidate will have a strong background in data engineering, experience with...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Arting Digital Full time

    Position Title : Data EngineerExp : 5+ yearsLocation : RemotePrimary Skills : Data warehousing, ETL leveraging Snowflake, ADF ,Python Qualification : AnyRoles and responsibilities : An offshore Data Engineer to work with the Investment Analytics team. This person needs to have a strong exp of Data warehousing and ETL leveraging Snowflake, ADF and Python. A...

  • Azure Data Engineer

    3 weeks ago


    Metros/Anywhere in India/Multiple Locations Xcel Hire Management Solutions Full time

    Position : Azure Senior Data EngineerLocation : Any location within IndiaJob Type : D&A Competency RoleJob Summary :We are seeking a highly motivated and experienced Azure Senior Data Engineer to join our team. The ideal candidate will be responsible for Researching, designing, building, maintaining, and supporting data pipelines and data lakes in Azure...

  • Azure Data Engineer

    4 weeks ago


    Metros/Anywhere in India/Multiple Locations, IN Xcel Hire Management Solutions Full time

    Position : Azure Senior Data EngineerLocation : Any location within IndiaJob Type : D&A Competency RoleJob Summary :We are seeking a highly motivated and experienced Azure Senior Data Engineer to join our team. The ideal candidate will be responsible for Researching, designing, building, maintaining, and supporting data pipelines and data lakes in Azure...

  • Azure Data Engineer

    1 month ago


    Metros/Anywhere in India/Multiple Locations Xcel Hire Management Solutions Full time

    Position : Azure Senior Data EngineerLocation : Any location within IndiaJob Type : D&A Competency RoleJob Summary :We are seeking a highly motivated and experienced Azure Senior Data Engineer to join our team. The ideal candidate will be responsible for Researching, designing, building, maintaining, and supporting data pipelines and data lakes in Azure...