Data Engineer

2 weeks ago


Anywhere in IndiaMultiple Locations, IN Mobile Programming LLC Full time

Data Engineer

Exp - 4-7 years

Location - Remote

Notice period - Immediate Only

Mandatory skill : Python, Airflow, Spark, AWS, SQL

Key Responsibilities :

  • Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Python, Airflow, and Spark.
  • Data Integration: Integrate data from various sources into a cohesive and consistent format suitable for analytics and reporting.
  • Cloud Infrastructure: Utilize AWS services to build and manage robust data infrastructure.
  • Data Transformation: Implement data transformation processes to clean and prepare data for analytics.
  • Performance Optimization: Optimize data workflows and processes for efficiency and scalability.
  • Collaboration: Work closely with data scientists, analysts, and other stakeholders to understand data needs and deliver appropriate solutions.
  • Documentation: Create and maintain comprehensive documentation for data processes, systems, and workflows.
Mandatory Skills:
  • Python: Proficient in Python programming for data manipulation and automation.
  • Airflow: Experience in using Apache Airflow for orchestrating data workflows.
  • Spark: Hands-on experience with Apache Spark for big data processing.
  • AWS: Expertise in AWS services such as S3, Redshift, Lambda, and other relevant tools.
  • SQL: Strong SQL skills for querying and managing relational databases.

(ref:hirist.tech)
  • Aptus Data Labs

    2 weeks ago


    Anywhere in India/Multiple Locations, IN Aptus Data Labs Full time

    Role - Data Architect/Data Engineer Lead- AWSExp - 8+ YearsLocation - RemoteSkills - Data architecture, Data modelling & design, Data Governance, MDM, Python, SQL, ETL, AWS CloudWe are seeking a highly skilled and experienced Data Architect to join our team. The ideal candidate will have 8+ years of experience in data architecture, with a focus on AWS cloud...

  • MLOps Engineer

    2 weeks ago


    Anywhere in India/Multiple Locations, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...

  • Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Data Engineer (Integration)Experience Required : 10+yrsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :- Understand all forms of data integration including APIs - Event-based, Streaming, REST and GraphQL API, CDC/Replication, Batch,...

  • Senior/Staff Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Grorapid labs Full time

    Senior / Staff Engineer Data EngineeringExperience Required : 8 - 14 years working Days 5 days/week Office Location : Remote WorkingRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner.- Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Paralleldots Full time

    Job Description :As a Senior Data Engineer at ParallelDots, you will be responsible for overseeing the design and development of advanced data solutions. You will work closely with data scientists, analysts, and other stakeholders to ensure that our data infrastructure meets the highest standards of scalability, reliability, and :- Lead the design,...

  • Lead Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations, IN Pro5.ai Full time

    Job Description :Technical delivery lead on platform and project builds for building and maintaining optimised and highly available data pipelines that facilitate data management and data analytics solutions. The role will drive the development of data processing frameworks and data architectural approaches that scale to handle the business's growing...


  • Anywhere in India/Multiple Locations, IN Dotflick Solutions Full time

    Profile : DevOps and Data EngineerJob description : This role is a Hybrid DevOps and Data Engineering.Mode : WFO/WFHRoles & responsibilities : - Setting up tools and required infrastructure- Defining and setting development, test, release, update, and support processes for DevOps operation- Have the technical skill to review, verify, and validate the...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Perfecthire Full time

    Job Description : We are seeking a talented and experienced Data Engineer to join our team and play a key role in the development and implementation of our end-to-end 834 EDI solution. A robust level of experience or familiarity with 834 EDI (Electronic Data Interchange) transactions is critical for this role. As a Data Engineer, you will be responsible for...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Ridgeant Techonologies Full time

    Responsibilities :- Collaborate with stakeholders to understand business requirements and data needs, and translate them into scalable and efficient data engineering solutions using AWS Data Services.- Design, develop, and maintain data pipelines using AWS serverless technologies such as- Glue, S3, Lambda, DynamoDB, Athena, and RedShift.- Implement data...


  • Anywhere in India/Multiple Locations, IN Spruce IT Pvt. Ltd. Full time

    Pan India. Experience : 5-8 years. JD : Azure Databricks : Role : Data Engineer (Sr).- The Senior Data Engineer will be responsible for the build of Enterprise Data platform.- Setting up the data pipelines that are scalable, robust and resilient and build pipelines to validate, ingest, normalize/enrich and business-specific processing of healthcare data.-...

  • Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN AAR Consultancy Full time

    Technical Skills :1. Google Cloud Platform (GCP) : In-depth knowledge and hands-on experience with GCP services such as BigQuery, Dataflow, Dataproc, Pub/Sub, Data Studio, and Cloud Storage.2. Data Engineering : Strong understanding of data engineering principles, including data ingestion, transformation, processing, and storage.3. Big Data Technologies :...

  • Data Engineer

    4 weeks ago


    Bangalore/Anywhere in India/Multiple Locations, IN Talent Socio Full time

    Job Description :The Data Engineer will be responsible for designing, developing, and maintaining data pipelines, data warehouses, and databases. The Data Engineer will also be responsible for data integration, data modeling, ETL processes, and data analytics.Requirements :- Data Engineering, ETL, Data Warehousing, and Data Modeling skills.- Experience in...

  • Data Engineer

    1 day ago


    Anywhere in India/Multiple Locations, IN Huquo Full time

    Position : AWS Data EngineerLocation : Pune/ Gurgaon/ HybridExperience : 5+Job Description :- 5+ years of experience as a Data Engineer on the AWS Stack- AWS Solutions Architect or AWS Developer Certification required- Solid experience with AWS services such as Cloud Formation, S3, Athena, Glue, Glue Data Brew, EMR/Spark, RDS, Redshift, Data Sync, DMS,...

  • Azure Data Engineer

    2 days ago


    Anywhere in India/Multiple Locations, IN TekNinjas Full time

    Role : Data Engineer - Azure Synapse Analytics - Experience in Data engineering projects using Microsoft Azure platform (Min 2-3 projects)- Strong expertise in data engineering tools and storage such as Azure ADLS Gen2, Blob storage- Experience implementing automated Synapse pipelines- Ability to implement Synapse pipelines for data integration ETL/ELT using...

  • Azure Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN DEVENIR SOFTWARE PRIVATE LIMITED Full time

    Position : Azure Data EngineerExperience : 4 to 12+ yearsRelevant 5+ Exp is mustLocation : Pan IndiaFulltime roleImmediate : - Design, build, and maintain data pipelines and ETL processes on Azure cloud platform- Develop and implement data solutions using Azure data services such as Azure Data Factory, Azure SQL Database, Azure Databricks, and Azure Synapse...


  • Anywhere in India/Multiple Locations, IN Calyptus Full time

    Responsibilities :- Collaborating with business teams to design systems architecture- Design and implement robust, scalable, and optimized data architectures.- Lead the development and maintenance of scalable data pipelines and build out new integrations to support continuing increases in data volume and complexity.Pipeline ownership :- Develop integrations...

  • Data Engineer

    1 month ago


    Anywhere in India/Multiple Locations, IN Aricent Full time

    Job Profile : Data EngineerLocation : WFO/WFH (Both Available)Specialization : IT/Cloud/Data Management Job Description :- Completed Bachelors degree or diploma (or equivalent experience) in Computer Science, Software Engineering or Software Architecture preferred; candidates with substantial and relevant industry experience are also eligible- 2+ years of...


  • Anywhere in India/Multiple Locations, IN TekNinjas Full time

    Position : Senior Data Engineer- An independent contributor expected to be an expert in the technology area.- Excellent Communication & Customer Interaction Skills with positive attitude.Job Description :Must Have :- 5-7 Years of data engineering experience in building ETL and ETL data pipelines for various types of data source extraction, incremental...

  • Lead Data Engineer

    3 weeks ago


    Anywhere in India/Multiple Locations, IN Vista Full time

    About you :- Passionate about both Data Engineering and Machine Learning Engineering, you can likewise wear one or the other hat according to what you need to accomplish- Passionate about GenAI an excited to join a Team working on state of the art GenAI topics- Ideate and build data products that drive value for internal and external customers- Write quality...

  • Data Engineer

    1 day ago


    Bangalore/Anywhere in India/Multiple Locations, IN Talhive HR Management LLP Full time

    About Loopio :Loopio supercharges the way companies respond to Requests for Proposals (RFPs), Due Diligence Questionnaires (DDQs), and Security Questionnaires. Our platform helps our 900 customers work faster, create higher-quality proposals, and win more business. Our mission is to empower people to focus on what matters. We do this by giving both our...