Data Engineering Specialist

2 weeks ago


Gurgaon, Haryana, India talent potential consulting Full time

Key Responsibilities:

  • Design, develop, and deliver high-quality, scalable, and secure enterprise systems, primarily developed in Python.
  • Develop and manage data pipelines and large-scale data processing systems.
  • Proactively contribute to Agile processes, collaborating with cross-functional teams.
  • Develop applications using Django, asynchronous programming, and multi-threading.
  • Manage and optimize both relational (MySQL) and non-relational (NoSQL) databases.
  • Implement and manage Kafka messaging systems.
  • Lead CICD processes for continuous integration and delivery of data engineering pipelines using GitLab.
  • Implement software design patterns to ensure scalability, maintainability, and efficiency of the codebase.
  • Utilize Jira for task tracking, project management, and sprint planning.
  • Ensure version control and code management using GitLab.

Requirements:

  • Minimum 5 years of software development experience in a commercial environment.
  • 4+ years of Python development experience.
  • Strong expertise in MySQL and NoSQL databases.
  • Experience in Kafka-based messaging systems.
  • Experience in Agile development.
  • Experience in CICD pipeline management using GitLab.
  • Proficiency in (any) Django, Flask, Fast API.
  • Strong knowledge of software design patterns.
  • Experience in data engineering and pipeline development.
  • Strong understanding of asynchronous programming and multi-threading.
  • Hands-on experience with Jira for project management and Agile task tracking.

Salary Range: $120,000 - $180,000 per year



  • Gurgaon, Haryana, India TalentXO Full time

    Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our client's team, who offers online cohort-based courses for architects, engineers, and designers in the AEC industry.The ideal candidate will have experience in designing, implementing, and optimizing scalable and efficient data architectures and pipelines to...


  • Gurgaon, Haryana, India Material Full time

    Job Title: Data Engineering SpecialistIn the role of Data Engineering Specialist at Material, you will be responsible for designing and developing data pipelines using AWS Glue, Apache Airflow, and other relevant technologies. This position requires extensive experience with AWS Glue, Apache Airflow, Kafka, SQL, Python, and DataOps tools and technologies.The...


  • Gurgaon, Haryana, India NTT DATA Full time

    Job OverviewWe are seeking a highly skilled Data Processing Specialist to join our team at NTT DATA. As a key member of our operations team, you will be responsible for reviewing and processing basic customer transactions, investigating and resolving data or account discrepancies, and providing excellent customer service.About the RoleThis is a 24 x 7...


  • Gurgaon, Haryana, India Spectral Consultants – Search & Recruitment firm Full time

    At Spectral Consultants, we are on the hunt for a talented Data Engineering Specialist to join our team. This is an exciting opportunity for a skilled professional to design and implement large-scale data processing pipelines using Hive, Spark, Hadoop, and MapReduce.We are looking for someone with hands-on experience in building scalable and efficient data...


  • Gurgaon, Haryana, India Drimlite Full time

    Job Title: Data Engineering Specialist\Helpers are needed to design, build, and maintain data pipelines. \\A strong background in PySpark, Databricks, and Azure DevOps is required.\\As a member of the global analytics team, you will collaborate with colleagues to ensure efficient data handling and gain insights that drive business decisions.\Key...

  • Data Engineer

    1 month ago


    Gurgaon, Haryana, India MINFY TECHNOLOGIES PRIVATE LIMITED, Full time

    Job Title : Data Engineer - Cloud Data Pipeline SpecialistWe are seeking an experienced Data Engineer to join our team at Minfy Technologies Private Limited. The estimated salary for this role is ₹1,500,000 - ₹2,500,000 per annum, depending on experience. Company OverviewMinfy Technologies Private Limited is a leading technology company that specializes...


  • Gurgaon, Haryana, India IGT Full time

    Job DescriptionWe are seeking a highly skilled Senior Data Engineering Specialist to join our team at IGT. As a key member of our data engineering team, you will play a vital role in designing, developing, and maintaining scalable data pipelines using Python and PySpark.In this role, you will work closely with cross-functional teams to gather and understand...


  • Gurgaon, Haryana, India First Call HReSource Full time

    **Job Details**We are seeking a highly skilled Data Engineering and Architecture Specialist to join our team at First Call HReSource. In this role, you will be responsible for designing, implementing, and maintaining scalable and efficient data pipelines across various systems.Key Responsibilities:Design and develop data pipelines using Azure Databricks,...


  • Gurgaon, Haryana, India Publicis Groupe Full time

    Job OverviewData Engineers play a crucial role in enabling data ingestion and use across various functions. As a Data Engineer Specialist at Publicis Groupe, you will be responsible for supporting multiple aspects of data management.About the JobWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in...


  • Gurgaon, Haryana, India Absolutdata Full time

    Absolutdata Job OpportunityAzure Cloud Data Engineering Specialist Role OverviewThis is a pivotal position at Absolutdata, where you will lead the development and implementation of cloud-based data engineering solutions using Azure services. As an accomplished Data Engineer with expertise in database design, you will play a critical role in architecting...

  • Data Engineer

    3 weeks ago


    Gurgaon, Haryana, India IGT Solutions Full time

    **Job Overview**IGT Solutions is seeking a highly skilled Data Engineer - Technical Specialist to join our dynamic team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data pipelines using Azure Databricks and related Azure services.Responsibilities:Design and develop scalable and...

  • Data Engineer

    1 week ago


    Gurgaon, Haryana, India MINDTEL GLOBAL PRIVATE LIMITED Full time

    Job Overview">MINDTEL GLOBAL PRIVATE LIMITED is seeking a highly skilled Data Engineer - Cloud Specialist to join our team. This role involves designing, developing, and maintaining robust data pipelines using Azure Data Factory (ADF) to ingest, transform, and load data into data warehouses and data lakes.">About the Role">We are looking for an experienced...


  • Gurgaon, Haryana, India Nagarro Full time

    Company OverviewNagarro is a global leader in digital transformation, providing cutting-edge technology solutions to clients across various industries.SalaryThe estimated salary for this position is $150,000 - $180,000 per annum, depending on experience and qualifications.Job DescriptionWe are seeking an exceptional Associate Staff Engineer to join our team...

  • ETL Data Specialist

    2 weeks ago


    Gurgaon, Haryana, India Douxware Technologies Full time

    Douxware Technologies seeks an experienced ETL Data Specialist to design, develop, and maintain Extract, Transform, Load processes using SSIS or other ETL tools.The ideal candidate will have a solid understanding of data management principles and experience in managing data warehouses.Design, develop, and maintain ETL processes using SSIS or any other ETL...

  • Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India airtel Full time

    At Airtel, we are seeking an experienced Data Engineer to join our team as a MongoDB Specialist. This role will be responsible for designing, implementing, and maintaining large-scale MongoDB databases.About UsAirtel is a leading telecommunications company that provides innovative services to customers worldwide. We are committed to delivering exceptional...


  • Gurgaon, Haryana, India Majid Al Futtaim Full time

    We are seeking a highly skilled Data Engineer and BI Support Specialist to join our technical support team at Majid Al Futtaim. In this role, you will be responsible for ensuring the smooth functioning of our data integration processes and supporting day-to-day operations of data pipelines.Key ResponsibilitiesProvide technical support for SAP Data Services...

  • Senior Data Engineer

    2 weeks ago


    Gurgaon, Haryana, India Innova ESI Full time

    About the RoleAre you a highly skilled and experienced Senior Data Engineer looking to take your career to the next level? We are seeking an exceptional individual to join our team at Innova ESI as a Senior Data Engineer - ETL Process Specialist.In this role, you will be responsible for designing, developing, and maintaining robust data pipelines and data...


  • Gurgaon, Haryana, India Status Neo Full time

    Job Title: Data Architect SpecialistAt Status Neo, we're looking for a skilled Data Architect Specialist to join our team.We offer an estimated salary of $120,000 - $180,000 per annum.Company OverviewStatus Neo is a forward-thinking organization that prides itself on innovation and excellence. We strive to create a work environment that fosters...


  • Gurgaon, Haryana, India Advatix Full time

    Company OverviewAdvatix is a forward-thinking organization seeking a skilled Chief Data Infrastructure Specialist to join our team. Our company prides itself on innovation and excellence in data engineering.


  • Gurgaon, Haryana, India exl Full time

    Job OverviewWe are seeking an experienced Senior AWS Data Engineering Specialist to join our team at EXL. This is a challenging and rewarding opportunity for the right candidate.About UsEXL is a leading business process management company that helps clients achieve high-quality, cost-effective results across various sectors.Key ResponsibilitiesDesign and...