Data Engineer

2 weeks ago

Delhi, Delhi, India MatchMove Full time

You will get to :

- Design, build, and maintain high-performance data pipelines that integrate large-scale transactional data from our payments platform, ensuring data quality, reliability, and compliance with regulatory requirements.

- Develop and manage distributed data processing pipelines for both high-volume data streams and batch processing workflows in a cloud-native AWS environment.

- Implement observability and monitoring tools to ensure the reliability and scalability of the data platform, enabling stakeholders to make confident, data-driven decisions.

- Collaborate with cross-functional teams to gather requirements and deliver business-critical data solutions, including automation of payment transactions lifecycle management, regulatory reporting, and compliance.

- Design and implement data models across various storage paradigms to support payment transactions at scale while ensuring efficient data ingestion, transformation, and storage.

- Maintain data integrity by implementing robust validation, testing, and error-handling mechanisms within data workflows.

- Ensure that the data platform adheres to the highest standards for security, privacy, and governance.

- Provide mentorship and guidance to junior engineers, driving innovation, best practices, and continuous improvement across the :

- 4-6 years of experience in backend development and/or data platform engineering.

- Proficiency in Python, with hands-on experience using data-focused libraries such as NumPy, Pandas,

SQLAlchemy, and Pandera to build high-quality data pipelines.

- Strong expertise in AWS services (S3, Redshift, Lambda, Glue, Kinesis, etc.) for cloud-based data infrastructure and processing.

- Experience with multiple data storage models, including relational, columnar, and time-series databases.

- Proven ability to design and implement scalable, reliable, and high-performance data workflows, ensuring data integrity, performance, and availability.

- Experience with workflow orchestrators such as Apache Airflow or Argo Workflows for scheduling and automating data pipelines.

- Familiarity with Python-based data stack tools like DBT, Dask, Ray, Modin, and Pandas for distributed data processing.

- Hands-on experience with data ingestion, cataloging, and change-data-capture (CDC) tools.

- Understanding of DataOps and DevSecOps practices to ensure secure and efficient data pipeline development and deployment.

- Strong collaboration, communication, and problem-solving skills, with the ability to work effectively

across multiple teams and geographies.

- Experience in payments or fintech platforms is a strong plus, particularly in processing high volumes of transactional data.

(ref:hirist.tech)

  • Senior Data Engineer

    3 weeks ago

    Delhi, Delhi, India Aptus Data Labs Full time

    Job Title : Senior Data EngineerLocation : : 58 YearsEmployment Type : Full-TimeAbout the Role :Aptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. Youll work on modern data lake architectures and high-performance pipelines in AWS, enabling real-time insights and...

  • Data Engineer

    3 weeks ago

    Delhi, Delhi, India Comtek Full time

    About the Role : We are seeking a skilled Data Engineer to join our team and contribute to our cutting-edge data platform built on a medallion data lake architecture. You will design, develop, and maintain robust data pipelines while collaborating on innovative AI engineering projects. This role combines traditional data engineering responsibilities with...

  • Associate Software Engineer

    3 weeks ago

    Delhi, Delhi, India NTT DATA Full time

    Req ID 325447 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Associate Software Engineer to join our team in NTT PAN India locations Delhi IN-DL India IN Role Overview...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Reve Full time

    Job Title : Data EngineerThis is a unique opportunity to join our team as a skilled data engineer with extensive experience in Python-based data engineering.About the Role : - Design and develop scalable data pipelines using Python.- Work on API development, testing, and deployment.- Develop expertise in ETL/ELT tools and workflow orchestration.-...

  • Data Engineer

    3 days ago

    Delhi, Delhi, India Straive Full time ₹ 6,00,000 - ₹ 12,00,000 per year

    Company DescriptionStraive operationalizes Data Analytics and AI for global enterprises, including several Fortune 500 companies, to drive efficiency and enhance user experience. As a global leader in AI-driven value creation, Straive empowers diverse clients across industries such as Banking, Financial and Information Services, Retail, Media and Technology,...

  • Data Engineer

    3 weeks ago

    Delhi, Delhi, India Animaker Inc Full time

    Role Overview :We are looking for a highly skilled with expertise in Kafka, Python, and Azure Databricks (preferred) to drive our healthcare data engineering projects. The ideal candidate will have deep experience in real-time data streaming, cloud-based data platforms, and large-scale data processing. This role requires strong technical leadership,...

  • Data Engineer

    3 weeks ago

    Delhi, Delhi, India Haruto Technologies LLP Full time

    Role : GCP Data EngineerLocation : RemoteExperience Required : 5+ YearsAbout the Role :We are looking for an experienced GCP Data Engineer who has strong expertise in building and optimizing data pipelines, big data processing, and data warehousing solutions on Google Cloud Platform. The ideal candidate should be hands-on with BigQuery, DataProc, PySpark,...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India SproutsAI Full time

    Job Description :The Data Engineer will be responsible for designing, developing, and maintaining the data infrastructure for a healthcare organization. The ideal candidate will have experience in working with healthcare data, including EHR, HIMS, PACS, and RIS. They will also have experience with SQL, Elasticsearch, and data integration tools such as :-...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Avisoft Full time

    Company DescriptionAvisoft is a Technology and IT company based in Mohali and Jammu. We are the preferred cost-effective and quality remote tech partner for global businesses. We offer Product Engineering, IT Consultancy, Project Outsourcing and Staff Augmentation services. We partner with businesses to design and build Tech platforms from scratch or to...

  • Security Managed Services Engineer

    2 weeks ago

    Delhi, Delhi, India NTT DATA Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAAs a Security...