
Data Engineer
4 days ago
You Will Get To
- Design, build, and maintain high-performance data pipelines that integrate large-scale transactional data from our payments platform, ensuring data quality, reliability, and compliance with regulatory requirements.
- Develop and manage distributed data processing pipelines for both high-volume data streams and batch processing workflows in a cloud-native AWS environment.
- Implement observability and monitoring tools to ensure the reliability and scalability of the data platform, enabling stakeholders to make confident, data-driven decisions.
- Collaborate with cross-functional teams to gather requirements and deliver business-critical data solutions, including automation of payment transactions lifecycle management, regulatory reporting, and compliance.
- Design and implement data models across various storage paradigms to support payment transactions at scale while ensuring efficient data ingestion, transformation, and storage.
- Maintain data integrity by implementing robust validation, testing, and error-handling mechanisms within data workflows.
- Ensure that the data platform adheres to the highest standards for security, privacy, and governance.
- Provide mentorship and guidance to junior engineers, driving innovation, best practices, and continuous improvement across the :
- 4-6 years of experience in backend development and/or data platform engineering.
- Proficiency in Python, with hands-on experience using data-focused libraries such as NumPy, Pandas,
SQLAlchemy, and Pandera to build high-quality data pipelines.
- Strong expertise in AWS services (S3, Redshift, Lambda, Glue, Kinesis, etc.) for cloud-based data infrastructure and processing.
- Experience with multiple data storage models, including relational, columnar, and time-series databases.
- Proven ability to design and implement scalable, reliable, and high-performance data workflows, ensuring data integrity, performance, and availability.
- Experience with workflow orchestrators such as Apache Airflow or Argo Workflows for scheduling and automating data pipelines.
- Familiarity with Python-based data stack tools like DBT, Dask, Ray, Modin, and Pandas for distributed data processing.
- Hands-on experience with data ingestion, cataloging, and change-data-capture (CDC) tools.
- Understanding of DataOps and DevSecOps practices to ensure secure and efficient data pipeline development and deployment.
- Strong collaboration, communication, and problem-solving skills, with the ability to work effectively
across multiple teams and geographies.
- Experience in payments or fintech platforms is a strong plus, particularly in processing high volumes of transactional data.
)
-
Data Engineer
2 weeks ago
Greater Kolkata Area, India Workmates Core2Cloud Full time ₹ 9,00,000 - ₹ 12,00,000 per yearResponsibilitiesJob DescriptionAbout The RoleAs a Junior/Senior Data Engineer, you'll be taking the lead in designing and maintaining complex data ecosystems. Your experience will be instrumental in optimizing data processes, ensuring data quality, and driving data-driven decision-making within the organization.Architecting and designing complex data systems...
-
Data Engineer
2 weeks ago
Greater Kolkata Area, India Patch Infotech Pvt Ltd Full time ₹ 1,04,000 - ₹ 1,30,878 per yearPosition :Data EngineerExperience :5-8 YearsLocation :Work From HomeJob SummaryWe are seeking a skilled Data Engineer with 5-8 years of experience to join our remote team. The ideal candidate will have extensive experience with AWS Glue and a strong background in building and maintaining robust data pipelines. You will be responsible for designing,...
-
Data Engineer
2 weeks ago
Greater Kolkata Area, India Sundew Full time ₹ 15,00,000 - ₹ 20,00,000 per yearSundew is a leading digital transformation firm with an 18-year legacy of excellence. We specialize in digital strategy, application development, and engineering, utilizing MEAN, MERN, and LAMP stacks, with PHP Laravel as our primary proficiency. As we continue to expand, we are seeking a skilled and experienced Data Engineer to design and optimize data...
-
Senior Data Engineer
2 weeks ago
Greater Kolkata Area, India Lexmark Full time ₹ 15,00,000 - ₹ 20,00,000 per yearLexmark is now a proud part of Xerox, bringing together two trusted names and decades of expertise into a bold and shared vision.When you join us, you step into a technology ecosystem where your ideas, skills, and ambition can shape what comes next. Whether you're just starting out or leading at the highest levels, this is a place to grow, stretch, and make...
-
Data Engineer
4 days ago
Greater Kolkata Area, India The IT Firm Full time ₹ 5,00,000 - ₹ 8,00,000 per yearResponsibilitiesDesign, build, and maintain data pipelines and ETL workflows on Google Cloud Platform.Work with BigQuery, Dataflow, Pub/Sub, Dataproc, and Cloud Storage to enable scalable data solutions.Develop and optimize data models, transformations, and analytics layers.Write efficient Python/SQL scripts for data processing and automation.Collaborate...
-
Senior Data Engineer
20 hours ago
Greater Kolkata Area, India Omni Reach Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are seeking a Senior Data Engineer to build scalable, cloud-native data platforms and enable end-to-end MLOps workflows. You will design ETL/ELT pipelines, manage data lakes/warehouses/feature stores, and ensure high-performance, secure, and cost-efficient pipelines for AI/ML and analytics. This role blends Data Engineering + MLOps to deliver...
-
SQL Data Engineer
2 weeks ago
Greater Kolkata Area, India Atom Systems Full time ₹ 1,04,000 - ₹ 1,30,878 per yearJob SummaryWe are seeking a Data Engineer with expertise in SQL, Data Modeling, AWS Glue, Python, and MS Excel.The ideal candidate will design scalable data solutions, build reliable pipelines, and ensure high-quality, well-modeled data to drive business insights.Key ResponsibilitiesDesign and maintain robust data models to support analytics and reporting...
-
Data Engineer
2 days ago
Greater Hyderabad Area, India People Tech Group Inc Full timePractice Lead – Data Practitioner Location: Hyderabad Department: Data & AI Strategy Job Summary: We are seeking a dynamic and technically accomplished Practice Lead – Data Engineering & Data Science to lead the development of scalable, high-performance data platforms and advanced analytics capabilities across the enterprise. This role combines deep...
-
Data Engineer
2 days ago
Greater Hyderabad Area, India People Tech Group Inc Full timePractice Lead – Data Practitioner Location: Hyderabad Department: Data & AI Strategy Job Summary: We are seeking a dynamic and technically accomplished Practice Lead – Data Engineering & Data Science to lead the development of scalable, high-performance data platforms and advanced analytics capabilities across the enterprise. This role combines deep...
-
Data Engineer
2 days ago
Greater Hyderabad Area, India People Tech Group Inc Full timePractice Lead – Data PractitionerLocation: HyderabadDepartment: Data & AI StrategyJob Summary:We are seeking a dynamic and technically accomplished Practice Lead – Data Engineering & Data Science to lead the development of scalable, high-performance data platforms and advanced analytics capabilities across the enterprise. This role combines deep...