Senior/ data engineer
1 month ago
About Mitra Innovation ( Mitra AI is a global technology company that specializes in AI-driven solutions, cloud engineering, enterprise integration and workflow automation.
Headquartered in the UK, Mitra has been serving global clients for the last 12 years in the US, UK, EU and APAC, across industries such as BFSI, telecommunications, healthcare, and retail, helping businesses modernize and optimize their operations.
Working mode This is a FULL-TIME PERMANENT , REMOTE role for all Indian candidates.
Role We are looking for talented Senior Data Engineers/ Data Engineers to join our team and play a key role in building and maintaining data streaming pipelines.
The successful candidate will have experience with event-driven architectures and be proficient in Kafka, Apache Beam, or Flink.
This position will focus on ensuring scalable data processing, optimizing pipeline performance, and ensuring data security and observability.
Job Specific Duties & Responsibilities Design, build, and maintain data streaming pipelines for both batch and real-time processing using Kafka and Flink or Apache Beam Develop and manage Kafka AVRO schemas to ensure robust data serialization Create Kafka streamers for publishing and subscribing, ensuring data flow across systems Integrate API clients with OAuth 2 for REST and Graph QL services Implement containerized solutions using Docker for streamlined deployments Collaborate with cross-functional teams, participating in Agile ceremonies such as sprint planning and user story grooming Develop and perform testing at all levels, including unit, functional, integration, and non-functional testing Design data models and integrate them into SQL databases Required Skills, Experience & Qualifications Data Engineer - 3+ years of hands-on experience with Kafka, Redis, Apache Beam, Flink for event-driven design and implementation Senior Data Engineer - 5+ years of hands-on experience with Kafka, Redis, Apache Beam, Flink for event-driven design and implementation Strong Kafka AVRO schema design skills Experience in Kafka streamers (publishers/subscribers) development using Apache Beam or Flink Proficiency in API development (REST/Graph QL) with OAuth 2 Experience with Docker containerization Strong testing mindset with experience in TDD/BDD Proficiency in SQL databases such as Postgre SQL and data modelling Knowledge of Kubernetes (K8s) and Amazon EKS Experience working with AWS services for cloud-based solutions Understanding of data security measures, including encryption and ACL on Kafka topics Knowledge of Kafka optimization techniques (compression) Experience in observability, including metrics, tracing, and logging Nice to have Experience with Kubernetes pipeline tools such as Argo CD, Git Ops, and Helm Charts Familiarity with Artifactory for managing artefacts Exposure to Dev Sec Ops tools like Snyk for vulnerability scanning Experience with Git Hub Actions for continuous integration and delivery Observability tools knowledge (AWS Cloud Watch, ELK, Grafana, Prometheus) Experience with Kafka load testing to ensure system reliability
-
Senior Data Engineer
4 weeks ago
India iO Associates - UKEU Full timeJob Title: Senior Data Engineer Location: Mohali Salary: Negotiable on the current package iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse,...
-
Senior Data Engineer
4 weeks ago
india iO Associates - UKEU Full timeJob Title: Senior Data EngineerLocation: MohaliSalary: Negotiable on the current packageiO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS...
-
Senior Data Engineer
2 weeks ago
India iO Associates - UKEU Full timeJob Title: Senior Data Engineer Location: Mohali Salary: up to 30 LPA iO Associates is looking for a Senior Data Engineer in Databricks, Python, Scala, Azure Synapse, and Azure Data Factory to join our dynamic team. Responsibilities include developing and troubleshooting complex data pipelines using Databricks, PySpark, Synapse, ADF, ADLS...
-
Lead Data Engineer
6 days ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Lead Data Engineer
5 days ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
Senior data engineer
2 weeks ago
India Synechron Full timeGood-day, We have an immediate opportunity for the Senior Data Engineer Job Role: Senior Data Engineer Job Location: Bangalore BCIT Experience- 7 to 10 years Notice : upto 15 Days. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and...
-
Senior Data Engineer
4 weeks ago
India Recmatrix Consulting Full timeJob Title: Senior Data Engineer Location: Remote within India Employment Type: Contract Experience Level: 6+ years Position Overview: We are seeking a Senior Data Warehouse Engineer to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and Content...
-
Senior data engineer
4 weeks ago
India Recmatrix Consulting Full timeJob Title: Senior Data Engineer Location: Remote within India Employment Type: Contract Experience Level: 6+ years Position Overview: We are seeking a Senior Data Warehouse Engineer to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and...
-
Senior data engineer
2 weeks ago
India Linuxpect Private Limited Full timeWe are seeking an experienced and skilled Senior Data Engineer with 5 to 10 years of hands-on experience in building and managing data pipelines and big data infrastructure. The ideal candidate will have a strong technical background in data engineering tools, big data ecosystems, and programming languages. This role will focus on designing, implementing,...
-
Senior Data Engineer
2 months ago
india ValueLabs Full timeDear Aspirants, We at ValueLabs have an Opening for Senior Azure Data Engineer role. Below is the JD for the same. Role: Sr Data Engineer Experience: 5+ Years Preferable Immediate Joiners The Azure Data Engineer is responsible for the design, development, and maintenance of data pipelines, data warehouses, and data lakes for the organization. This role...
-
AWS Data Engineer
2 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
2 weeks ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob DescriptionWe are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources. There...
-
AWS Data Engineer
2 weeks ago
india ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
AWS Data Engineer
3 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....
-
Senior Data Engineer
4 weeks ago
india Recmatrix Consulting Full timeJob Title: Senior Data EngineerLocation: Remote within IndiaEmployment Type: ContractExperience Level: 6+ yearsPosition Overview:We are seeking a Senior Data Warehouse Engineer to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and Content teams, along...
-
Senior data infrastructure engineer
2 weeks ago
India SourceBae Full timeJob Role Senior Data Infrastructure Engineer Experience 5+ years Location: Remote Duration:3 - 6 months Job Description Title: Senior Data Infrastructure Engineer About the role As a Senior Data Infrastructure engineer, you will be working with Data Engineering, Analyst and Operations teams to build and maintain a secure, scalable and...
-
Senior Data Engineer
2 weeks ago
India Varcus infinity Full time € 30,00,000 - € 40,00,000Job Title: Senior Data Engineer Location: India (Permanent Work From Home) Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience) Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience (Note: Candidate must be available to work in PST time zone and able to join within a month.) ...
-
Senior Data Engineer
2 weeks ago
india Varcus infinity Full timeJob Title: Senior Data Engineer Location: India (Permanent Work From Home) Salary: ₹30 - ₹40 LPA (flexible for exceptional candidates based on experience) Experience Level: Minimum 5 years, with preference for candidates with e-commerce experience (Note: Candidate must be available to work in PST time zone and able to join within a...
-
Senior Data Engineer
4 weeks ago
India Recmatrix Consulting Full timeJob Title: Senior Data EngineerLocation: Remote within IndiaEmployment Type: ContractExperience Level: 6+ yearsPosition Overview:We are seeking a Senior Data Warehouse Engineer to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and Content teams, along...
