Data Engineer Real Time Streaming

2 weeks ago


Chennai, Tamil Nadu, India Sphere IT Full time
Education

- Degree, Post graduate in Computer Science or related field (or equivalent industry experience)

Experience

- Minimum 4+ years of development and design experience in Java/Scala with Flink, Beam (or spark streaming) and Kafka.

Technical Skills

- Extensive coding experience and knowledge in Event driven and streaming architecture
- Experience in JVM tuning for performance
- Knowledge on Containerization using Docker and Kubernetes.
- Working knowledge on Caching systems, with particular experience using Redis will be preferable. [Nice to have]
- Linux OS configuration and use, including shell scripting.
- Good hands on experience with design patterns and their implementation.
- Well versed with CI/CD principles (GitHub, Jenkins etc.), and actively involved in solving, troubleshooting issues in distributed services ecosystem
- Experience working with SQL and NoSQL databases
- Familiar with Distributed services resiliency and monitoring in a production environment.
- Experience in designing, building, testing and implementing security systems – including identifying security design gaps in existing and proposed architectures and recommend changes or enhancements.
- Responsible for adhering to established policies, following best practices, developing and possessing an in-depth understanding of exploits and vulnerabilities, resolving issues by taking the appropriate corrective action.
- Knowledge on security controls designing Source and Data Transfers including CRON, ETLs, and JDBC-ODBC scripts.
- Understand basics of Networking including DNS, Proxy, ACL, Policy and troubleshooting
- High level knowledge of compliance and regulatory requirements of data including but not limited to encryption, anonymization, data integrity, policy control features in large scale infrastructures
- Understand data sensitivity in terms of logging, events and in memory data storage– such as no card numbers or personally identifiable data in logs.
- Implements wrapper solutions for new/existing components with no/minimal security controls to ensure compliance to bank standards.

Functional Skills

- Experience in Agile methodology.
- Ensure quality of technical and application architecture and design of systems across the organization.
- Effectively research and benchmark technology against other best in class technologies.
- Experience in Banking, Financial and Fintech experience in an enterprise environment preferred
- Able to influence multiple teams on technical considerations, increasing their productivity and effectiveness,
- by sharing deep knowledge and experience.
- Self-motivator and self-starter, Ability to own and drive things without supervision and works collaboratively with the teams across the organization.

Soft Skills

- Have excellent soft and interpersonal skills to interact and present the ideas to team. The engineer should've good listening skills and speaks clearly in front of team, stakeholders and management. The engineer should always carry positive attitude towards work and establishes effective team relations and builds a climate of trust within the team. Should be enthusiastic and passionate and creates a motivating environment for the team.

Interested candidates can send their resumes to bhakti.godbole@sphereitglobal.com

  • Chennai, Tamil Nadu, India ValueLabs Full time

    Company OverviewWe are ValueLabs, a pioneering technology firm committed to innovation and excellence. Our team is passionate about delivering cutting-edge solutions that transform businesses.Job DescriptionAs a Real-Time Streaming (RTS) Engineer at ValueLabs, you will play a crucial role in designing and developing real-time streaming applications using...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Job OverviewWe are looking for a highly motivated and experienced Data Engineer to lead the design, development, and deployment of real-time streaming systems. As a key member of our engineering team, you will be responsible for architecting and implementing scalable data pipelines that enable business-critical insights and decision-making.


  • Chennai, Tamil Nadu, India ValueLabs Full time

    About ValueLabsValueLabs is a leading provider of digital transformation solutions. We help businesses thrive in an increasingly complex and rapidly changing world.We're seeking a skilled Data Engineer for Real-Time Streaming Systems to join our team in Chennai.


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Job Title: Real-Time Streaming (RTS) EngineerOverviewWe are a leading technology firm, ValueLabs, seeking a highly skilled RTS Engineer to join our team. As an RTS Engineer, you will be responsible for designing and developing real-time streaming applications using Java/Scala/Python with Flink, Beam (or Spark Streaming), and Kafka.Technical...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Job OverviewWe are seeking a skilled Data Streaming Specialist to join our team at ValueLabs. As a Data Streaming Specialist, you will be responsible for designing and implementing real-time data streaming solutions using Flink, Beam, and Kafka.Key Responsibilities:Design and develop scalable data streaming pipelines using Java, Scala, or PythonImplement...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Company Overview:Valuelabs is a leading technology consulting firm that helps businesses solve complex problems through innovative solutions. Our team of experts works closely with clients to understand their needs and deliver tailored solutions that meet their objectives.Job Summary:We are seeking a highly skilled Data Engineer to join our team in Chennai....


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Job OverviewAt Valuelabs, we're on the lookout for an exceptional Senior Real-Time Streaming Data Engineer to join our team in Chennai. As a key member of our crew, you'll be responsible for designing and implementing scalable data processing systems using Java/Scala/Python with Flink, Beam, or Spark Streaming.Key Responsibilities:- Design, develop, and...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    About the RoleThe successful candidate will have a deep understanding of real-time streaming technologies, including Apache Kafka, Flink, Beam, and Spark. You will work closely with cross-functional teams to develop and deploy data-intensive applications that drive business value.


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Job Title: Real-Time Streaming (RTS) Engineer Job Description We are seeking a highly skilled RTS Engineer to join our team at Valuelabs . As an RTS Engineer, you will be responsible for designing and developing real-time streaming applications using Java/Scala/Python with Flink, Beam (or Spark Streaming), and Kafka. Technical Skills Containerization and...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Dear Aspirants,Greetings from Valuelabs Hope you all are doing safe and well Hiring RTS - Real Time Streaming || Dubai || ValuelabsExperience: 5+ YearsTimings: Regular ShiftLocation: Chennai || Valuelabs OfficeJDExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Company OverviewValueLabs is a leading technology company that specializes in providing innovative solutions to its clients. Our team of experts works together to deliver high-quality projects that meet the needs of our customers.Salary and BenefitsWe offer competitive salaries and a range of benefits to our employees, including health insurance, retirement...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Company OverviewValueLabs is a leading technology services company that enables businesses to innovate and succeed in the digital era. Our team of experts has extensive experience in delivering cutting-edge solutions that drive business growth.Job DescriptionWe are seeking an experienced Java/Scala Developer to join our Real-Time Systems team. As a key...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Dear Aspirants,Greetings from Valuelabs Hope you all are doing safe and well Hiring RTS - Real Time Streaming || Chennai || ValuelabsExperience: 5+ YearsTimings: Regular ShiftLocation: Chennai || Valuelabs OfficeJDExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Dear Aspirants, Greetings from Valuelabs Hope you all are doing safe and well Hiring RTS - Real Time Streaming || Chennai || ValuelabsExperience: 5+ YearsTimings: Regular ShiftLocation: Chennai || Valuelabs OfficeJDExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Dear Aspirants,Greetings from Valuelabs Hope you all are doing safe and well Hiring RTS - Real Time Streaming || Chennai || ValuelabsExperience: 5+ YearsTimings: Regular ShiftLocation: Chennai || Valuelabs OfficeJDExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Dear Aspirants,Greetings from Valuelabs Hope you all are doing safe and well Hiring RTS - Real Time Streaming || Dubai || ValuelabsExperience: 5+ YearsTimings: Regular ShiftLocation: Chennai || Valuelabs OfficeJDExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Dear Aspirants,Greetings from Valuelabs Hope you all are doing safe and well Hiring RTS - Real Time Streaming || Dubai || ValuelabsExperience: 5+ YearsTimings: Regular ShiftLocation: Chennai || Valuelabs OfficeJDExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Dear Aspirants,Greetings from Valuelabs Hope you all are doing safe and well Hiring RTS - Real Time Streaming || Dubai || ValuelabsExperience: 5+ YearsTimings: Regular ShiftLocation: Chennai || Valuelabs OfficeJDExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Dear Aspirants, Greetings from Valuelabs Hope you all are doing safe and well Hiring RTS - Real Time Streaming || Dubai || ValuelabsExperience: 5+ YearsTimings: Regular ShiftLocation: Chennai || Valuelabs OfficeJDExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data...


  • Chennai, Tamil Nadu, India ValueLabs Full time

    Dear Aspirants,Greetings from Valuelabs Hope you all are doing safe and well Hiring RTS - Real Time Streaming || Dubai || ValuelabsExperience: 5+ YearsTimings: Regular ShiftLocation: Chennai || Valuelabs OfficeJDExperienceMinimum 5+ years of development and design experience in Java/Scala/Python with Flink, Beam (or Spark Streaming using Real Time data and...