Streaming Data Engineer

7 days ago


Chennai, Tamil Nadu, India Lakshya Software Technologies Pvt. Ltd. Full time

Company Overview

Lakshya Software Technologies Pvt. Ltd. is a pioneering technology firm dedicated to harnessing the power of data-driven insights.

Salary

We offer an attractive compensation package of ₹ 20,00,000 per annum, considering the expertise and experience required for this role.

Job Description

We are seeking a highly skilled Streaming Data Engineer to join our team and play a pivotal role in designing, developing, and deploying real-time data pipelines using Apache Flink Streaming or Spark Streaming.

The ideal candidate will have hands-on experience with Apache Kafka, Python, SQL, and orchestration tools like Apache Airflow.

Required Skills and Qualifications

- Expertise in Python Language (MUST)

- Proficiency in SQL (ability to write complex queries) (MUST)

- Hands-on experience in Apache Flink Streaming or Spark Streaming (MUST)

- Experience with Apache Kafka (MUST)

- Strong understanding of data lake development concepts

- Familiarity with orchestration tools like Apache Airflow

- Knowledge of Spark and Hive optimization techniques

- Good-to-have skills: Trino/AWS Athena, Snowflake, Data Quality, File Storage (S3)

Benefits

We offer a dynamic work environment, flexible working hours, and opportunities for growth and professional development.

Others

Please submit your resume and cover letter to apply for this exciting opportunity.


  • Big Data Expert

    2 weeks ago


    Chennai, Tamil Nadu, India LTIMindtree Full time

    Job Title: Big Data Expert - Real Time Streaming ProfessionalWe are seeking a highly skilled Big Data Expert - Real Time Streaming Professional to join our team at LTIMindtree.About the RoleThe ideal candidate will have experience in developing and implementing big data solutions using Spark, Kafka, and Hive. They will work closely with cross-functional...

  • Data Scientist Lead

    3 weeks ago


    Chennai, Tamil Nadu, India Crayon Data Full time

    About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE.Our flagship platform, maya.ai, helps enterprises across the Banking, Fin-tech, and Travel industries create and capture sustainable revenue streams by unlocking the value of data.


  • Chennai, Tamil Nadu, India Truetech Full time

    We are seeking an experienced Data Engineer to join our team at Truetech.**Job Summary:**We are looking for a skilled Big Data Engineer to design, build, and optimize data pipelines using technologies like Apache Spark, Python, Apache Airflow, Kafka, and GCP (BigQuery, DataProc, Cloud Composer). You will work on scalable data solutions, real-time streaming,...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...


  • Chennai, Tamil Nadu, India Alp Consulting Ltd. Full time

    We are looking for a highly skilled Data Engineer to join our team at Alp Consulting Ltd.The ideal candidate will have 4-14 years of experience in Big Data and Data-related technology, with expert-level understanding of distributed computing principles.Key skills and qualifications include expertise in Apache Spark, hands-on programming with Python,...


  • Chennai, Tamil Nadu, India Alp Consulting Ltd. Full time

    About Alp Consulting Ltd.">Alp Consulting Ltd. is a leading consulting firm that specializes in providing innovative data engineering solutions to its clients. As a Data Engineer, you will be working closely with our team of experts to design and implement data processing systems that meet the needs of our clients.">Estimated Salary Range">The estimated...

  • Big Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India LTIMindtree Full time

    Job Title: Big Data EngineerCompany Overview: LTIMindtree is a leading digital transformation consulting and technology services company, seeking an experienced Big Data Engineer to join our team.Salary: The estimated annual salary for this position is around $120,000-$180,000, depending on location and experience.Job Description: As a Big Data Engineer at...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    OverviewWelcome to Wavicle Data Solutions, a leading provider of innovative data management solutions. We are seeking an experienced Data Engineering Director to join our team and lead the development of our data engineering initiatives.


  • Chennai, Tamil Nadu, India Nextgen Creation Inc Full time

    Job Title: Data Engineer SpecialistWe are seeking a highly skilled Data Engineer Specialist to join our team at Nextgen Creation Inc in Chennai, India. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.About the Role:We are looking for a seasoned professional...

  • Lead Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    Job Title: Lead Data Engineer**Overview**We are seeking an experienced Lead Data Engineer to join our team at Wavicle Data Solutions. The successful candidate will play a pivotal role in architecting and implementing data solutions, leveraging their expertise in managing data-related projects, including Data Engineering and Data Analytics...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    About the RoleWe are seeking a skilled and passionate Java Software Engineer to join our team at Wavicle Data Solutions.The successful candidate will be responsible for designing, developing, and maintaining high-performance Java applications that meet the needs of our business.As a key member of our engineering team, you will collaborate closely with other...


  • Chennai, Tamil Nadu, India Crayon Data Full time

    Company Overview">Crayon Data is a pioneering firm in the field of artificial intelligence-led revenue acceleration solutions. With headquarters in Singapore and local presence in India and the UAE, the company has been transforming the world's choices since its inception in 2012.Their flagship platform, maya.ai, empowers enterprises across Banking,...


  • Chennai, Tamil Nadu, India Wipro Ltd Full time

    About the RoleWipro Ltd is seeking an experienced Data Engineer to join our team. In this role, you will be responsible for designing and developing batch and streaming solutions using various Big Data technologies.You will work closely with our architect to design secure and scalable solutions that meet the needs of our business. Additionally, you will be...

  • Data Engineer Lead

    3 weeks ago


    Chennai, Tamil Nadu, India CYGNVS Full time

    About UsCYGNVS is a dynamic and innovative company that values excellence and enjoyment in crafting exceptional products.Salary InformationThe estimated salary for this role is between $120,000 to $180,000 per annum, depending on experience.Job DescriptionWe are seeking a highly skilled Data Engineer to join our Analytics Engineering team. As a Data...


  • Chennai, Tamil Nadu, India LTIMindtree Full time

    We are seeking a seasoned Data Engineer to join our team at LTIMindtree.As a Data Engineer, you will play a crucial role in designing and developing large-scale data processing systems using Apache Spark.Key Responsibilities:Design and develop scalable data pipelines using Apache Kafka for real-time streamingDevelop and maintain complex data warehouses using...


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    Job OverviewData Engineers at Cynosure Corporate Solutions design and develop large-scale data processing systems that handle massive amounts of data from various sources. As a Senior Data Engineering Manager, you will lead the development of our company's data infrastructure, ensuring it is scalable, efficient, and secure.About the RoleWe are seeking an...

  • Data Engineer

    2 weeks ago


    Chennai, Tamil Nadu, India Techstar Group Full time

    Bachelor's in engineering or Master's degree in Computer Science or Information Systems, preferably with domain knowledge in mortgage. The successful candidate will have a minimum of 7 years' experience in data engineering.Key technical skills include strong expertise in data models, PostgreSQL and Snowflake databases, Pyspark performance tuning, and data...


  • Chennai, Tamil Nadu, India Recro Full time

    About the Role:We are seeking an experienced Data Engineer to lead our team in developing and implementing scalable data solutions. As a Lead Data Engineer, you will be responsible for designing and building efficient data pipelines, ETL processes, and BI streaming pipelines that can handle large-scale data.Key Responsibilities:Brew scalable Data Engineering...

  • API Developer

    3 weeks ago


    Chennai, Tamil Nadu, India iXceed Solutions Full time

    Job Title: API Developer - Event Streaming ExpertAbout iXceed Solutions:iXceed Solutions is a cutting-edge technology company dedicated to delivering innovative solutions that transform businesses.Salary Range: $120,000 - $180,000 per yearJob Description:Key Responsibilities:Design and develop scalable, high-performance APIs using APIGEE that align with...


  • Chennai, Tamil Nadu, India Techstar Group Full time

    Bachelor's in engineering or a Master's degree in Computer Science, Information Systems, and domain knowledge in Mortgage is highly preferred.Job Description:OverviewAt TechStar Group, we're seeking an experienced data engineer to lead our cloud data architecture team. The ideal candidate will have a strong background in data modeling with...