Data Engineer for Scalable Big Data Solutions

1 month ago


Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full time

We are seeking an experienced Data Engineer to join our team at RiskInsight Consulting Pvt Ltd. This role involves designing, developing, and deploying scalable Big Data applications using Apache Spark.

Responsibilities
  • Collaborate with data scientists and business analysts to understand requirements and translate them into technical solutions.
  • Write efficient and optimized code to process and analyze large volumes of data.
  • Implement data ingestion processes from various data sources to the Big Data platform.
  • Create and maintain data pipelines and workflows for data processing and analytics.
  • Perform data quality checks and ensure data integrity throughout the system.
  • Troubleshoot and debug production issues to identify and resolve technical problems.

To be successful in this role, you will have a bachelor's degree in Computer Science, Engineering, or a related field, and 4-6 years of experience in Big Data development using Apache Spark. You should be proficient in Scala or Python programming languages and have hands-on experience with Hadoop, Hive, and/or HBase. Familiarity with distributed computing frameworks such as Spark Streaming and Kafka is also required.

Estimated Salary: $120,000 - $180,000 per year, depending on location and experience. The salary range is based on industry standards and market conditions.

As a Data Engineer at RiskInsight Consulting Pvt Ltd, you will work independently and collaborate with cross-functional teams to ensure seamless integration of Big Data applications with other systems. You will also stay updated with the latest Big Data technologies and tools to drive innovation and improve performance.



  • Chennai, Tamil Nadu, India Truetech Full time

    We are seeking an experienced Data Engineer to join our team at Truetech.**Job Summary:**We are looking for a skilled Big Data Engineer to design, build, and optimize data pipelines using technologies like Apache Spark, Python, Apache Airflow, Kafka, and GCP (BigQuery, DataProc, Cloud Composer). You will work on scalable data solutions, real-time streaming,...


  • Chennai, Tamil Nadu, India LTIMindtree Full time

    Job Description:A challenging role has arisen at LTIMindtree for a seasoned Big Data Architect with expertise in designing and developing large-scale data platforms. As a key member of our team, you will be responsible for leveraging your knowledge of big data technologies to create scalable solutions that meet the evolving needs of our clients.Key...


  • Chennai, Tamil Nadu, India Wipro Ltd Full time

    About the RoleWipro Ltd is seeking an experienced Data Engineer to join our team. In this role, you will be responsible for designing and developing batch and streaming solutions using various Big Data technologies.You will work closely with our architect to design secure and scalable solutions that meet the needs of our business. Additionally, you will be...


  • Chennai, Tamil Nadu, India m2p fintech Full time

    Job Description:M2P Fintech is looking for a skilled Data Engineer to build and set up advanced data solutions. As part of a collaborative cross-functional team, you will work in a fast-paced and agile work environment, delivering high-quality and innovative solutions that have a significant business impact.Key Responsibilities: - Develop and maintain highly...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India MNR Solutions Full time

    About UsMNR Solutions is a leading technology firm with a strong presence in Bangalore and Chennai, India. Our company culture values innovation and collaboration, making us an ideal place for talented professionals to grow.Job SummaryWe are seeking an experienced Data Engineer to join our dynamic team as a Big Data Solutions Specialist. The successful...


  • Chennai, Tamil Nadu, India BRISKWIN IT SOLUTIONS PRIVATE LIMITED Full time

    At Briskwin IT Solutions Private Limited, we are seeking an exceptional Senior Big Data Engineer to join our team. Estimated Annual Salary: ₹2,400,000Job Description:We are looking for a highly skilled and experienced Senior Big Data Engineer to lead the development of large-scale data processing pipelines using Apache Kafka, Spark, and Scala. The ideal...

  • Big Data Architect

    2 weeks ago


    Chennai, Tamil Nadu, India Trinity Technology solutions Full time

    We are Trinity Technology Solutions, a forward-thinking company seeking an exceptional Senior Cloud Data Engineer to drive the development and deployment of robust data pipelines and warehouse solutions on Google Cloud Platform (GCP). With over 5+ years of experience in big data engineering or a related field, you will leverage your expertise in big data...

  • Big Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    We are seeking an experienced Big Data Engineer to join our team at Krishpar Technologies Pvt. Ltd.**Salary:** ₹15,00,000 - ₹25,00,000 per annumAs a Big Data Engineer, you will be responsible for designing and developing scalable data pipelines using Pyspark on Hadoop, Hive, and Kafka.**Required Skills and Qualifications: 4+ years of experience in Big...

  • Data Engineer

    1 month ago


    Chennai, Tamil Nadu, India Synechron Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at Synechron. As a Data Engineer, you will be responsible for designing, building, and maintaining efficient, reusable, and reliable Java code.About the Role:The successful candidate will have 7+ years of experience in big data and a strong understanding of object-oriented...

  • Big Data Developer

    3 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Summary:The role of a Big Data Developer at Tata Consultancy Services involves delivering scalable solutions utilizing Hadoop, Hive, and Scala technologies.About the Role:This position requires a skilled developer to work on complex big data projects, focusing on data transformation, aggregation, and performance enhancement using Hadoop, Hive SQLs, and...


  • Chennai, Tamil Nadu, India InfoCentroid Software Solutions Pvt. Ltd Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking an experienced Senior Big Data Engineer to join our team at InfoCentroid Software Solutions Pvt. Ltd in Chennai. The ideal candidate will have a strong background in data engineering, a deep understanding of Google Cloud Platform (GCP) services, and hands-on experience with SQL, Python,...


  • Chennai, Tamil Nadu, India Recro Full time

    About the Role:We are seeking an experienced Data Engineer to lead our team in developing and implementing scalable data solutions. As a Lead Data Engineer, you will be responsible for designing and building efficient data pipelines, ETL processes, and BI streaming pipelines that can handle large-scale data.Key Responsibilities:Brew scalable Data Engineering...

  • Big Data Engineer

    4 weeks ago


    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Title: Big Data EngineerTata Consultancy Services is seeking a skilled Big Data Engineer to join our team. As a leading global consulting and IT services company, we empower our clients to become digital businesses.The estimated salary for this role is ₹1,200,000 - ₹2,500,000 per annum, based on location and experience.About the Role:We are looking...


  • Chennai, Tamil Nadu, India ANRI Solutions HR Services Full time

    At ANRI Solutions HR Services, we are looking for a highly skilled Big Data Engineering Specialist to lead our data engineering efforts. The ideal candidate will have extensive experience in Spark and Scala, with a strong background in creating end-to-end data pipelines.Key Responsibilities:Design and develop scalable data pipelines using Spark and...


  • Chennai, Tamil Nadu, India Globalemployees Full time

    Job Title: Big Data Solutions ArchitectWe are seeking an experienced Data Engineer to join our team at Globalemployees. The successful candidate will have a strong background in data engineering and a proven track record of designing and implementing scalable data pipelines.Key Responsibilities:Design and implement data pipelines to extract, transform, and...


  • Chennai, Tamil Nadu, India SM IT SERVICES Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join SM IT SERVICES. The ideal candidate will have a strong background in data engineering and a deep understanding of Google Cloud Platform (GCP) services.Key Responsibilities:Design, develop, and maintain scalable and robust data pipelines using GCP services.Work with BigQuery to design and...


  • Chennai, Tamil Nadu, India m2p fintech Full time

    Company OverviewM2P Fintech is a leading API infrastructure company in Asia, founded in 2014 and headquartered in Chennai. With operations in over 20 markets across the Asia Pacific, MENA, and Oceania regions, M2P works with 100+ banks, 100+ NBFCs, and has engaged with 600+ Fintech partners across various industries, serving over 35 million end users.Salary...


  • Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full time

    About Krishpar Technologies Pvt. Ltd.We are seeking a highly skilled Big Data Solution Architect to join our team in Chennai or Bangalore.Salary: ₹15,00,000 - ₹25,00,000 per annumJob Description:The successful candidate will design and develop scalable big data solutions using Pyspark on Hadoop, Hive, and/or Kafka, HBase, MongoDB, and other relevant...


  • Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    OverviewWelcome to Wavicle Data Solutions, a leading provider of innovative data management solutions. We are seeking an experienced Data Engineering Director to join our team and lead the development of our data engineering initiatives.


  • Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time

    About Cynosure Corporate SolutionsCynosure Corporate Solutions is a leading organization in the field of data engineering and big data solutions.