Big Data Engineer

2 weeks ago


Cochin, Kerala, India SPG Consulting Solutions Pvt Full time

Job Title: Senior Data Engineer

Company: Leading Data Solutions Provider


Location: Multiple locations including Chennai, Pune, Noida, Kochi, Hyderabad, Trivandrum


About the Role: Are you someone who thrives on working with large-scale data processing systems? We are looking for a Senior Data Engineer with solid experience in SQL, Spark, Scala, and AWS to join our dynamic team.


Skills Required:

  • Minimum 6-7 years of experience in Spark and SQL, with 2-3 years in AWS
  • Demonstrated track record in optimizing performance
  • Ability to enhance efficiency and productivity in projects
  • Capacity to streamline processes and deliver high-quality outcomes

Key Responsibilities:

  • Design, implement, and maintain large-scale data processing systems using Spark and Scala
  • Develop and optimize SQL queries for data extraction and analysis
  • Deploy and manage data pipelines in AWS for reliability and scalability
  • Collaborate with teams for data-driven improvements
  • Monitor system performance, troubleshoot issues, and implement solutions
  • Ensure data quality through rigorous testing and validation
  • Stay updated with the latest big data technologies for innovation

  • Big Data Engineer

    1 week ago


    Cochin, Kerala, India NOV Full time

    Purpose of the Position:This role is part of the Digital Technology Services team at NOV, a corporate group dedicated to a wide array of data and analytics projects. As a member of this team, you will have the opportunity to work with diverse technologies and collaborate with various departments. This is a highly independent position, demanding strong...


  • Cochin, Kerala, India Strands Energy Pvt. Ltd Full time

    Software Engineer-Big Data, Analytics DevelopmentJOB DESCRIPTIONWe are looking for skilled Software Engineers experienced in big-data applications. If you love designing, data analytics, and coding challenges in an emerging field, this opportunity is for you!As a Software Developer at Strands Energy Private Limited, you will play a crucial role in analyzing,...


  • Cochin, Kerala, India Strands Energy Pvt. Ltd Full time

    Software Engineer-Big Data, Analytics Development JOB DESCRIPTIONWe are on the lookout for talented Software Engineers who have experience in big-data applications. If you are passionate about designing, data analytics, coding and would like to challenge yourself with exciting work in an emerging domain, join usAs a Software developer at Strands Energy...


  • Cochin, Kerala, India Strands Energy Pvt. Ltd Full time

    Software Engineer-Big Data, Analytics DevelopmentJOB DESCRIPTIONWe are on the lookout for talented Software Engineers who have experience in big-data applications. If you are passionate about designing, data analytics, coding and would like to challenge yourself with exciting work in an emerging domain, join usAs a Software developer at Strands Energy...

  • Data engineer

    2 weeks ago


    Cochin, Kerala, India Zaportiv Full time

    Experienced Data Engineer with over 3 years of hands-on experience in developing, testing, and implementing robust data pipelines.Proficient in SQL and Python, adept at leveraging these tools to extract, transform, and load data efficiently.Demonstrated expertise in data analysis and manipulation, utilizing advanced techniques to derive actionable insights...


  • Cochin, Kerala, India Pearlsoft Technologies LLP Full time

    Lead Azure Data EngineerExperience ?10+ years of hands-on work experienceResponsibilities?Design and develop business-critical backend systems using high-quality data pipelines.?Assemble large, complex data sets that meet functional / non-functional business requirements.?Build the infrastructure required for optimal extraction, transformation, and loading...

  • Data Engineer

    2 weeks ago


    Cochin, Kerala, India Mindcurv Technology Solutions Pvt. Ltd. Full time

    Data EngineerAbout MindcurvWe help our customers rethink their digital business, experiences, and technology to navigate the new digital reality. We do this by designing sustainable and accountable solutions for humans living in a digital world. Mindcurv holistically covers the market's need to digitalise business processes and customer experiences and take...

  • Azure Data Engineer

    2 weeks ago


    Cochin, Kerala, India Nastech Global Full time

    Job Title:Azure Data EngineerLocations:Bangalore, Chennai, Pune, Kochi, IndiaExperience Required:6+ Years (including 3+ years of relevant experience with Azure)Job Description:We are seeking a highly skilled and experienced Azure Data Engineer to join our team in Bangalore, Chennai, Pune, or Kochi. The ideal candidate will have extensive experience in...

  • Azure Data Engineer

    2 weeks ago


    Cochin, Kerala, India Nastech Global Full time

    Job Title: Azure Data Engineer Locations: Bangalore, Chennai, Pune, Kochi, India Experience Required: 6+ Years (including 3+ years of relevant experience with Azure) Job Description: We are seeking a highly skilled and experienced Azure Data Engineer to join our team in Bangalore, Chennai, Pune, or Kochi. The ideal candidate will have extensive...

  • Data Scientist

    2 weeks ago


    Cochin, Kerala, India Prevalent AI Full time

    **Company Profile: **Prevalent AI (PAI) is a Security Data Science Company, founded in the UK, by experts recognized globally, for solvingcompanies understand, deploy and support the most advanced security solutions, by developing a security architecturebased on a deep understanding of Data Science, Security Tradecraft and Big Data Technologies.PAI's...

  • Data Scientist

    2 weeks ago


    Cochin, Kerala, India IBM Full time

    IntroductionAs a Data Scientist at IBM, you will help transform our clients' data into tangible business value by analyzing information, communicating outcomes and collaborating on product development. Work with Best in Class open source and visual tools, along with the most flexible and scalable deployment options. Whether it's investigating patient trends...

  • Data Scientist

    2 weeks ago


    Cochin, Kerala, India IBM Full time

    IntroductionAs a Data Scientist at IBM, you will help transform our clients' data into tangible business value by analyzing information, communicating outcomes and collaborating on product development. Work with Best in Class open source and visual tools, along with the most flexible and scalable deployment options. Whether it's investigating patient trends...

  • Data Engineer

    2 weeks ago


    Cochin, Kerala, India Mindcurv Technology Solutions Pvt. Ltd. Full time

    Data EngineerAbout MindcurvMindcurv helps customers reimagine their digital business, experiences, and technology in the ever-evolving digital landscape. We focus on creating sustainable solutions for individuals navigating the digital world.At Mindcurv, we offer a comprehensive range of services covering various aspects of digital transformation:Strategy...

  • Data Engineer

    2 weeks ago


    Cochin, Kerala, India ProPMO Services Private Limited Full time

    Job Description : We have a requirement for 3 Data Engineers who could join us on a short notice. 3 to 8 years of professional software development/engineering experience. Specialist experience working in Python coding as a Data Engineer. Must have good experience working with databases PostgreSQL/MySQL/MS SQL. Must have good experience working in AWS/GCP...

  • Data Architect

    2 weeks ago


    Cochin, Kerala, India Prevalent AI Full time

    Company Profile:PAI team consists of Cyber Security Domain Specialists, Information Security Analysts, Data Scientists, Data Engineers and Data Analysts focused on developing advanced security analytics solutions (Solution Development) and delivering security insights to our clients.**Role Purpose & Key Accountabilities: At Prevalent.AI, we build Data...

  • Senior Data Scientist

    2 weeks ago


    Cochin, Kerala, India Mindcurv Technology Solutions Pvt. Ltd. Full time

    Senior Data ScientistJob Description:Company Overview:Mindcurv helps clients redefine their digital business, experiences, and technology to adapt to the evolving digital landscape. They create sustainable solutions for individuals in a digital world following DevOps and agile principles.Your Role:Deliver Data Science projects focusing on advanced...


  • Cochin, Kerala, India Brennan IT India Private Limited Full time

    Data Engineering Consultant Position: Data Engineering ConsultantWork Location: Navi Mumbai or KochiPURPOSE OF ROLEAs a Data Engineering Consultant, you will deliver projects based on Microsoft's Azure Data Services. This will include developing components, peer-reviewing code and contributing to the Intellectual Property Library.The function of this...

  • Senior Data Scientist

    2 weeks ago


    Cochin, Kerala, India Mindcurv Technology Solutions Pvt. Ltd. Full time

    Senior Data ScientistJob Description:Note: Looking for somebody who can join within 30 Days.About MindcurvWe help our customers rethink their digital business, experiences, and technology to navigate the new digital reality. We do this by designing sustainable and accountable solutions for humans living in a digital world. Mindcurv holistically covers the...

  • AWS Data Engineer

    2 weeks ago


    Cochin, Kerala, India SPG Consulting Solutions Pvt Full time

    5-7 years of Data engineering experience.- Must have hands-on experience in AWS Aurora RDS Postgre SQL, AWS S3, AWS Athena and AWS Quicksight, AWS protegrity etc.- Strong knowledge on Creating objects , data modeling tuning, Interface , ETL and reporting.- Should have knowledge on SQL Queries with Databases like Oracle, MySQL etc.- Strong knowledge on NoSQL...


  • Cochin, Kerala, India NDimensionZ Solutions Pvt. Full time

    Python Data Science EngineerHi,We are looking for a Python data science engineer with 3+ years of experienceResponsibilities: Design, develop, and implement data pipelines using Python. Wrangle, clean, and transform large datasets using NumPy and Pandas. Perform exploratory data analysis (EDA) to identify patterns, trends, and anomalies. Develop and...