AWS Data Engineer

2 weeks ago


Thiruvananthapuram, Kerala, India Soulpage IT Solutions Full time

Location: Hyderabad (On-site)

Experience: 4+ years

Company: Soulpage IT Solutions Pvt. Ltd.

About Us

Soulpage IT Solutions is an AI/ML technology company based in Hyderabad, specializing in cutting-edge solutions for data engineering, AI, and cloud-based analytics. We are looking for an experienced Data Engineer with expertise in Big Data technologies, Python, and PySpark to join our team.

Key Responsibilities:

Develop and optimize PySpark applications using Spark DataFrames in Python.

Work on large-scale data processing, ensuring performance optimization for high-volume data pipelines.

Implement best practices for version control using Git.

Work with Amazon Analytics services such as Amazon EMR, Amazon Athena, and AWS Glue.

Utilize Amazon Compute services including AWS Lambda, EC2, and storage solutions like S3, SNS.

Work with columnar storage formats like Parquet, Avro, ORC, and apply compression techniques (Snappy, Gzip).

Good to have experience with data warehousing concepts (dimensions, facts, schemas – Star, Snowflake).

Good to have experience with AWS databases such as Aurora, RDS, Redshift, ElastiCache, or DynamoDB.

Requirements:

4+ years of experience in IT, with strong hands-on expertise in Big Data technologies.

Mandatory: Hands-on experience in Python and PySpark.

Experience working on AWS ecosystem, including EMR, Athena, Glue, Lambda, EC2, S3, and SNS.

Strong understanding of data modeling and warehousing concepts.

Proficiency in working with structured and semi-structured data.

Ability to optimize Spark jobs for better performance and efficiency.

Why Join Us?

Work on cutting-edge AI & ML projects in a fast-growing technology company.

Be part of an innovative and collaborative work environment.

Career growth opportunities in Big Data, AI, and Cloud technologies.

Competitive salary and benefits.

Interested? Apply now.


  • AWS Service Owner

    3 weeks ago


    Thiruvananthapuram, Kerala, India UST Full time

    1. AWS Operations & Service Ownership:Define and execute the AWS Operation & Engineering strategy in alignment with business needs.Oversee the design, deployment, administration, and optimization of AWS environments.Ensure high availability, reliability, and scalability of AWS workloads and services.2. Security, Compliance & Governance:Implement and maintain...

  • AWS Service Owner

    2 weeks ago


    Thiruvananthapuram, Kerala, India UST Full time

    1. AWS Operations & Service Ownership: Define and execute the AWS Operation & Engineering strategy in alignment with business needs. Oversee the design, deployment, administration, and optimization of AWS environments. Ensure high availability, reliability, and scalability of AWS workloads and services. 2. Security, Compliance & Governance: Implement...

  • Data Engineer

    4 weeks ago


    Thiruvananthapuram, Kerala, India TalentBasket Full time

    Job DescriptionWe are seeking a skilled Data Engineer with expertise in PySpark, Databricks, and SQL to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience in handling large datasets, optimizing performance, and working with cloud-based data platforms.Key Responsibilities:- Develop and maintain...

  • AWS Service Owner

    2 weeks ago


    Thiruvananthapuram, Kerala, India UST Global Solutions Full time

    Responsibilities : AWS Operations & Service Ownership : - Define and execute the AWS Operation & Engineering strategy in alignment with business needs.- Oversee the design, deployment, administration, and optimization of AWS environments. - Ensure high availability, reliability, and scalability of AWS workloads and services. - Security, Compliance &...

  • AWS Service Owner

    3 weeks ago


    Thiruvananthapuram, Kerala, India UST Global Solutions Full time

    Responsibilities : AWS Operations & Service Ownership : - Define and execute the AWS Operation & Engineering strategy in alignment with business needs.- Oversee the design, deployment, administration, and optimization of AWS environments. - Ensure high availability, reliability, and scalability of AWS workloads and services. - Security, Compliance &...

  • Data Engineer

    2 weeks ago


    Thiruvananthapuram, Kerala, India TalentBasket Full time

    Job Description :We are seeking a skilled Data Engineer with expertise in PySpark, Databricks, and SQL to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience in handling large datasets, optimizing performance, and working with cloud-based data platforms.Key Responsibilities :- Develop and maintain...

  • Data Engineer

    3 weeks ago


    Thiruvananthapuram, Kerala, India TalentBasket Full time

    Job Description :We are seeking a skilled Data Engineer with expertise in PySpark, Databricks, and SQL to design, build, and maintain scalable data pipelines and infrastructure. The ideal candidate will have experience in handling large datasets, optimizing performance, and working with cloud-based data platforms.Key Responsibilities :- Develop and maintain...


  • Thiruvananthapuram, Kerala, India Futuremug Full time

    Job Title: Senior Data EngineerWe are looking for a skilled data engineer to join our team at Futuremug. As a senior data engineer, you will be responsible for designing and implementing scalable data solutions using PySpark and Python.Key Responsibilities:- Develop and maintain data processing pipelines using PySpark and Python.- Work with large datasets to...


  • Thiruvananthapuram, Kerala, India Velodata Global Pvt Ltd Full time

    About the Role :We are seeking a highly motivated and experienced Senior Data Engineer - I to join our growing data team in Thiruvananthapuram. In this role, you will be responsible for designing, developing, and maintaining scalable and efficient data pipelines on the Databricks platform. You will work closely with data scientists, analysts, and other...

  • Data Engineer

    5 days ago


    Thiruvananthapuram, Kerala, India Catalyst Clinical Research, LLC Full time

    Catalyst Clinical Research provides customizable solutions to the biopharmaceutical and biotechnology industries through Catalyst Oncology, a full-service oncology CRO, and multi-therapeutic global functional and CRO services through Catalyst Flex. The company"s customer-centric flexible service model, innovative technology, expert team members, and...


  • Thiruvananthapuram, Kerala, India Palnar Full time

    Springboot + AWS Developer Job Code : PAL/SAD// No: of position: 6 to 8 [5 to 8 years of experience] Technologies: Java, Spring boot, AWS Location : Trivandrum / Bangalore Work Type : Permanent Contact Email ID : Job Description: AWS – Terraform, S3, Lambda, SQS, SNS, Event Bridge, DynamoDB, Glue, AWS Batch etc., Java Backend –...

  • Azure Data Engineer

    4 weeks ago


    Thiruvananthapuram, Kerala, India Xpetize Technology Solutions Private Limited Full time

    Job Description- Design and develop warehouse solutions using Azure Synapse Analytics, ADLS, ADF, Databricks, Power BI, Azure Analysis Services- Should be proficient in SSIS, SQL and Query optimization.- Should have experience as a technical lead mentoring data engineer and driving data-oriented projects.- Should have worked in onshore offshore model...


  • Thiruvananthapuram, Kerala, India Stanra Tech Solutions Full time

    Urgent Requirement : Senior Data EngineerLocation : Trivandrum or Chennai (Hybrid working arrangement)Work Schedule : Normal working hoursExperience : 7+ yearsKey Requirements :- Proven experience in real-time and batch data processing with Apache Flink or Apache Spark- Expertise in workflow orchestration using Temporal IO or similar frameworks- Proficiency...


  • Thiruvananthapuram, Kerala, India Armada Systems Full time

    About the Company Armada is an edge computing startup that provides computing infrastructure to remote areas where connectivity and cloud infrastructure is limited, as well as areas where data needs to be processed locally for real-time analytics and AI at the edge. We're looking to bring on the most brilliant minds to help further our mission of bridging...


  • Thiruvananthapuram, Kerala, India Muthoot Fincorp Ltd. Full time

    Job DescriptionAt Muthoot Fincorp Ltd., we are seeking a highly skilled Senior Data Analyst to join our team. As a key member of our analytics department, you will be responsible for designing and maintaining data pipelines, optimizing data architecture, and delivering key insights to support business decisions.Key Responsibilities:Design, build, and...

  • Data Analytics Lead

    4 days ago


    Thiruvananthapuram, Kerala, India Muthoot Fincorp Ltd. Full time

    Our TeamWe are a diverse team of professionals who are passionate about data analytics and innovation. Our team members come from various backgrounds and bring a wealth of knowledge and experience to the table. We are committed to collaboration, open communication, and continuous learning. Our team is responsible for designing and implementing data solutions...

  • Senior Data Engineer

    4 weeks ago


    Thiruvananthapuram, Kerala, India RapidBrains Full time

    Senior Data Engineer Job Overview: We are seeking a skilled Senior Data Engineer to design, implement, and maintain robust data solutions on SQL Server (SSIS, SSAS, UC4 Atomic). The role involves optimizing data processes, troubleshooting performance issues, and ensuring data quality while working in an onshore-offshore model. Key Responsibilities: Design...

  • Senior Data Analyst

    3 weeks ago


    Thiruvananthapuram, Kerala, India Muthoot Fincorp Ltd. Full time

    Job Title: Senior Data Analytics PersonnelJob Description:We are looking for an experienced Senior Data Analytics professional to join our dynamic team. The ideal candidate will have deep expertise in data management, analytics, and reporting, combined with a solid understanding of business processes, preferably in the financial sector. This role involves...

  • Senior Data Analyst

    3 weeks ago


    Thiruvananthapuram, Kerala, India Muthoot Fincorp Ltd. Full time

    Job Title:Senior Data Analytics PersonnelJob Description:We are looking for an experienced Senior Data Analytics professional to join our dynamic team. The ideal candidate will have deep expertise in data management, analytics, and reporting, combined with a solid understanding of business processes, preferably in the financial sector. This role involves...

  • Azure Data Engineer

    4 weeks ago


    Thiruvananthapuram, Kerala, India VGreenTEK Full time

    Job Title Azure Data Engineer Trivandrum - Onsite Job Type Full Time PermanentLocation Trivandrum Work From Office Experience 5 to 7years Overall 5-7 years of experience in data engineering and transformation on Cloud 3 Years of Very Strong Experience in Azure Data Engineering Databricks Expertise in supporting developing Data warehouse...