AWS Pyspark- Lead

2 weeks ago

Kerala, India UST Full time ₹ 15,00,000 - ₹ 25,00,000 per year

As a skilled Data Engineer with 5+ years of experience, you will be responsible for designing, implementing, and maintaining robust, scalable data architectures on AWS. Your expertise in PySpark and experience with AWS cloud data services such as S3, Glue, and Redshift will be crucial in enabling seamless data flows and efficient ETL pipelines across the cloud infrastructure. Key Responsibilities: - Design, implement, and maintain scalable and robust data architectures on AWS. - Utilize AWS services like S3, Glue, and Redshift for data storage, processing, and analytics. - Develop and implement ETL processes using PySpark for data extraction, transformation, and loading into AWS storage solutions. - Collaborate with cross-functional teams to ensure seamless data flow across different AWS services. - Ensure high-quality code and adherence to best practices in data engineering and cloud deployment. Qualification Required: - 5+ years of experience in Data Engineering. - Strong hands-on experience with PySpark for ETL and data processing tasks. - Proven experience working with AWS data services: S3, Glue, and Redshift. - Solid understanding of data modeling, SQL, and database design. - Experience with designing and building data pipelines on AWS. Additionally, you should have a Bachelors or Masters degree in Computer Science, Information Technology, or a related field. About the Company: The company specializes in data engineering and technology solutions, providing opportunities to work with cutting-edge technologies like AWS, PySpark, and more. Joining the team will expose you to a collaborative environment where your skills and expertise will be valued in shaping innovative data architectures.,

  • Solution Architect

    3 days ago

    Thiruvananthapuram, Kerala, India UST Global Full time

    12 - 15 Years - 1 Opening - Trivandrum **Role description**: **Responsibilities**: - AWS Data Architecture Design, implement, and maintain scalable and robust data architectures on AWS. - Utilize AWS services such as S3, Glue, and Redshift for data storage, processing, and analytics. - ETL Development with PySpark Develop and implement ETL processes using...

  • Trq24-0301-03-trq24-0301-04

    2 weeks ago

    Kerala, India IBS Software Full time

    **Job Title **Location (s) **Years of Experience Good exposure to Public API Gateway - AWS API Gateway Service Registry and Load balancing -K8s Service/ Nginx Ingress Controller Good exposure to Spring Boot ,Apache CXF Hibernate Data access layer -Spring Data repositories, Mybatis. Working knowledge in below tools Distributed Cache -Redis, Ehcache Analytics...

  • Associate Data Architect Ii

    2 weeks ago

    Thiruvananthapuram, Kerala, India UST Global Full time

    12 - 15 Years - 1 Opening - Trivandrum **Role description**: Senior Data Architect - Big Data & Cloud Solutions Experience: 10+ Years Industry: Information Technology / Data Engineering / Cloud Computing Required Skills & Qualifications: 10+ years of experience in data engineering, architecture, or related roles. Strong hands-on experience with: Apache...

  • ▷ Immediate Start: Lead I

    3 weeks ago

    Thiruvananthapuram, Kerala, India UST Full time

    Role Proficiency This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources Must be skilled in ETL tools such as Informatica Glue Databricks and DataProc with coding expertise in Python PySpark and SQL Works independently and has a deep...

  • Associate Data Architect I- Azure/snowflake

    22 hours ago

    Thiruvananthapuram, Kerala, India UST Global Full time

    9 - 12 Years - 1 Opening - Trivandrum **Role description**: **Tech Lead - Azure/Snowflake & AWS Migration** **Key Responsibilities** - Design and develop scalable data pipelines using Snowflake as the primary data platform, integrating with tools like Azure Data Factory, Synapse Analytics, and AWS services. - Build robust, efficient SQL and Python-based...

  • Associate Iii

    4 days ago

    Thiruvananthapuram, Kerala, India UST Full time

    Role Proficiency This role requires proficiency in data pipeline development including coding and testing data pipelines for ingesting wrangling transforming and joining data from various sources Must be adept at using ETL tools such as Informatica Glue Databricks and DataProc with coding skills in Python PySpark and SQL Works independently and demonstrates...

  • Lead I

    3 weeks ago

    Thiruvananthapuram, Kerala Kochi, Kerala, India UST Full time

    We are seeking an experienced Technical Lead with over 7 years of expertise in managing time-sensitive multi-stakeholder projects specifically within the health plan data domain Enrollments Claims Payments The ideal candidate will have a strong technical foundation in SQL Oracle MS SQL and cloud technologies AWS GCP preferred This is a hands-on leadership...

  • Technical Lead

    3 weeks ago

    Kochi, Kerala, India Talent Basket Full time

    Technical Lead Required Skills Experience 7-8 years of software development experience with a strong focus on JavaScript TypeScript 3 years in a technical leadership role Proven experience building applications with React React Hooks Redux etc Electron desktop app development Node js REST APIs backend logic Java or C Strong understanding of IoT concepts MQTT...

  • Cloud Pre-Sales

    2 weeks ago

    Kerala, India ITHR Technologies Consulting Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Job Title: Cloud Pre-Sales & Delivery Lead (Solutions Architect)Location: Kochi, IndiaEmployment Type: Full-TimeExperience Level: 8+ YearsRole Overview:We are looking for a Cloud Pre-Sales & Delivery Lead with strong AWS solutionarchitecture expertise, people management skills, and experience handling internationalclients. The role involves engaging with...

  • Senior / Lead Engineer - DevOps (AWS/Azure/GCP)

    4 weeks ago

    Kochi, Kerala, India, Ernakulam QBurst Full time

    Description:We are seeking an experienced and versatile DevOps Engineer. The ideal candidate will have hands-on experience with CI/CD pipelines, Kubernetes, Linux systems, monitoring/logging tools, and Infrastructure as Code (IaC) technologies.Key Responsibilities:• Design, implement, and manage scalable, secure cloud infrastructure.• Build and maintain...