AWS Data Engineer

2 weeks ago

Malappuram, India TerraGiG Full time

RoleAWS Data EngineerExperience8+ yearsLocationRemoteTime ZoneUKDuration2 months (Extendable)Job DescriptionDesign, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.Writing reusable, testable, and efficient codeIntegration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of pySpark scripts.Need to ensure overall build delivery quality is good and on-time delivery is done at all times.Should be able to handle meetings with customers with ease.Need to have excellent communication skills to interact with the customer.Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (onsite as well as offshore) *5+ years of experience in programming with python. Strong proficiency in python*Familiarity with functional programming concepts*3+ years of hands-on experience in developing ETL data pipelines using pySpark on AWS EMR*Experience in building pipelines and data lake for large enterprises on AWS*Good understanding of Spark’s Dataframe and API*Experience in configuring EMR clusters on AWS*Experience in dealing with AWS S3 object storage from Spark.*Experience in troubleshooting spark jobs. Knowledge of monitoring spark jobs using Spark UI*Performance tuning of Spark jobs.*Understanding fundamental design principles behind business processes Process Knowledge and Expertise:Demonstrated experience in change management processes, including understanding of governance frameworks and preparation of supporting artefacts required for approvals.Strong clarity on the path to production, with hands-on involvement in deployments, testing cycles, and obtaining business sign-offs.Proven track record in technical solution design, with the ability to provide architectural guidance and support implementation strategies. Databricks-Specific Skills:Experience in at least developing and delivering end-to-end Proof of Concept (POC) solutions covering the below:Basic proficiency in Databricks, including creating jobs and configuring clusters.Exposure to connecting external data sources (e.g., Amazon S3) to Databricks.Understanding of Unity Catalog and its role in data governance.Familiarity with notebook orchestration and implementing modular code structures to enhance scalability and maintainability. Important Pointers:Candidates must have actual hands-on work experience, not just home projects or academic exercises.Profiles should clearly state how much experience they have in each skill area, as this helps streamline the interview process.Candidates must know their CV/profile inside out, including all projects and responsibilities listed. Any ambiguity or lack of clarity on the candidate’s part can lead to immediate rejection, as we value accuracy and ownership.They should be able to confidently explain their past experience, challenges handled, and technical contributions.

  • Aws data engineer

    1 day ago

    Malappuram, India Randstad Digital Full time

    Job Role: Aws Data Engineer Location: Kochi Experience:-6-13years Note: Inperson Interview-Kochi Immediate joiners or below 10 days Notice period candidates preferred Job Description Key Responsibilities Typical job descriptions include the following core responsibilities: Data Pipeline Development: Design, build, and maintain Extract, Transform, Load (ETL)...

  • AWS Engineer

    2 days ago

    Malappuram, India Spryc Systems Full time

          Job Summary:We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS technologies, infrastructure as code, and security hardening at an enterprise scale. If you are passionate about cloud Engineer,...

  • Senior data engineer

    5 days ago

    Malappuram, India SAIVA AI Full time

    We are building the future of healthcare analytics. Join us to design, build, and scale robust data pipelines that power nationwide analytics and support our machine learning systems. Our goal: pipelines that are reliable, observable, and continuously improving in production.This is a fully remote role, open to candidates based in Europe or India, with...

  • Data Engineer

    3 weeks ago

    Malappuram, India AAA Global Full time

    Data Engineer | MumbaiLocation: IndiaIndustry: Proprietary Trading / Financial MarketsExperience: 4+ yearsEmployment Terms: Full-time, PermanentCompensation: Competitive, market-alignedIntroductionWe are seeking an experienced Data Engineer to strengthen our core Data Engineering team. In this key role, you will ensure the secure, scalable, and efficient...

  • Data engineer

    3 weeks ago

    Malappuram, India Sapaad Full time

    WHO WE ARESapaad is a global leader in unified commerce platforms, delivering world-class software solutions for the food and beverage industry. Our flagship product, also named Sapaad, has achieved remarkable success over the past decade, empowering thousands of F&B businesses across 40+ countries—with many more coming onboard each day.Driven by a...

  • Data Engineer

    3 weeks ago

    Malappuram, India Manuh Technologies Full time

    Key ResponsibilitiesDesign, develop, and maintain ETL/ELT pipelines to process structured and unstructured data.Build and optimize data lakes and data warehouses using AWS services (e.g., S3, Glue, Redshift, EMR, Lambda).Develop automation scripts and tools using Python for data integration, validation, and transformation.Collaborate with data analysts, data...

  • Devops (aws + linux)

    1 day ago

    Malappuram, India OpenSource Technologies Inc. Full time

    Designation: Dev Ops Engineer Designation: Dev Ops Engineer Job Title: Dev Ops Engineer Experience:- Upto 5yr (AWS + Linux) No. Of Opening- 1 Job Summary: We are seeking a talented Dev Ops Engineer with over 3 years of experience and a strong background in AWS. The candidate should have excellent experience working on live international web and mobile...

  • Fullstack- Node.js, Typescript,AWS

    3 weeks ago

    Malappuram, India Sonata Software Full time

    Fullstack- Node.js, Typescript,AWSExp: 7+ years for SE III Location: HyderbadEssential Qualifications:Proficient in Node.js, TypescriptProficient with AWS Cloud Services: Lambda, Step Functions, DynamoDB, RDS, SNS, SQS, API Gateway, S3Solid relational database skills using PostgreSQL or MySQLProficient with monitoring and alerting tools: AWS CloudWatch,...

  • Senior Cost Optimization Engineer

    3 weeks ago

    Malappuram, India Whatjobs IN C2 Full time

    Position Overview Are you passionate about technology and excited by the challenge of turning complex cloud billing data into strategic cost savings? Do you thrive on solving puzzles with AWS and Azure platforms while delivering measurable Engineering impact? We're looking for a self-driven technology enthusiast who sees cost optimization not just as expense...

  • Data scientist

    3 weeks ago

    Malappuram, India Recro Full time

    Tech StackModeling & ML Frameworks: Python, scikit-learn, Py Torch, Tensor Flow — spanning classicalML, deep learning, and transformer-based architectures. Includes modern ensemble methods(XGBoost, Light GBM) for large-scale structured modeling.Applied Domains: Ranking, Recommendation, Dynamic Pricing, Forecasting, Supply–DemandOptimization, Semantic...