AWS Data Engineer

4 weeks ago

Madurai, India TerraGiG Full time

Role AWS Data Engineer Experience 8+ years Location Remote Time Zone UK Duration 2 months (Extendable)Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of pySpark scripts. Need to ensure overall build delivery quality is good and on-time delivery is done at all times. Should be able to handle meetings with customers with ease. Need to have excellent communication skills to interact with the customer. Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (onsite as well as offshore)*5+ years of experience in programming with python. Strong proficiency in python *Familiarity with functional programming concepts *3+ years of hands-on experience in developing ETL data pipelines using pySpark on AWS EMR *Experience in building pipelines and data lake for large enterprises on AWS *Good understanding of Spark’s Dataframe and API *Experience in configuring EMR clusters on AWS *Experience in dealing with AWS S3 object storage from Spark. *Experience in troubleshooting spark jobs. Knowledge of monitoring spark jobs using Spark UI *Performance tuning of Spark jobs. *Understanding fundamental design principles behind business processesProcess Knowledge and Expertise: Demonstrated experience in change management processes, including understanding of governance frameworks and preparation of supporting artefacts required for approvals. Strong clarity on the path to production, with hands-on involvement in deployments, testing cycles, and obtaining business sign-offs. Proven track record in technical solution design, with the ability to provide architectural guidance and support implementation strategies.Databricks-Specific Skills: Experience in at least developing and delivering end-to-end Proof of Concept (POC) solutions covering the below: Basic proficiency in Databricks, including creating jobs and configuring clusters. Exposure to connecting external data sources (e.g., Amazon S3) to Databricks. Understanding of Unity Catalog and its role in data governance. Familiarity with notebook orchestration and implementing modular code structures to enhance scalability and maintainability.Important Pointers: Candidates must haveactual hands-on work experience , not just home projects or academic exercises. Profiles should clearly statehow much experience they have in each skill area , as this helps streamline the interview process. Candidates mustknow their CV/profile inside out , including all projects and responsibilities listed. Any ambiguity or lack of clarity on the candidate’s part can lead to immediate rejection, as we value accuracy and ownership. They should be able to confidently explain their past experience, challenges handled, and technical contributions.

  • AWS Data Engineer

    2 days ago

    Madurai, Tamil Nadu, India Techmango Technology Services Private Limited Full time ₹ 80,00,000 - ₹ 2,40,00,000 per year

    About TechMango:Founded in 2014, TechMango Technology Services is a leading software development company with a strong focus on emerging technologies. Our primary goal is to deliver strategic solutions that align with our business partners' technological needs.We specialize in providing custom software solutions using the best available technologies,...

  • Associate/Junior AWS Data Engineer

    2 weeks ago

    Madurai, Tamil Nadu, India Techmango Technology Services Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job Location: MaduraiJob Experience: 2-8 YearsModel of Work: HybridTechnologies: AWSFunctional Area: Software DevelopmentJob Summary:Job Title: Associate AWS Data EngineerLocation: Madurai (Hybrid)Experience: 2+ YearsEmployment Type: Full-timeAbout the Role We are looking for a skilled AWS Data Engineer with hands-on experience in building and optimizing...

  • Aws engineer

    2 weeks ago

    Madurai, India Spryc Systems Full time

          Job Summary: We are seeking an experienced AWS Engineer to design, implement, and maintain AWS infrastructure and services in a managed service environment. The ideal candidate will possess deep expertise in AWS technologies, infrastructure as code, and security hardening at an enterprise scale. If you are passionate about cloud Engineer,...

  • Techmango Technology

    3 days ago

    Madurai, India Techmango Technology Services Private Limited Full time

    Position : Senior/Lead AWS Data EngineerExperience : 8 to 15 YearsJob Location : Madurai/BangaloreBudget : OpenWork Mode : RemoteMandate Skills : AWS, RedShift, Snowflake, Writing complex SQL Queries.Job Description : Were looking for a seasoned Data Engineer to join our Engineering organization and take ownership of the systems that power our data-driven...

  • Data Engineer

    2 weeks ago

    Madurai, India IntraEdge Full time

    Websitehttp://www.intraedge.comJob Title: Data EngineerExperience: 5–9 yearsLocation: [Remote]Job Summary:We are looking for a skilled Data Engineer with strong expertise in Python, PySpark, AWS services (Glue, Lambda), and Snowflake. The ideal candidate will design, build, and maintain scalable data pipelines, ensure efficient data integration, and enable...

  • Senior AWS Administrator

    2 weeks ago

    Madurai, India CYAN360 Full time

    Job title: AWS Infrastructure Engineer Position: Full Time Work Timings: 2:30 PM to 11:30 PM IST Salary: OpenResponsibilities: ETL/ELT processes using AWS services such as AWS Glue, AWS Lambda and AWS Step Functions. Ensure data quality, security, and compliance with industry best practices and regulatory requirements. Monitor for query failures, resource...

  • Data Engineer With Databricks Expertise

    6 days ago

    Madurai, India Whatjobs IN C2 Full time

    Job Summary We are seeking a highly skilled Data Engineer with Databricks certifications and extensive practical experience working with the Databricks Lakehouse platform and its supporting capabilities. The ideal candidate will possess a robust understanding of AWS services relevant to data engineering and demonstrate proficiency in data pipeline...

  • Techmango Technology

    3 days ago

    Madurai, India Techmango Technology Services Private Limited Full time

    Job Description Position : Senior/Lead AWS Data Engineer Experience : 8 to 15 Years Job Location : Madurai/Bangalore Budget : Open Work Mode : Remote Mandate Skills : AWS, RedShift, Snowflake, Writing complex SQL Queries. Job Description Were looking for a seasoned Data Engineer to join our Engineering organization and take ownership of the systems that...

  • Data Engineer with Databricks Expertise

    1 week ago

    Madurai, India Hello World Tech Consulting Full time

    Job SummaryWe are seeking a highly skilled Data Engineer with Databricks certifications andextensive practical experience working with the Databricks Lakehouse platform and itssupporting capabilities. The ideal candidate will possess a robust understanding of AWSservices relevant to data engineering and demonstrate proficiency in data pipelinedevelopment,...

  • Data modeler

    3 weeks ago

    Madurai, India HCLTech Full time

    Looking for Immediate joiners - From 5+ to 7 yrs :-Key Responsibilities:Design and implement conceptual, logical, and physical data models aligned with business and regulatory requirements.Develop and maintain ETL/ELT pipelines to support data ingestion, transformation, and integration across systems.Collaborate with Dev Ops, BI, and application teams to...