AWS Data Engineer

2 days ago

India TerraGiG Full time

Role AWS Data Engineer Experience 8+ years Location Remote Time Zone UK Duration 2 months (Extendable) Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of pySpark scripts. Need to ensure overall build delivery quality is good and on-time delivery is done at all times. Should be able to handle meetings with customers with ease. Need to have excellent communication skills to interact with the customer. Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (onsite as well as offshore) *5+ years of experience in programming with python. Strong proficiency in python *Familiarity with functional programming concepts *3+ years of hands-on experience in developing ETL data pipelines using pySpark on AWS EMR *Experience in building pipelines and data lake for large enterprises on AWS *Good understanding of Spark’s Dataframe and API *Experience in configuring EMR clusters on AWS *Experience in dealing with AWS S3 object storage from Spark. *Experience in troubleshooting spark jobs. Knowledge of monitoring spark jobs using Spark UI *Performance tuning of Spark jobs. *Understanding fundamental design principles behind business processes Process Knowledge and Expertise: Demonstrated experience in change management processes, including understanding of governance frameworks and preparation of supporting artefacts required for approvals. Strong clarity on the path to production, with hands-on involvement in deployments, testing cycles, and obtaining business sign-offs. Proven track record in technical solution design, with the ability to provide architectural guidance and support implementation strategies. Databricks-Specific Skills: Experience in at least developing and delivering end-to-end Proof of Concept (POC) solutions covering the below: Basic proficiency in Databricks, including creating jobs and configuring clusters. Exposure to connecting external data sources (e.g., Amazon S3) to Databricks. Understanding of Unity Catalog and its role in data governance. Familiarity with notebook orchestration and implementing modular code structures to enhance scalability and maintainability. Important Pointers: Candidates must have actual hands-on work experience , not just home projects or academic exercises. Profiles should clearly state how much experience they have in each skill area , as this helps streamline the interview process. Candidates must know their CV/profile inside out , including all projects and responsibilities listed. Any ambiguity or lack of clarity on the candidate’s part can lead to immediate rejection, as we value accuracy and ownership. They should be able to confidently explain their past experience, challenges handled, and technical contributions.

  • Aws Data Engineer

    6 days ago

    India Adastra Corp Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    As an AWS Data Engineer, you will be responsible for:Technical requirements gathering and development of functional specificationsCommunicating with technical contacts regarding incoming and outgoing data interfacesImplementing the data pipelinesDevelop and implement best practices for AWS applications: Data Integration, Analytics & ReportingCreate ETL jobs...

  • AWS Data Engineer

    3 days ago

    Hyderabad, India Coforge Full time

    Job Description We're Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred. Job Locations: Hyderabad & Greater Noida Experience Required: 5 to 7 Years Send your CV to [Confidential Information] About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data...

  • AWS Data Engineer

    5 days ago

    Bengaluru, India Coforge Full time

    Job Description AWS Data Engineer Job Location: Bengaluru Experience Required: 5+ Years Mandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell Job Description: We are looking for an experienced AWS Engineer with around 5-8 years of...

  • Senior Data Scientist

    2 weeks ago

    Mumbai, India Amazon Web Services (AWS) Full time

    Job Description Description AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and...

  • Data Engineer

    3 weeks ago

    Delhi, India Weekday (YC W21) Full time

    Job Description This role is for one of our clients Company Name: Muoro.io Industry: Technology, Information and Media Seniority level: Mid-Senior level Min Experience: 5 years Location: NCR JobType: full-time We are seeking an experienced Data Engineer with deep expertise in the AWS data ecosystem to design, build, and optimize scalable data pipelines and...

  • AWS Data Engineer

    4 weeks ago

    india Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy Services Job Openings at TCS Skill: AWS Data Engineer Exp range:6 yrs to 10 yrs location : Bangalore Notice period– 30 – 45 daysPls find the Job Description below. Hands-on experience in Pyspark, Glue Experience on EMR, S3, IAM, Lambda, Cloud formation, Python AMI Rehydration, Python, ELB and other AWS...

  • AWS Data Engineer

    2 weeks ago

    India Inityinfotech Full time

    Job Description AWS Data Engineer Experience :- 5+ years Location : Remote Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark especially with AWS S3 object storage. Performance...

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India, Karnataka L&T Technology Services Full time

    AWS Data Engineer:Exp: 8-10 yrsLocation: BangaloreSkills:1) Graduate with 8-10 years of experience working as a AWS Data Engineer2) Excellent knowledge of PySpark, JavaScript, AWS - RDS, and Redshift

  • AWS Data Engineer

    3 weeks ago

    india Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill: AWS Data EngineerExp range: 6 yrs to 10 yrslocation: BangaloreNotice period – 30 – 45 daysPls find the Job Description below.- Hands-on experience in Pyspark, Glue - Experience on EMR, S3, IAM, Lambda, Cloud formation, Python - AMI Rehydration, Python, ELB and other AWS...

  • Data engineer

    3 weeks ago

    India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions Architect  Travel: International travel required (up to 30–40%)   Position Summary:   We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+...