AWS Data Engineer
1 week ago
RoleAWS Data EngineerExperience8+ yearsLocationRemoteTime ZoneUKDuration2 months (Extendable)Job DescriptionDesign, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR.Writing reusable, testable, and efficient codeIntegration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of pySpark scripts.Need to ensure overall build delivery quality is good and on-time delivery is done at all times.Should be able to handle meetings with customers with ease.Need to have excellent communication skills to interact with the customer.Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (onsite as well as offshore) *5+ years of experience in programming with python. Strong proficiency in python*Familiarity with functional programming concepts*3+ years of hands-on experience in developing ETL data pipelines using pySpark on AWS EMR*Experience in building pipelines and data lake for large enterprises on AWS*Good understanding of Spark’s Dataframe and API*Experience in configuring EMR clusters on AWS*Experience in dealing with AWS S3 object storage from Spark.*Experience in troubleshooting spark jobs. Knowledge of monitoring spark jobs using Spark UI*Performance tuning of Spark jobs.*Understanding fundamental design principles behind business processes Process Knowledge and Expertise:Demonstrated experience in change management processes, including understanding of governance frameworks and preparation of supporting artefacts required for approvals.Strong clarity on the path to production, with hands-on involvement in deployments, testing cycles, and obtaining business sign-offs.Proven track record in technical solution design, with the ability to provide architectural guidance and support implementation strategies. Databricks-Specific Skills:Experience in at least developing and delivering end-to-end Proof of Concept (POC) solutions covering the below:Basic proficiency in Databricks, including creating jobs and configuring clusters.Exposure to connecting external data sources (e.g., Amazon S3) to Databricks.Understanding of Unity Catalog and its role in data governance.Familiarity with notebook orchestration and implementing modular code structures to enhance scalability and maintainability. Important Pointers:Candidates must have actual hands-on work experience, not just home projects or academic exercises.Profiles should clearly state how much experience they have in each skill area, as this helps streamline the interview process.Candidates must know their CV/profile inside out, including all projects and responsibilities listed. Any ambiguity or lack of clarity on the candidate’s part can lead to immediate rejection, as we value accuracy and ownership.They should be able to confidently explain their past experience, challenges handled, and technical contributions.
-
AWS Data Engineer
7 days ago
Bangalore, India Coforge Full timeAWS Data Engineer Job Location: Bengaluru Experience Required: 5+ Years Mandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell Job Description: We are looking for an experienced AWS Engineer with around 5-8 years of hands-on experience...
-
Aws data engineer
4 weeks ago
Bangalore, India L&T Technology Services Full timeAWS Data Engineer: Exp: 8-10 yrs Location: Bangalore Skills: 1) Graduate with 8-10 years of experience working as a AWS Data Engineer 2) Excellent knowledge of Py Spark, Java Script, AWS - RDS, and Redshift
-
AWS Data Engineer
2 weeks ago
bangalore, India Coforge Full timeWe are Hiring AWS Data Engineers at Coforge Ltd. Job Location: Bangalore Experience Required: 5 to 7 Years. Availability: Immediate joiners preferred Send your CV to WhatsApp: for any queries Role Overview:- Coforge Ltd. is seeking a skilled AWS Engineer with 5–7 years of hands-on experience in designing, deploying, and managing cloud-native applications...
-
AWS Data Engineer
5 days ago
bangalore, India Tata Consultancy Services Full timeRole** - AWS Data EngineerTechnical Skill Set -Aws data engineer having strong experience of PythonExperience Range -6 to 8Technical/Behavioral Competency1. Proficient in Python, with experience in deploying Python packages and OOP, Experience in ingesting data from different data sources (APIs, Web scraping, Flat-files, Databases) 2. hands-on experience in...
-
AWS Data Engineer
6 days ago
bangalore, India Tata Consultancy Services Full timeJob Title: AWS Data Engineer Exp Range: 5-14 YearsJob Location: Bangalore or Bhubaneswar or Hyderabad Job Description: •Bachelor's degree in Engineering , Technology computer science, statistics, biostatistics, mathematics, biology or other health related field or equivalent experience that provides the skills and knowledge necessary to perform the...
-
AWS Data Engineer
6 days ago
bangalore, India Coforge Full timeWe are seeking a skilled Data Engineer (AWS- Scala Mandatory) to join our dynamic team. This role involves building and maintaining robust data pipelines, designing scalable databases, and collaborating with stakeholders to deliver high-quality data solutions. Responsibilities Build and maintain data pipelines using AWS Glue , Python , EMR/Spark , and...
-
AWS Data Engineer
3 days ago
Bangalore Division, India Coforge Full timeWe are Hiring AWS Data Engineers at Coforge Ltd. Job Location: Bangalore Experience Required: 5 to 7 Years. Availability: Immediate joiners preferred 📧 Send your CV to Gaurav.2.Kumar@coforge.com 📱 WhatsApp: 9667427662 for any queries Role Overview:- Coforge Ltd. is seeking a skilled AWS Engineer with 5–7 years of hands-on experience in designing,...
-
Urgent! AWS Data Engineer
1 week ago
Bangalore, India Coforge Full timeAWS Data Engineer Job Location: Bengaluru Experience Required: 5+ Years Mandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell Job Description: We are looking for an experienced AWS Engineer with around 5-8 years of hands-on experience...
-
AWS Data Engineer
2 weeks ago
bangalore, India Tata Consultancy Services Full timeDear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill: AWS Data Engineer Exp range: 6 yrs to 10 yrslocation: BangaloreNotice period – 30 – 45 daysPls find the Job Description below.Hands-on experience in Pyspark, GlueExperience on EMR, S3, IAM, Lambda, Cloud formation, PythonAMI Rehydration, Python, ELB and other AWS components...
-
AWS Data Engineer
2 days ago
bangalore, India Tata Consultancy Services Full timeRole - AWS Data Engineer Required Technical Skill Set - AWS,Snowflake,ETL,Python,Pyspark, DBT Experience Range - 6+ Years Technical/Behavioral Competency: • 5+ years experience with Sowflake development and integration • 3-7 years experience AWS cloud and AWS services such as S3 Buckets, Lambda, Glue, API Gateway, SQS queues, RDS, Redshift; •...
