Aws data engineer
6 hours ago
Bhavitha Tech, a CMMi Level 3 Company located in Bengaluru, specializes in digital transformation services including Application Modernization, Custom Product Development, AWS Cloud Consulting, Industrial 4.0 Io T, Consumer Io T, and ERP software implementation & support. With a diverse client portfolio ranging from enterprise companies like Baker Real Estate and Terex Corporation to startups and SMEs in North America and India, Bhavitha Tech is an AWS Services Select Partner offering professional and development services on AWS.
Role Description
This is a full-time on-site role for an AWS Data Engineer for one of Tier-1 IT Services companies. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics. The role requires hands-on experience in developing, constructing, testing, and maintaining data architectures.
Experience Required: 6+ Years
No.of Req : 2
Key Responsibilities:
● Data Pipeline Design and Development:
○ Design, build, and maintain data pipelines to ingest, process, and store data using AWS technologies.
○ Utilize Python programming to create efficient data processing workflows, handling large-scale data transformation tasks.
○ Build scalable and high-performance solutions for data extraction, transformation, and loading (ETL).
● AWS Services Expertise:
○ Work extensively with AWS services including S3, Red Shift, Glue, and Sage Maker to build end-to-end data solutions.
○ Develop and optimize data pipelines using AWS Glue for ETL processes, enabling efficient data movement across systems.
○ Use AWS Red Shift for data warehousing and ensure optimized performance for data queries and reporting.
○ Leverage AWS Sagemaker for deploying machine learning models and creating automated data workflows.
● Infrastructure as Code (Ia C) and CI/CD Management:
○ Implement Infrastructure as Code (Ia C) using Terraform to provision and manage cloud infrastructure for data projects.
○ Set up CI/CD pipelines with tools like Terraform, Jenkins, Bamboo, Code Build, and Code Fresh to automate deployment processes and enhance collaboration across teams.
● Business and Data Requirements Translation:
○ Work closely with business analysts and stakeholders to translate complex business and data requirements into scalable, efficient, and secure data solutions.
○ Optimize data pipelines and workflows to meet performance, scalability, and reliability requirements.
● Data Management and Optimization:
○ Develop and maintain data models, ensuring data is properly structured, and optimized for querying and analysis.
○ Use AWS Glue for data cataloging, transformation, and scheduling, ensuring that data workflows are efficient and consistent.
● Testing, Monitoring, and Troubleshooting:
○ Monitor the performance and health of data pipelines and AWS environments.
○ Troubleshoot and resolve issues related to data ingestion, transformation, and delivery.
○ Ensure data accuracy, consistency, and quality across the entire data pipeline lifecycle.
Key Requirements:
● Experience:
○ 6+ years of experience in data engineering with a focus on AWS technologies.
○ Strong proficiency in Python programming for data manipulation, transformation, and pipeline development.
○ Experience with AWS Glue, Red Shift, Sagemaker, and other AWS data services.
○ Proven expertise in data pipeline management and optimization in a cloud environment.
● Technical Skills:
○ Proficient with AWS S3, Glue, Red Shift, Sage Maker, Lambda, and other AWS data tools.
○ Experience with CI/CD tools such as Jenkins, Code Build, Bamboo, and Code Fresh.
○ Expertise in Infrastructure as Code (Ia C), specifically using Terraform for provisioning and managing cloud infrastructure.
○ Solid understanding of data engineering principles, ETL, and data warehousing concepts.
○ Experience in building and managing data pipelines for large-scale, high-volume datasets.
● Business and Analytical Skills:
○ Strong ability to translate complex data and business requirements into scalable and efficient data solutions.
○ Excellent problem-solving skills, with the ability to analyze and optimize data workflows.
○ Ability to collaborate with business analysts, data scientists, and stakeholders to deliver optimal data-driven solutions.
-
AWS Data Engineer
6 months ago
Bengaluru, India Torry Harris Full timeAre you an AWS Data Engineer looking for an exciting new opportunity? Look no further than Torry Harris! We are a leading digital transformation company, and we are currently seeking a talented and experienced AWS Data Engineer to join our team.As an AWS Data Engineer at Torry Harris, you will be responsible for designing, implementing, and maintaining our...
-
Bengaluru, India AWS India - Karnataka - D11 Full timeAWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. The AWS Global Support team interacts with leading companies and believes that world-class support is critical to customer success....
-
AWS Data Engineer
2 weeks ago
Bengaluru, India Spruce IT Pvt. Ltd. Full timeJob Title : AWS Data Engineer. Company : Spruce InfoTech, Inc. Job Type : Contract-to-Hire (C2H) with MNC. Location : Bangalore. Experience : 5+ years. Job Description : Spruce InfoTech, Inc. is hiring a skilled AWS Data Engineer to join a leading MNC on a Contract-to-Hire basis. The ideal candidate will bring robust experience in cloud data engineering,...
-
AWS Data Engineer
1 day ago
Bengaluru, India Bhavitha Tech, CMMi Level 3 Company Full timeCompany DescriptionBhavitha Tech, a CMMi Level 3 Company located in Bengaluru, specializes in digital transformation services including Application Modernization, Custom Product Development, AWS Cloud Consulting, Industrial 4.0 IoT, Consumer IoT, and ERP software implementation & support. With a diverse client portfolio ranging from enterprise companies like...
-
AWS Data Engineer
2 days ago
Bengaluru, India Bhavitha Tech, CMMi Level 3 Company Full timeCompany Description Bhavitha Tech, a CMMi Level 3 Company located in Bengaluru, specializes in digital transformation services including Application Modernization, Custom Product Development, AWS Cloud Consulting, Industrial 4.0 IoT, Consumer IoT, and ERP software implementation & support. With a diverse client portfolio ranging from enterprise companies...
-
Cloud Engineer
3 weeks ago
Bengaluru, Karnataka, India AWS India - Karnataka Full timeAbout the RoleWe are seeking a highly skilled Cloud Support Engineer to join our team at Amazon Web Services (AWS) India - Karnataka. As a key member of our support organization, you will be responsible for providing exceptional customer service and technical expertise to our global customers.Key ResponsibilitiesLeverage your extensive experience in network,...
-
Aws data engineer
6 hours ago
Bengaluru, India Tata Consultancy Services Full timeDear Candidate,Greetings from TATA CONSULTANCY SERVICES LIMITED!!!Skill: AWS Data Engineer + Python & ScalaLocation: PAN INDIAExperience: 4 to 8 yearsIndustry experience in Data Engineering on AWS cloud with glue, redshift , Athena experience.Ability to write high quality, maintainable, and robust code, often in SQL, Scala and Python.3+ Years of Data...
-
Data Engineer, Infra-Finance Business intelligence
5 months ago
Bengaluru, India AWS India - Karnataka Full timeDo you have a desire to make a major contribution to the future in the rapid growth environment of Cloud Computing? Are you passionate about data and code? Does the prospect of dealing with massive volumes of data excite you? Do you want to build data engineering solutions that process millions of records? Amazon Web Services is looking for a Data Engineer...
-
AWS Data Engineer
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeExperience: 4+ YearsLocation: bangalore/hyderabadRole: AWS Data EngineerJob Description:Good hands on experience in Python programming and Pyspark and snowflake· Data Engineering experience using AWS core services (Lambda, Glue, EMR and RedShift) · Required skill set- SQL, Airflow· Have Experience with snowflake or Hive or AWS S3· Responsibility – Will...
-
AWS Support Manager
4 weeks ago
Bengaluru, Karnataka, India AWS India - Karnataka Full timeAWS Support Manager Job DescriptionDrive technical excellenceAWS India Support is seeking an experienced AWS Support Manager to lead a team of 15-20 Support Engineers in India. As a Support Manager, you will be responsible for managing day-to-day operations, ensuring SLA commitments are met, and driving personnel management to ensure engineers have what they...
-
Aws data engineer
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeExperience: 4+ YearsLocation: bangalore/hyderabadRole: AWS Data EngineerJob Description:Good hands on experience in Python programming and Pyspark and snowflake· Data Engineering experience using AWS core services (Lambda, Glue, EMR and Red Shift) · Required skill set- SQL, Airflow· Have Experience with snowflake or Hive or AWS S3· Responsibility –...
-
AWS Data Engineer
2 weeks ago
Bengaluru, India Deloitte Full timeWe are looking for Candidates who are having experience in AWS Data Engineer .Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaKey Responsibilities:Build & manage ETL pipelines using Python , PySpark & AWS Glue .Process and store data on AWS S3 & optimize queries in Redshift .Develop serverless solutions with AWS Lambda & design...
-
Aws data engineer
2 weeks ago
Bengaluru, India Deloitte Full timeWe are looking for Candidates who are having experience in AWS Data Engineer.Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaKey Responsibilities:Build & manage ETL pipelines using Python , Py Spark & AWS Glue.Process and store data on AWS S3 & optimize queries in Redshift.Develop serverless solutions with AWS Lambda & design...
-
AWS Data Engineer
1 day ago
Bengaluru, India Tata Consultancy Services Full timeDear Candidate,Greetings from TATA CONSULTANCY SERVICES LIMITED!!!Skill: AWS Data Engineer + Python & ScalaLocation: PAN INDIAExperience: 4 to 8 yearsIndustry experience in Data Engineering on AWS cloud with glue, redshift , Athena experience.Ability to write high quality, maintainable, and robust code, often in SQL, Scala and Python.3+ Years of Data...
-
AWS Data Engineer
2 days ago
Bengaluru, India Tata Consultancy Services Full timeDear Candidate, Greetings from TATA CONSULTANCY SERVICES LIMITED!!! Skill: AWS Data Engineer + Python & Scala Location: PAN INDIA Experience: 4 to 8 years Industry experience in Data Engineering on AWS cloud with glue, redshift , Athena experience. Ability to write high quality, maintainable, and robust code, often in SQL, Scala and Python. 3+ Years of...
-
AWS Data Engineer
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeWe are looking forAWS Data EngineerAWS Data EngineerExperience Range- 5 to 10years.Work Location -Kolkata/Bangalore/Pune/Bhubaneswar /DelhiMode of Interview: Online InterviewInterview Date: 27th Nov 24 (Wednesday)Interview Time: 10 am to 5pmMandatory Skills: AWS Data engineering, Python, Concepts and implementation experience of API, Problem-Solving and...
-
AWS Data Engineer
4 weeks ago
Bengaluru, India NEC Software Solutions (India) Full timeJob DescriptionWhat you’ll be doing: Building Scalable Data Pipelines: Designing and developing high-quality, scalable ETL pipelines for processing big data using AWS analytical services, leveraging no-code tools, and reusable Python libraries to ensure efficiency and reusability.Collaborating & Aligning with Project Goals: Working closely with...
-
AWS Data Engineer
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeExperience: 4+ YearsLocation: bangalore/hyderabadRole: AWS Data EngineerJob Description:Good hands on experience in Python programming and Pyspark and snowflake· Data Engineering experience using AWS core services (Lambda, Glue, EMR and RedShift) · Required skill set- SQL, Airflow· Have Experience with snowflake or Hive or AWS S3· Responsibility – Will...
-
AWS Data Engineer
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeExperience: 4+ Years Location: bangalore/hyderabad Role: AWS Data Engineer Job Description: Good hands on experience in Python programming and Pyspark and snowflake · Data Engineering experience using AWS core services (Lambda, Glue, EMR and RedShift) · Required skill set- SQL, Airflow · Have Experience with snowflake or Hive or AWS S3 · Responsibility...
-
AWS Data Engineer
3 weeks ago
Bengaluru, India Tata Consultancy Services Full timeWe are looking for AWS Data EngineerAWS Data EngineerExperience Range- 5 to 10years.Work Location - Kolkata/Bangalore/Pune/Bhubaneswar /DelhiMode of Interview: Online InterviewInterview Date: 27th Nov 24 (Wednesday)Interview Time: 10 am to 5pmMandatory Skills: AWS Data engineering, Python, Concepts and implementation experience of API, Problem-Solving and...