Aws data engineer

3 weeks ago

Bangalore, India Bhavitha Tech, CMMi Level 3 Company Full time

Company Description Bhavitha Tech, a CMMi Level 3 Company located in Bengaluru, specializes in digital transformation services including Application Modernization, Custom Product Development, AWS Cloud Consulting, Industrial 4.0 Io T, Consumer Io T, and ERP software implementation & support. With a diverse client portfolio ranging from enterprise companies like Baker Real Estate and Terex Corporation to startups and SMEs in North America and India, Bhavitha Tech is an AWS Services Select Partner offering professional and development services on AWS. Role Description This is a full-time on-site role for an AWS Data Engineer for one of Tier-1 IT Services companies. The Data Engineer will be responsible for tasks such as data engineering, data modeling, ETL processes, data warehousing, and data analytics. The role requires hands-on experience in developing, constructing, testing, and maintaining data architectures. Experience Required: 6+ Years No.of Req : 2 Key Responsibilities: ● Data Pipeline Design and Development: ○ Design, build, and maintain data pipelines to ingest, process, and store data using AWS technologies. ○ Utilize Python programming to create efficient data processing workflows, handling large-scale data transformation tasks. ○ Build scalable and high-performance solutions for data extraction, transformation, and loading (ETL). ● AWS Services Expertise: ○ Work extensively with AWS services including S3, Red Shift, Glue, and Sage Maker to build end-to-end data solutions. ○ Develop and optimize data pipelines using AWS Glue for ETL processes, enabling efficient data movement across systems. ○ Use AWS Red Shift for data warehousing and ensure optimized performance for data queries and reporting. ○ Leverage AWS Sagemaker for deploying machine learning models and creating automated data workflows. ● Infrastructure as Code (Ia C) and CI/CD Management: ○ Implement Infrastructure as Code (Ia C) using Terraform to provision and manage cloud infrastructure for data projects. ○ Set up CI/CD pipelines with tools like Terraform, Jenkins, Bamboo, Code Build, and Code Fresh to automate deployment processes and enhance collaboration across teams. ● Business and Data Requirements Translation: ○ Work closely with business analysts and stakeholders to translate complex business and data requirements into scalable, efficient, and secure data solutions. ○ Optimize data pipelines and workflows to meet performance, scalability, and reliability requirements. ● Data Management and Optimization: ○ Develop and maintain data models, ensuring data is properly structured, and optimized for querying and analysis. ○ Use AWS Glue for data cataloging, transformation, and scheduling, ensuring that data workflows are efficient and consistent. ● Testing, Monitoring, and Troubleshooting: ○ Monitor the performance and health of data pipelines and AWS environments. ○ Troubleshoot and resolve issues related to data ingestion, transformation, and delivery. ○ Ensure data accuracy, consistency, and quality across the entire data pipeline lifecycle. Key Requirements: ● Experience: ○ 6+ years of experience in data engineering with a focus on AWS technologies. ○ Strong proficiency in Python programming for data manipulation, transformation, and pipeline development. ○ Experience with AWS Glue, Red Shift, Sagemaker, and other AWS data services. ○ Proven expertise in data pipeline management and optimization in a cloud environment. ● Technical Skills: ○ Proficient with AWS S3, Glue, Red Shift, Sage Maker, Lambda, and other AWS data tools. ○ Experience with CI/CD tools such as Jenkins, Code Build, Bamboo, and Code Fresh. ○ Expertise in Infrastructure as Code (Ia C), specifically using Terraform for provisioning and managing cloud infrastructure. ○ Solid understanding of data engineering principles, ETL, and data warehousing concepts. ○ Experience in building and managing data pipelines for large-scale, high-volume datasets. ● Business and Analytical Skills: ○ Strong ability to translate complex data and business requirements into scalable and efficient data solutions. ○ Excellent problem-solving skills, with the ability to analyze and optimize data workflows. ○ Ability to collaborate with business analysts, data scientists, and stakeholders to deliver optimal data-driven solutions.

  • Aws data engineer

    3 weeks ago

    Bangalore, India Deloitte Full time

    We are looking for Candidates who are having experience in AWS Data Engineer. Experience Required: 5+ years. Location: Bengaluru, Karnataka, India Key Responsibilities: Build & manage ETL pipelines using Python , Py Spark & AWS Glue . Process and store data on AWS S3 & optimize queries in Redshift . Develop serverless solutions with...

  • Aws data engineer

    4 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    We are looking for AWS Data Engineer AWS Data Engineer Experience Range- 5 to 10years. Work Location - Kolkata/Bangalore/Pune/Bhubaneswar /Delhi Mode of Interview: Online Interview Interview Date: 27th Nov 24 (Wednesday) Interview Time: 10 am to 5pm Mandatory Skills: AWS Data engineering, Python, Concepts and implementation...

  • AWS Data Engineer

    4 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TATA CONSULTANCY SERVICES LIMITED!!! Skill: AWS Data Engineer + Python & Scala Location: PAN INDIA Experience: 4 to 8 years Industry experience in Data Engineering on AWS cloud with glue, redshift , Athena experience. Ability to write high quality, maintainable, and robust code, often in SQL, Scala and...

  • AWS Data Engineer

    1 month ago

    Bangalore, India Tata Consultancy Services Full time

    We are looking for AWS Data Engineer AWS Data Engineer Experience Range- 5 to 10years. Work Location - Kolkata/Bangalore/Pune/Bhubaneswar /Delhi Mode of Interview: Online Interview Interview Date: 27th Nov 24 (Wednesday) Interview Time: 10 am to 5pm Mandatory Skills: AWS Data engineering, Python, Concepts and implementation...

  • aws data engineer

    2 months ago

    bangalore, India Genpact Full time

    hi everyone,we are hiring for Aws data engineerBangalore location4-8 years of expimmediate joiner

  • aws data engineer

    2 months ago

    Bangalore, India Genpact Full time

    hi everyone, we are hiring for Aws data engineer Bangalore location 4-8 years of exp immediate joiner

  • Data Engineer

    1 month ago

    Bangalore, India BizViz Technologies Pvt Ltd Full time

    Position Overview : We are seeking a Data Engineer with a strong background in AWS and 2-5 years of relevant experience. The ideal candidate will possess excellent communication and interpersonal skills, as these are crucial for our collaborative and dynamic work environment.Location : HSR Layout - Bangalore, KAExperience : 2-5 yearsKey Responsibilities :...

  • AWS Data Engineer

    2 days ago

    Bangalore, India Quess IT Staffing Full time

    Company Name:- Quess IT Staffing Job Title -AWS Data Engineer Experience : 3+Years Location-: Bengaluru/Hyderabad(Hybrid) Notice Period:- Immediate to 15 Days Skill:- AWS Glue/Python, Glue (Catalog, Jobs, Connections, Crawlers, Workflows), Athena and a good understanding of Cross Account permissions.

  • Senior Data Engineer

    1 month ago

    Bangalore, India Kloud9 Full time

    Job Description : As a Senior Data Engineer, you will partner with Software Engineers, Data Scientists and Business Intelligence Engineers. You will gain a deep understanding of our services and the data they produce and become our resident expert in how to transform that data into a format that is useful for analytics and business intelligence. You will...

  • Data Engineer

    4 weeks ago

    Chennai/Bangalore/Pune/Hyderabad/Noida, India MNR Solutions Full time

    Job Description : We are looking for an experienced AWS Data Engineer to join our team. The ideal candidate will have extensive knowledge of AWS data services and a strong background in data engineering. This role involves designing, implementing, and maintaining data pipelines and architectures to support business intelligence and analytics initiatives.Key...

  • Programmers.io | AWS Data Engineer

    3 weeks ago

    bangalore, India Programmers.io Full time

    Job Description: Job Title: AWS Data Engineer Shift Timings: 1:30 PM - 10:30 PM Location: Jaipur Experience required: 3 to 8 years AWS Data Engineer - MarketingKey Tasks: Analyze existing marketing data/tables and summarize data. Collaborating with existing DE team to ingest additional data sources for marketingDeveloping data workflows to process, clean...

  • AWS Data Engineer

    1 week ago

    Bangalore, India Consultancy Full time

    Job Description : - Experience as a Data Engineer with strong track record of designing and implementing data solutions. - Experience in programming language as Python or Java, with experience in building data pipelines and workflows. - Experience with cloud data warehousing technologies, such as Snowflake and Redshift. - Experience with distributed...

  • AWS Data Engineer

    1 month ago

    Bangalore/Noida, India Firstcareercentre Full time

    Job Summary :We are seeking a highly skilled and experienced AWS Data Engineer to join our data team. The AWS Data Engineer will be responsible for designing, developing, and optimizing data pipelines, integrating various data sources, and implementing AWS cloud solutions. The ideal candidate should have a strong background in data engineering, cloud...

  • Aws data engineer

    3 weeks ago

    Bangalore, India Tata Consultancy Services Full time

    Dear Candidate, Greetings from TCS Human Resources Team!! Job Role: AWS Data Engineer Job Locations: PAN India Experience Range: 6 to 9 years Development experience with python Pandas, Num Py, Snowflake and Snowpark. Implementing ETL pipelines within and outside of a data warehouse using Python and Snowflakes Snow SQL Querying Snowflake...

  • Data Engineer

    2 days ago

    Bangalore, India Coders Brain Technology Private Limited Full time

    We are seeking a skilled and motivated Data Engineer to join our team. The ideal candidate will have expertise in AWS, Spark, Python, AWS Lambda, Glue, and Airflow, with 6years of relevant experience. This role is critical for developing and maintaining scalable data pipelines and ensuring efficient data integration across our platforms.Key Responsibilities...

  • Data Engineer

    1 month ago

    Remote/Bangalore, India Creative Technostructure Full time

    Role : AWS Data EngineerLocation : Remote Timings : Day Shift Notice Period : Immediate Joiner or maximum up to 15 days. Experience : 2.5 to 4 Years Job Description : Required Skills and Qualifications :- 2+ years of experience in data engineering, with a focus on AWS and Python.- Strong proficiency in Python for scripting and building data workflows.-...

  • AWS Data Engineer

    4 weeks ago

    Bangalore, India Teamware Solutions ( A division of Quantum Leap Co Full time

    AWS Data Engineer Location : Bangalore.- We are seeking a highly skilled AWS- Developer- with 6 years of experience to join our innovative team.- The ideal candidate will have in-depth knowledge and hands-on experience with AWS- services, particularly PySpark, AWS- Glue, Lambda, DMS, S3, SQL, and DBT.- The successful candidate will be responsible for...

  • Deloitte | AWS Data Engineer | bangalore

    1 month ago

    bangalore, India Deloitte Full time

    We are looking for Candidates who are having experience in AWS Data Engineer .Experience Required: 5+ years.Location: Bengaluru, Karnataka, IndiaKey Responsibilities:Build & manage ETL pipelines using Python , PySpark & AWS Glue .Process and store data on AWS S3 & optimize queries in Redshift .Develop serverless solutions with AWS Lambda & design...

  • Azure Data Engineer

    3 weeks ago

    Bangalore, India Juniper Consultancy Services Full time

    Who are we looking for :We are looking for an experienced AWS Data Engineer with expertise in PySpark and Python to join our dynamic team. You will be responsible for designing, implementing, and maintaining scalable data pipelines and infrastructure,leveraging the power of AWS services and big data technologies.Technical Skills : - 8+ years of experience in...

  • AWS Data Engineer

    1 month ago

    Bangalore, India JoulestoWatts Business Solutions Pvt Ltd Full time

    Role : AWS Data Engineer. Experience : 6+ Years. Location : Bangalore (Work from office 5 Days). Job Description : AWS Data Engineer/Lead Developer- ,experience with Sql, S3, AWS Glue, AWS Lambda, Pyspark, Aurora DB, Dynamo DB, Redshift, Datawarehousing, CI/CD, Stonebranch(Scheduling Tool).- We are seeking a highly skilled AWS Data Engineer to join our team...