AWS Data Engineer for one of the leading Big4

2 days ago

Bengaluru, Karnataka, India Acme Services Full time
Job Title: AWS Data Engineer

Location: Bangalore, Gurgaon and Pune

Experience: 5 to 10 years

Employment Type: Full-time

About the Role

We are seeking a highly skilled AWS Data Engineer to design, build, and optimize scalable data pipelines and platforms. The ideal candidate will have strong expertise in AWS cloud services, Snowflake, Python, Airflow, Glue, Redshift, and Kafka and will be responsible for ensuring efficient data integration, processing, and availability for analytics and business insights.

Key Responsibilities

- Design, develop, and maintain scalable data pipelines and ETL processes on AWS.
- Work extensively with Snowflake for data warehousing, transformations, and performance optimization.
- Develop automation scripts using Python and PyScript to streamline data workflows.
- Orchestrate and schedule complex workflows using Apache Airflow.
- Integrate, clean, and process structured/unstructured data from multiple sources including Kafka streams.
- Manage data storage, transformation, and loading in AWS Redshift, Glue, and S3.
- Ensure data quality, governance, and security across all stages of the pipeline.
- Collaborate with Data Scientists, Analysts, and other stakeholders to deliver reliable and timely data solutions.
- Monitor, troubleshoot, and optimize data processes for performance and cost efficiency.

Required Skills & Experience

- Strong hands-on experience in AWS cloud services (Redshift, Glue, S3, Lambda, IAM, EC2, etc.).
- Expertise in Snowflake data warehousing and query optimization.
- Proficiency in Python & PyScript for data engineering tasks.
- Solid experience with Airflow for workflow orchestration and scheduling.
- Knowledge of Kafka for real-time data ingestion and streaming.
- Strong understanding of ETL/ELT pipelines, data modeling, and data integration best practices.
- Experience with SQL and handling large-scale datasets.
- Good problem-solving and analytical skills with attention to detail.

  • AWS Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India Sampoorna Consultants Private Limited Full time

    Job DescriptionOur Client in India is one of the leading providers of risk, financial services and business advisory, internal audit, corporate governance, and tax and regulatory services.Our Client was established in India in September 1993, and has rapidly built a significant competitive presence in the country. The firm operates from its offices in...

  • Lead Software Engineer, Data Management

    1 week ago

    Bengaluru, Karnataka, India Capital One Full time US$ 1,50,000 - US$ 2,00,000 per year

    Voyager , India, Bangalore, KarnatakaLead Software Engineer, Data Management - Capital One SoftwareEver since our first credit card customer in 1994, Capital One has recognized that technology and data can enable even large companies to be innovative and personalized. As one of the first large enterprises to go all-in on the public cloud, Capital One needed...

  • AWS Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from TCSTCS is Hiring For Principal AWS Data EngineerExperience: 10 to 14 yearsLocation: BangaloreJob DescriptionRole: AWS Data EngineerExperience: 10-12 yearsLocation: BengaluruMust Have Tech Skills:Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a...

  • AWS Data Engineer

    4 weeks ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering...

  • AWS Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:- Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering...

  • Data Engineer with Snowflake, AWS Glue, Kafka, API

    1 day ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer with Snowflake, AWS Glue, Kafka, API to join our team in Bangalore, Karntaka (IN-KA), India (IN).- 6+...

  • AWS Data Engineer

    3 days ago

    Bengaluru, Karnataka, India KPMG Global Services Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Mandatory SkillsBachelor's degree in computer science, Data Science, engineering, mathematics, information systems, or a related technical discipline 5+ years of relevant experience in data engineering roles Detailed knowledge of data warehouse technical architectures, data modelling, infrastructure components, ETL/ ELT and reporting/analytic tools and...

  • AWS Data Engineer

    3 hours ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services We are hiring AWS Data Engineer Position: AWS Data Engineer Job Location: Bangalore Experience : 10-14 years Interested professionals kindly apply through the link. Must Have: Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and...

  • AWS Data Engineer

    18 hours ago

    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a...

  • Data Engineer- Lead Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India One 97 Full time

    Job DescriptionRole OverviewWe are seeking an experienced Lead Data Engineer to join our Data Engineering team at Paytm, India's leading digital payments and financial services platform. This is a critical role responsible for designing, building, and maintaining large-scale, real-time data streams that process billions of transactions and user interactions...