Data Engineer-AWS, Python

3 hours ago

Noida, Uttar Pradesh, India 3Pillar Global Full time ₹ 12,00,000 - ₹ 24,00,000 per year

Embark on an exciting journey into the realm of software development with 3Pillar We extend an invitation for you to join our team and gear up for a thrilling adventure. At 3Pillar, our focus is on leveraging cutting-edge technologies that revolutionize industries by enabling data driven decision making. As a Senior Data Engineer, you will hold a crucial position within our dynamic team, actively contributing to thrilling projects that reshape data analytics for our clients, providing them with a competitive advantage in their respective industries.

Job Summary

For this role, we are seeking a Senior Data Engineer for our Client's ETL Support Team to act as a technical pillar during our Client's transition to an AWS-native data environment. You will be a key escalation point, responsible for handling the most complex data pipeline issues. This role may move beyond simple support; you might be requested to harden and improve our Client's systems by driving performance tuning, cost optimization, and automation initiatives.

Work Location: Noida, Sec 62

Working days per week: 5

Rotational Shift : Candidates should be flexible working on a Roster basis including Weekends but maximum 5 days a week

Responsibilities:
  • Job Monitoring: Monitor approximately 2,300 scheduled jobs (daily, weekly, monthly) to ensure timely and successful execution. Execute on-demand jobs as required by the business.
  • Troubleshooting & RCA: Troubleshoot job failures, perform detailed root cause analysis (RCA), and provide clear documentation for all findings.
  • Issue Resolution: Address and resolve bugs and data-related issues reported by the business team.
  • Data Integrity: Verify source file placement in designated directories to maintain data integrity. Reload Change Data Capture (CDC) tables when structural changes occur in source systems.
  • Data Synchronization: Help manage synchronization between external databases (including Teradata write-backs) and AWS Glue tables.
  • Development: Assist in developing new solutions, enhancements, and bug fixes using AWS Glue, Lambda, and Step Functions.
  • Stakeholder Support: Answer questions from the business and support User Acceptance Testing (UAT) inquiries.
  • Decision Making: Make timely decisions to resolve issues, execute tasks efficiently, and escalate complex problems to senior or lead engineers as needed, all while maintaining agreed-upon SLAs.
  • Documentation: Participate in knowledge transfer to internal resources and assist in creating necessary documentation and runbooks.
Qualifications:
  • Experience: 3-5 years of relevant experience.
  • Technical Skills: In-depth knowledge of AWS Glue, AWS Lambda, and AWS Step Functions.
  • Core Concepts: A deep understanding of ETL processes and data warehouse design.
  • Problem-Solving: Proven ability to troubleshoot data pipelines and perform root cause analysis (RCA).
  • Should have worked on Python scripting
  • Experience: Hands-on experience with Glue, Lambda, and Step Function development.
  • Availability: Must be able to work a day shift that includes coverage for weekends and holidays on a rotational basis.
  • Preferred Skills: Familiarity with Change Data Capture (CDC) processes, Teradata, and integration with SAS & RMJ events.

  • AWS Data Engineer

    2 days ago

    Noida, Uttar Pradesh, India Topcoder Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Detailed JDAWS Data Engineer – Data Pipeline & ModellingRoles and ResponsibilitiesDesign, develop, and maintain scalable data pipelines using AWS Glue (Spark, Python) and Delta Lake for efficient ETL processing.Model and transform data across different layers (raw, staging, processed) to support analytics and reporting requirements.Orchestrate complex data...

  • Python AWS

    6 days ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Why Join Iris?Are you ready to do the best work of your career at one ofIndia's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture thattruly values your talent and ambitions?Join Iris Software — one of thefastest-growing IT services companies— whereyou own and shape your success story.About UsAt Iris Software, our...

  • Python AWS

    6 days ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Posted On: 14 Oct 2025Location: Noida, UP, IndiaCompany: Iris SoftwareWhy Join Iris?Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?Join Iris Software — one of the fastest-growing IT services companies —...

  • AWS Data Engineer

    4 days ago

    Noida, Uttar Pradesh, India Ashra Technology Full time ₹ 10,00,000 - ₹ 20,00,000 per year

    6+NoidaGreeting from AshratechnologiesWe are HiringRole: Data EngineerExp: 6+YearsLocations; Noida,GurugramData Engineer (AWS + pySpark)JD as provided below6+ years of overall IT experience, which includes hands on experience in Big Data technologies.Mandatory - Hands on experience in Python and PySpark.Build pySpark applications using Spark Dataframes in...

  • AWS Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India Coforge Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are seeking a skilledData Engineer (AWS- Scala Mandatory)to join our dynamic team. This role involves building and maintaining robust data pipelines, designing scalable databases, and collaborating with stakeholders to deliver high-quality data solutions.ResponsibilitiesBuild and maintain data pipelines using AWS Glue , Python , EMR/Spark , and ...

  • Python/Django + AWS

    6 days ago

    Noida, Uttar Pradesh, India Iris Software Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Why Join Iris?Are you ready to do the best work of your career at one ofIndia's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture thattruly values your talent and ambitions?Join Iris Software — one of thefastest-growing IT services companies— whereyou own and shape your success story.About UsAt Iris Software, our...

  • Django/Python + AWS

    2 weeks ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Posted On: 17 Sept 2025Location: Noida, UP, IndiaCompany: Iris SoftwareWhy Join Iris?Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?Join Iris Software — one of the fastest-growing IT services companies —...

  • AWS Data Engineer

    2 weeks ago

    Noida, Uttar Pradesh, India EXL Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About the Role:We are seeking a talented AWS Data Engineer with expertise in AWS Services, to join our dynamic team. The ideal candidate will have a strong background in data engineering, data processing, and cloud technologies. You will play a crucial role in designing, developing, and maintaining our data infrastructure to support our...

  • Python AWS QA

    4 hours ago

    Noida, Uttar Pradesh, India Iris Software Full time ₹ 10,00,000 - ₹ 20,00,000 per year

    Posted On: 29 Sept 2025Location: Noida, UP, IndiaCompany: Iris SoftwareWhy Join Iris?Are you ready to do the best work of your career at one of India's Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?Join Iris Software — one of the fastest-growing IT services companies —...

  • AWS Engineer

    5 days ago

    Noida, Uttar Pradesh, India InfoObjects Full time ₹ 1,30,000 - ₹ 17,00,000 per year

    Job Title: AWS Engineer (Proof of Concept – Cloud Migration)Location:Onsite for Thailand (Candidate from India who are willing to travel to Thailand for 6-8 Months can also apply)Engagement Type: Full-timeProject Context:The role involves working on a Proof of Concept (POC) to demonstrate that existing or new applications can be successfully deployed,...