Current jobs related to Principal AWS Data Engineer - Bengaluru, Karnataka - NorthStar HR Consultants

  • AWS Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:- Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering...

  • AWS Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy Services We are hiring AWS Data Engineer Position: AWS Data Engineer Job Location: Bangalore Experience : 10-14 years Interested professionals kindly apply through the link. Must Have: Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and...

  • AWS Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring AWS Data Engineer Position: AWS Data EngineerJob Location: BangaloreExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Summary: In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Summary: In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organisation to design and implement scalable data infrastructure and processes using...


  • Bengaluru, Karnataka, India Q1 Technologies Full time

    We are currently looking to fill the AWS Principal Architect role and would appreciate it if you could share suitable profiles for this position For your reference I have attached the job description JD Please feel free to reach out if you have any questions or need further clarification Below are the key guidelines for submitting profiles The candidate...

  • AWS Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, PySpark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • Aws data engineer

    1 week ago


    Bengaluru, Karnataka, India Acme Services Full time

    We are seeking an AWS Data Engineer skilled in AWS, Python, Py Spark, Glue, S3, Lambda, and other AWS data services. The role involves designing and implementing scalable data pipelines, performing ETL processes, and optimizing data workflows on AWS. Candidates must have hands-on experience with cloud-based data solutions, strong coding skills in Python, and...

  • AWS Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Teamware Solutions Full time

    About the Company Greetings from Teamware Solutions a division of Quantum Leap Consulting Pvt. Ltd About the Role We are hiring an AWS Data Engineer Location: Bangalore Work Model: Hybrid Experience: 5-7 years Notice Period: Immediate- 15 days Open roles: 22 Data Engineer: Data Engineer, DevOps, Data Modeller, QA, Business systems...

Principal AWS Data Engineer

4 weeks ago


Bengaluru, Karnataka, India NorthStar HR Consultants Full time

Job Summary:

In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the Data Engineering organization to design and implement scalable data infrastructure and processes using technologies such as Python, PySpark, EMR Serverless, Iceberg, Glue and Glue Data Catalog. The main goal of this position is to ensure successful migration and establish robust data quality governance across the new platform, enabling reliable and efficient data processing. Success in this role requires deep technical expertise, exceptional problem-solving skills, and the ability to lead and mentor within an agile team.

Must Have Tech Skills:

● Prior Principal Engineer experience, leading team best practices in design, development, and implementation, mentoring team members, and fostering a culture of continuous learning and innovation

● Extensive experience in software architecture and solution design, including microservices, distributed systems, and cloud-native architectures.

● Expert in Python and Spark, with a deep focus on ETL data processing and data engineering practices.

● Deep technical knowledge of AWS data services and engineering practices, with demonstrable experience of implementing data pipelines using tools like EMR, AWS Glue, AWS Lambda, AWS Step Functions, API Gateway, and Athena

● Experience of delivering Lakehouse solutions/architectures

Nice To Have Tech Skills:

● Knowledge of additional programming languages and development tools to provide flexibility and adaptability across varied data engineering projects

● A master's degree or relevant certifications (e.g., AWS Certified Solutions Architect, Certified Data Analytics) is advantageous

Key Accountabilities:

● Lead complex projects autonomously, fostering an inclusive and open culture within development teams. Mentor team members and lead technical discussions.

● Provides strategic guidance on best practices in design, development, and implementation.

Leads the development of high-quality, efficient code and develops necessary tools and applications to address complex business needs

● Collaborates closely with architects, Product Owners, and Dev team members to decompose solutions into Epics, leading the design and planning of these components.

● Drive the migration of existing data processing workflows to a Lakehouse architecture, leveraging Iceberg capabilities.

● Serves as an internal subject matter expert in software development, advising stakeholders on best practices in design, development, and implementation

Key Skills:

● Deep technical knowledge of data engineering solutions and practices. Expert in AWS services and cloud solutions, particularly as they pertain to data engineering practices

● Extensive experience in software architecture and solution design

● Specialized expertise in Python and Spark

● Ability to provide technical direction, set high standards for code quality, and optimize performance in data-intensive environments.

● Skilled in leveraging automation tools and Continuous Integration/Continuous Deployment (CI/CD) pipelines to streamline development, testing, and deployment.

● Exceptional communicator who can translate complex technical concepts for diverse stakeholders, including engineers, product managers, and senior executives.

● Provides thought leadership within the engineering team, setting high standards for quality, efficiency, and collaboration. Experienced in mentoring engineers, guiding them in advanced coding practices, architecture, and strategic problem-solving to enhance team capabilities.

Educational Background:

● A bachelor's degree in computer science, Software Engineering, or a related field is essential.