Engineer Ii

You Lead the Way We ve Got Your Back With the right backing people and businesses have the power to progress in incredible ways When you join Team Amex you become part of a global and diverse community of colleagues with an unwavering commitment to back our customers communities and each other Here you ll learn and grow as we help you create a career journey that s unique and meaningful to you with benefits programs and flexibility that support you personally and professionally At American Express you ll be recognized for your contributions leadership and impact every colleague has the opportunity to share in the company s success Together we ll win as a team striving to uphold our and powerful backing promise to provide the world s best customer experience every day And we ll do it with the utmost integrity and in an environment where everyone is seen heard and feels like they belong Join Team Amex and let s lead the way together What we re looking for You re a talented creative and motivated engineer who loves developing powerful stable and intuitive apps - and you re excited to work with a team of individuals with that same passion You ve accumulated years of experience and you re excited about taking your mastery of Cloud Big Data and Java to a new level You enjoy challenging projects involving big data sets and are cool under pressure You re no stranger to fast-paced environments and agile development methodologies - in fact you embrace them With your strong analytical skills your unwavering commitment to quality your excellent technical skills and your collaborative work ethic you ll do great things here at American Express Purpose of the Role American Express is on a path to migrate big data workloads from on-prem to a cloud hosted solution There are hundreds of usecases who would be adopting to this change and plan to move their usecases from On-prem Big data cluster to GCP native warehouse As an Engineer you will deliver technical solutions using cutting edge technologies and industry best practices to implement cloud native tools and help usecases in this large scale migration You should have experience in architecting deploying automating cloud-based data platforms You should be well versed in technologies such as GCP Big data Java Scala Spark Kafka APIs Python RDBMS NoSQL etc You should have experienced in building and using low code no code data transformation tools for setting up complex rules Responsibilities As a Big Data Engineer you ll be responsible for designing and building high performance and scalable data platforms You should be a quick learner to understand user needs and guide them towards most suitable path You will be required to effectively collaborate with product teams from business group and understand the user needs requirements roadmap and vision of different tooling You will ride high on creating automated tools that will cater to multiple usecases and speed up the enablement process You will work with a variety of teams and individuals including platform engineers usecase owners analytical users to understand their needs and come up with innovative solutions You will follow the Amex-way of building engineering products that leads to engineering excellence by adopting DevOps principals Qualifications Bachelor s degree in Computer Science Engineering or a related field Master s degree would be a plus Great to have - GCP professional certification - Data Engineer Cloud Architect will be preferable 3 years of software development experience with hands-on expertise in coding in Java Python Scala etc 2 years of experience in setting up ETL jobs on low-code UI 2 years of experience in using GCP cloud tools such as BigQuery Data Proc Data Flow Cloud SQL Pub Sub etc Strong SQL RDBMS skills Expert in writing complex SQLs for different databases such as Hive MySQL Postgres etc Proficiency in working with NoSQL databases as well Experience working with Spark Big Data and Hive Experience in Git Management including PR reviews maintaining code hygiene In-depth understanding of data warehousing concepts dimensional modelling and data integration techniques Experience in optimising high volume data processing jobs Hands-on experience on CICD pipelines Automated test frameworks DevOps and source code management will be a big plus XLR Jenkins Git Stash Jira Confluence Splunk etc Experience working in Agile SAFe framework for development Excellent communication and analytical skills Excellent team-player with ability to work with global team We back you with benefits that support your holistic well-being so you can be and deliver your best This means caring for you and your loved ones physical financial and mental health as well as providing the flexibility you need to thrive personally and professionally Competitive base salaries Bonus incentives Support for financial-well-being and retirement Comprehensive medical dental vision life insurance and disability benefits depending on location Flexible working model with hybrid onsite or virtual arrangements depending on role and business need Generous paid parental leave policies depending on your location Free access to global on-site wellness centers staffed with nurses and doctors depending on location Free and confidential counseling support through our Healthy Minds program Career development and training opportunities American Express is an equal opportunity employer and makes employment decisions without regard to race color religion sex sexual orientation gender identity national origin veteran status disability status age or any other status protected by law Offer of employment with American Express is conditioned upon the successful completion of a background verification check subject to applicable laws and regulations