Big Data Developer

Role: Big Data + GCP Engineer.Location: Bengaluru, KA (Hybrid)Type: FulltimeWe are looking for energetic, high-performing and highly skilled Big Data + GCP Engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Enterprise Personalization portfolio focused on delivering the next generation global marketing capabilities. This team is responsible for building products that power Merchant Offers personalization for our members.Job Description:- Demonstrated leadership in designing sustainable software products, setting development standards, automated code review process, continuous build and rigorous testing etc- Ability to effectively lead and communicate across 3rd parties, technical and business product managers on solution design- Primary focus is spent writing code, API specs, conducting code reviews & testing in ongoing sprints or doing proof of concepts/automation tools- Applies visualization and other techniques to fast-track concepts- Functions as a core member of an Agile team driving User story analysis & elaboration, design and development of software applications, testing & builds automation tools- Works on a specific platform/product or as part of a dynamic resource pool assigned to projects based on demand and business priority- Design, develop, and deploy scalable applications on the Google Cloud Platform using Java 8 & above and Big Data technologies- In-depth understanding of Google Cloud Platform services and architecture.- Experience with containerization technologies such as Docker and Kubernetes is a plus.- Awareness of best practices for cloud-based application development, ensuring security, reliability, and efficiency.- Troubleshoot and resolve issues related to application performance and functionality on cloudQualification:- A Bachelor's degree in computer science, computer engineering, other technical discipline, or equivalent work experience- 7+ years of experience in software development; 3-5 years in leading teams of engineers- Demonstrated experience with Agile or other rapid application development methods- Demonstrated experience with object-oriented design and coding- Full-Stack development exposure- Demonstrated experience on these core technical skills (Mandatory)· Strong programming knowledge in Pyspark, Data processing· Hands-on experience in Big Data technologies (Spark, Hive, MapReduce and Hbase)· Understanding and experience with UNIX / Shell / Perl / Python scripting· Proficiency in developing and deploying applications on GCP using services such as Compute Engine, App Engine, Cloud Functions, Big Query, Cloud SQL, DataProc, DataFlow etc.· Database query optimization and indexing· Relational Database (PostGreS / MySQL / DB2 etc)· Data Serialization techniques (Ex: Avro)· Parallel & distributed (multi-tiered) systems· Application design, software development and automated testing.- Demonstrated experience on these additional technical skills (Nice to Have)· Web services design and implementation using REST / SOAP and Java· Message Queuing, Stream processing (Kafka)· Elastic Search· AJAX tools/ Frameworks.· Experience with implementing integrated automated release management using tools/technologies/frameworks like Maven, Git, code/security review tools, Jenkins, Automated testing and Junit.