Java Developer with Dataflow and Apache Beam

1 week ago


Bengaluru, Karnataka, India Luxoft Full time

Project description

The Cirrus project is developing cloud-based compliance state-of-the-art archive products to archive and retain real time communications data in line with internal and external regulatory requirements. The product is developed in-house in an agile development setup, based on business requirements from multiple stakeholder parties. By employing continuous development and deployment principles, the team is aiming to transition from project to product management to support the bank with a robust compliance archive solutions for the next decade. For large global investment bank we are looking for GCP-qualified cloud engineers to help with the FIC (fixed income and currencies) cloud migrations under project Cirrus.
Knowledge of Financial Services/FIC would be great - but the primary skills we need are in building, migrating and deploying applications to GCP, terraform module coding, google infrastructure, cloud-native services such as GCE, GKE, CloudSQL/Postgres, logging and monitoring, etc. & good written and spoken English, as we would like these engineers to help with knowledge transfer to our existing development & support teams.
We would like to place people alongside the engineers they'll be working with in the bank.

Responsibilities

  • Using one of the Apache Beam SDKs, Team build a program that defines the pipeline. Then, one of Apache Beam's supported distributed processing backends, such as Dataflow, executes the pipeline. This model let team concentrate on the logical composition of application data processing job, rather than the physical orchestration of parallel processing.

SKILLS

Must have

  • Team is looking Senior Developer ( 6 to 8 Years)
  • Apache Beam with GCP & java
  • Cloud Data flow
  • Data Pipeline
  • Cloud pub/sub
  • Big Query
  • Cloud Composer - Airflow

Nice to have

Banking Domain



  • Bengaluru, Karnataka, India U-SET Full time

    Java GCP Dataflow Developer Minimum 5+ of relevant experience in full stack Java development with 2+ years in GCPJob Overview : The Java GCP Dataflow developer will be responsible for the design, development, and deployment of highperformance, scalable, and reliable Java applications with GCP . The ideal candidate will have a strong understanding of Java,...


  • Bengaluru, Karnataka, India Tredence Inc. Full time

    Role - GCP Data EngineerExperience : 5~9 yearsPreferred Data Engineering BackgroundHybrid role fromBangalore, Chennai, Pune, Gurgaon, KolkataHere is the job description for the same -Job Requirement:Have Implemented and Architected solutions on Google Cloud Platform using the components of GCPExperience with Apache Beam/Google Dataflow/Apache Spark in...

  • GCP Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Tredence Inc. Full time

    Have Implemented and Architected solutions on Google Cloud Platform using the components of GCPExperience with Apache Beam/Google Dataflow/Apache Spark in creating end to end data pipelines.Experience in some of the following:Python, Hadoop, Spark, SQL, Big Query, Big Table Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning.Experience programming...


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Pvt Ltd Full time

    Job LocationBangalore, Karnataka, IndiaJob DescriptionWe are looking for an analytical, big-picture thinker who is driven to enhance and further the mission of Tredence by delivering technology to internal business and functional stakeholders. You will serve as a leader to drive the IT strategy to create value across the organization. This Data Engineer will...

  • GCP Data Engineer

    1 week ago


    Bengaluru, Karnataka, India Tredence Inc. Full time

    Have Implemented and Architected solutions on Google Cloud Platform using the components of GCP Experience with Apache Beam/Google Dataflow/Apache Spark in creating end to end data pipelines. Experience in some of the following: Python, Hadoop, Spark, SQL, Big Query, Big Table Cloud Storage, Datastore, Spanner, Cloud SQL, Machine Learning. Experience...


  • Bengaluru, Karnataka, India PradeepIT Consulting Services Pvt Ltd Full time

    Job Location Bangalore, Karnataka, India Job Description We are looking for an analytical, big-picture thinker who is driven to enhance and further the mission of Tredence by delivering technology to internal business and functional stakeholders. You will serve as a leader to drive the IT strategy to create value across the organization. This Data Engineer...


  • Bengaluru, Karnataka, India Antal International Full time

    Job Description Bachelor's degree in computer science, engineering, or a related field. Equivalent work experience may be considered in lieu of a degree. Strong experience in designing, developing, and maintaining data pipelines and ETL processes on Google Cloud Platform (GCP). Proficiency in GCP data services, such as BigQuery, Dataflow, Pub/Sub,...


  • Bengaluru, Karnataka, India F335 Deutsche India Private Limited, Bangalore Branch Full time

    Deutsche Bank has set for itself ambitious goals in the areas of Sustainable Finance, ESG Risk Mitigation as well as Corporate Sustainability.As Climate Change throws new Challenges and opportunities, Bank has set out to invest in developing a Sustainability Technology Platform, Sustainability data products and various sustainability applications which will...

  • Java Developer

    1 week ago


    Bengaluru, Karnataka, India Dynpro India Pvt. ltd Full time

    Mandatory Skills for screening (Limit to top 5 and include version): Java Basics, 1.8 features such as Lambdas, Streams etc, Exception Handling, Junit, Apache Beam,Spring boot framework, Replicator framework(similar to Spring boot), Guice dependency Injection, SQL Good to have (Not Mandatory): Brog, Working knowledge on Google Cloud Platform Detailed Job...


  • Bengaluru, Karnataka, India KSmart Staffing Solutions Full time

    Position : Java Developer with Apache Flink, KafkaTechnical Stack: SQL, Postgres, GraphQLKafka, Flink, Neo4j Responsibilities:Excellent knowledge of Relational Databases, SQL and ORM technologies (JPA2, Hibernate)Experience with Apache Flink and its related ecosystem for real-time data processing.Experience of Apache Kafka, and micro-service is a...


  • Bengaluru, Karnataka, India Capgemini Full time

    Minimum 2 years' experience in GCP Data Engineering. Strong data engineering experience using Java or Python programming languages or Spark on Google Cloud. Should have worked on handling big data. Strong communication skills.- experience in Agile methodologies ETL, ELT skills, Data movement skills, Data processing skills. Certification on Professional...


  • Bengaluru, Karnataka, India F335 Deutsche India Private Limited, Bangalore Branch Full time

    Description Strong technical knowledge and experience in Java 8 and Enterprise Java Strong technical knowledge and hands on experience in Java frameworks – Spring Batch, Sprint Boot, and Hibernate. Strong technical knowledge and experience in Database - Oracle Should have sound knowledge in Build tools - maven(preferably), gradle. Should have...


  • Bengaluru, Karnataka, India NR Consulting - India Full time

    Job locations: Bangalore (Preferred)JD with Mandatory keyskill:Strong hands on knowledge on Apache SOLR and/or Lucid Works Fusion in the last 3 to 4 years.Mandatory skills: At least 8-10 years of experience in Java/J2EE and related technologies with sound understanding of design principles. Proven experience in designing and developing search solutions...

  • Java Specialist

    1 week ago


    Bengaluru, Karnataka, India Infogain Full time

    Job Description:Person with 5+ years of experience in development for senior role and 8+ years experience for lead role.Good hands-on knowledge on Core Java and should be able to write complex SQL queriesKnowledge on Apache BeamKnowledge on Any cloud technologies (GCP, AWS, Azure).Good communication and willing to work independentlyWilling to learn new...


  • Bengaluru, Karnataka, India Corporate Resources Full time

    Job Description7 years of experience in software design and development 5 years of experience in the data engineering field is preferred 3 years of Hands-on experience in GCP cloud data implementation suite such as Big Query, Pub Sub, Data Flow/Apache Beam, Airflow/Composer, Cloud Storage,Strong experience and understanding of very large-scale data...


  • Bengaluru, Karnataka, India F335 Deutsche India Private Limited, Bangalore Branch Full time

    Description Deutsche Bank has set for itself ambitious goals in the areas of Sustainable Finance, ESG Risk Mitigation as well as Corporate Sustainability. As Climate Change throws new Challenges and opportunities, Bank has set out to invest in developing a Sustainability Technology Platform, Sustainability data products and various sustainability...


  • Bengaluru, Karnataka, India Corporate Resources Full time

    Job Description 7 years of experience in software design and development 5 years of experience in the data engineering field is preferred 3 years of Hands-on experience in GCP cloud data implementation suite such as Big Query, Pub Sub, Data Flow/Apache Beam, Airflow/Composer, Cloud Storage, Strong experience and understanding of very large-scale data...


  • Bengaluru, Karnataka, India Quess Full time

    About Us: Quess IT Staffing is the biggest IT staffing company in India, with more than 20 years of experience placing IT professionals in 300+ companies across various levels and skill sets. Our 10,000+ associates work in 80+ cities, proficient in over 500 technological skills, helping deliver innovative solutions to top industries. Quess IT Staffing is...


  • Bengaluru, Karnataka, India F335 Deutsche India Private Limited, Bangalore Branch Full time

    Strong technical knowledge and experience in Java 8 and Enterprise JavaStrong technical knowledge and hands on experience in Java frameworks – Spring Batch, Sprint Boot, and Hibernate.Strong technical knowledge and experience in Database OracleShould have sound knowledge in Build tools maven(preferably), gradle.Should have sound knowledge in web server...


  • Bengaluru, Karnataka, India Blue Yonder Full time

    Overview :Embark on a leadership role within the Blue Yonder Data Science and Machine Learning team as a Staff Data Scientist, steering our machine learning platform that processes real-time data and powers deep learning models, generating billions of predictions daily. Collaborate closely with sales, product, and engineering teams to spearhead the design...