GCP Dataflow Engineer

4 weeks ago


Bangalore, Karnataka, India Swift Strategic Staff Solutions INC Full time

Job Description :

We are looking for a highly skilled GCP Dataflow Engineer to join our team.

As a GCP Dataflow Engineer, you will be responsible for developing and maintaining data processing pipelines using Google Cloud Platform (GCP) services, particularly Apache Beam and Dataflow.

You will leverage your expertise in Java programming, data processing concepts, and GCP technologies to design and implement efficient and scalable data processing solutions.

Responsibilities :

- Develop and maintain data processing pipelines using Apache Beam and Google Cloud Dataflow.

- Utilize your proficiency in Java ecosystems, including OOPs patterns, writing reusable Java libraries, concurrency patterns, MVC patterns, and JDBC, to implement robust and efficient code.

- Implement clean and maintainable code, adhering to best practices and coding standards.

- Utilize code versioning tools like Git for efficient collaboration and version control.

- Leverage your experience with GCP services to design and implement data processing solutions that meet business requirements.

- Hands-on knowledge of Apache Beam, Dataflow, Beam SQL, and GSUtil commands for efficient data processing and manipulation.

- Collaborate with cross-functional teams to integrate data processing pipelines with other systems and applications.

- Act as a subject matter expert on GCP Dataflow and related technologies, providing guidance and support to team members as needed.

Skillset :

- Proficient in Java ecosystems, OOPs patterns, and concepts.

- Strong experience in writing reusable Java libraries and implementing concurrency patterns.

- Familiarity with MVC patterns and JDBC for database interactions.

- Ability to write clean and maintainable code, with experience using code versioning tools like Git.

- Hands-on experience with Google Cloud Platform (GCP), particularly GCP Dataflow and Apache Beam.

- Experience with Beam SQL and GSUtil commands for data manipulation and management.

- Knowledge of REST API development, BigQuery, and Airflow is a plus.

Qualifications :

- Bachelor's degree in Computer Science, Engineering, or related field.

- 3+ years of experience in Java development, with a focus on data processing.

- 1+ years of experience working with Google Cloud Platform (GCP) services, particularly Dataflow and Apache Beam.

- Strong analytical and problem-solving skills.

- Excellent communication and collaboration skills.

(ref:hirist.tech)

  • Bangalore, Karnataka, India RapidBraiins Full time

    Position : AI/ML Engineer. Experience Required : 5 10 years, with a minimum of 3 years focused on AI and machine learning.Location : Bangalore. Notice Period : 0-30 days. Job Description :- Develop and deploy machine learning models using relevant Google Cloud Platform (GCP) services like Vertex AI and BigQuery ML.- Collaborate with cross-functional teams to...


  • Bangalore, Karnataka, India RapidBraiins Full time

    Position : AI/ML Engineer. Experience Required : 5 10 years, with a minimum of 3 years focused on AI and machine learning.Location : Bangalore. Notice Period : 0-30 days. Job Description :- Develop and deploy machine learning models using relevant Google Cloud Platform (GCP) services like Vertex AI and BigQuery ML.- Collaborate with cross-functional teams to...

  • Lead Data Engineer

    2 months ago


    Bangalore, Karnataka, India Aryan Solutions Pte Ltd Full time

    We are urgently looking for Lead Data Engineer. Location : Bangalore ( Remote). Job Description : - Experience with GCP technologies (BigQuery, DataFlow, PubSub) and DBT. - Strong experience in Java is required.- Candidates without Java experience will not be considered.- Apart from Java, it is preferable but not necessary to have Python and NodeJS...

  • Lead Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Aryan Solutions Pte Ltd Full time

    We are urgently looking for Lead Data Engineer. Location : Bangalore ( Remote). Job Description : - Experience with GCP technologies (BigQuery, DataFlow, PubSub) and DBT. - Strong experience in Java is required.- Candidates without Java experience will not be considered.- Apart from Java, it is preferable but not necessary to have Python and NodeJS...


  • Bangalore, Karnataka, India Grizmo Labs Full time

    Requirements :- Experience with GCP technologies (BigQuery, DataFlow, PubSub) and DBT.- Strong experience in Java is required. - Candidates without Java experience will not be considered.- Apart from Java, candidates must be able to understand the trade-off between performance, simplicity, maintainability, and timeline constraints when developing software...

  • Senior Data Engineer

    2 months ago


    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...

  • Senior Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India TecHHire Global Full time

    Job Description :We are looking for a Senior Data engineer-GCP who can design and build production data pipelines from ingestion to consumption within a big data architecture using Python, Scala, PySpark, Java implementing data engineering, ingestion, and curation functions on GCP :Must be able to write quality code and build secure, highly available...

  • Data Engineer

    4 weeks ago


    Bangalore, Karnataka, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India Acsa Technologies Private Limited Full time

    Details JD :- 5+ years working experience as a data or software engineer in a fast-paced growing company.- Excellent SQL and Python knowledge strong hands-on data modeling and data warehousing skills and experience in transformations orchestrated through technologies such as dbt/cloud dataflow would be a plus.- Strong experience applying software engineering...

  • Senior APIGEE Engineer

    2 months ago


    Bangalore, Karnataka, India SKANDHA IT SERVICES PRIVATE LIMITED Full time

    About the job:Role: Senior Apigee engineer Location: Remote (India)Full timeRequirements:- Certification in Google Cloud Platform (GCP) or equivalent experience.- Proven experience designing and implementing API solutions using Apigee- Strong understanding of API management principles, including security, scalability, and performance optimization.-...


  • Bangalore, Karnataka, India Radhamani Textiles Pvt Ltd Full time

    Job Summary :We are seeking a highly skilled BigQuery and Database Engineer to join our team. The ideal candidate will have extensive experience in managing and optimizing databases, with a specific focus on Google BigQuery. You will be responsible for designing, implementing, and maintaining our data infrastructure to ensure high performance, scalability,...


  • Bangalore, Karnataka, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget : Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...


  • Bangalore, Karnataka, India Notus Full time

    Job Title : GCP (Google Cloud Platform) SpecialistNumber of Positions : 6 (1 Senior Role, 5 Lead Roles)Shift : 12 : 00 PM to 9 : 00 PM OR 1 : 00 PM to 10 : 00 PMLocation : TechM India locationsNotice Period : Early/Immediate/30 days (Positions need to be filled by May)Budget : Senior Role : 4 to 5/6 years of experience - Depending upon hike % and candidate...

  • Radhamani Textiles

    3 weeks ago


    Bangalore, Karnataka, India Radhamani Textiles Pvt Ltd Full time

    Job Summary :We are seeking a highly skilled BigQuery and Database Engineer to join our team. The ideal candidate will have extensive experience in managing and optimizing databases, with a specific focus on Google BigQuery. You will be responsible for designing, implementing, and maintaining our data infrastructure to ensure high performance, scalability,...

  • Data Engineer

    2 months ago


    Bangalore/Hyderabad, Karnataka, India Growel Softech Pvt. Ltd. Full time

    Job Description :Role : Data EngineerRequired Technical Skills :- More than 5 years' experience implementing data solutions- Strong proficiency in Python with an emphasis in building data pipelines- Experience in big data technologies like HDFS, YARN, Map-Reduce, Kafka, Spark, Airflow, etc.- Experience with Apache Airflow, Google Composer and dataflow-...

  • Data Engineer

    2 months ago


    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Data Engineer

    3 weeks ago


    Bangalore, Karnataka, India CYBERSAPIENT TECHNOLOGIES PRIVATE LIMITED Full time

    Company Description : CST Cyber Sapient is a company dedicated to helping clients achieve advocacy through exceptional product and service experiences. We work closely with our clients to drive change within their organization and provide support in areas such as strategic vision, product innovation, user experience, talent support, and technical delivery....

  • Unison Consulting

    2 months ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....

  • Unison Consulting

    3 weeks ago


    Bangalore, Karnataka, India Unison consulting pte ltd Full time

    About the Role:We are seeking a talented Solution Architect to join our team and play a key role in designing and implementing innovative big data solutions. You will be responsible for translating business needs into scalable, reliable, and high-performance technology architectures, leveraging your expertise in Databricks and other big data technologies....


  • Bangalore, Karnataka, India ARR Recruitment Solutions Full time

    Job Description : We are seeking a skilled and experienced SQL and Tableau Developer to join our team.- The ideal candidate will have a minimum of 5 years of experience with strong proficiency in SQL, advanced SQL techniques, and Tableau visualization tools.- The candidate should be adept at building different charts and collaborating effectively with...