Bison Global Technology Search | Cloud Data Engineer

3 days ago


india Bison Global Technology Search Full time

Cloud Data Engineer is required - 100% Remote working

IMMEDIATE JOINER REQUIRED


Cloud Data Engineer is required ASAP


With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.

You should also have strong experience with Spark and Scala for data processing and have data extraction from SAP / ERP system experience


  • You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes.


  • Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential.



Key Responsibilities:


Design and Development:

  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management:

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.

Performance Optimization:

  • Monitor and optimize the performance of data pipelines and ETL processes.
  • Implement best practices for data management, including data governance, security, and compliance.

Collaboration and Communication:

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.

Documentation and Maintenance:

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing ETL pipelines and data integrations.


Essential experience must include


  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms: AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.
  • Strong programming skills in Python, Java, or Scala.
  • Proficient in SQL and query optimization techniques.
  • Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
  • Knowledge of data governance, security, and compliance best practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.


Preferred Qualifications:

  • Experience with other data tools and technologies such as Apache Spark, or Hadoop.
  • Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).
  • Experience with CI/CD pipelines and DevOps practices for data engineering



  • india Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.You will be responsible for designing,...


  • india Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working IMMEDIATE JOINER REQUIREDCloud Data Engineer is required ASAPWith a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data...


  • India Bison Global Technology Search Full time

    At Bison Global Technology Search, we are seeking a highly skilled Cloud Data Engineer to join our team. This role involves designing and implementing robust data pipelines and building scalable data lakes using cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data...


  • India Bison Global Technology Search Full time

    Job Description:Bison Global Technology Search is seeking an experienced Cloud Data Engineer to join our team.As a Cloud Data Engineer at Bison Global Technology Search, you will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes. You will work closely with cross-functional teams to design and...


  • India Bison Global Technology Search Full time

    About the RoleWe are seeking an experienced Cloud Data Engineer to join our team at Bison Global Technology Search.Job Summary:The ideal candidate will have a strong background in cloud-native ETL tools and extensive experience with data extraction from SAP/ERP systems.Key Responsibilities:Design, develop, and maintain scalable ETL pipelines using...


  • India Bison Global Search Full time

    **Job Overview**Bison Global Search is a leader in Test and Measurements solutions, empowering customers to accelerate innovation cycles and achieve success.As an Executive Business Development Manager, you will educate and consult prospective customers on building test solutions for their technology products, helping them drive growth and trust in our...


  • india Bison Global Search Full time

    Our client a large product company in Chennai is looking for Firmware Development Engineers with experience in between 2-6 years for multiple roles Our client is conducting a recruitment drive on Saturday 7th December and we are looking for candidates who can attend the interview this Saturday The role would require someone who is interested in working...


  • india Bison Global Search Full time

    Our client a large product company in Chennai is looking for Firmware Development Engineers with experience in between 2-6 years for multiple rolesOur client is conducting a recruitment drive on Saturday 7th December and we are looking for candidates who can attend the interview this SaturdayThe role would require someone who is interested in working on BIOS...

  • Cloud Data Engineer

    6 days ago


    India Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working IMMEDIATE JOINER REQUIREDCloud Data Engineer is required ASAPWith a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data...

  • Cloud Data Engineer

    5 days ago


    India Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working IMMEDIATE JOINER REQUIRED Cloud Data Engineer is required ASAP With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP...

  • Cloud Data Engineer

    2 weeks ago


    India Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.You will be responsible for designing,...

  • Cloud Data Engineer

    2 weeks ago


    India Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc. You will be responsible for designing,...


  • india Bison Global Search Full time

    Job DescriptionOur Client is a leader in Test and Measurements and continues to build Test solutions for latest technologies that are shaping the world and making it a better place every day. As an Account Manager, you educate and provide consultation to prospective customers on how to build a test solution for their upcoming technology products. You help...


  • India Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working IMMEDIATE JOINER REQUIREDCloud Data Engineer is required ASAPWith a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data...

  • Cloud Data Engineer

    1 hour ago


    India Bison Global Technology Search Full time

    Cloud Data Engineer is required - 100% Remote working IMMEDIATE JOINER REQUIRED Cloud Data Engineer is required ASAP With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP...


  • india VXI Global Solutions Full time

    We are looking Data Engineers to join our dynamic team and contribute to our mission of harnessing the power of data to drive growth and success. As a Data Engineer at VXI Global Solutions, you will play a critical role in designing, implementing, and maintaining our data infrastructure to support our customer experience and management initiatives. You will...


  • india HTC Global Services Full time

    About the Company - HTC Global Services serves the customers in Digital, Cloud platforms in Application Development &Maintenance, ERP Implementation, Packages/ IP Solutions & Products. Please visit the website in the link below: to have Project management skills. About the Role - Looking for Azure Data Engineer who has good exposure in ADF, Azure SQL,...


  • India Dyntech | Financial Technology Development Full time

    Role Overview:As an SEO Specialist at VeraTrade, you will play a pivotal role in driving organic traffic and visibility for our clients' online presence. Leveraging your deep expertise in search engine optimization, you will be responsible for developing and implementing comprehensive strategies to help our clients rank higher in search engine results.Key...


  • India Dyntech | Financial Technology Development Full time

    Role Overview: As an SEO Specialist at VeraTrade, you will play a pivotal role in driving organic traffic and visibility for our clients' online presence. Leveraging your deep expertise in search engine optimization, you will be responsible for developing and implementing comprehensive strategies to help our clients rank higher in search engine results. Key...


  • India DeepConverse Full time

    At DeepConverse, we're seeking a highly skilled Senior Search Technology Expert to join our team. This role offers the opportunity to work on challenging search problems at scale and implement cutting-edge search technologies.Salary: $120,000 - $180,000 per yearAbout the RoleWe're looking for an experienced Search/Information Retrieval Engineer to design,...