Bison Global Technology Search | Cloud Data Engineer

5 days ago

mysore, India Bison Global Technology Search Full time

Cloud Data Engineer is required - 100% Remote working

IMMEDIATE JOINER REQUIRED


Cloud Data Engineer is required ASAP


With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.

You should also have strong experience with Spark and Scala for data processing and have data extraction from SAP / ERP system experience


  • You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes.


  • Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential.



Key Responsibilities:


Design and Development:

  • Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
  • Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
  • Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, BigQuery and Azure Synapse.
  • Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
  • Develop and optimize data processing jobs using Spark Scala.

Data Integration and Management:

  • Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
  • Ensure data quality and integrity through rigorous testing and validation.
  • Perform data extraction from SAP or ERP systems when necessary.

Performance Optimization:

  • Monitor and optimize the performance of data pipelines and ETL processes.
  • Implement best practices for data management, including data governance, security, and compliance.

Collaboration and Communication:

  • Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
  • Collaborate with cross-functional teams to design and implement data solutions that meet business needs.

Documentation and Maintenance:

  • Document technical solutions, processes, and workflows.
  • Maintain and troubleshoot existing ETL pipelines and data integrations.


Essential experience must include


  • 7+ years of experience as a Data Engineer or in a similar role.
  • Proven experience with cloud platforms: AWS, Azure, and GCP.
  • Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
  • Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
  • Experience in building and managing data lakes and data warehouses.
  • Proficiency with data platforms like Redshift, Snowflake, BigQuery, Databricks, and Azure Synapse.
  • Experience with data extraction from SAP or ERP systems is a plus.
  • Strong experience with Spark and Scala for data processing.
  • Strong programming skills in Python, Java, or Scala.
  • Proficient in SQL and query optimization techniques.
  • Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
  • Knowledge of data governance, security, and compliance best practices.
  • Excellent problem-solving and analytical skills.
  • Strong communication and collaboration skills.


Preferred Qualifications:

  • Experience with other data tools and technologies such as Apache Spark, or Hadoop.
  • Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).
  • Experience with CI/CD pipelines and DevOps practices for data engineering

  • Cloud Engineering Manager

    2 weeks ago

    Mysore, Karnataka, India InOrg Global Full time

    Job SummaryWe are seeking a highly skilled Senior DevOps Engineer to join our team at InOrg Global. As a key member of our engineering team, you will be responsible for designing and implementing our DevSecOps solutions, ensuring rigorous approval processes for deploying into each environment, and managing cloud resources across AWS, Azure, and GCP.This role...

  • Global DevOps Strategist

    2 weeks ago

    Mysore, Karnataka, India InOrg Global Full time

    About InOrg GlobalInOrg Global empowers organizations to achieve global competitiveness through seamless integration of talent, technology, and strategic capabilities.We help companies augment their capabilities to rapidly scale their teams and meet evolving business demands as a Global Capability Center Partner.Senior DevOps Engineer Job DescriptionWe are...

  • Cloud Engineering Professional

    3 weeks ago

    Mysore, Karnataka, India Tata Consultancy Services Full time

    Job Title: Cloud Engineering Professional - Big Data SpecialistAbout the Role:In this exciting role as a Cloud Engineering Professional - Big Data Specialist at Tata Consultancy Services, you will be responsible for designing and implementing big data solutions using Google Cloud Platform (GCP) technologies. With a focus on delivering high-quality results,...

  • Cloud Solutions Architect

    2 weeks ago

    Mysore, Karnataka, India InOrg Global Full time

    About the RoleInOrg Global is seeking a highly skilled Senior DevOps Engineer to lead the design and implementation of our DevSecOps solutions, encompassing CI/CD pipelining.The ideal candidate will have extensive experience in DevSecOps methodologies, with a proven track record of successful implementation.They will be responsible for ensuring rigorous...

  • Senior Cloud Data Architect

    3 weeks ago

    Mysore, Karnataka, India Nisum Full time

    We are seeking a highly skilled Senior Cloud Data Architect to join our dynamic team at Nisum. This role is ideal for professionals with a solid background in cloud technologies, data engineering, and ETL.About the Role:This position plays a key role in designing and implementing data-intensive solutions, ensuring data governance, and building scalable data...

  • Cloud Architecture Lead

    2 weeks ago

    Mysore, Karnataka, India InOrg Global Full time

    Job Title: Senior DevOps EngineerWe are seeking a highly skilled Senior DevOps Engineer to join our team at InOrg Global. As a Senior DevOps Engineer, you will play a critical role in leading the design and implementation of our DevSecOps solutions.Key responsibilities include:Designing and implementing DevSecOps solutions that ensure robust security and...

  • Cloud Engineer

    1 month ago

    Mysore division, India Amossys Consulting Services Full time

    Position Title: Cloud Engineer Experience Required: 4+ yearsEmployment Type: PermanentEmployment Mode: Onsite/HybridLocation: IndiaIndustry: Information Technology (IT) services and ConsultingJob Summary:We're seeking a skilled Cloud Engineer to join a top-tier global MNC - Information Technology (IT) services and Consulting industry. They provide services...

  • DevOps Engineer Leader

    2 weeks ago

    Mysore, Karnataka, India InOrg Global Full time

    About the CompanyInOrg Global helps organizations achieve global competitiveness through seamless integration of talent, technology, and strategic capabilities.We are a global capability center partner to companies of all sizes, from startups to Fortune 500s, augmenting clients' capabilities to rapidly scale their teams and meet evolving business demands.Our...

  • Google Cloud Data Engineer

    1 month ago

    Mysore division, India Tata Consultancy Services Full time

    Greetings from TCS!!Job Title: Google Cloud Data EngineerJob location: Bengaluru , KolkataExperience Range: 10-12 YearsMinimum Qualification:15 years of full-time educationJob Description:Experience on BigQuery, Cloud Storage or equivalent cloud platforms• Knowledge of BigQuery ingress and egress patterns• Experience in writing Airflow DAGs• Knowledge...

  • Search Engine Optimization Executive

    2 weeks ago

    Mysore division, India Recooty Full time

    DescriptionWe are seeking a talented SEO Executive to join our Indore team. As a SEO Executive, your primary focus will be on implementing strategies to increase organic search rankings, drive traffic to websites, and enhance overall visibility in search engine results.About RecootyRecooty is a dynamic US-based startup, headquartered in Indore, Central...

  • Senior Systems Architect

    2 weeks ago

    Mysore, Karnataka, India InOrg Global Full time

    About the PositionInOrg Global is looking for a talented Senior DevOps Engineer to lead the design and implementation of our DevSecOps solutions. As a key member of our team, you will be responsible for ensuring the efficient and secure deployment of our applications, leveraging cloud technologies and Agile development methodologies.This role is ideal for an...

  • Cloud Infrastructure Engineer

    3 weeks ago

    Mysore, Karnataka, India Aurigo Software Technologies Pvt Ltd Full time

    **Company Overview**Aurigo Software Technologies Pvt Ltd is a leading provider of cloud-based software solutions for the construction and infrastructure industries.We are seeking an experienced Cloud Infrastructure Engineer to join our team in Bengaluru, India. The successful candidate will play a key role in designing, implementing, and maintaining highly...

  • Andela | Data Engineer | mysore

    1 month ago

    mysore, India Andela Full time

    Data EngineerAndelaLocation Requirement: IndiaAbout AndelaAndela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with...

  • Cloud Infrastructure Engineer

    4 weeks ago

    Mysore, Karnataka, India Tech Mahindra Full time

    We are seeking a highly skilled Cloud Infrastructure Engineer to join our team in Tech Mahindra, India. As a key member of our cloud infrastructure team, you will be responsible for designing, implementing, and maintaining scalable and reliable cloud infrastructure on Google Cloud Platform (GCP).Key Responsibilities:Design and implement secure, scalable, and...

  • DevOps Leader

    2 weeks ago

    Mysore, Karnataka, India InOrg Global Full time

    About the RoleAs a Senior DevOps Engineer at InOrg Global, you will lead the design and implementation of our DevSecOps solutions, encompassing CI/CD pipelining.This role is ideal for an experienced professional with extensive knowledge in DevSecOps methodologies, cloud technologies, and Agile development methodologies. If you are passionate about driving...

  • Live Connections | GCP Data Engineer

    3 weeks ago

    Mysore, India Live Connections Full time

    Exp: 5yrs to 8yrsPrimary skills :GCP DataBig queryCloud storagePUB/SUBData flowAirflowRequired Skills:5 years of experience in data engineering, with a focus on GCP services.Proficiency in using GCP services such as BigQuery, Dataflow, Pub/Sub, and Cloud Storage.Strong experience with Apache Airflow for workflow orchestration.Solid understanding of ETL...

  • Akaike Technologies | Lead Data Scientist

    3 weeks ago

    Mysore, India Akaike Technologies Full time

    Role:Lead Data Scientist / Senior Data ScientistLocation:Bengaluru & Chennai (Hybrid)Experience:5-8 yearsCompany Overview:Akaike Technologies is a dynamic and innovative AI-driven company dedicated to building impactful solutions across various domains. Our mission is to empower businesses by harnessing the power of data and AI to drive growth, efficiency,...

  • Google Cloud Platform

    3 weeks ago

    Mysore division, India Strative Full time

    Job SummaryWe are seeking an experienced GCP Engineer to design and implement scalable cloud infrastructure for our AI-powered document processing platform. Working directly with the CTO, you will architect cost-efficient infrastructure using Infrastructure as Code (IaC) principles for high-volume document processing and LLM API integration. This...

  • Strategic Marketing Leader for Global Growth

    2 weeks ago

    Mysore, Karnataka, India ProductLife Group Full time

    ProductLife Group is a leading company in the LifeSciences sector, seeking an experienced Growth Marketing Director to spearhead our marketing efforts. As a key member of our team, you will work closely with the Global Head of Marketing to develop and implement a comprehensive growth strategy that drives business success.The ideal candidate will be a...

  • Java Backend Developer

    4 weeks ago

    Mysore, Karnataka, India L&T Technology Services Full time

    We are seeking a highly skilled Java Backend Developer with expertise in cloud services to join our team at L&T Technology Services.Estimated Salary: ₹1,200,000 - ₹1,800,000 per annum based on experience and locationAbout the Job:The ideal candidate will have hands-on experience in developing RESTful APIs using Java 8 and above, Spring Boot, and WebAPI....