Cloud Data Pipeline Specialist

1 day ago

Mysore, Karnataka, India beBeeInformatician Full time ₹ 20,00,000 - ₹ 30,00,000
Job Description:

We are seeking a highly experienced Informatica Engineer to design and develop cloud-based ETL pipelines using Azure services and integrate data into AWS Datalake or other modern data platforms.

This role involves working on cutting-edge cloud technologies to design, develop, and maintain scalable ETL pipelines using Azure Data Factory and related services.

The successful candidate will be responsible for processing, transforming, and loading large datasets into AWS Datalake or other data stores, collaborating with data architects, analysts, and business stakeholders to gather requirements and deliver efficient data solutions.

  • Design, develop, and maintain scalable ETL pipelines using Azure Data Factory and related services.
  • Process, transform, and load large datasets into AWS Datalake or other data stores.
  • Collaborate with data architects, analysts, and business stakeholders to gather requirements and deliver efficient data solutions.
  • Work closely with data scientists to build effective data workflows.
  • Create and manage data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.
  • Implement data validation and cleansing procedures to ensure data quality and integrity.
  • Monitor and troubleshoot data pipeline issues to ensure data availability and consistency.
  • Optimize pipelines for scalability, performance, and cost-efficiency.
Required Skills and Qualifications:Key Responsibilities:

A strong understanding of data warehouse modeling (Kimball, Inmon) and experience with API ingestion and streaming ingestion methods is essential.

Familiarity with DevOps (CI/CD) and Infrastructure as Code is also required.

  • Strong hands-on experience in Informatica and cloud-based analytics.
  • Expert-level knowledge of: Azure Data Factory, Azure Synapse Analytics, Azure, SQL, Azure Data Lake & Azure App Service.
  • Experience with API ingestion and streaming ingestion methods.
  • Familiarity with DevOps (CI/CD) and Infrastructure as Code.
  • Strong understanding of data warehouse modeling (Kimball, Inmon).
Benefits:

This role is ideal for individuals who are passionate about working with cutting-edge cloud technologies and want to take on exciting challenges.

  • Senior Cloud Architect

    3 days ago

    Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data Engineering Role">We are seeking a highly experienced data engineer with 5+ years of experience in designing, building, and optimizing scalable data pipelines and architectures on Google Cloud Platform (GCP).">The ideal candidate is hands-on with Google Cloud Storage (GCS), BigQuery, Apache Airflow, and Python, and is adept at managing complex...

  • Cloud Data Specialist

    7 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Cloud Data SpecialistAbout the Role:We are seeking a highly skilled data professional to join our team. The ideal candidate should have expertise in cloud-based data solutions and experience with Microsoft Azure services.The successful candidate will be responsible for designing, implementing, and maintaining robust data systems that support...

  • Data Pipeline Architect

    1 week ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerAbout the RoleWe are seeking a seasoned professional to build data pipelines and integrate healthcare data.This role is critical in creating scalable pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated information to machine learning systems for inference.You will work...

  • Data Pipeline Specialist

    3 days ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 75,00,000 - ₹ 1,20,00,000

    Data Engineering is a vital function within our organization, driving business growth and informing strategic decision-making.We're on a mission to revolutionize the food and beverage industry with our powerful cloud-based platform.As a Data Engineer, you'll design and optimize distributed data pipelines, infrastructure, and tools that power insights across...

  • Data Pipeline Specialist

    7 days ago

    Mysore, Karnataka, India beBeeetldeveloper Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Are you a data pipeline specialist looking for a new challenge?We have an exciting opportunity for an ETL Developer to join our team of talented professionals.In this role, you will be responsible for designing, developing, and maintaining efficient data pipelines using IBM DataStage and AWS Glue/Lambda. You will work closely with architects, business...

  • Cloud Data Specialist

    5 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Cloud Data Engineer Job DescriptionJob Overview:The role of a cloud data engineer involves developing, constructing, testing and maintaining data acquisition pipelines for large volumes of structured and unstructured data in Google Cloud.This includes batch and real-time processing. The candidate will be responsible for building large and complex datasets...

  • Data Pipeline Architect

    2 weeks ago

    Mysore, Karnataka, India beBeeDataPipelineDeveloper Full time ₹ 37,50,000 - ₹ 52,50,000

    Senior Data Pipeline DeveloperJob OverviewAs a Senior Data Pipeline Developer, you will be responsible for designing and implementing high-performance data pipelines using advanced ETL concepts and methodologies.Key ResponsibilitiesDesign and implement complex data pipelines utilizing ETL frameworks and tools such as SSIS and AWS GlueDevelop and maintain...

  • Senior Cloud Data Engineer

    5 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    Cloud Data SpecialistWe are seeking an experienced Cloud Data Specialist to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining scalable data pipelines and ETL processes using GCP services.Design, develop, and maintain scalable data pipelines and ETL processes using GCP services such as BigQuery, Cloud...

  • Cloud-Based Data Engineer

    5 days ago

    Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 20,00,000

    Job Title: Data Engineering SpecialistKey Responsibilities:Design, develop and optimize data pipelines to integrate multiple sources into cloud-based data platforms.Implement and maintain continuous integration/continuous deployment (CI/CD) pipelines for data workflows.Deploy and manage containerized applications using Kubernetes orchestration.Ensure data...

  • Chief Data Pipeline Architect

    5 days ago

    Mysore, Karnataka, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,20,000

    Cloud Data Engineer Job DescriptionWe are seeking an experienced Cloud Data Engineer to design and develop scalable ETL pipelines using cloud-native tools. The ideal candidate will have extensive experience with cloud platforms (AWS, Azure, GCP), data lakes, and warehouses.Key Responsibilities:Design and Development: Design scalable ETL pipelines, architect...