Data Pipeline Architect

2 days ago

Mysore, Karnataka, India beBeeDataPipelineDeveloper Full time ₹ 37,50,000 - ₹ 52,50,000
Senior Data Pipeline Developer

Job Overview

As a Senior Data Pipeline Developer, you will be responsible for designing and implementing high-performance data pipelines using advanced ETL concepts and methodologies.

Key Responsibilities
  • Design and implement complex data pipelines utilizing ETL frameworks and tools such as SSIS and AWS Glue
  • Develop and maintain detailed test cases based on business and technical requirements to ensure data integrity and validation
  • Collaborate with cross-functional teams to identify and resolve defects in the data pipeline
  • Work closely with stakeholders to gather requirements and provide solutions that meet their needs
  • Stay up-to-date with industry trends and emerging technologies to continually improve data pipeline design and implementation
Requirements
  • 7+ years of experience in ETL development, data pipeline architecture, and testing
  • Strong understanding of advanced ETL concepts, data warehouse design, and database testing methodologies
  • Proficient in RDBMS: MySQL, Oracle SQL, and NoSQL databases
  • Hands-on experience with cloud-based platforms such as AWS, Azure, and Google Cloud Platform
  • Skilled in programming languages: Java, Python, and C#
  • Experience with automation tools such as Jenkins, Docker, and Kubernetes
  • Advanced SQL skills: joins, group functions, analytical functions, subqueries, and window functions
  • AWS services: CloudWatch, EventBridge, QuickSight, Batch Jobs, Lambda, S3, Redshift, Glue, and IAM
Desirable Skills
  • Experience with machine learning and artificial intelligence tools such as TensorFlow and PyTorch
  • CI/CD pipeline integration for automated testing and deployment
  • Containerization using Docker and Kubernetes

  • Data Pipeline Architect

    13 hours ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerAbout the RoleWe are seeking a seasoned professional to build data pipelines and integrate healthcare data.This role is critical in creating scalable pipelines that process clinical encounter data, retrieve associated medical documents, and deliver validated information to machine learning systems for inference.You will work...

  • Azure Data Pipeline Architect

    15 hours ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 21,00,000

    Job Overview:We are seeking a skilled professional to design and deploy robust data pipelines that support data governance and analytics initiatives. This role will focus on building production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage analysis, retention tracking, and metadata integration,...

  • Cloud Data Architect

    15 hours ago

    Mysore, Karnataka, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 12,00,000

    As a Data Architect on the Microsoft Azure platform, you will be responsible for designing and implementing scalable data architectures that meet business objectives.Key Responsibilities:Data Pipeline Development: Design and implement efficient data pipelines using Azure Data Factory, Apache Beam, or other relevant tools to ensure high-quality data...

  • Senior Data Solutions Architect

    2 days ago

    Mysore, Karnataka, India beBeeDataSolutions Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Data Solutions ArchitectAbout the RoleWe are seeking a highly skilled and experienced Senior Data Solutions Architect to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining large-scale data pipelines and ETL processes on Databricks.Key ResponsibilitiesDesign and...

  • Senior Data Architect

    2 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    We are seeking an experienced Senior Data Architect to join our dynamic team of consultants.This role involves designing, developing and maintaining large-scale data processing systems that enable advanced analytics and business intelligence. You will work closely with data scientists, analysts, and other engineers to ensure the availability, reliability and...

  • Data Intelligence Architect

    10 hours ago

    Mysore, Karnataka, India beBeeArtificialIntelligence Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Data Intelligence Architect">Job Description">We are seeking an exceptional Data Intelligence Architect to join our team. As a key member of our organization, you will play a pivotal role in designing and implementing scalable data intelligence platforms that integrate structured and unstructured data sources.">">Develop AI-Powered Data Pipelines:...

  • Senior Data Architect

    2 days ago

    Mysore, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job Title: Senior Data ArchitectWe are seeking a skilled and experienced Senior Data Architect to lead the design, development, and implementation of our data architecture strategy.The ideal candidate will have a strong background in data engineering, data science, and cloud computing, with experience in designing and implementing large-scale data...

  • Senior Data Architect Azure Databricks

    2 days ago

    Mysore, Karnataka, India beBeeAzureDatabricksExpert Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Architect Azure DatabricksWe are seeking a seasoned data architect to design and implement cutting-edge data solutions using Azure Databricks. As a key member of our team, you will be responsible for developing and optimizing complex data pipelines, ensuring data quality, security, and scalability.The ideal candidate has 8+ years of...

  • Visionary Data Cloud Architect

    7 hours ago

    Mysore, Karnataka, India beBeeDataCloudExpert Full time ₹ 17,28,105 - ₹ 23,10,800

    Sought after Salesforce Data Cloud Architect to spearhead innovative data cloud initiatives, leveraging 10+ years of hands-on expertise.This role demands deep understanding of Salesforce Data Cloud and proven leadership skills to guide technical teams, design scalable architectures, and drive enterprise-wide data-driven transformations.As a key player in...

  • Chief Data Architect

    2 days ago

    Mysore, Karnataka, India beBeeDataEngineer Full time ₹ 17,95,200 - ₹ 23,16,800

    Data Engineering RoleWe are seeking a skilled Data Engineer to design, build, and optimize scalable data pipelines.The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanced analytics initiatives.Design and build ETL/ELT pipelines using AWS Glue, Lambda, and...