Data Pipeline Architect

15 hours ago

Thiruvananthapuram, Kerala, India beBeePipelines Full time US$ 1,20,000 - US$ 1,80,000

Job Overview

We are seeking a highly skilled Data Pipeline Architect to design, develop, and maintain large-scale data processing solutions.

The ideal candidate will have hands-on expertise in PySpark, Python, SQL, and real-time data streaming to contribute to the design and implementation of scalable data pipelines in cloud environments.

Key Responsibilities Include:

  • Designing and Developing Efficient Data Pipelines using PySpark and Spark.
  • Implementing ETL Solutions to Integrate Structured and Unstructured Data from Multiple Sources.
  • Developing and Maintaining Hive Queries for Seamless Data Transformations.
  • Writing Optimized SQL Queries for Large Datasets.
  • Building and Monitoring Real-Time Streaming Solutions using Apache Kafka.
  • Working on Databricks to Create, Manage, and Optimize Data Workflows.
  • Deploying and Managing Solutions in Azure Cloud Services (e.g., Data Lake, Synapse).
  • Collaborating with Cross-Functional Teams to Deliver Data-Driven Solutions.

Benefits include opportunities for growth and development, a dynamic work environment, and collaboration with experienced professionals.

  • Data Pipeline Architect

    16 hours ago

    Thiruvananthapuram, Kerala, India beBeePipeline Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Data Pipeline ArchitectWe are seeking a skilled data pipeline architect to lead the development of our data infrastructure. The successful candidate will have a strong background in designing and implementing data pipelines using Ab Initio and experience with Agile methodologies.Mandatory Skills:A deep understanding of ETL/ELT methodology, Data...

  • Data Pipeline Architect

    4 days ago

    Thiruvananthapuram, Kerala, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Opportunity: Data Pipeline ArchitectKey Responsibilities:Design and implement data pipelines using advanced technologies to drive business growth.Collaborate with cross-functional teams to develop and maintain large-scale data architectures.Develop and execute data warehousing strategies to improve data accessibility and insights.Ensure seamless...

  • Senior Data Architect

    1 day ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Summary:We are seeking an experienced data architect with expertise in designing and implementing scalable data pipelines and architectures on Google Cloud Platform (GCP).Key Responsibilities:Data Pipeline Development: Design and implement highly reliable, secure and efficient data pipelines on GCP.ETL/ELT Process Development: Develop robust ETL/ELT...

  • Enterprise Data Pipeline Architect

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a highly skilled Snowflake Developer and Infrastructure Integration Expert to lead full lifecycle implementations.As a seasoned professional in data engineering, infrastructure, and DevOps, you will be responsible for secure platform setup, cloud integration, and high-performance data pipeline development.This is an exciting...

  • Data Pipeline Architect

    1 day ago

    Thiruvananthapuram, Kerala, India beBeeAzure Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job Opportunity:The position of Azure Integration Engineer involves designing, developing, and deploying data pipelines using Azure Data Factory (ADF) to integrate with various data sources.Responsibilities include troubleshooting and resolving issues with Azure Synapse Analytics, optimizing performance and query tuning for Azure Synapse Analytics, Power BI...

  • Data Pipeline Architect

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a skilled and detail-oriented Data Engineer to design, build, and manage scalable data pipelines and enterprise data solutions.This role will be critical in supporting our analytics, reporting, and data science initiatives by delivering high-quality, reliable, and performant data systems.The ideal candidate will have expertise in Azure, SQL...

  • Chief Data Pipeline Architect

    6 days ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job TitleWe are seeking a highly skilled Data Engineer with 7-10 years of experience to join our team.The ideal candidate will have a strong background in designing and optimizing data pipelines, as well as a passion for working with large datasets to drive business insights.Key Responsibilities:Design, build, and maintain scalable data pipelines and...

  • Senior Data Pipeline Architect

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Data Solutions SpecialistThis position involves developing and maintaining scalable data pipelines to support growing data volumes and complexity.Data solutions specialists will collaborate with analytics and business teams to improve data models for business intelligence tools, enhancing data accessibility and driving data-driven decision...

  • Data Architect

    1 week ago

    Thiruvananthapuram, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Senior Data Engineer SMEWe are seeking a highly skilled Data Architect to design, build, and maintain our modern data platform.You will work across the full data stack from ingestion and transformation to orchestration and delivery playing a key role in scaling our analytics and reporting capabilities.Key Responsibilities:Design and implement...

  • AWS Cloud Data Pipeline Architect

    21 hours ago

    Thiruvananthapuram, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior AWS Data Engineer JobWe are seeking a highly skilled Senior AWS Data Engineer to join our data engineering team. The ideal candidate will have deep expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python, along with hands-on experience in the AWS ecosystem.Key Responsibilities:Design, develop, and maintain robust...