Data Pipeline Architect

13 hours ago

Kannur, Kerala, India beBeeArchitect Full time ₹ 20,00,000 - ₹ 25,00,000

Cloud Data Solutions Architect

Job Overview

Our organization is seeking an accomplished Cloud Data Solutions Architect with extensive experience in designing and implementing cloud data pipelines using AWS Databricks, Snowflake, Python, and Fivetran.

Key Responsibilities:
  • Domain Identification: Collaborate with data product stewards to define foundational business data domains and identify data domain elements.
  • Lineage Reports and Extraction Patterns: Develop data source lineage reports and recommend data extraction and replication patterns for efficient data management.
  • Migration and Optimization: Lead the migration of big data to AWS Cloud on S3, Snowflake, and Redshift, optimizing resource utilization along the way.
  • Problem-Solving and Team Management: Break down complex problems into manageable pieces and effectively manage cross-functional teams.
Requirements:
  1. Hands-on Experience: Proficiency with AWS Databricks, especially S3 and Snowflake, is essential.
  2. Analytical and Problem-Solving Skills: Strong analytical and problem-solving skills, combined with exceptional collaboration and leadership abilities, are required for success.
  3. Technical Expertise: Experience with ETL methods, relational databases, and SQL is necessary for this role.
  4. Communication and Collaboration: Excellent communication and collaboration skills are crucial for effective teamwork and stakeholder engagement.
  5. Initiative Prioritization: Ability to manage multiple initiatives and prioritize tasks in a fast-paced environment is vital.
Benefits and Others:

This position offers opportunities for professional growth and development in a dynamic and innovative work environment. If you are passionate about leveraging cloud technologies to drive business success, we encourage you to apply.

  • Chief Data Pipeline Architect

    6 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewAs a Data Engineer, you will play a pivotal role in designing and developing scalable data pipelines on Google Cloud Platform (GCP).Design and build robust data pipelines to extract, transform, and load data from various sources.Collaborate with cross-functional teams to understand business requirements and translate them into technical...

  • Data Architect

    1 week ago

    Kannur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Architect RoleEffective data processing is a critical aspect of any organization. As such, we seek an experienced professional to fill the role of Big Data Architect.Key Responsibilities:Design and implement scalable data architectures using Apache Spark and related tools.Configure and maintain data pipelines for seamless data flow.Develop and...

  • Data Architect

    1 week ago

    Kannur, Kerala, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled and motivated data architect to design, develop, and maintain scalable data pipelines that process and transform large volumes of structured and unstructured data.Key Responsibilities:Design and implement scalable data architectures for processing structured and unstructured data.Develop and maintain...

  • Senior Data Architect

    1 week ago

    Kannur, Kerala, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data ArchitectWe are seeking a highly skilled and experienced Data Architect to join our organization.This role is critical in designing, developing, and maintaining large-scale data pipelines that support our business operations.Strong Experience in PySpark:Hands-on expertise in building scalable data pipelines using PySpark.Proficiency in...

  • Data Infrastructure Architect

    2 days ago

    Kannur, Kerala, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 1,80,00,000

    Job Title: Data Platform Engineering LeadWe are seeking a highly skilled and experienced Data Platform Engineering Lead to drive the design, development, and maintenance of our company's core data foundation.This is a key role that requires a hands-on approach to architecting and scaling our data platform, as well as collaborating with cross-functional teams...

  • Data Architect

    2 weeks ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    As a skilled data architect, you will play a pivotal role in designing and building high-performance data pipelines that drive business forward.Key ResponsibilitiesDesign scalable data pipelines using Spark and ETL workflowsProcess massive datasets using Spark, PySpark, and SQLDevelop real-time streaming applications with Spark Streaming/KafkaCollaborate...

  • Senior Cloud Data Pipeline Specialist

    2 days ago

    Kannur, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data Engineer PositionWe are seeking a skilled and motivated Cloud Data Engineer with hands-on experience in building scalable data pipelines and cloud-native solutions.Key Responsibilities:Design, develop, and optimize robust data ingestion pipelines using GCP services such as Pub/Sub, Dataflow, and Cloud Storage.Architect and manage scalable BigQuery...

  • Senior ETL Developer for Data Pipeline Development

    1 week ago

    Kannur, Kerala, India beBeeDataPipeline Full time ₹ 18,00,000 - ₹ 21,00,000

    Job Description:">Seeking a skilled ETL Developer to design, develop and maintain scalable data pipelines using IBM DataStage and AWS Glue. The ideal candidate will have experience working with Snowflake and proficient in SQL, Unix scripting and Python.Requirements:">4+ years of experience in ETL development with at least 1–2 years in IBM...

  • Chief Cloud Data Architect

    5 days ago

    Kannur, Kerala, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    About Data EngineersHighly skilled data engineers are in high demand as organizations seek to leverage data to drive business decisions.We are looking for an experienced cloud data engineer with a strong background in AWS, Azure, and GCP. Our ideal candidate will have expertise in designing and developing scalable data pipelines, architecting and...

  • Lead Data Architect

    10 hours ago

    Kannur, Kerala, India beBeeDataScientist Full time ₹ 1,00,00,000 - ₹ 2,20,00,000

    Lead Data ArchitectJob Summary:We are seeking a highly skilled Lead Data Architect to design and develop AI/ML solutions using OpenAI, Claude, or other LLMs in production environments.Key Responsibilities:Develop and implement Python-based APIs (REST, GraphQL) for data integration and processing.Collaborate with cross-functional teams to drive MLOps and...