Chief Data Pipeline Architect

4 days ago


Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 20,00,000
Key Data Engineer Position

We are seeking a highly skilled data professional with 4+ years of experience in designing, building, and optimizing ETL pipelines for large-scale data processing workflows. The ideal candidate will have hands-on experience working with Azure Cloud services including Azure Data Factory, Databricks, and related technologies.

Responsibilities
  • Design, develop, and maintain scalable ETL pipelines for batch data ingestion and egress using Azure Data Factory and Databricks.
  • Implement data transformation workflows using PySpark and Scala Spark for high-performance data processing.
  • Collaborate with business teams to gather requirements and translate them into effective data solutions.
  • Maintain detailed documentation for solutions, processes, and troubleshooting guides.
Required Skills and Qualifications
  • Strong programming skills in Python and Scala.
  • Hands-on experience with Spark (PySpark & Scala Spark).
  • Proficiency in SQL for data querying and transformation.
  • Good knowledge of Azure Cloud, Azure Data Factory (ADF), and Azure Databricks.
Benefits

This is an opportunity to work on challenging projects and grow your career as a data engineer. We provide a collaborative and dynamic work environment that encourages learning and innovation.



  • Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our growing team of consultants.Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.Architect and implement data warehouses, data lakes, and other storage solutions that support...

  • Chief Data Architect

    7 hours ago


    Thrissur, Kerala, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Seeking a seasoned data architect with extensive experience in designing and implementing end-to-end data pipelines, data integration solutions for structured and unstructured data sources and targets on cloud.Responsibilities:Lead multiple data engagements on GCP Cloud for data lakes, data engineering, data migration, data warehouse, and business...


  • Thrissur, Kerala, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Engineering LeadershipWe are seeking a highly experienced and strategic Cloud Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks.The ideal candidate will lead a team of talented cloud engineers to design and deliver scalable data pipelines and analytics platforms, ensuring high performance, reliability, and...


  • Thrissur, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Chief Data Infrastructure SpecialistWe are seeking a seasoned Chief Data Infrastructure Specialist to spearhead the development and implementation of our data ecosystem strategy.Key Responsibilities:Design, build, and maintain scalable and secure enterprise data architectures, encompassing data lakes, warehouses, and real-time streaming...


  • Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a highly skilled data engineer with extensive experience in designing, building, and optimizing scalable data pipelines using AWS Lambda, Glue, DBT, and SQL. The ideal candidate will be responsible for enabling seamless data integration, transformation, and analytics to support business intelligence and advanced...


  • Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,20,00,000

    We're seeking a highly skilled Big Data Engineer to help us scale and optimize our data processing capabilities.As a key member of our team, you'll design, build, and maintain high-performance data pipelines that process terabytes of data. Your focus will be on optimizing existing systems, identifying performance bottlenecks, and implementing solutions to...


  • Thrissur, Kerala, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are looking for a skilled and detail-oriented professional to join our data engineering team. As a key member of the team, you will design, build, and manage scalable data pipelines and enterprise data solutions.Job RequirementsYou should have deep expertise in Azure, SQL Server, and Databricks.Azure Data Services: Data Factory, ADLS, Azure SQL, Azure...


  • Thrissur, Kerala, India beBeeData Full time ₹ 15,00,000 - ₹ 18,00,000

    Cloud Data ArchitectRole OverviewWe are seeking an experienced cloud data architect to design, develop, and maintain scalable data pipelines and architectures that support business analytics initiatives. This role will focus on building production-ready workflows for ingestion, transformation, quality checks, lineage capture, access auditing, cost usage...


  • Thrissur, Kerala, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    We are currently seeking a skilled Data Architect to design, develop, and govern our data architecture and pipelines.The ideal candidate will be collaborative, well-organised, and able to think outside the box. Most importantly, this role is for an individual who is passionate about making a difference through healthcare.Key Responsibilities:Data...

  • Senior Data Architect

    9 hours ago


    Thrissur, Kerala, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    **Job Overview**We are seeking an expert in designing and implementing efficient, scalable ETL/ELT pipelines and data flows using SQL and ETL/ELT design principles to build and maintain our modern data platform.Key Responsibilities:Develop transformation models using dbt and orchestrate pipelines via Airflow.Optimize large-scale processing jobs in Apache...