Data Pipeline Architect

18 hours ago


Kollam, Kerala, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000
Senior Data Engineer Role

This senior data engineer position involves working with cross-functional teams to design, develop, and maintain large-scale data pipelines. The ideal candidate will have a strong background in data engineering, excellent communication skills, and the ability to collaborate effectively.

Key Responsibilities
  • Develop and implement ETL processes using Python, Scala, Spark, and Pyspark.
  • Collaborate with stakeholders to identify business requirements and translate them into technical solutions.
  • Design and maintain data architectures using Azure/AWS Databricks.
  • Ensure high-quality data processing and analytics through strong SQL and RDBMS skills.
  • Implement continuous integration and deployment (CI/CD) using Jenkins/Bamboo and version control systems like Git.
Requirements
  • 5+ years of relevant experience in data engineering.
  • Strong knowledge of data engineering tools such as Azure/AWS Databricks, Python, Scala, Spark, and Pyspark.
  • Experience with CI/CD tools like Jenkins/Bamboo and version control systems like Git.
  • Excellent communication and collaboration skills.
  • Knowledge on Delta Live Tables (DLT) is an added advantage.


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job DescriptionWe are seeking a skilled Data Engineer to join our team. As a Data Engineer, you will design, develop, and maintain robust data pipelines, data warehouses, and analytics platforms that serve as the backbone of our digital marketing product development.You will collaborate with cross-functional teams including Data Scientists, Product Managers,...


  • Kollam, Kerala, India beBeeDataEngineer Full time ₹ 19

    Senior data engineers design and develop complex data pipelines using Airflow and Python. The role involves creating efficient workflows that meet business needs.Key Responsibilities:Develop, maintain, and optimize data workflowsCollaborate with cross-functional teams to integrate data pipelinesWrite high-quality code in PythonThe ideal candidate has...


  • Kollam, Kerala, India beBeeData Full time ₹ 25,00,000 - ₹ 35,00,000

    Job SummaryWe are seeking an experienced Cloud Data Architect to design high-performance data pipelines using AWS cloud services and Databricks.The role involves building scalable ETL/ELT workflows, managing big data environments, and ensuring seamless data availability for analytics, AI/ML, and business intelligence use cases.


  • Kollam, Kerala, India beBeeCloud Remote Work Freelance Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Cloud Computing EngineerWe are seeking a skilled Cloud Computing Engineer to design and implement cloud-based solutions using Azure and Google Cloud platforms.The ideal candidate will have expertise in automating data pipelines to facilitate efficient data flow and processing. They will also develop and manage data pipelines using technologies like PySpark...


  • Kollam, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Data Architect SpecialistWe are seeking an experienced Data Architect Specialist to join our team.The ideal candidate will have a strong background in data engineering and architecture, with expertise in designing and developing scalable data pipelines, architectures, and models.Responsibilities:Design and Develop Data Solutions: Design, develop, and...

  • Data Architect

    7 days ago


    Kollam, Kerala, India Pro5 Full time

    We are seeking a talented Data Architect to design, develop, and govern our data architecture and pipelines. to join as soon as possible. Ideally someone who has worked on multiple projects with GCP-Big Query, Data Proc technologies. The candidate will need to be collaborative, organised, think out-of-the-box, and be ready to pursue new opportunities. Most...


  • Kollam, Kerala, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Pipeline SpecialistWe are seeking an experienced Senior Data Pipeline Specialist to build and maintain production-grade data pipelines at scale using AWS services.The ideal candidate has 3–5 years of professional experience in designing and implementing scalable data architectures.About the Role:We need someone with hands-on expertise in...


  • Kollam, Kerala, India beBeeSeniorDataEngineer Full time ₹ 30,00,000 - ₹ 40,00,000

    Transform Data Infrastructure Our company is seeking a skilled Senior Data Engineer to lead the optimization and scalability of data delivery pipelines. This critical role will design, build, and maintain highly scalable data pipelines, optimize data delivery, and automate data processes. 


  • Kollam, Kerala, India beBeeData Full time ₹ 50,00,000 - ₹ 1,00,00,000

    Job DescriptionAs a Senior Data Architect, you will play a pivotal role in designing and implementing cutting-edge data pipelines that transform complex, unstructured datasets into high-quality, structured information. This role combines deterministic extraction techniques with innovative automation to scale attribute mapping, quality assurance, and...


  • Kollam, Kerala, India beBeeData Full time ₹ 60,00,000 - ₹ 1,20,00,000

    Cloud data architects design, build and maintain infrastructure for storing, processing and retrieving data. This role involves developing scalable data pipelines using cloud services.Key Responsibilities:Designing data pipelines using Azure Data Factory and other relevant tools.Developing real-time data integrations using Kafka, MS Event Hubs and other...