Senior Data Pipelines Architect

2 days ago

Salem, Tamil Nadu, India beBeeData Full time ₹ 1,51,00,000 - ₹ 2,01,00,000

Job Overview

We are seeking an experienced Data Engineer to design, develop, and maintain scalable data pipelines on Databricks.

The ideal candidate will have a strong background in data engineering, experience with cloud platforms, and expertise in Databricks (including Databricks SQL, Delta Lake, and MLflow).

Responsibilities

  • Design and implement data pipelines for efficient data processing and analytics.
  • Develop and maintain ETL processes to ensure high-quality data integration.
  • Collaborate with cross-functional teams to gather requirements and deliver actionable data solutions.
  • Optimize data workflows for performance, cost-efficiency, and reliability.
  • Integrate data from multiple sources into Delta Lake and cloud data warehouses.
  • Implement best practices in data governance, security, and quality management.
  • Provide technical leadership and mentor junior engineers in data engineering best practices.

Requirements

  • 7+ years of experience in data engineering.
  • Proven expertise in Databricks, PySpark, Spark SQL, and Scala.
  • Hands-on experience with cloud platforms (Azure preferred; AWS/GCP a plus).
  • Proficiency in data modeling, ETL development, and data warehousing concepts.
  • Solid understanding of big data ecosystems.
  • Strong SQL development skills with a focus on performance tuning.
  • Experience in implementing CI/CD pipelines for data solutions.

  • Senior Data Engineer

    24 hours ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityWe are seeking a highly skilled Senior Data Engineer to join our team and play a key role in scaling our analytics and reporting capabilities.This role is perfect for someone with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure who thrives in a fast-paced, engineering-driven environment.You'll work...

  • Solution Architect for Large Scale Data Pipelines

    11 hours ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Solution Architect for Large Scale Data Pipelines

  • Chief Data Pipeline Architect

    1 day ago

    Salem, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Azure Data EngineerWe're looking for a skilled data professional to design, develop and run comprehensive end-to-end data pipelines using Microsoft Azure.Key Responsibilities:Design and implement data pipelines on Azure Data Factory (ADF), Databricks (ADB) and Data Lake (ADLS Gen2)Develop and maintain scalable data solutions handling data validation,...

  • Senior Data Pipeline Engineer

    3 days ago

    Salem, Tamil Nadu, India beBeeIngestion Full time US$ 1,00,000 - US$ 1,50,000

    Job DescriptionWe are seeking a Data Ingestion Specialist with expertise in continuous integration and deployment (CI/CD) and container orchestration to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.The ideal candidate will have hands-on experience with data pipelines, automation, and infrastructure...

  • Senior Data Pipeline Developer

    12 hours ago

    Salem, Tamil Nadu, India beBeeDataPipeline Full time ₹ 12,00,000 - ₹ 20,00,000

    Data Pipeline Developer PositionWe are seeking an experienced professional to design and maintain large-scale data pipelines using Python and AWS.Data Pipelines Development: Develop and implement complex data pipelines that efficiently manage and process massive datasets.ETL Processes Implementation: Implement and optimize Extract, Transform, Load processes...

  • Data Pipeline Test Engineer

    2 days ago

    Salem, Tamil Nadu, India beBeeTest Full time ₹ 15,00,000 - ₹ 21,00,000

    Job TitleA senior test engineer is needed to lead the testing strategy and execution for a project using Databricks, Data Factory pipelines, and Power BI.5+ years of experience in data pipeline/ETL testing with at least 2+ years as a Test Lead.Key responsibilities include:Driving the testing strategy and execution for the project.Leading a team of test...

  • Senior Data Architect Position

    3 days ago

    Salem, Tamil Nadu, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 40,00,000

    Job OpportunityWe are seeking a skilled Data Architect to design and develop our data architecture and pipelines. The ideal candidate has experience with GCP-Big Query, Data Proc technologies.This role requires a collaborative, organised, and innovative thinker who is passionate about making a difference through healthcare.Key ResponsibilitiesDesign scalable...

  • Data Architect

    4 weeks ago

    Salem, Tamil Nadu, India Yoda Tech Full time

    Company DescriptionYoda Tech Pte. Ltd. is a Singapore-based company that focuses on dividing digitalization into small logical Micro initiatives with ready-to-use Micro-bots. The company aims to reduce IT operations spend by emphasizing Automate + Robotize, Power Application Development, Infrastructure, Maintenance, and Support.Role Overview:We are seeking...

  • Senior Pipeline Specialist

    1 day ago

    Salem, Tamil Nadu, India beBeePipeline Full time ₹ 80,00,000 - ₹ 1,40,00,000

    Senior Pipeline SpecialistWe are seeking a skilled Senior Pipeline Specialist to join our team and oversee the management of our end-to-end release process.This role involves designing, implementing, and managing DevOps pipelines to streamline software development and deployment.You will work closely with developers and admins to ensure smooth release...

  • Chief Data Architect

    21 minutes ago

    Salem, Tamil Nadu, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled and experienced Senior Data Engineer to lead our team of big data engineers. As a key member of our organization, you will be responsible for designing and implementing large-scale data processing systems, leading cross-functional teams, and collaborating with clients to understand their...