Senior Data Architect

2 days ago

Madurai, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000
Lead Data Engineer Job Description

We are seeking a highly skilled Lead Data Engineer to join our team. As a Lead Data Engineer, you will be responsible for designing, developing, and optimizing data pipelines using Azure and Databricks.

This is a senior technical role with high expectations. The consultant must be extremely hands-on, technically strong in Azure and Databricks, and capable of delivering high-quality solutions with speed and precision.

The ideal candidate is a hands-on problem solver who ensures efficiency in their own work while also helping the wider team become more productive and technically stronger.

  • Key Responsibilities:
  • Design, develop, and optimize data pipelines using Azure and Databricks.
  • Hands-on work with Databricks Asset Bundles (DABs) for CI/CD and environment management.
  • Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services.
  • Continuously adopt and apply new Databricks features to accelerate delivery.
  • Optimize Spark, SQL, and Python code for performance and scalability.
  • Apply software engineering best practices (e.g., TDD, CI/CD, modular design, code reviews) to ensure a robust, maintainable, and strategic data ecosystem.
  • Mentor team members to improve overall team productivity and technical capability.
Required Skills & Qualifications

We are looking for a candidate with 8+ years of experience in Data Engineering and at least 5 years of hands-on experience in Azure & Databricks.

  • Strong Expertise In:
  • Databricks (Delta Lake, Databricks SQL, Workflows, Databricks Asset Bundles, MLflow basics, Unity Catalog)
  • Azure Data Services (ADF, Azure Synapse, Azure Data Lake, Azure SQL)
  • Python, SQL, Spark (with proven performance optimization skills)
  • Strong knowledge of modern data architectures (Lakehouse, governance)
Benefits

The ideal candidate will have a track record of efficient delivery and helping teams accelerate execution.

  • Soft Skills & Attributes:
  • Efficiency-driven mindset – focused on speeding up both personal and team delivery.
  • Strong communicator within the team, able to share knowledge and mentor effectively.
  • Highly motivated, proactive, and results-oriented.
  • Ability to work in a fast-paced environment with quick turnarounds.
Preferred Skills

Experience with AI-driven development to accelerate coding, improve productivity, and maintain high-quality implementations is preferred.

  • Senior Data Architect

    2 days ago

    Madurai, Tamil Nadu, India beBeeData Full time US$ 1,00,000 - US$ 2,00,000

    About Data ArchitectsData architects play a pivotal role in designing and implementing data management systems, ensuring seamless integration with business operations.

  • Senior Data Architect

    3 days ago

    Madurai, Tamil Nadu, India beBeeDataIntegration Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Informatica DeveloperJob OverviewWe are seeking a highly skilled and experienced Informatica IDMC ETL developer to join our team. As an ideal candidate, you will have a deep understanding of ETL design, data pipeline development, and Informatica Cloud Data Integration (CDI). You will be responsible for designing, developing, testing, and...

  • Chief Data Architect

    20 hours ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineer PositionWe are seeking an experienced Senior Data Engineer to lead the design, development, and maintenance of our modern data platform.Data Engineering: Design and implement efficient, scalable ETL/ELT pipelines and data flows.Transformation Models: Develop transformation models using dbt and orchestrate pipelines via Airflow.Processing...

  • Senior Data Architect

    6 days ago

    Madurai, Tamil Nadu, India beBeeData Full time US$ 1,20,000 - US$ 1,50,000

    We're seeking a seasoned Data Engineer to spearhead our clients' data modernization endeavors. As a key member of our team, you'll work closely with 70+ engineers to guide and assist clients in their data transformation journeys.Our team collaborates with companies driving innovation and creating new products in uncharted markets. We bring senior engineers,...

  • Cloud Data Architect

    20 hours ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Cloud Data ArchitectAs a Cloud Data Architect, you will design and develop cutting-edge technology that combines Large Language Models (LLMs), Agents, Knowledge Graph, and vector search in the cloud to revolutionize financial data analysis.Design scalable systems that can handle large-scale document processing during due diligence.Develop sophisticated...

  • Senior Enterprise Data Architect

    7 hours ago

    Madurai, Tamil Nadu, India beBeeArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data ArchitectDesign and implement a robust data warehousing platform for the pharmaceutical industry.Key Responsibilities:Data Modeling: Develop logical and physical data models to ensure efficient data storage and retrieval.ETL Processes: Design, develop, and optimize ETL processes to accurately and efficiently move data from various sources into the data...

  • Data Ecosystem Architect

    20 hours ago

    Madurai, Tamil Nadu, India beBeeDataArchitecture Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking a skilled Data Architect to develop and implement our end-to-end data architecture strategy, ensuring our data foundation supports business growth and innovation.The ideal candidate will be responsible for designing and building scalable and secure enterprise data architecture, including data lakes, warehouses, and real-time...

  • Cloud-Based Data Architect

    23 hours ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Role: Data ArchitectOverviewA data architect with 4+ years of experience is required to design and develop cloud-based data architectures. The ideal candidate should have expertise in building scalable real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.Key Responsibilities:Design and maintain cloud-based data...

  • Senior Cloud Data Architect

    2 days ago

    Madurai, Tamil Nadu, India beBeeInformatica Full time ₹ 12,50,717 - ₹ 18,10,111

    Job Title: Senior Data EngineerPrimary Skills: SQL, Informatica IDMC, ETL ConceptsPacific Data Integrators seeks a highly skilled and experienced Informatica IDMC ETL Developer with a deep understanding of ETL design, data pipeline development, and cloud-based data integration.Key Responsibilities:Design, develop, and deploy complex ETL solutions using...

  • Chief Data Architect

    3 hours ago

    Madurai, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Senior Data Engineer RoleWe are seeking a skilled Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing high-quality data pipelines and systems for reporting, analytics, and operational use cases. Main Responsibilities: Design and implement scalable data architectures...