Big Data Architectural Specialist

5 days ago

Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

About this Role

We are seeking a highly skilled Data Engineering Leader with deep expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and lakehouse architectures.

You will work closely with cross-functional teams to provide thought leadership and deliver robust, secure, and high-performance data solutions that empower analytics and data science initiatives.

Key Responsibilities:

  • Design, develop, and maintain scalable data pipelines using Azure Data Factory and Azure Synapse Analytics.
  • Build and optimize lakehouse architectures on Azure using Delta Lake.
  • Work closely with client stakeholders to understand their requirements and provide thought leadership to translate the same into technical scripts.
  • Implement data ingestion, transformation, and orchestration workflows from diverse sources (APIs, databases, cloud storage).
  • Ensure data quality, consistency, and security across the data lifecycle.
  • Leverage Azure services such as Data Lake Storage Gen2, Event Hubs, Azure Functions, and Key Vault.
  • Implement Infrastructure as Code (IaC) using Terraform or Bicep for automated provisioning and configuration.
  • Optimize cloud resource usage for performance and cost-efficiency.
  • Design and implement star schema and other data modeling techniques to support analytical workloads.
  • Collaborate with analysts and data scientists to deliver advanced analytics solutions.
  • Conduct data quality assessments and contribute to data governance initiatives.
  • Participate in design reviews, code reviews, and cross-functional planning sessions.

Required Technical Skills:

  • Expert-level experience with Azure Data Services: Azure Data Factory, Azure Databricks, Azure Synapse, Azure Data Lake Storage.
  • Strong proficiency in SQL for complex transformations and performance tuning.
  • Advanced Python skills for data pipeline development and orchestration.
  • Experience with Terraform or similar IaC tools for Azure.
  • Familiarity with CI/CD pipelines and DevOps practices.
  • Experience with containerization (Docker, Kubernetes) is a plus.
  • Strong understanding of data governance, security (RBAC, VNETs, Managed Identities), and compliance in Azure.
  • Experience with batch and streaming data processing using tools like Structured Streaming or Event Hubs.

Soft Skills & Mindset:

  • Growth mindset with a passion for continuous learning and innovation.
  • Strong collaboration skills across engineering, analytics, and business teams.
  • Robust client management skills.
  • Structured problem-solving approach with a focus on scalability and maintainability.
  • Resilient under pressure with a solution-oriented attitude.
  • Excellent communication and documentation skills.

Preferred Qualifications:

  • Microsoft Certified: Azure Data Engineer Associate or equivalent.
  • Experience with Delta Live Tables, Unity Catalog, or MLflow is a plus.
  • Familiarity with GCP or AWS is a bonus.

  • Big Data Technologist

    2 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job SummaryBig Data Specialist role involves working with large-scale data processing systems and technologies including PySpark, Scala Spark, and Java Spark SQL. The ideal candidate will have experience in implementation projects, building data pipelines, transformation logics, and data models.About the PositionDesign, develop, and maintain large-scale data...

  • Big Data Architect

    5 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistJob Description: We are seeking a highly skilled engineer to design, build, and maintain robust data pipelines that handle high-volume financial data. This individual will be responsible for developing scalable and efficient data architectures to meet the needs of our business.Key Responsibilities:Design and Develop...

  • Cloud Big Data Expert

    2 days ago

    Vellore, Tamil Nadu, India beBeeBigData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Cloud Data Architect PositionWe are seeking a skilled Cloud Data Architect to join our team. The ideal candidate will have a strong understanding of big data architecture, cloud adoption strategies, and solution design.

  • Big Data Engineer

    5 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data Engineering RoleWe are looking for a skilled Big Data Engineer to lead our team in delivering scalable and efficient data infrastructure. The ideal candidate will have expertise in Cloudera and Linux commands, as well as strong knowledge of data migration, performance tuning, and application deployment.Key Responsibilities:Design and manage...

  • Senior Big Data Technology Specialist

    1 week ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 22,35,200 - ₹ 26,16,000

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team. In this role, you will be responsible for designing, building, and maintaining high-performance data pipelines that process terabytes of data.Your primary focus will be on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing...

  • Big Data Engineer

    4 days ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    As a seasoned professional, you will have the opportunity to design and build large-scale data pipelines that handle massive amounts of structured and unstructured data.Key Responsibilities:Develop, implement, and maintain complex data pipelines that ensure high availability, scalability, and reliability.Own end-to-end ETL/ELT processes, focusing on...

  • Data Engineer

    6 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data ProfessionalAs a senior data engineer at a leading technology firm, you will be responsible for working with large-scale data sets to uncover valuable insights and inform business decisions.Key Responsibilities:Develop and maintain scalable big data architectures using distributed processing frameworks and data warehousing solutions.Collaborate with...

  • Data Architect Specialist

    4 hours ago

    Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job TitleWe are seeking a skilled professional to fill the position of Data Engineer.The ideal candidate will have a strong background in designing, building, and maintaining highly available data platforms.Proficiency in working with cloud-based solutions such as AWS and Redshift is required.Strong skills in designing complex data pipelines for batch and...

  • Advanced Data Architecture Specialist

    7 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job DescriptionAs a Senior Data Engineer, you will play a key role in designing, building, and optimizing scalable data pipelines and Lakehouse architectures using Microsoft Azure.Our ideal candidate will have expertise in Azure Data Services, strong proficiency in SQL for complex transformations, and advanced Python skills for data pipeline development and...

  • Big Data Engineer Role

    2 days ago

    Vellore, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 25,00,000

    As a seasoned data professional, you have the opportunity to take on a pivotal role in designing and developing scalable data systems.Key Responsibilities:Develop large-scale data processing systems using Hadoop, Spark, and other tools in the Big Data Eco System.Design and implement efficient data storage and retrieval solutions using HDFS and related...