Lead Data Pipeline Architect

4 days ago

Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title: Senior Data Engineer">

About the Position

We are seeking a highly skilled data engineer with expertise in Microsoft Azure to design, build, and optimize scalable data pipelines and architectures. This role involves collaborating with cross-functional teams to develop and implement data-driven solutions that meet business needs.

Key Responsibilities

  • Design, develop, and maintain scalable data pipelines using Azure Data Factory and Synapse Analytics to ensure efficient data processing and integration.
  • Build and optimize lakehouse architectures on Azure using Delta Lake to provide secure and reliable data storage.
  • Work closely with stakeholders to understand their requirements and provide technical leadership to ensure successful project outcomes.
  • Implement data ingestion, transformation, and orchestration workflows from diverse sources to support real-time analytics and reporting.
  • Ensure data quality, consistency, and security across the data lifecycle through rigorous testing and validation.
  • Leverage Azure services such as Data Lake Storage Gen2, Event Hubs, and Key Vault to enhance data management and security.
  • Implement Infrastructure as Code (IaC) using Terraform or Bicep for automated provisioning and configuration to improve efficiency and reduce errors.
  • Optimize cloud resource usage for performance and cost-efficiency by monitoring and analyzing system metrics.
  • Design and implement star schema techniques to support analytical workloads and improve query performance.
  • Collaborate with analysts and data scientists to deliver advanced analytics solutions that drive business insights and decision-making.
  • Conduct data quality assessments and contribute to governance initiatives to ensure compliance with industry standards and regulations.
  • Participate in design reviews, code reviews, and cross-functional planning sessions to foster collaboration and knowledge sharing.

  • Chief Data Pipeline Architect

    1 day ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 24,00,000

    We are seeking a highly motivated and experienced Data Engineer to lead the design, build, and maintenance of robust data pipelines. The ideal candidate will have deep expertise in cloud-based data processing technologies using GCP, AWS, or Azure.Responsibilities:Create scalable data pipelines using cloud services (GCP, AWS, or Azure).Implement data...

  • Visionary AI Pipeline Architect

    24 hours ago

    Dindigul, Tamil Nadu, India beBeeComputer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Computer Vision EngineerWe are seeking an accomplished Senior Computer Vision Engineer to spearhead the design and implementation of sophisticated CV pipelines. The ideal candidate will have 6-10 years of experience in architecting and deploying CV systems, with expertise in multi-object tracking, object detection, semi/unsupervised learning, and...

  • Strategic Data Pipeline Architect

    5 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 17,50,000 - ₹ 25,85,000

    Lead Data Engineer OpportunityWe are seeking a highly skilled and experienced Lead Data Engineer to join our team.The ideal candidate will have deep hands-on expertise in Azure and Databricks, with a strong track record of delivering high-quality solutions with speed and precision.Key Responsibilities:Design, develop, and optimize data pipelines using Azure...

  • Chief Data Architect

    3 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,52,16,000 - ₹ 2,01,93,600

    Job OverviewWe are seeking a seasoned Data Engineering Specialist to join our team. In this role, you will design and implement cutting-edge data warehousing solutions using Snowflake and Azure Data Factory.As a key member of our engineering team, you will work closely with DW/BI leads to understand ETL pipeline development requirements, identify gaps in...

  • Expert Data Architect

    3 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    About This RoleWe are looking for a skilled Data Architect to design and implement scalable ETL/ELT pipelines using Azure Databricks, PySpark, and Delta Lake.Key Responsibilities:Collaborate with cross-functional teams to develop high-quality data solutions.Design and deploy efficient ETL/ELT pipelines with Azure Databricks by utilizing PySpark and...

  • High-Performance Data Pipeline Architect

    3 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 22,00,000

    Job OverviewThe role of Data Engineer is a critical component in the design and implementation of high-performance data pipelines. Our ideal candidate will possess extensive knowledge of AWS cloud services, Databricks, and Python/SQL for data transformation.

  • Data Pipeline Specialist

    5 days ago

    Dindigul, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a skilled Senior Data Engineer to take on the challenge of building and maintaining our data pipelines.Responsibilities:Develop ETL pipelines using FiveTran, DBT Cloud, and custom frameworksImplement client-specific data transformations for HighTouch integrationSupport data ingestion and quality checks during client...

  • Chief Data Architect

    1 day ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:We are seeking a highly skilled Data Architect to design and implement a scalable data platform leveraging modern technologies.The ideal candidate has a strong foundation in SQL engineering, cloud data architectures, and modern data pipelines. Experience with hosted data warehouse platforms is a plus.Key Responsibilities:Design and build a...

  • Data Pipeline Specialist

    5 days ago

    Dindigul, Tamil Nadu, India beBeeSoftwareEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    We are seeking an experienced professional to drive testing strategy and execution for a project leveraging Databricks, Data Factory pipelines and Power BI. The ideal candidate will have expertise in testing data pipelines using Python, SQL, etc. along with experience in JIRA test management. Additionally, the role requires experience with GitHub/Bitbucket...

  • Data Solutions Architect

    4 days ago

    Dindigul, Tamil Nadu, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Solutions ArchitectJob Summary:We are seeking a skilled and detail-oriented professional to design, build, and manage scalable data pipelines and enterprise data solutions. This role will be critical in supporting our analytics, reporting, and data science initiatives by delivering high-quality, reliable, and performant data systems.The ideal...