Data Pipeline Architect

7 days ago

Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Unlock Your Potential in Data Engineering

Your potential, unleashed. The global economy is evolving at an unprecedented rate, and it's a perfect time to unleash your skills in data engineering.

You'll have the chance to combine our drive to propel with purpose with your passion for data engineering. You'll be part of a team that collaborates, innovates, grows, and makes an impact that matters.

About This Role

We are seeking a skilled and detail-oriented Data Engineer with deep expertise in Azure, SQL Server, and Databricks to design, build, and manage scalable data pipelines and enterprise data solutions.

Key Responsibilities:
  • Design, develop, and manage ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks for batch and real-time data processing.
  • Integrate data from various structured and unstructured sources including SQL Server, Azure SQL Database, Azure Data Lake Storage (ADLS), and external APIs.
  • Build and maintain data models, data marts, and data warehouses using SQL Server and Azure Synapse Analytics.
  • Write efficient and optimized SQL queries, stored procedures, views, and triggers in SQL Server.
  • Use Databricks (Spark with Python/Scala) to process large datasets for transformation and analytics.
  • Ensure data quality, integrity, security, and compliance across the pipeline using data validation, monitoring, and auditing techniques.
  • Collaborate with data analysts, data scientists, and business stakeholders to define and deliver data solutions.
  • Implement CI/CD pipelines using Azure DevOps.
  • Monitor and optimize the performance of data pipelines and queries across Azure and SQL Server environments.
Requirements:
  • Bachelor's degree in Computer Science, Engineering, Information Systems, or related field.
  • 5+ years of experience in data engineering or related roles.
  • Proven experience with:
  • Azure Data Services: Data Factory, ADLS, Azure SQL, Azure Synapse
  • Databricks (Azure implementation), including experience with Spark (Python or Scala).
  • Microsoft SQL Server: Writing advanced SQL, stored procedures, and performance tuning.
  • Strong understanding of data warehousing concepts, ETL/ELT best practices, and data modelling (star/snowflake schema).
  • Familiarity with data governance, RBAC, and data security practices in Azure.
  • Experience with CI/CD tools like Azure DevOps and version control with Git.
  • Excellent problem-solving skills and the ability to work collaboratively in a fast-paced environment.
How You'll Grow

At Deloitte, you can be a leader irrespective of your career level. Our colleagues are characterised by their ability to inspire, support, and provide opportunities for people to deliver their best and grow both as professionals and human beings.

We believe in the unique skills, attitude, and potential each and every one of us brings to the table to make an impact that matters.

  • Distinguished Data Pipeline Architect

    6 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 50,00,000

    About the Role:We are seeking a seasoned Senior Data Engineer to join our team. This is a critical role responsible for designing, building, and maintaining our data pipeline architecture.This engineer will collaborate closely with data scientists and analysts to facilitate data-related functionalities.They will lead the optimization and scalability of data...

  • Data Pipeline Engineer

    1 week ago

    Guntur, Andhra Pradesh, India beBeeETLPipeline Full time ₹ 20,00,000 - ₹ 25,00,000

    ETL DeveloperWe are seeking a highly skilled and motivated ETL Developer to join our data engineering team.You will work on designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage, AWS Glue, and Snowflake. Key Responsibilities:Design and Develop ETL PipelinesLeverage best practices for schema design, partitioning, and...

  • Chief Data Pipeline Architect

    4 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Data Engineer RoleWe're seeking a skilled professional to lead our data engineering department, designing and building production-level data pipelines that handle large volumes of structured and unstructured data.

  • Data Architect

    6 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,50,00,000

    Job Description:We are seeking an experienced Data Architect to lead the design and implementation of our data architecture. This individual will be responsible for creating and maintaining a scalable, secure, and reliable data infrastructure that meets the needs of our business. Key Responsibilities:Develop and maintain large-scale data pipelines using...

  • Senior Data Architect

    2 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 35,00,000

    Job Overview:">We are seeking an experienced data architect with 3-12 years of experience in designing and developing scalable data pipelines, data lakes, and data warehouses.The ideal candidate will have strong expertise in designing and developing data pipelines using Oracle Data Flow or Apache Spark (PySpark), with a solid understanding of data patterns,...

  • Data Pipeline Specialist

    7 days ago

    Guntur, Andhra Pradesh, India beBeeIngestion Full time ₹ 15,00,000 - ₹ 17,50,000

    Seeking a seasoned Ingestion Expert to spearhead data ingestion strategies. This role demands expertise in designing, developing, and optimizing data pipelines for integrating various sources into Databricks.Key Responsibilities:Design and implement robust data ingestion pipelines for integrating multiple sources into Databricks.Develop and maintain...

  • Data Solutions Architect

    2 weeks ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Solutions ArchitectKey ResponsibilitiesDesign and implement large-scale data architecturesDevelop and maintain efficient ETL processes on DatabricksCollaborate with cross-functional teams to gather requirements and deliver actionable data solutionsOptimize data workflows for performance, cost-efficiency, and reliabilityIntegrate data from...

  • Azure Data Architect

    7 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    We're seeking a highly skilled Data Architect to design and develop scalable data systems for our organization.Key Responsibilities:Data System Design – Create efficient, secure, and reliable data pipelines using Azure Databricks, Azure Data Lake, and Microsoft Purview.Quality Assurance – Implement robust quality checks to capture issue-level metadata,...

  • Cloud Data Architect

    2 days ago

    Guntur, Andhra Pradesh, India beBeeData Full time ₹ 1,74,00,000 - ₹ 2,61,00,000

    Job Title: Cloud Data ArchitectLocation: RemoteKey Responsibilities:Manage and lead the migration of on-premises Enterprise Data Warehouse to cloud-based data platform using Azure Cloud tools and Snowflake.Design, develop, and implement data platform solutions using Azure Data Factory, Self-hosted Integration Runtime, Logic Apps, Azure Data Lake Storage...

  • Data Pipeline Specialist

    7 days ago

    Guntur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 18,00,000

    Data Engineer Job OverviewWe are seeking a skilled Data Engineer to design and implement efficient data pipelines that transform large datasets into high-quality structured data.Key Responsibilities:Normalize heterogeneous data into structured outputs (CSV, SQL, JSON) for large-scale comparisons.Document workflows, maintain reusable extraction modules, and...