Data Architect Specialist

2 days ago

Agra, Uttar Pradesh, India beBeeDataEngineer Full time US$ 95,000 - US$ 1,55,000

Job Description

  • The primary objective of this position is to design and implement continuous integration/continuous deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.
  • This role requires hands-on expertise in building and automating data pipelines, managing multi-environment deployments, and working with modern DevOps/configuration management tools.

Key Responsibilities:

  1. Design and Implement CI/CD Pipelines: Create efficient and scalable pipelines for data engineering workflows.
  2. Configure and Maintain GitHub Branch Protection Rules: Set up and manage GitHub branch protection rules and workflows to ensure smooth code integration and deployment.
  3. Build and Optimize Spark Jobs: Develop, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  4. Automate Databricks Deployments: Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  5. Develop and Maintain Data Pipelines: Build and maintain robust data pipelines using Python and SQL.
  6. Implement Unit Testing: Write and execute unit tests, validation, and quality checks for data workflows.
  7. Manage Multi-Environment Deployments: Ensure reliability and consistency across multiple environments (Dev, Stage, Prod).
  8. Configure Workflows and Automation: Create configuration files (YAML, JSON) for workflows, pipelines, and automation.
  9. Troubleshoot and Resolve Issues: Identify and resolve configuration or syntax issues in YAML and related files.
  10. Collaborate with Cross-Functional Teams: Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting.
  11. Migrate Legacy Reports: Migrate legacy reports into modern, self-serve dashboards using Snowflake, Tableau, or Power BI.
  12. Ensure Long-Term Reliability: Put guardrails in place with data contracts, quality checks, and documentation.

Requirements:

  • Strong Skills: Proficiency in SQL, Databricks (Spark), and Python/R.
  • GitHub and CI/CD Experience: Strong knowledge of GitHub and CI/CD practices (branch protection, GitHub Actions workflows).
  • Unit Testing and Quality Checks: Experience implementing unit tests and quality checks in data workflows.
  • Databricks Asset Bundles: Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • YAML Configuration Management: Familiarity with YAML configuration management, debugging, and error resolution.
  • Problem-Solving Skills: Strong problem-solving and debugging skills in data engineering workflows.
  • Cloud Data Warehouse: Experience with Snowflake or another cloud data warehouse.
  • Tableau/Power BI: Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

  • Senior Data Architect

    1 day ago

    Agra, Uttar Pradesh, India beBeeDataArchitecture Full time ₹ 90,00,000 - ₹ 1,80,00,000

    Lead Data ArchitectJob Description:The ideal candidate will be a seasoned data architect responsible for designing and overseeing the architecture of Microsoft Fabric solutions. This includes integration with Power BI, Synapse, Data Factory, and other Azure services.Key Responsibilities:Design and implement scalable and secure data solutionsCollaborate with...

  • Cloud Data Architect

    3 days ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 16,00,000 - ₹ 25,10,000

    Job Title: Cloud Data ArchitectLocation: Remote Work EnvironmentJob Type: Full-TimeAbout the RoleWe are seeking an experienced Cloud Data Architect to lead the design and implementation of scalable, secure, and highly available data engineering solutions using Azure Data Engineering technologies.The ideal candidate will have a strong background in cloud...

  • Chief Data Architect

    6 hours ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title:Chief Data ArchitectWe are seeking an experienced leader to build our data engineering strategy.The ideal candidate will have strong technical skills and leadership abilities.

  • Senior Serverless Data Architect

    6 hours ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Serveless Data ArchitectWe are seeking a skilled Serveless Data Architect to join our team. As a key member of our data solutions group, you will be responsible for designing and implementing serverless architectures using AWS services.Data Ingestion: Develop serverless data ingestion pipelines using AWS services such as Kinesis, S3, and Glue.Data...

  • Data Architect

    6 days ago

    Agra, Uttar Pradesh, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Architect">This position is responsible for the design and development of high-performance data solutions using SAP BW/4HANA. The ideal candidate will have a strong focus on data engineering with 5-10 years of experience in designing, implementing, and supporting SAP BW/4HANA solutions.">About This Role:">We are looking for a highly skilled...

  • Data Pipeline Architect

    23 hours ago

    Agra, Uttar Pradesh, India beBeeDataEngineering Full time US$ 1,80,000 - US$ 2,50,000

    Job DescriptionWe are seeking a skilled Senior Data Engineer to lead the optimization and scalability of our data pipeline architecture.Architect, build, and maintain robust, high-throughput data pipelines and infrastructure.Partner with cross-functional teams to design solutions that meet evolving data requirements and business objectives.Establish best...

  • Senior Data Architect

    6 hours ago

    Agra, Uttar Pradesh, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Unlock the full potential of data and AI to drive business outcomes.Job SummaryArtefact is a global consulting services company that empowers organizations to transform data into tangible business results. We're seeking an exceptional Data Architect to design, develop, and implement robust data architectures that meet business requirements.Key...

  • Senior Data Solutions Architect

    21 hours ago

    Agra, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Senior Data Solutions ArchitectAzure data engineers play a crucial role in designing, building, and maintaining robust data pipelines to curate and ingest data efficiently.Design, build, and maintain scalable data solutions using Azure cloud services.Work with cross-functional teams to deploy and manage data workflows.Implement and maintain CI/CD...

  • Cloud Data Governance Architect

    2 hours ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Enterprise Data Solutions ArchitectWe are seeking a skilled Enterprise Data Solutions Architect with 6–8 years of experience in designing, developing, and managing enterprise data solutions on Google Cloud Platform (GCP).This individual will have a strong background in cloud data architecture, data warehousing, big data processing, and data integration,...

  • Data Pipeline Architect

    23 hours ago

    Agra, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Data Pipeline Architect">This role involves designing, developing and maintaining scalable data pipelines to support business growth and decision making. The ideal candidate will have a strong understanding of big data technologies and experience working with cloud-based platforms.Develops and maintains complex data pipelines using cloud-based...