Data Architect

1 day ago

Lucknow, Uttar Pradesh, India beBeeData Full time US$ 1,00,000 - US$ 1,20,000

Job Title: Data Architect

We are seeking a highly skilled professional to lead our data architecture initiatives. As a key member of our team, you will be responsible for designing and implementing complex data pipelines using various technologies such as Databricks (Spark), Python, and SQL.

Key Responsibilities:

  • Data Pipeline Design and Management: Design, implement, and manage CI/CD pipelines using GitHub Actions or equivalent tools to ensure smooth code integration and deployment.
  • Github Configuration and Maintenance: Configure and maintain Github branch protection rules and workflows to ensure reliability and consistency.
  • Spark Job Development and Optimization: Build, optimize, and debug Spark jobs in Databricks for large-scale data processing.
  • Databricks Deployment Automation: Automate Databricks deployments using Databricks Asset Bundles (DABs) or similar frameworks.
  • Robust Data Pipelines Development: Develop, test, and maintain robust data pipelines using Python and SQL.
  • Unit Testing and Quality Checks: Implement unit testing, validation, and quality checks for data workflows.
  • Multienvironment Deployment Management: Manage multienvironment deployments (Dev, Stage, Prod) ensuring reliability and consistency.
  • Configuration File Maintenance: Write and maintain configuration files (YAML, JSON) for workflows, pipelines, and automation.
  • Troubleshooting and Error Resolution: Troubleshoot and resolve configuration or syntax issues in YAML and related files.
  • Business Continuity: Keep critical Databricks notebooks running reliably to ensure business continuity.
  • Legas Report Migration: Migrate legacy reports into modern, self-serve dashboards (Snowflake, Tableau, Power BI).
  • Partnership with Crossfunctional Teams: Partner with cross-functional teams to understand needs and deliver data models, insights, and reporting they can trust.
  • Data Reliability: Put guardrails in place with data contracts, quality checks, and documentation to ensure long-term reliability.

Required Skills and Qualifications:

  • Technical Skills: Strong skills in SQL, Databricks (Spark), and Python/R.
  • Github and CICD Knowledge: Strong knowledge of Github and CICD practices (branch protection, Github Actions workflows).
  • Unit Testing and Quality Check Experience: Experience in implementing unit tests and quality checks in data workflows.
  • Automation Tools Familiarity: Knowledge of Databricks Asset Bundles (DABs) or similar automation tools.
  • YAML Configuration Management: Familiarity with YAML configuration management, debugging, and error resolution.
  • ProblemSolving and Debugging Skills: Strong problem-solving and debugging skills in data engineering workflows.
  • Cloud Data Warehouse Experience: Experience with Snowflake or another cloud data warehouse.
  • TableauPowerBI Dashboard Experience: Hands-on experience with Tableau/Power BI dashboards and a good sense for usability.

  • Data Architect

    17 hours ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectAbout the Role:We are seeking a skilled Data Architect to design, develop, and optimize data ingestion, transformation, and governance frameworks.The ideal candidate will have deep expertise in building scalable data pipelines, implementing enterprise-grade data governance, security, and AI-powered engineering automation.This role...

  • Data Architect

    12 hours ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Job SummaryWe are seeking a skilled Data Architect to design and develop scalable data pipelines that process and transform large volumes of structured and unstructured data.Key Responsibilities:Design and implement data architectures for processing structured and unstructured data.Build and maintain ETL/ELT workflows for data ingestion from diverse sources...

  • Data Engine Architect

    3 days ago

    Lucknow, Uttar Pradesh, India beBeeSearchEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    About the RoleWe are seeking an experienced search engineer to join our team. This is a unique opportunity to architect the backbone of our data engine from scratch.

  • Cloud Data Solutions Architect

    7 hours ago

    Lucknow, Uttar Pradesh, India beBeeCloud Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Cloud Data Solutions ArchitectA leading organization is seeking a skilled Cloud Data Solutions Architect to design, build, and maintain robust data pipelines. This role requires expertise in cloud services, CI/CD pipelines, and strong SQL skills.Key Responsibilities:Design and implement scalable data solutions using cloud services.Collaborate with...

  • Visionary Salesforce Data Cloud Architect

    21 minutes ago

    Lucknow, Uttar Pradesh, India beBeeDataCloudArchitect Full time ₹ 20,00,000 - ₹ 30,00,000

    Salesforce Data Cloud Architect Job DescriptionJob Title: Salesforce Data Cloud ArchitectJob Type: Freelance/Contract - 6 monthsJob OverviewWe are seeking a highly skilled and experienced Salesforce Data Cloud Architect to lead our data-first initiatives at enterprise scale. This is an exciting opportunity for a talented individual to drive strategy,...

  • Distributed Data Architect

    8 hours ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Data Architect - Distributed SystemsAs a highly skilled Data Architect, you will play a pivotal role in designing and implementing scalable data systems that meet the evolving needs of our organization.Key Responsibilities:Technical Expertise: Develop an in-depth understanding of distributed computing architectures to design and implement efficient data...

  • Data Solutions Architect

    6 days ago

    Lucknow, Uttar Pradesh, India beBeeSolutions Full time ₹ 35,00,000 - ₹ 50,00,000

    Job DescriptionWe are seeking a highly skilled Data Solutions Architect to design, develop, and maintain data pipelines and ETL processes on Databricks.About the RoleLead the architecture and implementation of scalable, secure, and high-performance data solutions.Collaborate with business stakeholders, data scientists, and analysts to gather requirements and...

  • Data System Architect

    5 days ago

    Lucknow, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job DescriptionAs a Data Engineer, you will be responsible for designing and developing high-quality data systems that meet the needs of our clients.You will work independently to develop and deliver features and tasks to a high standard, collaborating with cross-functional teams as needed.The ideal candidate has 8+ years of experience in software...

  • Cloud Data Architect

    2 days ago

    Lucknow, Uttar Pradesh, India beBeeDataScientist Full time ₹ 15,00,000 - ₹ 21,00,000

    DescriptionWe are seeking a technical leader to drive the development of our training content on Azure's modern data and AI stack. You will be responsible for defining and reviewing presentations, labs, and real-world scenarios that showcase advanced learning experiences aligned to DP-203, AI-102, and DP-100 certification paths.Key Responsibilities:Define...

  • Data Architect Specialist

    2 hours ago

    Lucknow, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking an experienced professional to lead the design, implementation and optimization of scalable data solutions.Architect and deliver end-to-end data solutions on Snowflake.Demonstrate deep understanding of data warehousing concepts and work with structured, semi-structured, and unstructured data.Apply deep expertise in Snowflake architecture...