Lead Data Architect

18 hours ago

Gandhinagar, India beBeeDataEngineer Full time

Unlock Career Advancement in Data EngineeringWe are seeking a Senior Data Engineer to join our team and play a crucial role in shaping the future of healthcare analytics.This is an exciting opportunity for candidates based in Europe or India with periodic team gatherings in Mountain View, California.Pipeline Development: Design, build, and maintain scalable ETL pipelines using Python, Pandas, PySpark, and SQL orchestrated with Airflow MWAA.Data Lake Management: Develop and maintain the SAIVA Data Lake Lakehouse on AWS ensuring quality governance, scalability, and accessibility.Distributed Processing: Run and optimize distributed data processing jobs with Spark on AWS EMR and/or EKS.Ingestion Frameworks: Implement batch and streaming ingestion frameworks APIs databases files event streams.Quality Checks: Enforce validation and quality checks to ensure reliable analytics and ML readiness.Monitoring and Troubleshooting: Monitor and troubleshoot pipelines with CloudWatch integrating observability tools like Grafana, Prometheus, or Datadog.Infrastructure Automation: Automate infrastructure provisioning with Terraform following AWS best practices.Integration Management: Manage SQL Server, PostgreSQL, and Snowflake integrations into the Lakehouse.On-call Support: Participate in an on-call rotation to support pipeline health and resolve incidents quickly.Qualifications: 5+ years in data engineering, ETL pipeline development, or data platform roles flexible for exceptional candidates.Architectural Experience: Experience designing and operating data lakes or Lakehouse architectures on AWS S3, Glue, Lake Formation, Delta Lake, Iceberg.Technical Skills: Strong SQL skills with PostgreSQL, SQL Server, and at least one AWS cloud warehouse Snowflake or Redshift.Programming Proficiency: Proficiency in Python, Pandas, PySpark, Scala, or Java a plus.Hands-on Experience: Hands-on with Spark on AWS EMR and/or EKS for distributed processing.Workflow Orchestration: Strong background in Airflow MWAA for workflow orchestration.AWS Expertise: Expertise with AWS services: S3, Glue, Lambda, Athena, Step Functions, ECS, CloudWatch.Terraform and CI/CD: Proficiency with Terraform for IaC familiarity with Docker, ECS, and CI/CD pipelines.Monitoring and Alerting: Experience building monitoring, validation, and alerting into pipelines with CloudWatch, Grafana, Prometheus, or Datadog.Communication Skills: Strong communication skills and ability to collaborate with data scientists, analysts, and product teams.Track Record: A track record of delivering production-ready, scalable AWS pipelines not just prototypes.Join us in shaping the future of healthcare analytics

  • Data Architect Lead

    23 hours ago

    Gandhinagar, India beBeeDataArchitect Full time

    The role of a Data & AI Architect is instrumental in designing and implementing comprehensive data platform solutions.This position requires 12-15 years of relevant work experience. The ideal candidate will be based in Bengaluru, India.Main responsibilities include leading technical solutioning for RFPs/RFIs, conducting workshops with senior executives, and...

  • Leading Snowflake Data Architect

    3 days ago

    Gandhinagar, India beBeeData Full time

    Key Role Overview:The role of Principal Snowflake Architect is to act as a trusted advisor and global evangelist for our data practice, focusing specifically on the Banking, Financial Services, and Insurance (BFSI) sector.This position requires a unique blend of deep, hands-on architectural expertise and proven thought leadership. The ideal candidate will...

  • Senior Data Architect

    3 days ago

    Gandhinagar, India beBeeData Full time

    Job OverviewWe seek an accomplished data architect to lead the implementation of high-performance analytical systems from scratch.

  • Senior Data Architect

    22 hours ago

    Gandhinagar, India Delphie Consulting services Full time

    #SeniorDataArchitect #DataArchitect #Snowflake #DataEngineering #ETLDeveloper #DataWarehouse #DBT #CloudData #DataMigration #DataModeling #ImmediateJoiner #HiringNow #TechJobs Job Title: Senior Data Architect Experience: 10+ Years Job Location: Trivandrum / Kochi Work Mode: Hybrid Shift Timing: 12 PM – 9 PM IST (Mandatory overlap with EST time zone) We are...

  • Cloud Data Architect Position

    3 days ago

    Gandhinagar, India beBeeDataArchitect Full time

    AWS Data Architect PositionWe are seeking a skilled professional to lead the design and implementation of cloud data architectures on AWS.Key Responsibilities:Develop cloud data architectures using AWS services such as S3, Redshift, Glue, and Lake Formation.Leverage IAM for optimal performance and ensure data security compliance with best...

  • Data Architect Specialist

    3 days ago

    Gandhinagar, India beBeeData Full time

    Data Architect SpecialistAt our organization, we design, develop, and optimize large-scale data systems and cloud-based solutions.We are seeking a Data Architect Specialist to join our team who can leverage Python for data engineering tasks and has hands-on experience designing ETL/ELT pipelines.The ideal candidate will have expertise in AWS cloud services...

  • Data Engineer Lead

    20 hours ago

    Gandhinagar, India beBeeData Full time

    Senior Data ArchitectWe are seeking an experienced professional to join our team as a Senior Data Architect. This role centers on architecting robust data pipelines across on-prem and cloud ecosystems, automating ingestion from varied sources including APIs.Design, Develop, and Optimize ETL/ELT Data PipelinesAutomate Data Ingestion WorkflowsIntegrate...

  • Highly Disciplined Lead Architect Wanted

    24 hours ago

    Gandhinagar, India beBeeArchitect Full time

    Lead Architect RoleWe are looking for a highly skilled Lead Architect to work remotely and lead all design work. The ideal candidate should be self-disciplined, technically strong, and capable of managing multiple projects with minimal supervision.Main Responsibilities:Develop conceptual layouts, 2D plans, elevation concepts, working drawings, detail...

  • Technical Architect

    4 weeks ago

    Gandhinagar, India Whatjobs IN C2 Full time

    We are seeking a seasoned GCP Data Warehouse Architect to lead the design, development, and governance of scalable, secure, and high-performance data architectures on Google Cloud Platform (GCP). The ideal candidate will have a proven track record in architecting enterprise-grade data warehouses and large-scale data pipelines that support real-time...

  • Lead Data Engineer – Python

    4 weeks ago

    Gandhinagar, India Whatjobs IN C2 Full time

    Job Title: Lead Data Engineer – Python & GCP Location : Hyderabad Exp : 10+ Years Overview: We are seeking an experienced Lead Data Engineer with strong expertise in Python and Google Cloud Platform (GCP) . You will design, develop, and manage scalable ETL/ELT data pipelines , work closely with clients to understand requirements, and build data solutions...