Senior Data Architect

2 weeks ago

varanasi, India beBeeData Full time

Data Engineer: Build the Future of Healthcare AnalyticsWe're revolutionizing healthcare analytics by designing, building, and scaling robust data pipelines that power nationwide insights and support machine learning systems. Our goal is to create pipelines that are reliable, observable, and continuously improving in production.This role offers flexibility, allowing candidates to work from anywhere with an internet connection, suitable for those based in Europe or India. However, periodic team gatherings will be required in Mountain View, California.Design and Develop Scalable ETL Pipelines: Utilize Python (Pandas, PySpark) and SQL, orchestrated with Airflow (MWAA), to build efficient data pipelines.Develop and Maintain the Data Lake/Lakehouse: Ensure quality, governance, scalability, and accessibility on AWS, leveraging SAIVA.Run and Optimize Distributed Data Processing Jobs: Use Spark on AWS EMR and/or EKS to process large datasets efficiently.Implement Batch and Streaming Ingestion Frameworks: Integrate APIs, databases, files, and event streams to gather data.Enforce Validation and Quality Checks: Guarantee reliable analytics and ML readiness by implementing robust validation processes.Monitor and Troubleshoot Pipelines: Leverage CloudWatch and integrate observability tools like Grafana, Prometheus, or Datadog to ensure smooth pipeline operation.Automate Infrastructure Provisioning: Use Terraform to automate infrastructure setup, adhering to AWS best practices.Manage Integrations: Seamlessly connect SQL Server, PostgreSQL, and Snowflake to the Lakehouse.Participate in On-Call Rotation: Support pipeline health and resolve incidents promptly as part of an on-call rotation.Contribute to Engineering Best Practices: Collaborate in design/code reviews and contribute to the development of production-grade code.5+ Years of Experience: Possess significant experience in data engineering, ETL pipeline development, or related roles.Data Lake Architecture Expertise: Have a deep understanding of designing and operating data lakes or Lakehouse architectures on AWS.Strong SQL Skills: Proficient in SQL with PostgreSQL, SQL Server, and at least one AWS cloud warehouse.Python and Spark Proficiency: Strong skills in Python (Pandas, PySpark) and hands-on experience with Spark on AWS EMR and/or EKS.Airflow and AWS Expertise: Experienced with Airflow (MWAA) for workflow orchestration and AWS services such as S3, Glue, Lambda, Athena, Step Functions, ECS, and CloudWatch.Terraform and CI/CD: Familiarity with Terraform for IaC and CI/CD pipelines.Multitool Proficiency: Skilled in using multiple tools and technologies to achieve goals.Excellent Communication: Possess strong communication skills to collaborate effectively with data scientists, analysts, and product teams.Track Record of Deliveries: Proven ability to deliver production-ready, scalable AWS pipelines, not just prototypes.

  • Senior Enterprise Data Architect

    1 week ago

    varanasi, India beBeeDataArchitect Full time

    About Us We are a leading organization in the field of data architecture, committed to delivering cutting-edge solutions that meet the ever-evolving needs of our clients.The ideal candidate will be a seasoned professional with a deep understanding of data management principles and a proven track record of designing and implementing large-scale data...

  • Senior Data Architect

    5 days ago

    varanasi, India beBeeDataEngineering Full time

    Experienced Data Architect PositionWe are seeking a highly skilled Technical Architect with hands-on coding experience to spearhead our team's technological advancements. The ideal candidate will possess expertise in data engineering, including the design and management of complex data models and graphs.The successful candidate will also have extensive...

  • Principal Data Architect

    5 days ago

    varanasi, India beBeeDataEngineer Full time

    Senior Data EngineerThe role of Senior Data Engineer is pivotal in establishing a cutting-edge data platform on AWS. This position demands hands-on experience across both legacy and modern data stacks.Design, develop, and optimize data pipelines and ETL/ELT workflows on AWS.Transition legacy data solutions to contemporary AWS-native services.Implement and...

  • Data Architect

    2 weeks ago

    varanasi, India beBeeData Full time

    Lead Data ArchitectWe are seeking a highly skilled Lead Data Architect to join our team. As a Senior Data Engineer, you will be responsible for designing and developing data pipelines and ETL/ELT workflows on AWS.Design, develop, and optimize data pipelines and ETL/ELT workflows on AWS.Migrate legacy data solutions to modern AWS-native services.Implement and...

  • Senior Cloud Data Solutions Architect

    1 week ago

    varanasi, India beBeeData Full time

    Job Title: Cloud Data Solutions ArchitectAzure Data Architecture RoleWe are seeking a senior data architect to design and implement robust, scalable, high-performance data architectures that support our enterprise data initiatives.The ideal candidate should bring strong expertise in SQL, ETL/ELT, Microsoft Fabric, Azure Synapse Analytics, and a deep...

  • Visionary Data Architect

    2 weeks ago

    varanasi, India beBeeDataPlatform Full time

    Job Title: Senior Solutions Architect – DataSenior solutions architects design and deliver data platforms for pharma clients.The team builds simplified, integrated, and compliant technology stacks to help customers save time and money as they move from clinical & quality management to commercialization.Data Platform Architecture: Design end-to-end data...

  • Senior Data Architect

    7 days ago

    varanasi, India beBeeDataScience Full time

    Data Science ProfessionalJob Overview:We are seeking a highly skilled data science professional to join our team. The ideal candidate will have 8-12 years of experience in data modeling, transformation, and visualization.The role involves designing, architecting, and developing solutions using front-end development and best practices. Strong database...

  • Data Expert

    1 day ago

    varanasi, India beBeeData Full time

    Senior Data Architect Position OverviewWe are seeking a highly skilled and experienced Senior Data Architect to join our team. The successful candidate will have a strong background in data architecture and a proven track record of delivering complex data solutions.The Senior Data Architect will be responsible for designing, developing, and implementing...

  • Lead Data Platform Architect

    1 week ago

    varanasi, India beBeeData Full time

    Senior Solutions ArchitectWe are seeking an experienced Solutions Architect to lead the design and delivery of large-scale data platforms.Create end-to-end data architecture roadmaps for complex education systems.Develop robust data pipelines and orchestration frameworks to integrate disparate systems.Oversight of cloud-based data warehouses and lakes to...

  • Senior Technology Architect

    16 hours ago

    varanasi, India beBeeTechnology Full time

    **Job Opportunity:** Senior Technology ArchitectWe are seeking a seasoned technology professional to join our team as a Senior Technology Architect. This role involves leading the development and implementation of cutting-edge technologies that drive business growth and innovation.The ideal candidate will have a proven track record of successfully...