Data Architecture Lead

9 hours ago

Bengaluru, Karnataka, India beBeeDataArchitecture Full time ₹ 1,95,12,000 - ₹ 2,53,16,000

Job Title: Data Architecture Lead

Job Description:

The ideal candidate for this role will have a deep understanding of data modeling, ETL development, and database administration.

  • Design dimensional models using star/snowflake schema and balance normalization vs. performance trade-offs.
  • Collaborate with cross-functional teams to translate requirements into data models.
  • Implement backup, restore, and cross-region replication strategies for large-scale databases.
Data Modeling & Cloud Warehouse Management:

The Data Engineering team is responsible for designing and implementing data architectures that support the company's analytics and transactional systems.

  1. Design index templates, shard/replica allocation, and rollover policies for Elasticsearch clusters.
  2. Optimize sql / no-sql databases for performance and scalability.
ETL Development & Data Migrations:

The Data Engineer will lead large-scale data migrations with minimal downtime and ensure idempotency, data quality, and rollback strategies in all migration workflows.

  • Architect, build, and maintain batch and streaming ETL pipelines using EMR/Spark, Glue, Lambda, and Delta Lake.
Big Data Storage & Pipeline Maintenance:

The Data Engineer will oversee EMR/Spark pipelines, ensuring reliability and performance at scale, and leverage ECS/Fargate for containerized data workloads and ad-hoc processing.

  • Manage data lakes on S3 and HDFS; implement Delta Lake for ACID transactions and schema evolution.
Metadata & Governance:

The Data Engineer will manage Glue Data Catalog and Lake Formation permissions, establish data lineage, schema version control, and audit processes.

  • Manage data lifecycle and data governance.
Innovation & Technology Research:

The Data Engineer will evaluate and pilot emerging large-scale storage technologies, prototype next-generation data architectures, and develop PoCs for modern query engines.

  • Evaluate and pilot emerging large-scale storage technologies (Apache Iceberg, Hudi,Redshift RA3 & AQUA).
Cross-Functional Collaboration & Mentorship:

The Data Engineer will partner with DevOps and Security to enforce IAM roles, encryption (KMS), and network isolation, mentor DE II engineers on modeling best practices, ETL patterns, and database troubleshooting.

  • Partner with DevOps and Security to enforce IAM roles, encryption (KMS), and network isolation.
Required Skills and Qualifications:

The ideal candidate will possess 5+ years of hands-on experience in data modeling, ETL development, and database administration, as well as deep expertise in dimensional modeling and proven track record managing Amazon Redshift, PostgreSQL, and Elasticsearch at scale.

  • 5+ years of hands-on experience in data modeling, ETL development, and database administration.
  • Deep expertise in dimensional modeling (star/snowflake) and normalization trade-offs.
  • Proven track record managing Amazon Redshift, PostgreSQL, and Elasticsearch at scale.
  • Strong experience building and migrating ETL pipelines (EMR/Spark, Glue, Lambda, Delta Lake).
  • Proficiency with S3/HDFS architectures and data lake best practices.
  • Excellent SQL skills and proficiency in Python or Bash scripting.
  • Demonstrated success in large-scale data migrations with minimal business impact.
  • Strong communication, documentation, and mentoring abilities.

Preferred Qualifications:

  • AWS certifications (e.g., Database – Specialty, Big Data – Specialty)
  • Experience with additional NoSQL systems (DynamoDB, Cassandra)
  • Knowledge of data mesh or data fabric architectures
  • Background in DevOps practices (CI/CD for schema and ETL code changes, Terraform/CDK)

  • Data Architectural Lead

    5 days ago

    Bengaluru, Karnataka, India beBeeDataIntegration Full time ₹ 12,00,000 - ₹ 20,10,000

    Senior Data Integration SpecialistOur organization is seeking an experienced Senior Data Integration Specialist to lead the design and implementation of data architecture integrating Salesforce with other platforms.Key Responsibilities:Develop and implement data integration strategies integrating Salesforce with other platforms.Design and maintain ETL...

  • Data Architectural Lead

    3 days ago

    Bengaluru, Karnataka, India beBeeArtificialIntelligence Full time ₹ 1,20,00,000 - ₹ 2,40,00,000

    Job OpportunityThe company's mission is to create a comprehensive knowledge representation of every place on the planet, with applications across industries.Poiro is another project focusing on developing AI agents for marketers to bring brands closer to their customers.The job requires technical implementation and leadership of a small team of junior...

  • Data Architecture Lead

    3 days ago

    Bengaluru, Karnataka, India beBeeArchitect Full time US$ 1,80,000 - US$ 2,00,000

    As a strategic leader, this role involves shaping the future of data and AI architecture. Key responsibilities include:Leading the strategy to support business objectives and drive innovation.Developing and managing a team of architects to foster collaboration and continuous skills growth.Designing, implementing, and governing data platforms and AI solutions...

  • Team Lead

    4 weeks ago

    Bengaluru, Karnataka, India rc architecture Full time

    Join Our Team at RC ArchitectureCompany Overview RC Architecture is a Bangalore-based design firm known for delivering innovative, high-quality solutions with speed and creativity. We pride ourselves on pushing boundaries while ensuring the wise use of resources, including time and money. Team LeadWe're on the lookout for a passionate, creative, and...

  • Team Lead

    2 weeks ago

    Bengaluru, Karnataka, India rc architecture Full time

    Join Our Team at RC Architecture Company Overview  RC Architecture is a Bangalore-based design firm known for delivering innovative, high-quality solutions with speed and creativity. We pride ourselves on pushing boundaries while ensuring the wise use of resources, including time and money.   Team Lead We're on the lookout for a passionate,...

  • Team Lead

    23 hours ago

    Bengaluru, Karnataka, India rc architecture Full time

    Join Our Team at RC Architecture Company Overview RC Architecture is a Bangalore-based design firm known for delivering innovative, high-quality solutions with speed and creativity. We pride ourselves on pushing boundaries while ensuring the wise use of resources, including time and money.   Team LeadWe're on the lookout for a passionate, creative, and...

  • Team Lead

    1 week ago

    Bengaluru, Karnataka, India rc architecture Full time

    Join Our Team at RC Architecture Company Overview RC Architecture is a Bangalore-based design firm known for delivering innovative, high-quality solutions with speed and creativity. We pride ourselves on pushing boundaries while ensuring the wise use of resources, including time and money.   Team LeadWe're on the lookout for a passionate, creative, and...

  • Strategic Data Architecture Lead

    2 days ago

    Bengaluru, Karnataka, India beBeeDatabricksExpertise Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Engineer Leader PositionThe role involves leading high-performing teams to design, implement, and optimize large-scale data processing architectures.Required Skills and QualificationsDatabricks Expertise: Proficiency in Databricks platform capabilities including Spark, SQL, and data processing features.Programming Languages: Proficient...

  • Lead - Enterprise Architecture, Data & Analytics

    6 days ago

    Bengaluru, Karnataka, India Biocon Biologics Full time

    Job DescriptionKEY RESPONSIBILITIESWe are seeking a highly experienced Enterprise Architecture, Data & Analytics leader to lead the strategic implementation of architecture, data, analytics, and automation capabilities. The ideal candidate will have a minimum of 20 years of experience in setting up and scaling Data & Analytics Centers of Excellence (CoE),...

  • Lead project management- Quality

    1 day ago

    Bengaluru, Karnataka, India rc architecture Full time

    Join Our Team at RC Architecture RC Architecture is a Bangalore-based design firm known for delivering innovative, high-quality solutions with speed and creativity. Team Lead We're on the lookout for a passionate, creative, and experienced Interior Designer / Team Lead to join our dynamic team full-time in Bengaluru. This role is perfect for someone ready to...