Cloud Data Architect

3 weeks ago

Mumbai, Maharashtra, India Genpact Full time
Principal Consultant - Databricks Architect

Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that drive lasting value for clients. Our people across 30+ countries are driven by their curiosity, agility, and desire to create impact. Powered by our purpose – the pursuit of a world that works better for people – we serve leading enterprises, including the Fortune Global 500, with our deep business and industry expertise, digital operations services, and expertise in data, technology, and AI.

We are inviting applications for the role of Principal Consultant, Databricks Architect, who will be responsible for providing technical direction and leading a team of developers to achieve goals.

Key Responsibilities

Design and Implement Solutions

Architect and design solutions that meet functional and non-functional requirements.

Create and review architecture and solution design artifacts.

Evaluate re-use opportunities through the implementation of shared assets.

Enforce adherence to architectural standards/principles, global product-specific guidelines, usability design standards, etc.

Leadership and Guidance

Proactively guide engineering methodologies, standards, and leading practices.

Guidance of engineering staff and reviews of as-built configurations during the construction phase.

Provide insight and direction on roles and responsibilities required for solution operations.

Risk Management and Communication

Identify, communicate, and mitigate Risks, Assumptions, Issues, and Decisions throughout the full lifecycle.

Consider the art of the possible, compare various architectural options based on feasibility and impact, and propose actionable plans.

Technical Expertise

Demonstrate strong analytical and technical problem-solving skills.

Analyze and operate at various levels of abstraction.

Balance what is strategically right with what is practically realistic.

Requirements

Education and Experience

Bachelor's Degree or equivalent (CS, CE, CIS, IS, MIS, or engineering discipline) or equivalent work experience.

Experience in a solution architecture role using service and hosting solutions such as private/public cloud IaaS, PaaS, and SaaS platforms.

Technical Skills

Strong hands-on experience on various cloud services like ADF/Lambda, ADLS/S3, Security, Monitoring, Governance.

Experience in designing platforms on Databricks.

Hands-on experience in designing and building Databricks-based solutions on any cloud platform.

Hands-on experience in designing and building solutions powered by DBT models and integrating with Databricks.

Cloud and Data Engineering

Experience with cloud data engineering services and solutions, including Azure, AWS, and GCP.

Knowledge of data engineering concepts and related services of cloud providers.

Software Development

Good experience in Python and Spark.

Good experience in setting up development best practices.

Intermediate-level knowledge of data modeling.

Other Requirements

Experience in claims-based authentication (SAML/OAuth/OIDC), MFA, RBAC, SSO, etc.

Knowledge of cloud security controls, including tenant isolation, encryption at rest, encryption in transit, key management, vulnerability assessments, application firewalls, SIEM, etc.

Experience in building and supporting mission-critical technology components with DR capabilities.

Experience with multi-tier system and service design and development for large enterprises.

Preferred Qualifications

Experience in designing end-to-end architecture of unified data platforms.

Excellent coding skills in Python or Scala, preferably Python.

Experience in data engineering domain.

Experience in designing and implementing at least 2-3 projects end-to-end in Databricks.

Experience with Databricks components, including Delta Lake, dbConnect, db API 2.0, SQL Endpoint – Photon engine, Unity Catalog, Databricks workflows orchestration, Security management, Platform governance, Data Security.

Knowledge of new features available in Databricks and its implications along with various possible use cases.

Followed various architectural principles to design the best-suited solution per problem.

Well-versed with Databricks Lakehouse concept and its implementation in enterprise environments.

Strong understanding of data warehousing and various governance and security standards around Databricks.

Knowledge of cluster optimization and its integration with various cloud services.

Good understanding to create complex data pipelines.

Strong in SQL and Spark-SQL.

Strong performance optimization skills to improve efficiency and reduce cost.

Worked on designing both batch and streaming data pipelines.

Extensive knowledge of Spark and Hive data processing frameworks.

Worked on any cloud (Azure, AWS, GCP) and most common services like ADLS/S3, ADF/Lambda, CosmosDB/DynamoDB, ASB/SQS, Cloud databases.

Strong in writing unit test cases and integration tests.

Strong communication skills and worked with cross-platform teams.

Great attitude towards learning new skills and upskilling existing skills.

Responsible to set best practices around Databricks CI/CD.

Understand composable architecture to take full advantage of Databricks capabilities.

Good to have REST API knowledge.

Good to have understanding around cost distribution.

Good to have if worked on migration projects to build unified data platforms.

Good to have knowledge of DBT.

Experience around DevSecOps, including Docker and Kubernetes.

Software development full lifecycle methodologies, patterns, frameworks, libraries, and tools.

Knowledge of programming and scripting languages, such as JavaScript, PowerShell, Bash, SQL, Java, Python, etc.

Experience with data ingestion technologies, such as Azure Data Factory, SSIS, Pentaho, Alteryx.

Experience with visualization tools, such as Tableau, Power BI.

Experience with machine learning tools, such as mlFlow, Databricks AI/ML, Azure ML, AWS sagemaker, etc.

Experience in distilling complex technical challenges to actionable decisions for stakeholders and guiding project teams by building consensus and mediating compromises when necessary.

Experience coordinating the intersection of complex system dependencies and interactions.

Experience in solution delivery using common methodologies, especially SAFe Agile, but also Waterfall, Iterative, etc.

Demonstrated knowledge of relevant industry trends and standards.

  • Cloud Architect

    1 month ago

    Mumbai, Maharashtra, India Cloud 9 Infosystems Full time

    Cloud Architect Job DescriptionCloud 9 Infosystems, Inc. is a full-service consultancy based in Mumbai, specializing in end-to-end solutions for organizations' digital cloud strategy.We are seeking a highly skilled Cloud Architect to join our team. The successful candidate will be responsible for designing and implementing robust infrastructure components,...

  • Cloud Solutions Architect

    4 weeks ago

    Mumbai, Maharashtra, India Cloud 9 Infosystems Full time

    About the RoleCloud 9 Infosystems is seeking an experienced Cloud Architect to join our team. As a Cloud Architect, you will be responsible for designing and implementing robust infrastructure components, including networks, storage, and compute resources, on the Azure cloud platform.Key ResponsibilitiesDesign and deploy dynamically scalable and highly...

  • Cloud Infrastructure Architect

    3 weeks ago

    Mumbai, Maharashtra, India Cloud Counselage Pvt Ltd Full time

    Job Title: Cloud Infrastructure ArchitectJob Summary:We are seeking a highly skilled Cloud Infrastructure Architect to join our team at Cloud Counselage Pvt Ltd. As a Cloud Infrastructure Architect, you will be responsible for designing, implementing, and managing complex cloud-based infrastructure and services.Key Responsibilities:Design and implement cloud...

  • Cloud Solution Architect Lead

    1 week ago

    Mumbai, Maharashtra, India NTT DATA Full time

    About NTT DATAWe are a $30+ billion trusted global innovator of business and technology services.Serving 75% of the Fortune Global 100, we commit to helping clients innovate, optimize, and transform for long-term success.We invest over $3.6 billion each year in R&D to support organizations and society in moving confidently and sustainably into the digital...

  • Senior Cloud Data Center Architect

    3 weeks ago

    Mumbai, Maharashtra, India Jio Full time

    About the Role:Jio is seeking a highly experienced Senior Cloud Data Center Architect to join our team. As a key member of our data center infrastructure team, you will be responsible for designing and implementing large-scale data centers for our hybrid cloud environments.Key Responsibilities:Design and implement data center infrastructure for hybrid cloud...

  • Azure Cloud Data Architect

    4 weeks ago

    Mumbai, Maharashtra, India Quinnox Full time

    Job Title: Senior Data Architect for AzureJob Summary: We are seeking a highly skilled Senior Data Architect for Azure to design and implement data architecture solutions.Key Responsibilities:Designing the architecture for storing, processing, and managing data in Azure.Defining data models and ensuring data security and compliance.Implementing ETL (Extract,...

  • Snowflake Cloud Data Platform Architect

    3 weeks ago

    Mumbai, Maharashtra, India Apollo Global Management, Inc. Full time

    Job OverviewWe are seeking a highly skilled Snowflake Cloud Data Platform Architect to join our team at Apollo Global Management, Inc.Key ResponsibilitiesDesign and architect data solutions based on the Snowflake cloud data platform.Collaborate with stakeholders, data engineers, and business analysts to develop detailed data models and schema designs.Lead a...

  • Senior Data Architect

    6 days ago

    Mumbai, Maharashtra, India Fractal Full time

    AWS Lead Architect Job DescriptionFractal is seeking a highly skilled and experienced AWS Lead Architect to join our team.About the Role:As an AWS Lead Architect at Fractal, you will be responsible for designing and implementing large-scale enterprise data solutions using AWS data and analytics services.Key Responsibilities:Consult on, design, build, and...

  • Data Architect

    4 weeks ago

    Mumbai, Maharashtra, India Colgate-Palmolive Company Full time

    About the Role:We are seeking a highly skilled Data Architect to join our team at Colgate-Palmolive Company. As a Data Architect, you will be responsible for designing and implementing data solutions that meet the business needs of our organization.Key Responsibilities:Translate business requirements into technical solutionsDesign and implement data models...

  • Senior Data Engineer

    4 weeks ago

    Mumbai, Maharashtra, India General Mills Full time

    Job Title: Senior Data Engineer - Cloud ArchitectJob Summary:We are seeking a highly skilled Senior Data Engineer - Cloud Architect to join our team at General Mills. As a key member of our Enterprise Data Development team, you will be responsible for designing and architecting solutions to integrate and transform business data into Data Lake to deliver data...

  • Cloud Data Architect

    4 weeks ago

    Mumbai, Maharashtra, India CPP Investments Full time

    CPP Investments is a global investment organization that manages the assets of the Canada Pension Plan. As a Lead, Data Engineer, you will play a key role in designing and developing large-scale data processing systems using Amazon Web Services (AWS) cloud technology.The Data Engineering team is responsible for building robust and scalable data systems...

  • Cloud Infrastructure Architect – Global Data Foundation

    1 week ago

    Mumbai, Maharashtra, India General Mills Full time

    Job Title: Cloud Infrastructure Architect – Global Data FoundationJob Overview:The Enterprise Platform Team in Data & Analytics Squad at General Mills is seeking a skilled Cloud Infrastructure Architect to lead the development of a sustainable, secure, reliable, and resilient Big Data foundation. This individual will work closely with Data Architects, Data...

  • Cloud Solutions Architect Lead

    4 hours ago

    Mumbai, Maharashtra, India Rapyder Cloud Solutions Pvt Ltd Full time

    Job SummaryRapyder Cloud Solutions Pvt Ltd seeks an experienced Cloud Solutions Architect Lead to join our team. This is a challenging and rewarding role that requires strong technical knowledge of cloud technologies, excellent communication skills, and the ability to work with customers to understand their requirements and provide tailored solutions.About...

  • Cloud Data Solutions Architect

    6 days ago

    Navi Mumbai, Maharashtra, India Innovation Consulting Services Full time

    Data Architect Job DescriptionInnovation Consulting Services is seeking an experienced Data Architect to lead the design and implementation of robust data architectures on Google Cloud Platform (GCP). The ideal candidate will have a deep understanding of data modeling, data integration, and cloud data solutions.Key ResponsibilitiesDesign and implement...

  • Enterprise Cloud Infrastructure Specialist

    6 days ago

    Mumbai, Maharashtra, India NTT DATA Full time

    Job SummaryA career-defining opportunity has arisen for an Enterprise Cloud Infrastructure Specialist to join our team at NTT DATA. This role requires a seasoned professional with expertise in designing, architecting, and implementing end-to-end data management workflows.About UsNTT DATA is a leading IT services provider, empowering clients to build a better...

  • Data Architect

    2 weeks ago

    Mumbai, Maharashtra, India Talpro Full time

    Job Title: Data ArchitectWe are seeking a highly skilled Data Architect to join our team at Talpro. As a Data Architect, you will be responsible for designing and implementing data structures that meet the company's needs.Key Responsibilities:Designing data structures that include identifying, creating, preparing, and transforming dataCreating program...

  • Cloud Data Scientist

    2 weeks ago

    Mumbai, Maharashtra, India Cloud Counselage Pvt Ltd Full time

    Cloud Data Scientist Role DescriptionWe are seeking a talented Cloud Data Scientist to help us drive business growth through data-driven insights. As a key member of our team, you will be responsible for developing and implementing machine learning models to solve complex business problems.Collaborate with cross-functional teams to understand project...

  • Cloud Architect

    4 weeks ago

    Mumbai, Maharashtra, India Microsoft Full time

    OverviewAt Microsoft, we're looking for a skilled Cloud Architect to drive our Digital Application & Innovation team forward. As a Technology Innovation Expert, you'll own and win technical decision-making for customers, leveraging our cloud services to empower organizations to trust Azure for their workloads, tools, and data.Key ResponsibilitiesDesign and...

  • Data Architect

    2 months ago

    Navi Mumbai, Maharashtra, India Innovation Consulting Services Full time

    Role : Data Architect (GCP - Data Lake, Data Warehouse, BigQuery) Experience:- 8+ years in Data Warehousing, with 3+ years of relevant GCP experienceJob Description:We are looking for a highly skilled Data Architect with extensive experience in Google Cloud Platform (GCP) services, data modeling, and cloud data solutions. The ideal candidate will lead the...

  • Cloud Computing Team Lead

    6 days ago

    Mumbai, Maharashtra, India Cloud Counselage Pvt Ltd Full time

    Job Title: Cloud Computing Team Lead - Cloud Solutions ArchitectOverview: At Cloud Counselage Pvt Ltd, we are seeking an experienced Cloud Computing Team Lead to join our team. The successful candidate will lead a team of cloud engineers in the design, implementation, and management of cloud-based infrastructure and services.About the Role:This is a...