Bigdata Architect

3 days ago

Pune Maharashtra, India Codvo.ai Full time

Job Title: Big Data Architect / Databricks Architect

**Company Overview**:

- At Codvo, software and people transformations go hand-in-hand. We are a global empathy-led technology services company. Product innovation and mature software engineering are part of our core DNA. Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day. We continue to expand our digital strategy, design, architecture, and product management capabilities to offer expertise, outside-the-box thinking, and measurable results.

**The Role**
- We are seeking an experienced Big Data Architect with a specialization in Databricks to design the sophisticated data solutions that drive business value for our enterprise clients and power our internal AI products. You will be responsible for architecting scalable, high-performance data lakehouse platforms and end-to-end data pipelines. You will be the go-to expert for modern data architecture in a cloud-first world.

**Key Responsibilities**
- ** Architectural Design**: Design and document robust, end-to-end big data solutions on cloud platforms (AWS, Azure, GCP), with a strong focus on the Databricks Lakehouse Platform.
- ** Technical Leadership**: Provide technical guidance and oversight to data engineering teams on best practices for data ingestion (batch and streaming), transformation (ETL/ELT), and processing using Spark.
- ** Data Modeling & Governance**: Design and implement effective data models (e.g., Star Schema, Data Vault) and establish data governance policies for data quality, security, and compliance within the lakehouse.
- ** Technology Selection & Evaluation**: Evaluate and recommend appropriate data technologies, tools, and frameworks (e.g., workflow orchestrators, data quality tools) to meet project requirements.
- ** Stakeholder Collaboration**: Work closely with business analysts, data scientists, and client stakeholders to translate complex business requirements into tangible technical architecture.
- ** Proof of Concepts**: Lead and build Proof of Concepts (PoCs) to validate architectural approaches and new technologies in the big data and AI space.

**Required Qualifications & Skills**
- ** Experience**: 10+ years of experience in data engineering, data warehousing, or software engineering, with at least 4+ years in a dedicated Data Architect role.
- ** Core Technology Expertise**: Deep, hands-on architectural and implementation expertise with Apache Spark and the Databricks platform (including Delta Lake, Unity Catalog, and Structured Streaming) is mandatory.
- ** Cloud Proficiency**: Proven experience architecting and deploying data solutions on at least one major cloud provider (AWS, Azure, or GCP). Deep familiarity with cloud storage (S3, ADLS Gen2) and data services (Glue, Azure Data Factory) is required.
- ** Programming & SQL**: Strong proficiency in Python or Scala for data processing and expert-level SQL skills.
- ** AI/ML Acumen**: Strong understanding of modern AI concepts, including Large Language Models (LLMs), Retrieval Augmented Generation (RAG), and agentic architectures. Experience designing systems that incorporate AI/ML is crucial.
- ** Data Concepts**: In-depth knowledge of data warehousing concepts, data lake architecture, and modern Lakehouse patterns.
- Location - Remote(India)
- Time
- 2:30-11:30PM

  • BigData-Hadoop/Scala Engineer, AVP

    1 week ago

    Pune, India Deutsche Bank Full time

    Job Description BigData-Hadoop/Scala Engineer, AVP Position Overview Job Title : BigData-Hadoop/Scala Engineer, AVP Location : Pune, India Role Description A Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well...

  • BigData-Hadoop/Scala Engineer, AVP

    3 weeks ago

    Pune, Maharashtra, India Deutsche Bank Full time

    Job DescriptionBigData-Hadoop/Scala Engineer, AVPPosition OverviewJob Title : BigData-Hadoop/Scala Engineer, AVPLocation : Pune, IndiaRole DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected,...

  • BigData-Hadoop/Scala Engineer, AVP

    2 weeks ago

    Pune, Maharashtra, India Deutsche Bank Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    BigData-Hadoop/Scala Engineer, AVPJob ID: R0388873Full/Part-Time: Full-timeRegular/Temporary: RegularListed: Location: PunePosition OverviewJob Title : BigData-Hadoop/Scala Engineer, AVPLocation : Pune, IndiaRole DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key...

  • Senior Cloud Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeCloudDataArchitect Full time US$ 1,50,000 - US$ 2,00,000

    Senior Cloud Data ArchitectThis position offers the opportunity to lead and drive the design of scalable data architectures on cloud platforms. The ideal candidate will have a strong understanding of cloud-based systems, data modeling concepts, and distributed computing paradigms.Design and develop highly scalable data warehouses and big data solutions using...

  • Product Solution Architect

    2 weeks ago

    Pune, Maharashtra, India UST Global Full time

    15 - 25 Years- 3 Openings- Pune**Role description**: We are looking for an experienced and motivated **Product Solution Architect** with deep expertise in designing and implementing cutting-edge big-data solutions on the **Amazon Web Services (AWS)** platform. As a key member of our dynamic team, you will play an integral role in driving the success of our...

  • Big Data Architect

    6 days ago

    Pune, India Datametica Full time

    We at Onix Datametica Solutions Private Limited are looking for Bigdata Lead who have a passion for cloud with knowledge of different on-premise and cloud Data implementation in the field of Big Data and Analytic s including and not limiting to Teradata, Netezza, Exadata, Oracle, Cloudera, Hortonworks and alike. Ideal candidates should have technical...

  • BigData-Hadoop/Scala Engineer, AVP

    1 day ago

    Pune - Business Bay, India Deutsche Bank Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Description:Job Title : BigData-Hadoop/Scala Engineer, AVP Location : Pune, India Role DescriptionA Senior Engineer is responsible for designing and developing entire engineering solutions to accomplish business goals. Key responsibilities of this role include ensuring that solutions are well architected, with maintainability and ease of testing built in...

  • Technology Lead

    6 days ago

    Pune, India Atgeir Solutions Full time

    At Atgeir Solutions, we are pioneers in technological innovation. We're seeking a Technology Lead (Big Data / Cloud) who can drive technical excellence, mentor teams, and collaborate with clients to deliver large-scale solutions. This role offers a growth path to Technical Architect. We're Hiring | Technology Lead (Big Data / Cloud) Location:Global Delivery...

  • Trade - Technology Architect

    2 weeks ago

    Pune, India Citi Full time

    **Responsibilities**: - Executes the architectural vision for all IT systems through major, complex IT architecture projects; ensures that architecture conforms to enterprise blueprints. - Develops technology road maps, while keeping up-to-date with emerging technologies, and recommends business directions based on these technologies. - Provides technical...

  • AFC Transaction Monitoring

    2 weeks ago

    Pune, Maharashtra, India Deutsche Bank Full time ₹ 4,50,000 - ₹ 5,50,000 per year

    Job Title: AFC Transaction Monitoring - Senior Engineer, VP Location: Pune, India Role DescriptionYou will be joining the Anti-Financial Crime (AFC) Technology team and will work as part of a multi-skilled agile squad, specializing in designing, developing, and testing engineering solutions, as well as troubleshooting and resolving technical issues to...