ai - Big Data Architect - Azure Databricks

3 weeks ago

Pune, Maharashtra, India Codvo Full time

Job Title : Big Data Architect / Databricks Architect.

Company Overview :

At Codvo, software and people transformations go hand-in-hand.

We are a global empathy-led technology services company.

Product innovation and mature software engineering are part of our core DNA.

Respect, Fairness, Growth, Agility, and Inclusiveness are the core values that we aspire to live by each day.

We continue to expand our digital strategy, design, architecture, and product management capabilities to offer expertise, outside-the-box thinking, and measurable results.

The Role :

We are seeking an experienced Big Data Architect with a specialization in Databricks to design the sophisticated data solutions that drive business value for our enterprise clients and power our internal AI products.

You will be responsible for architecting scalable, high-performance data lakehouse platforms and end-to-end data pipelines.

You will be the go-to expert for modern data architecture in a cloud-first world.

Key Responsibilities :

- Architectural Design : Design and document robust, end-to-end big data solutions on cloud platforms (AWS, Azure, GCP), with a strong focus on the Databricks Lakehouse Platform.

- Technical Leadership : Provide technical guidance and oversight to data engineering teams on best practices for data ingestion (batch and streaming), transformation (ETL/ELT), and processing using Spark.

- Data Modeling & Governance : Design and implement effective data models (e.g., Star Schema, Data Vault) and establish data governance policies for data quality, security, and compliance within the lakehouse.

- Technology Selection & Evaluation : Evaluate and recommend appropriate data technologies, tools, and frameworks (e.g., workflow orchestrators, data quality tools) to meet project requirements.

- Stakeholder Collaboration : Work closely with business analysts, data scientists, and client stakeholders to translate complex business requirements into tangible technical architecture.

- Proof of Concepts : Lead and build Proof of Concepts (PoCs) to validate architectural approaches and new technologies in the big data and AI space.

Required Qualifications & Skills :

- Experience : 10+ years of experience in data engineering, data warehousing, or software engineering, with at least 4+ years in a dedicated Data Architect role.

- Core Technology Expertise : Deep, hands-on architectural and implementation expertise with Apache Spark and the Databricks platform (including Delta Lake, Unity Catalog, and Structured Streaming) is mandatory.

- Cloud Proficiency : Proven experience architecting and deploying data solutions on at least one major cloud provider (AWS, Azure, or GCP).

- Deep familiarity with cloud storage (S3, ADLS Gen2) and data services (Glue, Azure Data Factory) is required.

- Programming & SQL : Strong proficiency in Python or Scala for data processing and expert-level SQL skills.

- AI/ML Acumen : Strong understanding of modern AI concepts, including Large Language Models (LLMs), Retrieval Augmented Generation (RAG), and agentic architectures.

- Experience designing systems that incorporate AI/ML is crucial.

- Data Concepts : In-depth knowledge of data warehousing concepts, data lake architecture, and modern Lakehouse patterns.

Location Remote(India).

Time - 2 :30-11 :30PM.

(ref:hirist.tech)

  • Big Data Engineer

    3 hours ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Data Engineer PositionWe are seeking a highly skilled data engineer to spearhead the development of robust data solutions using Azure Databricks. The ideal candidate will possess a strong background in data engineering and be proficient in leveraging Apache Spark to build efficient data pipelines.Responsibilities include:Data Pipeline Development: Design,...

  • Azure Databricks Architect

    4 weeks ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position:We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql.- Role: Azure Databricks Architect- Location: All Persistent Locations- Experience: 12 to 17 years- Job Type: Full Time EmploymentWhat You'll Do:- 12+ years of experience in data architecture, data engineering, or analytics.- 5+ years of...

  • Azure Databricks Architect

    4 weeks ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position: We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql. Role: Azure Databricks Architect Location: All Persistent Locations Experience: 12 to 17 years Job Type: Full Time Employment What You'll Do: 12+ years of experience in data architecture, data engineering, or analytics. 5+ years of...

  • Azure Databricks Architect

    1 day ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position: We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql. Role: Azure Databricks Architect Location: All Persistent Locations Experience: 12 to 17 years Job Type: Full Time Employment What You'll Do: 12+ years of experience in data architecture, data engineering, or analytics. 5+ years of...

  • Azure Databricks Developer

    3 weeks ago

    Pune, Maharashtra, India People Prime World Wide Full time

    About Client :Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus...

  • Solution Architect – Databricks

    2 days ago

    Pune, Maharashtra, India Codvo Full time US$ 1,25,000 - US$ 1,75,000 per year

    Solution Architect – Databricks (Document AI & Knowledge Graph Focus) Location: India – Pune Company Overview We are a global empathy-led technology services company where software and people transformations go hand-in-hand.Product innovation and mature software engineering are part of our core DNA. Our mission is to help our customers accelerate...

  • Azure Databricks

    3 weeks ago

    Pune, Maharashtra, India Phygital Insights Private Limited Full time

    Job DescriptionDescriptionWe are seeking an experienced Azure Databricks professional to join our team in India. The ideal candidate will have a strong background in data engineering and be proficient in leveraging Azure Databricks to build robust data solutions.Responsibilities- Design and implement data pipelines using Azure Databricks to process large...

  • Azure Databricks

    4 weeks ago

    Pune, Maharashtra, India People Prime Worldwide Full time

    Our client is a global technology company headquartered in Santa Clara, California. it focuses on helping organisations harness the power of data to drive digital transformation, enhance operational efficiency, and achieve sustainability. over 100 years of experience in operational technology (OT) and more than 60 years in IT to unlock the power of data from...

  • GenAI/ML Engineer(Azure, Databricks)

    4 days ago

    Pune, Maharashtra, India Enterprise Minds, Inc Full time

    We're Hiring | AI/ML & Generative AI Developer Location: (Specify Location or Remote/Hybrid if applicable) Join our AI Innovation Team and help shape the future of AI-powered solutions We're looking for an experienced AI/ML & Generative AI Developer who's passionate about building cutting-edge Generative AI, LLM-powered applications, and Agentic AI...

  • Big Data Engineer

    1 day ago

    Pune, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer">We are seeking a highly skilled Big Data Engineer to drive the design and implementation of scalable data pipelines using Apache Spark, Databricks, or equivalent big data frameworks. This is an excellent opportunity for experienced professionals to join our organization and leverage their expertise to drive business outcomes through...