Lead Data Architect

1 week ago

Bengaluru, Karnataka, India Weekday Full time ₹ 12,00,000 - ₹ 36,00,000 per year

This role is for Weekday's client.

Mandatory Skills: Python, PySpark, SQL, Azure Databricks, Azure DataFactory, Azure Synapse, ETL,Data Architect

Role Overview: Lead Data Engineer

We are looking for a Senior Data Engineer with a strong background in Python, Spark, Databricks, and Azure to join our growing team. The ideal candidate will have extensive experience in data processing, working with cloud platforms (specifically Azure), and be able to handle complex data engineering tasks. 

Key Responsibilities:

  • Design, build, and optimize scalable data pipelines for large-scale data processing using Python and Apache Spark.
  • Leverage Azure Databricks to perform big data processing, including working with PySpark to process and analyze large datasets.
  • Utilize Azure Data Factory for seamless data integration and orchestration across cloud environments.
  • Implement and maintain solutions using Azure Data Lake Storage for big data analytics and transformation.
  • Write efficient and reusable Python code, utilizing libraries such as Pandas and NumPy, to process and manipulate data.
  • Work with core Azure data services like Azure SQL Database, Azure Synapse Analytics, Azure Cosmos DB, and Azure Blob Storage.
  • Design and maintain complex SQL queries for managing and analyzing relational databases.
  • Ensure high-quality data management, integrity, and security across all stages of data processing and analysis.
  • Collaborate with cross-functional teams to understand data requirements and build solutions to meet business needs.
  • Provide mentorship and guidance to junior team members.

Key Skills & Qualifications:

  • Experience: 7+ years of experience in data engineering or related roles, with a focus on cloud technologies and big data.
  • Programming: Proficiency in Python, including knowledge of Pythonic principles, data structures, and algorithms. Hands-on experience with libraries such as Pandas and NumPy.
  • Cloud Technologies: In-depth knowledge of Azure, including Azure SQL Database, Azure Synapse Analytics, Azure Cosmos DB, Azure Data Factory, Azure Blob Storage, and Azure Data Lake Storage.
  • Data Processing: Strong experience with Apache Spark using Azure Databricks and PySpark for large-scale data processing.
  • SQL: Strong skills in SQL for querying and managing relational databases. Ability to write complex and optimized SQL queries.
  • Communication: Excellent communication skills, with the ability to collaborate effectively across teams and present technical solutions to non-technical stakeholders.
  • Problem-Solving: Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve complex data challenges

  • AWS Architect Lead

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 1,00,00,000 - ₹ 2,00,00,000 per year

    Req ID: 327912NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AWS Architect Lead to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Title: Digital Engineering Sr...

  • Data Architect/Lead

    1 week ago

    Bengaluru, Karnataka, India Photon Group Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    DescriptionJob Title: Data Architect/Lead (Azure Data Systems)Location: BangaloreJob Description:We are seeking a highly skilled Data Architect/Lead with expertise in Azure Data Systems to join our team. As a Data Architect/Lead, you will be responsible for designing and implementing scalable, high-performance data solutions using Azure data services. This...

  • Data & AI Engineer Lead

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Salesforce Architect

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 342521NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Salesforce Architect - CPQ and Revenue Cloud to join our team in Bangalore, Karnātaka (IN-KA), India (IN). As an SFDC...

  • Lead Data Architect

    4 days ago

    Bengaluru, Karnataka, India Aezion, Inc Full time ₹ 12,00,000 - ₹ 30,00,000 per year

    Data Architect - Data & Analytics Delivery Practice LeadFulltimeBengaluru/CoimbatoreAbout the Role:We are seeking a highly skilled and results-drivenData & Analytics Delivery Practice Leadto lead our end-to-end data engineering, Big Data, Streaming and business intelligence (BI) solutions. This is a key leadership role for someone who thrives on building...

  • Data Architect

    1 week ago

    Bengaluru, Karnataka, India ID4 Consultancy Full time ₹ 14,40,000 - ₹ 16,80,000 per year

    Job Title: Data Architect Location: Noida / Pune / Nagpur / Bangalore Budget: ₹1.2L – ₹1.4L per month Experience: 10 to 14 Years Employment Type: Full-time Hiring Manager: SipraJob SummaryWe are seeking a highly skilled Data Architect to design and implement robust, scalable, and secure enterprise data solutions. You will play a key role in shaping our...

  • Data Architect

    1 week ago

    Bengaluru, Karnataka, India Glauben Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    ETRM Data Architect Aug 2025The Enterprise Trading Architect is a senior technical leader responsible for defining, designing, and implementing the comprehensive technology architecture supporting the organizations trading operations across asset classes, markets, and geographies. This role ensures that trading platforms, systems, and processes are...

  • Lead Data Architect

    2 days ago

    Bengaluru, Karnataka, India Thoughtworks Full time ₹ 8,00,000 - ₹ 12,00,000 per year

    Lead data architects at Thoughtworks play a key part in developing modern data architecture approaches to meet business objectives and provide end-to-end data solutions. They take a technical leadership role in enabling clients and Thoughtworks teams to align on outcomes that support the vision painted by data strategists. They lead, with support, the...

  • Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India Rackspace Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    As a Data Architect for Data, you are passionate about data and technology solutions and are driven to learn about them and keep up with market evolution. You will play an active role in delivering modern data solutions for clients including data ingestion/data pipeline design and implementation, data warehouse & data lake architectures, cognitive computing...

  • Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India Rackspace Full time ₹ 2,00,00,000 - ₹ 2,50,00,000 per year

    As a Data Architect for Data, you are passionate about data and technology solutions and are driven to learn about them and keep up with market evolution. You will play an active role in delivering modern data solutions for clients including data ingestion/data pipeline design and implementation, data warehouse & data lake architectures,...