Azure PySpark Solution Architect

1 week ago

thiruvananthapuram, India UST Full time

Azure Databricks / PySpark Solution Architect – Banking & Financial Services Pune (Balewadi) / Trivandrum We’re looking for an Azure Databricks & PySpark Solution Architect to design, build, and scale enterprise-grade data platforms for leading Banking & Financial Services clients. If you excel in Lakehouse architecture, PySpark engineering, data governance, and cloud-first analytics, this role is for you What You’ll Do ️ Architecture & Data Platform Design Build Databricks Lakehouse architecture using Delta Lake & Unity Catalog Design scalable batch + streaming data pipelines using PySpark, ADF/Synapse, Event Hubs/Kafka Define HLD/LLD, orchestration, CI/CD workflows, and cluster optimization Architect ingestion for core banking datasets—payments, transactions, fraud, regulatory ⚙️ Data Engineering, Performance & Analytics Enablement Develop high-performance ETL/ELT pipelines using PySpark, SQL, Auto Loader, Structured Streaming Optimize Spark workloads with AQE, caching, partitioning, Z-Ordering Implement Delta Lake best practices: CDC, schema evolution, versioning Enable ML Ops pipelines using MLflow, Feature Store, and Databricks workflows Ensure observability, reliability, and performance at scale Governance, Security & Technical Leadership Implement governance with Unity Catalog / Purview (lineage, RBAC, PII/PCI classification) Ensure compliance: PCI-DSS, AML/KYC, SOX, GDPR Architect secure environments: Key Vault, VNET, Private Endpoints Lead engineering teams, code reviews, DevOps automation (Azure DevOps, IaC – Terraform/Bicep) Engage with architects, SMEs, and business teams to define strategy ⭐ Mandatory Skills Azure Databricks, PySpark, Delta Lake, Auto Loader, Structured Streaming Azure Data Services: ADF, Synapse, ADLS Gen2, Event Hubs/Kafka Lakehouse architecture & distributed computing SQL/NoSQL + strong data modeling expertise Spark performance tuning for large-scale workloads Governance frameworks: Unity Catalog / Purview CI/CD, DevOps, IaC (Terraform/ARM/Bicep) Strong documentation & communication skills ✨ Good to Have Banking/FS domain expertise (fraud, payments, risk, regulatory, customer 360) Experience with Databricks across multiple clouds (Azure/AWS/GCP) Knowledge of event-driven and microservices-based architectures

  • Azure PySpark Solution Architect

    1 week ago

    thiruvananthapuram, India UST Full time

    Azure Databricks / PySpark Solution Architect – Banking & Financial Services Pune (Balewadi) / Trivandrum We’re looking for an Azure Databricks & PySpark Solution Architect to design, build, and scale enterprise-grade data platforms for leading Banking & Financial Services clients. If you excel in Lakehouse architecture, PySpark engineering, data...

  • Azure PySpark Solution Architect

    1 week ago

    Thiruvananthapuram, India UST Full time

    Azure Databricks / PySpark Solution Architect – Banking & Financial Services Pune (Balewadi) / Trivandrum We’re looking for an Azure Databricks & PySpark Solution Architect to design, build, and scale enterprise-grade data platforms for leading Banking & Financial Services clients. If you excel in Lakehouse architecture, PySpark engineering, data...

  • Azure PySpark Solution Architect

    1 week ago

    Thiruvananthapuram, India UST Full time

    Azure Databricks / PySpark Solution Architect – Banking & Financial ServicesPune (Balewadi) / TrivandrumWe’re looking for an Azure Databricks & PySpark Solution Architect to design, build, and scale enterprise-grade data platforms for leading Banking & Financial Services clients. If you excel in Lakehouse architecture, PySpark engineering, data...

  • Azure PySpark Solution Architect

    1 week ago

    Thiruvananthapuram, India UST Full time

    Azure Databricks / PySpark Solution Architect – Banking & Financial ServicesPune (Balewadi) / TrivandrumWe’re looking for an Azure Databricks & PySpark Solution Architect to design, build, and scale enterprise-grade data platforms for leading Banking & Financial Services clients. If you excel in Lakehouse architecture, PySpark engineering, data...

  • Azure PySpark Solution Architect

    1 week ago

    Thiruvananthapuram, India UST Full time

    Azure Databricks / PySpark Solution Architect – Banking & Financial ServicesPune (Balewadi) / TrivandrumWe’re looking for an Azure Databricks & PySpark Solution Architect to design, build, and scale enterprise-grade data platforms for leading Banking & Financial Services clients. If you excel in Lakehouse architecture, PySpark engineering, data...

  • Azure PySpark Solution Architect

    1 week ago

    thiruvananthapuram, India UST Full time

    Azure Databricks / PySpark Solution Architect – Banking & Financial ServicesPune (Balewadi) / TrivandrumWe’re looking for an Azure Databricks & PySpark Solution Architect to design, build, and scale enterprise-grade data platforms for leading Banking & Financial Services clients. If you excel in Lakehouse architecture, PySpark engineering, data...

  • Solutions Architect

    3 weeks ago

    Thiruvananthapuram, India Digivance Solution Full time

    Job Description :Job Overview :We are looking for a seasoned Architect/ Senior Lead with strong experience in the Retail domain, especially in Store Inventory, Order Management, and Omnichannel solutions. The ideal candidate will design scalable architectures, lead integrations, and drive cloud and data strategy using modern platforms like Azure, Databricks,...

  • Senior Azure Data Engineer

    3 days ago

    thiruvananthapuram, India Us Technology International Private Limited Full time

    Experience: Minimum 7years Location: Trivandrum, Kerala Work Timing: UK Shift Timining Key Accountabilities / Responsibilities: Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End pipeline design, and code quality. Review and optimize PySpark , SQL ,...

  • Senior Azure Data Engineer

    4 days ago

    Thiruvananthapuram, India Us Technology International Private Limited Full time

    Experience: Minimum 7years Location: Trivandrum, Kerala Work Timing: UK Shift Timining Key Accountabilities / Responsibilities: Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End pipeline design, and code quality. Review and optimize PySpark , SQL ,...

  • Senior Azure Data Engineer

    4 days ago

    Thiruvananthapuram, India Us Technology International Private Limited Full time

    Experience: Minimum 7yearsLocation: Trivandrum, KeralaWork Timing: UK Shift TiminingKey Accountabilities / Responsibilities: Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End pipeline design, and code quality.Review and optimize PySpark, SQL, and...