Azure PySpark Solution Architect

1 day ago

Trivandrum, India UST Full time

Azure Databricks / PySpark Solution Architect – Banking & Financial ServicesPune (Balewadi) / TrivandrumWe’re looking for an Azure Databricks & PySpark Solution Architect to design, build, and scale enterprise-grade data platforms for leading Banking & Financial Services clients.If you excel in Lakehouse architecture, PySpark engineering, data governance, and cloud-first analytics, this role is for youWhat You’ll Do️ Architecture & Data Platform Design- Build Databricks Lakehouse architecture using Delta Lake & Unity Catalog- Design scalable batch + streaming data pipelines using PySpark, ADF/Synapse, Event Hubs/Kafka- Define HLD/LLD, orchestration, CI/CD workflows, and cluster optimization- Architect ingestion for core banking datasets—payments, transactions, fraud, regulatory⚙️ Data Engineering, Performance & Analytics Enablement- Develop high-performance ETL/ELT pipelines using PySpark, SQL, Auto Loader, Structured Streaming- Optimize Spark workloads with AQE, caching, partitioning, Z-Ordering- Implement Delta Lake best practices: CDC, schema evolution, versioning- Enable ML Ops pipelines using MLflow, Feature Store, and Databricks workflows- Ensure observability, reliability, and performance at scaleGovernance, Security & Technical Leadership- Implement governance with Unity Catalog / Purview (lineage, RBAC, PII/PCI classification)- Ensure compliance: PCI-DSS, AML/KYC, SOX, GDPR- Architect secure environments: Key Vault, VNET, Private Endpoints- Lead engineering teams, code reviews, DevOps automation (Azure DevOps, IaC – Terraform/Bicep)- Engage with architects, SMEs, and business teams to define strategy⭐ Mandatory Skills- Azure Databricks, PySpark, Delta Lake, Auto Loader, Structured Streaming- Azure Data Services: ADF, Synapse, ADLS Gen2, Event Hubs/Kafka- Lakehouse architecture & distributed computing- SQL/NoSQL + strong data modeling expertise- Spark performance tuning for large-scale workloads- Governance frameworks: Unity Catalog / Purview- CI/CD, DevOps, IaC (Terraform/ARM/Bicep)- Strong documentation & communication skills✨ Good to Have- Banking/FS domain expertise (fraud, payments, risk, regulatory, customer 360)- Experience with Databricks across multiple clouds (Azure/AWS/GCP)- Knowledge of event-driven and microservices-based architectures

  • Solutions Architect

    2 weeks ago

    Trivandrum, India QBurst Full time

    DescriptionWe are seeking a skilled Solution Architect to lead solution design, ensure architectural integrity, and guide engineering teams across the full delivery lifecycle. This role requires strong technical expertise in .NET, React, cloud-native architectures, and effective collaboration with diverse stakeholders. The Solution Architect will drive...

  • Senior Data Engineer

    2 weeks ago

    Trivandrum, India Us Technology International Private Limited Full time

    Senior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description –Key Accountabilities / Responsibilities:- Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to...

  • Senior Data Engineer

    2 weeks ago

    Trivandrum, India Us Technology International Private Limited Full time

    Senior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description –Key Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to...

  • Senior Data Engineer

    2 weeks ago

    Trivandrum, India UST Full time

    Senior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob DescriptionKey Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to End...

  • Senior data engineer

    2 weeks ago

    Trivandrum, India Us Technology International Private Limited Full time

    Senior Data EngineersExperience - 6 +Yrs (5-7 relevant years)Location: TrivandrumMandatory Skill - Pyspark, SQL, Azure DatabricksUK Shift TimingJob Description –Key Accountabilities / Responsibilities:Provide technical direction and leadership to data engineers on data platform initiatives - ensuring adherence to best practices in data modelling, End to...

  • Solution Architect

    4 weeks ago

    Trivandrum, India Reflections Info Systems Full time

    Role OverviewWe are looking for a Solution Architect to support the design and delivery of scalable, secure, and high-performing technology solutions for our clients. This role combines hands-on technical expertise with strong architectural thinking. You will work closely with senior architects, delivery teams, and stakeholders to understand business needs,...

  • ServiceNow Solution Architect

    1 week ago

    Trivandrum, India Amroute Full time

    Title: ServiceNow Solution ArchitectLocation: Singapore (Onsite)Duration: 1 year plusThis a onsite position in Singapore, looking for someone who can relocate to Singapore.Job Summary:This role requires enterprise solution architect-level skills to assess current applications and supporting systems and articulate how ServiceNow can integrate with and/or...

  • Data Architect

    1 week ago

    Trivandrum, India Velodata Global Pvt Ltd Full time

    Job Title: Data ArchitectLocation: Cochin / Thiruvananthapuram ( Remote - First few days must work form the office)Experience: 15+ years overall, 8+ years in relevant data architecture rolessalary as per industry standardsAbout the RoleWe are looking for a hands-on Enterprise Data Architect to be a technical visionary and lead architect for our global...

  • Data Architect

    4 weeks ago

    Trivandrum, India Reflections Info Systems Full time

    We are looking for 10 + year experienced Data Architect with strong background in Snowflake, demonstrating leadership in technical design, architecture, and implementation of complex data solutions.Working hours - 8 hours , with a few hours of overlap during EST Time zone. This overlap hours is mandatory as meetings happen during this overlap hours. Working...

  • Azure Data Engineer

    1 week ago

    Trivandrum, India PepHire Full time

    We are seeking a highly skilled Data Engineer to join our dynamic team in Trivandrum. The ideal candidate will have strong expertise in Azure cloud services, data engineering, and analytics platforms. You will be responsible for designing, building, and optimizing scalable data pipelines and solutions to support business intelligence, reporting, and...