Data Engineer

5 days ago

Bengaluru, Karnataka, India Weekday AI Full time ₹ 8,00,000 - ₹ 12,00,000 per year

This role is for one of the Weekday's clients

Min Experience: 4 years

Location: Pune, Bangalore

JobType: full-time

We are looking for an experienced Data Engineer with strong capabilities across SQL, ETL, Data Warehousing, BI, DevOps, and CI/CD—combined with hands-on experience in core banking systems and regulatory reporting pipelines. The ideal candidate will be highly technical, detail-oriented, and comfortable working with complex financial data environments.

Requirements

Key Responsibilities1. Data Engineering & ETL Development
  • Design, build, and optimize ETL workflows for extracting data from Core Banking Systems (CBS) to support regulatory, analytics, and reporting needs.
  • Develop ingestion pipelines using Apache NiFi, Airflow, SSIS, Informatica, Python, PySpark, and Databricks.
  • Integrate and manage streaming solutions using Kafka or RabbitMQ.
  • Ensure pipeline reliability, performance, data accuracy, and high availability.
2. Data Warehousing & Data Modelling
  • Build and maintain staging, integration, and semantic layers within enterprise data warehouses.
  • Apply dimensional modelling techniques (star/snowflake schemas) and data vault concepts when needed.
  • Optimize schema structures across SQL and distributed data environments for scalability and speed.
3. SQL & Database Engineering
  • Write advanced SQL queries, stored procedures, and transformations.
  • Work extensively with SQL Server, Oracle, and MySQL.
  • Conduct performance tuning, indexing, and query optimization for large datasets.
4. Big Data & Distributed Processing
  • Develop scalable transformation pipelines using Databricks, PySpark, and distributed processing engines.
  • Handle large-scale data processing across structured and semi-structured datasets.
5. BI, Reporting & Visualization Support
  • Build clean and standardized datasets for regulatory and management reporting.
  • Develop dashboards and visualizations using Power BI.
  • Collaborate with reporting teams to ensure data quality, clarity, and compliance.
6. DevOps & CI/CD Automation
  • Implement CI/CD workflows using Azure DevOps, Git, Jenkins, or similar tools.
  • Manage version control, automated deployments, environment provisioning, and test automation.
  • Ensure secure, scalable, and efficient deployment of data engineering and ETL components.
7. Banking Domain Expertise
  • Collaborate with finance, compliance, risk, and operations teams.
  • Mandatory experience working with core banking systems such as T24, Finacle, or Flexcube.
  • Build and maintain regulatory reporting pipelines (CBUAE, SAMA, QCB, BASEL, IFRS, ALM, Liquidity, Credit Risk, etc.).
Required Skills
  • Databases: SQL Server, Oracle, MySQL
  • ETL Tools: Apache NiFi, Airflow, SSIS, Informatica
  • Big Data: Databricks, PySpark
  • Messaging: Kafka, RabbitMQ
  • Programming: Python (required), Java (preferred)
  • Reporting: Power BI
  • Data Warehousing: Star/Snowflake schema, dimensional modelling
  • DevOps/CI/CD: Git, Jenkins, Azure DevOps
  • Nice to Have: MongoDB, Neo4j (NoSQL/Graph DBs)
  • Domain Expertise: Core banking systems and regulatory reporting
Experience
  • 4–7 years of experience in data engineering, ETL development, SQL, BI, and DevOps.
  • Mandatory: Experience working within banks or financial institutions, including core banking systems and regulatory frameworks.

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....

  • Data Engineer

    3 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 345819NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Role:...

  • Sr. Data Engineer Data Science

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Data & AI Engineer Lead

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Req ID: 343998NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Sr ETL Developer (Architect) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Req ID: 344005NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - ETL Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: Design,...

  • Senior Data Engineer

    8 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 30,00,000 per year

    Build scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...