Data Engineer

2 days ago

Bengaluru, Karnataka, India CAI Full time ₹ 7,00,000 - ₹ 14,00,000 per year
Data Engineer

Req number:

R6646

Employment type:

Full time

Worksite flexibility:

RemoteWho we are

CAI is a global technology services firm with over 8,500 associates worldwide and a yearly revenue of $1 billion+. We have over 40 years of excellence in uniting talent and technology to power the possible for our clients, colleagues, and communities. As a privately held company, we have the freedom and focus to do what is right—whatever it takes. Our tailor-made solutions create lasting results across the public and commercial sectors, and we are trailblazers in bringing neurodiversity to the enterprise.

Job Summary

We are seeking a motivated Data Engineer to join our dynamic team. As a Data Engineer, you will play a crucial role in building cloud-based data lake and analytics architectures using AWS and Databricks and is proficient in Python programming for data processing and automation. This is a Full-time and Remote position.

Job Description

We are looking for a Data Engineer that has experience in building data products using Databricks and related technologies. This position will be Full-time and Remote position.

What You'll Do

  • Design, develop, and maintain data lakes and data pipelines on AWS using ETL frameworks and Databricks

  • Integrate and transform large-scale data from multiple heterogeneous sources into a centralized data lake environment

  • Implement and manage Delta Lake architecture using Databricks Delta or Apache Hudi

  • Develop end-to-end data workflows using PySpark, Databricks Notebooks, and Python scripts for ingestion, transformation, and enrichment

  • Design and develop data warehouses and data marts for analytical workloads using Snowflake, Redshift, or similar systems

  • Design and evaluate data models (Star, Snowflake, Flattened) for analytical and transactional systems

  • Optimize data storage, query performance, and cost across the AWS and Databricks ecosystem

  • Build and maintain CI/CD pipelines for Databricks notebooks, jobs, and Python-based data processing scripts

  • Collaborate with data scientists, analysts, and stakeholders to deliver high-performance, reusable data assets

  • Maintain and manage code repositories (Git) and promote best practices in version control, testing, and deployment

  • Participate in making major technical and architectural decisions for data engineering initiatives

  • Monitor and troubleshoot Databricks clusters, Spark jobs, and ETL processes for performance and reliability

  • Coordinate with business and technical teams through all phases of the software development life cycle

What You'll Need

Required

  • 5+ years of experience building and managing Data Lake Architecture on AWS Cloud

  • 3+ years of experience with AWS Data services such as S3, Glue, Lake Formation, EMR, Kinesis, RDS, DMS, and Redshift

  • 3+ years of experience building Data Warehouses on Snowflake, Redshift, HANA, Teradata, or Exasol

  • 3+ years of hands-on experience working with Apache Spark or PySpark, on Databricks

  • 3+ years of experience implementing Delta Lakes using Databricks Delta or Apache Hudi

  • 3+ years of experience in ETL development using Databricks, AWS Glue, or other modern frameworks

  • Proficiency in Python for data engineering, automation, and API integrations.

  • Experience in Databricks Jobs, Workflows, and Cluster Management

  • Experience with CI/CD pipelines and Infrastructure as Code (IaC) tools like Terraform or CloudFormation is a plus

  • Bachelor's degree in computer science, Information Technology, Data Science, or related field

Physical Demands

  • This role involves mostly sedentary work, with occasional movement around the office to attend meetings, etc.

  • Ability to perform repetitive tasks on a computer, using a mouse, keyboard, and monitor

Reasonable accommodation statement

If you require a reasonable accommodation in completing this application, interviewing, completing any pre-employment testing, or otherwise participating in the employment selection process, please direct your inquiries to or – 8111.

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 345819NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer / Developer (Pipelines & Analytics) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Role:...

  • Sr. Data Engineer Data Science

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Req ID: 342869NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer Data Science to join our team in Bangalore, Karnātaka (IN-KA), India (IN). ...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Key Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...

  • Data Engineering

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Req ID: 345813NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineering & Analytics Architect to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Role: Own the...

  • Data & AI Engineer Lead

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Framework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Req ID: 343998NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Sr ETL Developer (Architect) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Req ID: 344005NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - ETL Developer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). "Job Duties: Design,...

  • Senior Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 30,00,000 per year

    Build scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...

  • Sr Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    At least 6+ years of relevant experience in design, development, complete end-end design of enterprise-wide big data solution. Experience in designing & developing a big data solution using Spark, Scala, AWS Glue, Lambda, SNS/SQS, Cloudwatch is a must. Complete development, configuration, test cases and unit testing Perform code reviews and ensure standards...