Data Engineer

2 weeks ago

Bengaluru, India krtrimaIQ Cognitive Solutions Full time

Job Title: AWS Data Engineer

Location: Bengaluru | Hybrid

Experience: Minimum 4+ years

Company : krtrimaIQ Cognitive Solutions

Role Overview

We are seeking an experienced AWS Data Engineer with strong expertise in building, deploying, and optimizing data pipelines on AWS. The ideal candidate will have 4+ years of experience in data engineering with hands-on exposure to AWS-native services, orchestration tools, and scripting for large-scale data ingestion and transformation. This role involves working closely with solution architects and cross-functional teams to design scalable, metadata-driven data frameworks that support diverse ingestion patterns including batch, streaming, and APIs.

Roles & Responsibilities

Design and implement scalable data pipelines using AWS Glue and orchestration tools (Airflow / Step Functions).

Work on batch processing, real-time streaming pipelines using Kafka/Kinesis, and API-based data ingestion.

Develop and optimize pipelines with PySpark and Python scripting, leveraging AWS Glue (Spark-based framework).

Build and maintain API ingestion frameworks using AWS API Gateway.

Collaborate with solution architects to improve the data ingestion framework with AWS-native services, making them metadata-driven and adaptable for multiple ingestion patterns (batch, stream, APIs).

Develop reusable, efficient, and scalable data integration processes while ensuring data quality and compliance.

Write optimized queries in SQL and work with transformation tools like DBT.

Troubleshoot, monitor, and enhance workflow efficiency, ensuring smooth production operations.

Requirements / Skills

4+ years of IT industry experience, with at least 4 years as a Data Engineer on AWS.

Strong hands-on skills with AWS Glue, AWS Lambda, Airflow / Step Functions, PySpark, Python, SQL, DBT.

Experience in real-time data streaming solutions (using Kafka/Kinesis).

Proven expertise in building and maintaining data pipelines for large-scale data processing.

Experience in orchestrating workflows and handling dependency management with Airflow or Step Functions.

Knowledge of metadata-driven frameworks and automation for ingestion processes.

Strong problem-solving skills and ability to collaborate with architects and stakeholders.

Excellent communication skills for interaction with both technical and business teams.

Preferred Skills (Nice to Have)

Exposure to data lake/data warehouse solutions like Amazon Redshift or Snowflake.

Experience with DevOps practices for CI/CD in data pipeline deployments.

Knowledge of data governance, lineage, and security best practices in AWS.

Ready to take your AWS Data Engineering expertise to the next level? Apply now and be part of a high-impact team delivering modern data solutions

AWS #DataEngineer #BigData #Glue #PySpark #Python #SQL #Hiring #Airflow #Kinesis #BangaloreJobs #HybridJobs #immediatejoiner

  • Data Entry Operator

    1 week ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Engineer

    4 hours ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Snowflake Data Engineer

    4 hours ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Snowflake Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties:...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA, Inc. Full time

    Req ID: We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN). "Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack...

  • Senior Data Engineer

    5 hours ago

    Bengaluru, India NTT DATA Full time

    Job Description Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive. Your day at...

  • Technical Lead- Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data Senior Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Sr. Data Engineer

    3 hours ago

    Bengaluru, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr. Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Primary...

  • Data Engineer

    2 weeks ago

    Bengaluru, India NTT DATA Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key ResponsibilitiesData...