Data Engineer

2 days ago

Bengaluru, Karnataka, India krtrimaIQ Cognitive Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

Job Title: AWS Data Engineer

Location: Bengaluru | Hybrid

Experience: Minimum 4+ years

Company : krtrimaIQ Cognitive Solutions

Role Overview

We are seeking an experienced AWS Data Engineer with strong expertise in building, deploying, and optimizing data pipelines on AWS. The ideal candidate will have 4+ years of experience in data engineering with hands-on exposure to AWS-native services, orchestration tools, and scripting for large-scale data ingestion and transformation. This role involves working closely with solution architects and cross-functional teams to design scalable, metadata-driven data frameworks that support diverse ingestion patterns including batch, streaming, and APIs.

Roles & Responsibilities

Design and implement scalable data pipelines using AWS Glue and orchestration tools (Airflow / Step Functions).

Work on batch processing, real-time streaming pipelines using Kafka/Kinesis, and API-based data ingestion.

Develop and optimize pipelines with PySpark and Python scripting, leveraging AWS Glue (Spark-based framework).

Build and maintain API ingestion frameworks using AWS API Gateway.

Collaborate with solution architects to improve the data ingestion framework with AWS-native services, making them metadata-driven and adaptable for multiple ingestion patterns (batch, stream, APIs).

Develop reusable, efficient, and scalable data integration processes while ensuring data quality and compliance.

Write optimized queries in SQL and work with transformation tools like DBT.

Troubleshoot, monitor, and enhance workflow efficiency, ensuring smooth production operations.

Requirements / Skills

4+ years of IT industry experience, with at least 4 years as a Data Engineer on AWS.

Strong hands-on skills with AWS Glue, AWS Lambda, Airflow / Step Functions, PySpark, Python, SQL, DBT.

Experience in real-time data streaming solutions (using Kafka/Kinesis).

Proven expertise in building and maintaining data pipelines for large-scale data processing.

Experience in orchestrating workflows and handling dependency management with Airflow or Step Functions.

Knowledge of metadata-driven frameworks and automation for ingestion processes.

Strong problem-solving skills and ability to collaborate with architects and stakeholders.

Excellent communication skills for interaction with both technical and business teams.

Preferred Skills (Nice to Have)

Exposure to data lake/data warehouse solutions like Amazon Redshift or Snowflake.

Experience with DevOps practices for CI/CD in data pipeline deployments.

Knowledge of data governance, lineage, and security best practices in AWS.

Ready to take your AWS Data Engineering expertise to the next level? Apply now and be part of a high-impact team delivering modern data solutions

AWS #DataEngineer #BigData #Glue #PySpark #Python #SQL #Hiring #Airflow #Kinesis #BangaloreJobs #HybridJobs #immediatejoiner

  • Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Entry Operator

    5 days ago

    Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per year

    We are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...

  • Technical Lead- Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Kindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...

  • Data Senior Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Engineer

    11 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    14 hours ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Job Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...

  • Senior, Data Engineer

    2 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your day at NTT DATAThe Manager,...

  • Data Engineer

    11 hours ago

    Bengaluru, Karnataka, India NTT DATA Business Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience: 4 to 6 YearsLocation: Hybrid/Bangalore]Employment Type: Full-TimeRole & responsibilitiesMust-Have Skills:46 years of experience in data engineering roles.Proven experience in data migration and conversion projects (SAP or non-SAP).Strong knowledge of ETL concepts, tools, and frameworks.Proficiency in SQL, Python, or other data scripting...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: Key...