
Data Engineer
1 week ago
Job Role : Data Engineer
Experience : 12 - 16 years
Notice Period : Immediate - 30 days
Job Location : Bengaluru or PanIndia
Primary Skills : Bigdata, Spark, Scala and AWS
Secondary Skills : Kubernetes, Kafka
Job Description :
5+ years of software development experience with deep understanding of algorithms, data structures, design patterns, data pipelines and data warehousing.
Algorithms, data structures, design patterns required forà
Data processing (Sorting, filtering and aggregating large datasets)
Optimization (reducing time and space complexity in ETL)
Search and stream data (implementing fast lookups, sliding window, sampling, etc.)
• Strong hands-on experience in one or more programming languages such as Java, scala, Python or similar languages
Programming languages hands-on experience is required to handle complex data transformations
• Strong hands-on experience in distributed processing using Spark and Hive.
In Big data environment, experience in large scale distributed infrastructures for
data processing is required (Hadoop, Spark, Hive, Kafka, Redis)
• Hands on experience with AWS Cloud Computing platforms and understanding of scalability and reliability issues.
In Modern Data solutions cloud experience is required and mandatory
• Good understanding of Kubernetes including its core components and architecture
For CI/CD support, Cloud Compatibility, Auto scaling, schedule and manage jobs related to ETL, streaming, etc..
-
Data Entry Operator
10 hours ago
Bengaluru, Karnataka, India Design Engineer Full time ₹ 2,64,000 per yearWe are seeking a dedicated and detail-oriented Data Entry Operator (DEO) to support R&D projects. The role involves accurate data entry, documentation, and maintenance of research records in secure systems. The DEO will assist scientists, engineers, and administrative staff by ensuring timely and error-free handling of project information.Key...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearDesign and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack. Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from the application layer...
-
Data Engineer
2 weeks ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 25,00,000 per yearMigrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix systems....
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 1,04,000 - ₹ 1,30,878 per yearReq ID:321800We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karntaka (IN-KA), India (IN)."Job Duties: Key Responsibilities: Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per yearKey Responsibilities:Design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Provide thought leadership by recommending the most appropriate technologies and solutions for a given use case, covering the entire spectrum from...
-
Technical Lead- Data Engineer
10 hours ago
Bengaluru, Karnataka, India Astar Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearKindly find the Job Description Below.Job Title:Technical Lead- Data EngineerLocation: BangaloreYears of Experience: 8+ years of experienceSigmoidworks with a variety of clients from start-ups to fortune 500 companies. We are looking for a detailed oriented self-starter to assist our engineering and analytics teams in various roles as a Software...
-
Data & AI Engineer Lead
15 hours ago
Bengaluru, Karnataka, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per yearFramework Design & Architecture Architect a metadata-driven, Python/Spark-based framework for automated data validation across high-volume production datasets. Define DQ rule templates for completeness, integrity, conformity, accuracy, and timeliness. Establish data quality thresholds, escalation protocols, and exception workflows. Automation & Integration...
-
Data Engineer
9 hours ago
Bengaluru, Karnataka, India NTT DATA, Inc. Full time ₹ 10,00,000 - ₹ 25,00,000 per yearJob Duties:Migrate ETL workflows from SAP BODS to AWS Glue/dbt/Talend. Develop and maintain scalable ETL pipelines in AWS. Write PySpark scripts for large-scale data processing. Optimize SQL queries and transformations for AWS PostgreSQL. Work with Cloud Engineers to ensure smooth deployment and performance tuning. Integrate data pipelines with existing Unix...
-
Data Engineer
1 week ago
Bengaluru, Karnataka, India, Karnataka AMISEQ Full timeData Engineer Bangalore, KA WFO A minimum of 3 years of experience is required. Key ResponsibilitiesDevelop and maintain ETL/ELT pipelines using modern data engineering tools and frameworks7 * 24 On-call support data pipeline health, performance, and SLA complianceDocument data processes, schemas, and best practices SOPImplement data quality checks,...
-
Data Engineer
1 day ago
Bengaluru, Karnataka, India, Karnataka Acqueon Full timeAbout the JobWe are building a Customer Data Platform (CDP) designed to unlock the full potential of customer experience (CX) across our products and services. This role offers the opportunity to design and scale a platform that unifies customer data from multiple sources, ensures data quality and governance, and provides a single source of truth for...