big data engineer data analysis jobs in Bangalore

Data Architecture - Big Data Engineer What does a Data Engineer do As an experienced member of our Data Engineering Platform Group you will be responsible for building and taking ownership over the successful design and development of data engineering projects within Fiserv's Enterprise Data Analytics division. You will be required to apply your depth of...

Implementation experience on building large scale data applications from scratch (initial stages) Programming experience in Python or Java Good experience of deploying applications on AWS and usage of its services Must have experience with Hadoop Distributed File System (HDFS), Amazon Simple Storage Service (S3) Must have good experience on SQL Data...

Job Title / Primary Skill:  Big Data Developer (Lead/Associate Manager) Management Level: G150 Years of Experience:  8 to 13 years Job Location:  Bangalore (Hybrid) Must Have Skills:  Big data, Spark, Scala, SQL, Hadoop Ecosystem. Educational Qualification:  BE/BTech/ MTech/ MCA, Bachelor or masters degree in Computer Science, Job Overview Overall...

Role Responsibilities: Build scalable data pipelines and applications from scratch on AWS Design and manage data ingestion processes and workflows Collaborate with functional and data science teams to deliver data solutions Optimize data storage and organization using HDFS, S3, and Delta Lake Job Requirements: Strong programming experience in Python or...

Help design, build and continuously improve the clients online platform. Research, suggest and implement new technology solutions following best practices/standards. Take responsibility for the resiliency and availability of different products. Be a productive member of the team. Location: India- Bangalore or...

Key Responsibilities Develop and optimize ETL processes to streamline data flow, Manage and enhance BI tools like Metabase for secure and effective reporting, Build and maintain dashboards and data models to provide business teams with real-time insights, Work with Mixpanel or similar tools to analyze user behavior and generate actionable insights, Ensure...

We are seeking a highly skilled Data Engineer to contribute to the development and maintenance of our data infrastructure. You will leverage your proficiency in AWS Big Data Services, strong programming skills, and expertise in data modeling and warehousing to build robust and scalable data solutions. This role requires a solid understanding of DevOps...

Roles and Responsibilities Design, develop, and maintain large-scale data pipelines using Azure Data Factory (ADF) to extract, transform, and load data from various sources into Azure Data bricks. Develop complex ETL processes using Python scripts and SQL queries to process large datasets stored in Azure Data Lake Storage. Collaborate with cross-functional...

Job description Design and build scalable data infrastructure with efficiency, reliability, and consistency to meet rapidly growing data needs Build the applications required for optimal extraction, cleaning, transformation, and loading data from disparate data sources and formats using the latest big data technologies Building ETL/ELT pipelines and work...

Job description Requirements Implement/support new data solutions in datalake/datawarehouse built on snowflake. Develop and design data pipelines using python, spark and snowflake. Implement infrastructure as code using cloudformation and terraform. Design and Implement Continuous Integration/Continuous Deployments pipelines. Perform Data Modelling using...

Description We are seeking an experienced Data Engineer to join our team in India. The ideal candidate will have a robust background in designing and implementing data solutions that support our organization's data needs. You will work closely with data scientists and other stakeholders to ensure that our data infrastructure is reliable, efficient, and...

Data Engineer: PySpark+AWS Glue 4-8 years in Data Engineering with hands-on expertise in Snowflake, AWS Glue, AWS (S3/Lambda/CloudWatch), Python, PySpark, and SQL. Strong experience in ETL/ELT, Data Warehousing, Data Pipelines, Performance Tuning, and Cloud Data Platforms. Exposure to AI/ML or GenAI solutions is a plus Knowledge of Oracle Application...

Responsibilities: Ingest data from various internal and external sources into AWS Redshift and S3 buckets using methods such as DMS, Zero-ETL, Kinesis, Glue, Lambda, Lake Formation, Cross

Key Responsibilities Design, develop, and optimize data pipelines and ETL processes using modern data engineering tools and technologies Apply domain expertise in operations, supply chain, and manufacturing to deliver tailored data solutions Process and analyze large-scale operational datasets using frameworks like Apache Spark Implement data...

Collaborate with other engineers, customers to brainstorm and develop impactful data products tailored to our clients. Leverage AI and machine learning techniques to integrate intelligent features into our offerings. Develop, and optimize end-to-end data pipelines on AWS Follow best practices in software architecture and development. Implement effective cost...

Source, extract, and manipulate large data sets to serve Machine Learning and Artificial Intelligence needs of Paychex Insurance Agency. Responsibilities Utilize existing infrastructure to assemble large, complex data sets that meet business requirements through extraction, transformation, and loading of data from a wide variety of data sources Work...

Experience in SQL Snowflake Creation Data Warehouse Exposure to connect to different data sources and readying data layers for business consumption ETL Snowflake, with extensive experience in data warehouse architecture, management and Snow pipe. User Defined Function vs Stored Procedure, Multi Clusters DWH, Views vs Secure Views & Materialized views in...

At YASH, were a cluster of the brightest stars working with cutting-edge technologies Our purpose is anchored in a single truth bringing real positive changes in an increasingly virtual world and it drives us beyond generational gaps and disruptions of the future We are looking forward to hire SQL Professionals in the following areas : Data Engineer having 2...

GlobalFoundries is looking for a highly motivated Data Engineer to join our team. Reporting to the Lead Data Engineer, you will design, develop, and optimize data architectures and pipelines while supporting cross-platform product development. This role involves close collaboration with data scientists, machine learning engineers, and solutions architects to...

Position Summary... What you'll do... About Team GDF (Global Data Foundation) is part of Walmart's AI & Data organization - the team building the foundational data platforms that power AI, analytics, and decision-making across every Walmart banner and geography, from supply chain and merchandising to customer experience and enterprise AI agents. Our newly...