Apache Spark

Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

Job Description : In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

Job Description : In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

Job Description :In this role, you will play a critical part in designing, developing, and maintaining big data processing pipelines using your expertise in Scala and Apache Spark. You will collaborate closely with data engineers and data scientists to understand their data needs and translate those requirements into robust technical...

Key Responsibilities :Develop, implement, and maintain Spark applications for data processing and analytics.Design and optimize Spark jobs for performance and scalability.Implement Delta lake solutions for efficient data storage and management.Build streaming solutions for Internet of Things (IOT) using Spark streaming.Utilize Kafka expertise to design and...

Key Responsibilities : Develop, implement, and maintain Spark applications for data processing and analytics. Design and optimize Spark jobs for performance and scalability. Implement Delta lake solutions for efficient data storage and management. Build streaming solutions for Internet of Things (IOT) using Spark streaming. Utilize Kafka expertise to design...

Key Responsibilities :Develop, implement, and maintain Spark applications for data processing and analytics.Design and optimize Spark jobs for performance and scalability.Implement Delta lake solutions for efficient data storage and management.Build streaming solutions for Internet of Things (IOT) using Spark streaming.Utilize Kafka expertise to design and...

Python Developer or System Analyst.Essential Requirements:1. Ability to set up and manipulate python data structures like List, string, dictionaries, tuples2. Strong expertise in pandas and numpy.3. Familiar with data exploration, visualization and comparing metrics of large csv and parquet files including partitioned parquet files.4. Strong skills in join,...

Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects...

Responsibilities :Design and develop PySpark applications using Spark DataFrames and SQL to extract, transform, and load (ETL) data.Read data from various sources such as relational databases, data lakes, and cloud storage using PySpark connectors.Clean, transform, and enrich data using PySpark functions for data wrangling and manipulation.Build and maintain...

Responsibilities :Design and develop PySpark applications using Spark DataFrames and SQL to extract, transform, and load (ETL) data.Read data from various sources such as relational databases, data lakes, and cloud storage using PySpark connectors.Clean, transform, and enrich data using PySpark functions for data wrangling and manipulation.Build and maintain...

English , Engineering , Marketing , Product Development , SQL , Testing , A , AWS , Ability , Adjust , Agile , Agile Environment , Airflow , Analytics , Apache , Apache Spark , Application , Architecture , Availability , Best Practices , Business , CI , Cd , Challenges , Choice , Cloud , Code , Collect , Combined , Commerce , Company , Components , Concepts...

Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

Big Data EngineerPosition Overview :We are seeking a skilled Big Data Engineer to join our dynamic team. The ideal candidate will have expertise in designing, implementing, and maintaining large-scale data processing systems using cutting-edge technologies. As a Big Data Engineer, you will play a key role in building and optimizing data pipelines, data...

GCP Data Architect - CREQ186084 Description Python Knowledge with Py spark, Pandas and Python Objects Knowledge of Google Cloud Platform GCP Certified Prof. Data Engineer. Google Cloud GCP cloud composer, cloud storage, Data proc, Big query SQL Strong SQL & Advanced SQL Spark writing skills on Py spark DWH Data warehousing concepts & dimension modeling GIT...