Big Data Engineer

We seek a Middle Data Engineer to join our company remotely.This project is divided into four specialized teams, each responsible for a specific aspect of the development and deployment process. Now in the production phase, the project has established robust pipelines for multiple data sources, managing a variety of automated processes. These pipelines are...

Role & Responsibilities : - Create and maintain data pipelines that transfer data from select location (maintaining security protocols) into our Big Data financial crime solution Develop, implement, and standardize ETL processes to transform and cleanse data for pipeline development and reporting - Develop and implement data models and schemas to support...

About us : The Big data engineer will be responsible for the building of critical data infrastructure that surfaces data and insight and be the face to the data user community.You can analyze and test changes to our data architectures and processes and determine what the possible downstream effects and potential impacts to our data consumers,SUMMARY OF...

Job Description :- Design and implement robust data architectures leveraging Hadoop technologies to support business objectives. - Create efficient and scalable data pipelines using Hadoop ecosystem tools to extract, transform, and load data. - Administer Hadoop clusters and related tools to ensure optimal performance, reliability, and security. - Ensure...

Protegrity is seeking a passionate and talented Manager, Engineering Big Data to join our team. This position is a remote role.Data Privacy is important to all of us. At Protegrity our products make this possible in rest, in motion and in view for some of the largest companies in the world. Protegrity puts our customers in the best possible position to...

Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...

Job Overview : We are seeking a highly skilled and experienced Senior Azure Data Engineer to join our team. The ideal candidate will have over 10 years of experience in designing, developing, and implementing data solutions on Azure. This role involves working closely with cross-functional teams to build scalable, efficient, and secure data platforms. You...

Big Data Engineer with strong exp in Hadoop, Spark, SQL & AWS for one of the Fortune 500 Clients Company Name : Hum TechnologiesClient : One of the Fortune 500 CompaniesLocation : : Apache NiFi, HDFS, Hive, Impala, Spark, Spark Streaming, Kafka, Java/Scala, SQL, Shell scriptingRoles & Responsibilities :- Responsible for designing and implementing data...

SALARY : 10LPA - 16LPAJob Overview :Our client is seeking an experienced and detail-oriented Data Engineering and Machine Learning Tester to join our Quality Assurance team. The ideal candidate will have strong expertise in testing data pipelines, machine learning models, and large-scale data processing systems, specifically within the Databricks...

Position Summary :We are looking for seasoned Snowflake Architects and Engineers to join our team and lead the design and implementation of large-scale data solutions on the Snowflake platform. This role is suited for professionals with deep expertise in data architecture and extensive experience with Snowflake.Key Responsibilities : - Lead the architecture,...

Profile : Data Engineer (Remote, US Shift)Experience : 5 to 10 YearsAnnual CTC : INR(- ) 1,500,000 to 2,200,000Job Description :- Seeking an experienced Data Engineer who can play a crucial role in the company's fintech data lake project.Technical/Functional Skills :1. 5+ years of experience working in data warehousing systems2. Strong experience in...

EXO Edge is looking for an experienced Data Engineer to join our Data Engineering team. As a Data Engineer, you will design, develop, evaluate, and test data infrastructures. Source system analysis, data modeling, business measure development, and report/visualization formatting. Ensure compliance with policies and procedures, safety, state, and federal...

Role : ML Data the Team & Role :Railofy is solving the largest problems for Indian Railway passengers (90% of Indians travel by trains) - waitlisted tickets and quality of food in trains. We are a young team of technologists who have made a significant breakthrough in this field using Machine Learning, in order to create a major impact in the lives of...

Job Summary. We are seeking a highly skilled and experienced Senior AWS Data Engineer to lead our cloud data architecture, design, and development initiatives. The ideal candidate will have deep expertise in building and managing large-scale data pipelines and solutions on AWS, as well as strong experience in data architecture, ETL, and real-time data...

EXO Edge is looking for an experienced Data Engineer to join our Data Engineering team. As a Data Engineer, you will design, develop, evaluate, and test data infrastructures. Source system analysis, data modeling, business measure development, and report/visualization formatting. Ensure compliance with policies and procedures, safety, state, and federal...

Experience : 5 to 10 Years.Additional Skills : Fivetran Sksplash view Git Ci/cd Concepts. Job Description :- Seeking an experienced Data Engineer who can play a crucial role in the company's fintech data lake project. Technical/Functional Skills : Must have :- 5+ years of experience working in data warehousing systems.- Strong experience in Oracle Fusion...

Job Description :IDC Global is a software development company specializing in web development services for the real estate industry through distributed database technology. While our core models are real estate web search and back-office CRM-based tools, we also focus on database and data processing in order to solve problems and improve the performance of...

Required Skills : - 3+ years of professional experience in any one of the Cloud providers such as AWS, Azure or GCP- 3+ years experience in engineering data pipelines using data technologies (Python, Databricks, pySpark, Kafka) on large scale data sets- Experience building or maintaining a Data Platform that supports multiple engineering teams and processes...

Responsibilities :- Design, develop, and implement data pipelines and data lakes using Spark, EMR, and Hadoop.- Build and optimize data processing workflows on the AWS cloud platform.- Develop and maintain data ingestion and transformation processes using AWS Glue, EMR, Lambda functions, SQS, and SNS.- Implement real-time data processing solutions using AWS...

Job Description :We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with cross-functional...