Big Data Engineer

We are looking for Aws big data engineer In Remote , India Position : Aws big data engineerExperience : 7 to 9 YearLocation : Remote , India Mandate skills : BigData Python Pyspark AWS Glue Airflow Redshift Responsibilities :- Ensure effective Design, Development, Validation and Support activities in line with client needs and architectural requirements.,-...

Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...

Job Description : - Azure data Engineer - Azure Data Factory - azure databricks- python - sql- Azure Data Factory (ADF), PySpark, Databricks, ADLS, Azure SQL Database- Optional: Azure Synapse Analytics, Event Hub & Streaming Analytics, Cosmos DB and Purview.- Strong programming, unit testing & debugging skills in SQL, Python or Scala/Java.- Some experience...

Requirements : - 6+ years' experience with Big Data Technologies such as Apache Spark, Cloud Native, and Data Lakes, and Databricks. - Delivered ETL/ELT solutions including data extraction, transformation, cleansing, data integration, and data management. - Implemented batch ingestion pipelines. - Strong Python skills - automate tasks, write unit tests...

Required Qualifications :- 7-8 years of experience as a Data Engineer or in a similar role- Proficient in Python programming and PySpark for data processing and transformation- Extensive experience in designing and implementing data pipelines using AWS Glue and AWS MWAA (Airflow)- Strong SQL skills, including experience with AWS Redshift- Familiarity with...

Designation : Hadoop AdministratorOpen for Pan India(Any Location)Job Description :- Development and deployment of data applications- Design Implementation of infrastructure tooling and work on horizontal frameworks and libraries- Creation of data ingestion pipelines between legacy data warehouses and the big data stack- Automation of application back-end...

We have Immediate openings on Apache developerJob description : - Data Pipeline Development : Design, develop, and maintain data processing pipelines using Apache Spark and Scala, ensuring high performance and scalability.- Data Transformation and Analysis : Implement complex data transformations, aggregations, and analytics using Spark, optimizing for...

Job Description :Responsibilities :1. Explain and communicate the design / development to the customer2. Perform and evaluate test results against product specifications3. Break down complex problems into logical components4. Develop user interfaces business software components5. Use data models6. Estimate time and effort required for developing / debugging...

Job Title : Senior Data Engineer (Remote)Location : RemoteWe are hiring a Senior Data Engineer for one of our leading software development clients. The Senior Data Engineer will play a key role in building and extending data pipeline architecture, optimizing data flow, and supporting cross-functional teams. The ideal candidate has extensive experience in...

Role : Data Engineer - Spark/Scala. Job Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering. - Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark, HBase, Hive and...

Job Title : Data Engineer. Location : Remote. Experience : 6+ Years. Contract : 6 Months (Extendable). Skills Required : - Python : Extensive experience in Python for advanced data manipulation, automation, and scripting. - SQL : Expertise in SQL for complex querying, database management, and performance optimization. - Databricks : Proficient in using...

About the Role :We are looking for a talented and motivated Big Data Engineer to join our team. You will be responsible for designing, developing, and maintaining big data solutions. You will work closely with our team of data scientists and analysts to extract insights from large datasets.Responsibilities :- Design and develop big data solutions using...

Role : Data Engineer - Apache spark,Spark, Scala, PYspark, Hadoop, Hbase, HiveLocation : Pan IndiaWork Mode- HybridYear of Experience :Minimum 5 Years tp 12 YearsJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and...

Job Description :We are looking for a talented and experienced Data Engineer to join our team. You will be responsible for designing, building, and maintaining data pipelines, workflows, and infrastructure to support efficient data processing and analysis. The ideal candidate will have experience in workflow orchestration tools, database management, data...

Position Title : Big Data Architect Location : Remote Job Type : Contract - 3 months Experience Required : 10+ YearsRoles and Responsibilities :- Develop, design and automate large scale, high-performance data processing systems (batch and/or streaming) to drive business growth and improve the product experience.- Evangelize high quality software engineering...

Data Engineer (Python & SQL)Position : Data Engineer (Python & SQL)Locations : Hyderabad, Chennai, Bengaluru, Mumbai, Pune, Kolkata, GurugramJob Type : Full-TimeCompany : Reputed Big 4 MNC client company of Live Connections.Role Overview :We are looking for a skilled Data Engineer with experience in Python, SQL, and Financial Services Industry (FSI) to join...

We seek a Middle Data Engineer to join our company remotely.This project is divided into four specialized teams, each responsible for a specific aspect of the development and deployment process. Now in the production phase, the project has established robust pipelines for multiple data sources, managing a variety of automated processes. These pipelines are...

Role & Responsibilities : - Create and maintain data pipelines that transfer data from select location (maintaining security protocols) into our Big Data financial crime solution Develop, implement, and standardize ETL processes to transform and cleanse data for pipeline development and reporting - Develop and implement data models and schemas to support...

Job Designation : ETL DeveloperWFH / WFOJob Description :- Work Experience : Overall 3+ years of experience working on Databases, Data Warehouse, Data Integration and BI/Reporting solutions with relevant experience.Role & Responsibilities :- To be a Data expert/Architect in implementing solutions using Databases/ETL/DWH/Data Integration/Reporting tools with...

Job Role : Hadoop Administrator (Role open for multiple locations) - WFH and WFOJob description :What is your Role ?- You will manage Hadoop clusters, data storage, server resources, and other virtual computing platforms. - You perform a variety of functions, including data migration, virtual machine set-up and training, troubleshooting end-user problems,...