NucleusTeq - Big Data Engineer - Spark/Scala

Role : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...

Technical Requirements : Skills needed : Python, Spark, AWS, Airflow, Snowflake.Project Scope : Understand the code base built in AWS services and SQL and convert the same to tech stack primarily in airflow, : - Designing and building data models to support business requirements - Developing and maintaining data ingestion and processing systems -...

Job Description :Responsibilities :- Design, develop, and maintain scalable data pipelines and systems on AWS.- Implement data integration solutions using AWS services such as S3, Redshift, Glue, and Lambda.- Collaborate with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.- Optimize and tune data...

Technical Requirements :Skills needed : Python, Spark, AWS, Airflow, Snowflake.Project Scope : Understand the code base built in AWS services and SQL and convert the same to tech stack primarily in airflow, : - Designing and building data models to support business requirements - Developing and maintaining data ingestion and processing systems -...

About the Role:We are seeking a highly skilled Data Engineer to join our team. The successful candidate will be responsible for designing, building, and managing data pipelines using Azure Data Factory, Azure Databricks, and Azure Data Lake. He/She will also develop and optimize data workflows using Scala, Spark, and Python for large-scale data...

Job Description : Key Responsibilities : - Design, build, and maintain robust ETL pipelines to process and manage large-scale datasets using Databricks and Snowflake.- Collaborate with data scientists and analysts to understand data requirements and deliver actionable insights.- Develop and manage data integrations across various sources, ensuring data...

At NucleusTeq Consulting Pvt. Ltd., we are seeking a skilled Data Architect to join our team. As a key member of our organization, you will be responsible for designing and building data models to support business requirements.The ideal candidate will have experience with big data technologies such as Spark and AWS. Proficiency in programming languages like...

Key Responsibilities :- Lead and mentor a team of Big Data Engineers.- Participate in the design and implementation of the big data analytics architecture on Azure.- Develop and implement big data pipelines using Spark Scala and Python.- Write complex Hive queries to extract valuable insights from data lakes.- Collaborate with cross-functional teams (QA,...

Project Description : We've been engaged by an Investment Banking client in the Corporate, Commercial and Institutional Banking (CCIB) potfolio to work on the projects for managing analytics support for all the key initiatives of all segments/products. Responsibilities : - Choosing the right technologies for our use cases, deploy and operate. - Setting up...

Job Description :We are looking for an experienced Big Data Engineer to design, develop, and maintain scalable data processing pipelines and architectures. The ideal candidate will work on extracting insights from massive datasets, ensuring data quality, and contributing to our data-driven decision-making processes.Key Responsibilities :- Design and...

Position : Sr Big Data Engineer (GCP)Experience : 5 to 8 YrsLocation : Remote Shift Time : EST Shift (5:30 PM to 2:30 AM)Position Overview : We are seeking a highly skilled Senior Big Data Engineer with extensive experience in Big Data technologies, including Hadoop, Hive, PySpark, and expertise in Google Cloud Platform (GCP) and BigQuery. The successful...

About the Role : We are seeking a highly skilled and experienced Cloud Big Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining robust and scalable data pipelines and applications on the cloud. You will work with large datasets, leveraging big data technologies to extract meaningful...

About the RoleThe Lead Big Data Engineer - AI Consulting will be responsible for leading a team of data engineers in the design and implementation of big data solutions using PySpark. This role requires expertise in PySpark, Hadoop, Hive, and Spark, as well as strong leadership and collaboration skills.You will work closely with cross-functional teams to...

Company Overview:Resurgent Enterprise Solutions Private Limited is a leading provider of cutting-edge data engineering solutions.Job Description:We are seeking an experienced Data Engineer to join our team. As a key member of our data engineering group, you will design, build, and manage data pipelines using Azure Data Factory, Azure Databricks, and Azure...

Job Description :- Develop and maintain robust data pipelines for ingesting data from various sources such as databases, APIs, and streaming platforms.- Design and implement data transformation and cleaning processes to ensure data quality and consistency.- Develop data models and schemas for efficient data storage and retrieval.- Expertise in working with...

Key Responsibilities : - Design, develop, and implement data pipelines to extract, transform, and load (ETL) data from various sources (databases, APIs, cloud storage, streaming platforms). - Develop and maintain data pipelines using tools like Apache Spark, Kafka, and other big data technologies.- Ensure data quality and integrity throughout the data...

Job Description : - Develop and maintain robust data pipelines for ingesting data from various sources such as databases, APIs, and streaming platforms. - Design and implement data transformation and cleaning processes to ensure data quality and consistency. - Develop data models and schemas for efficient data storage and retrieval. - Expertise in...

About The Company :Ara's Client is a premier IT &ITeS Organization for the last 50 years with a pan India footprint. They are a pioneer and leader in the Indian ICT industry. With more than 4000 employees spread across 100 locations in India, They are adding value to every industry through its products, services and offerings.The Role :The Data Engineer will...

Job Description : - Strong experience with big data technologies and associated tools such as Hadoop, Unix, HDFS, Hive, Impala, etc. - Proficient in using Spark/Scala - Experience with data Import/Export using Sqoop or similar tools - Experience using Airflow, Jenkins or similar other automation tools - Excellent knowledge of SQL Server and database...

Spark Scala DeveloperShift : EURExperience : 10+ yearsResponsibilities :- Develop and optimize Scala/Spark jobs for data transformation, aggregation, and processing.- Design and implement data processing pipelines to efficiently handle large-scale data.- Produce unit tests for Spark transformations and related helper methods.- Write comprehensive...