Big Data Engineer

4 weeks ago

Delhi, India Manuh Technologies Full time
Position - Big Data EngineerLocation - Pune/Hyderabad/AnyExperience - 5+

Job SummaryAs a Big data engineer responsibilities include - review and analysis of requirements, design workshop participation and facilitation, design creation and documentation, data pipeline implementation, testing, bug fixing, release support and post release aftercare.You will be part of a team responsible for delivering the highest quality data processing and analytical systems, drawing upon your engineering and coding expertise, whilst being open minded to the opportunities the cloud provides. You will deliver code, facilitate solution designs and identify potential technical impediments then work to resolve them.

Roles & ResponsibilitiesDevise technical solution options aligned to the strategic architecture.Design data models / structures to support capital modelling and reporting processes.Influence the design and implementation of batched processes to create model inputs and execute modelsLiaise with other projects to achieve synergies through mutually beneficial design / delivery decisions.Act as a technical mentor/coach to developers to help them deliver solutions that meet customer requirements and architectural standards.Be available to discuss and resolve technical issues with individuals within and without the team.Help to embed the use of new technologies to deliver project goals.Help to ensure work carried out is in line with quality standards

Must Have:·Strong knowledge of Hadoop/Big Data concepts·Experience in working with Cloudera clusters is a plus·Experience in Analysing data sets and creating data models using SQL·Good working knowledge of Apache Spark with Java/Scala·Knowledge of Spark Streaming with Kafka·Must have hands on experience in building ETL pipelines using Apache NiFi·Must have hands on experience in Impala with Kudu·Experience in writing transformations using SQL·Experience in monitoring, debugging and troubleshooting Spark Jobs/Impala Queries in the cluster·Basic knowledge of Unix shell scripting·Good to have knowledge of Spring boot, Spring MVC, REST APIs and Microservices.·Good to have knowledge of AWS Cloud (EC2, IAM, S3, Lambda, CloudWatch etc.)

Skills:

Apache NiFi, HDFS, Hive, Impala, Spark, Spark Streaming, Kafka, Java/Scala, SQL, Shell scripting

  • Big Data Engineer

    2 weeks ago

    Delhi, Delhi, India Manuh Technologies Full time

    Job Title: Big Data EngineerAt Manuh Technologies, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop, Spark, and other big data technologies.Key Responsibilities:Design and develop data pipelines using...

  • Big Data DevOps Engineer

    2 weeks ago

    Delhi, Delhi, India Freelancer Recruiter Full time

    Job Title: Big Data DevOps EngineerWe are seeking a highly skilled Big Data DevOps Engineer to join our team at Freelancer Recruiter. The ideal candidate will have a strong background in managing the Big Data application stack, including HDFS, YARN, Spark, Hive, and HBase.Key Responsibilities:Design and implement scalable and highly available Big Data...

  • Big Data Engineer

    1 week ago

    Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Ace Recruit. As a Big Data Engineer, you will be responsible for designing and building scalable data ingestion pipelines, conceptualizing and executing high-performance data processing, and scheduling and orchestrating pipelines.Key...

  • Big Data Developer

    2 weeks ago

    Delhi, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required: 5+ years Employment Type: Full-time Employment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong...

  • Big Data Engineer

    2 weeks ago

    Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job Title: Big Data EngineerAs a key member of our team, you will play a crucial role in designing and building scalable data ingestion pipelines, high-performance data processing, and data harmonization using various Open Source, Big Data, and Cloud technologies on Microsoft Azure.Key Responsibilities:Design and build scalable data ingestion pipelines for...

  • Big Data Engineer

    2 weeks ago

    Delhi, Delhi, India Smartavya Analytica Private Limited Full time

    Job Title: Hadoop DeveloperAt Smartavya Analytica Private Limited, we are seeking a highly skilled Hadoop Developer to join our team.Key Responsibilities:Develop, test, and implement Big Data projects using Hadoop, Spark, and Hive.Lead the implementation of one or more tracks within projects, identifying and assigning tasks within the team, and providing...

  • Big Data Engineer

    2 weeks ago

    Delhi, Delhi, India Luxoft Full time

    Collateral Management Platform DeveloperWe are seeking a skilled developer to join our team in Pune, working on a cutting-edge liquidity risk and collateral management platform for a leading investment bank.Responsibilities:Develop new functionality for the Liquidity Risk platform in collaboration with global teams.Design and implement efficient data...

  • Big Data Architect

    2 weeks ago

    Delhi, Delhi, India Affine Full time

    Job Title: Big Data ArchitectAt Affine, we are seeking a highly skilled Big Data Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data pipelines, data warehouses, and data platforms.Key Responsibilities:Design and implement data pipelines using Spark, Python, Scala,...

  • Big Data Solutions Architect

    2 weeks ago

    Delhi, Delhi, India CallTek Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to design, develop, and maintain big data solutions. The ideal candidate will work closely with our team of data scientists and analysts to extract insights from large datasets.Key ResponsibilitiesDesign and develop big data solutions using Hadoop, Spark, or other big data technologies.Extract,...

  • Data Engineer/Big Data Technology Teaching Assistant

    4 weeks ago

    Delhi, India BeaconFire Inc. Full time

    Data Engineer/Big Data Technology Teaching AssistantJob Title: Teaching Assistant - Data Engineering/Big Data TechnologiesJob Description: We are seeking a Teaching Assistant with a solid foundation in Data Engineering to assist our team members with tasks such as conducting interviews for incoming candidates, addressing technical queries, and collaborating...

  • Architect : Big Data

    5 months ago

    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Senior Big Data Engineer

    5 days ago

    Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics using...

  • Big Data Solutions Architect

    2 weeks ago

    Delhi NCR, India ACS Consultants Full time

    Job Title: Big Data EngineerAt ACS Consultants, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing and implementing data engineering solutions on big data custom applications.Key Responsibilities:Design and develop data engineering solutions on big data custom applicationsModify...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Tata Consultancy Services Full time

    Job DescriptionAs a Data Engineer at Tata Consultancy Services, you will play a key role in designing, building, and optimizing systems for data collection, storage, access, and analytics at scale.Key Responsibilities:Design and develop data pipelines that convert raw data into formats usable by data scientists, data-centric applications, and other data...

  • Big Data Engineer

    4 weeks ago

    Hyderabad/Pune/Delhi NCR, IN Ace Recruit Full time

    Job Description :As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might :- Design and build scalable & metadata-driven data ingestion...

  • Big Data Engineer

    5 days ago

    Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job Description : As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might :- Design and build scalable & metadata-driven data...

  • Senior Big Data Engineer

    2 weeks ago

    Delhi, Delhi, India Luxoft Full time

    Job DescriptionWe are seeking a highly skilled Senior Big Data Developer to join our team in Pune, India. The successful candidate will work on the development of a liquidity risk and collateral management platform for one of the world's largest investment banks.Key ResponsibilitiesDesign and develop new functionality for the Liquidity Risk platform in...

  • Big Data Engineer

    2 weeks ago

    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, India GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at GAIUS HYPERLOCAL PRIVATE LIMITED. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions.Key Responsibilities:Design and develop scalable big data architectures and pipelines.Develop...

  • Big Data Engineer

    4 weeks ago

    Chennai/Bangalore/Hyderabad/Mumbai/Pune/Delhi/Coimbatore, IN Flipped.ai Full time

    Job Description : Big Data Engineer - Scala, SparkAbout the Role :We are seeking a highly skilled Big Data Engineer to join our team and help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions. You will...

  • Big Data Engineer

    2 weeks ago

    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, India GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to help us leverage the power of big data to drive innovation and business value. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions.Key ResponsibilitiesDesign, develop, and maintain scalable big data architectures...