Big data engineer

4 days ago


Bengaluru, India Virtusa Full time
Big data engineer - CREQ191311 Description Position: Big data engineer Primary skills: Big data, hadoop, pyspark Location: Hyderabad &BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like Kafka. Designing building installing configuring and supporting Hadoop Perform analysis of vast data stores. Good understanding of cloud technology. Must have strong technical experience in Design Mapping specifications HLD LLD. Must have the ability to relate to both business and technical members of the team and possess excellent communication skills. Leverage internal tools and SDKs, utilize AWS services such as S3, Athena, and Glue, and integrate with our internal Archival Service Platform for efficient data purging. Lead the integration efforts with the internal Archival Service Platform for seamless data purging and lifecycle management. Collaborate with the data engineering team to continuously improve data integration pipelines, ensuring adaptability to evolving business needs.
Develop and maintain data platforms using Python
Work with AWS and Big Data, design and implement data pipelines, and ensure data quality and integrity
Collaborate with crossfunctional teams to understand data requirements and design solutions that meet business needs
Implement and manage agents for monitoring, logging, and automation within AWS environments
Handling migration from PySpark to AWS Primary Location Bangalore, Karnataka, India Job Type Experienced Primary Skills Java, PySpark, Hive, Python, Kafka Years of Experience 8 Qualification Education: Any degree or equivalent Experience:6 years Travel No
  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, India Awign Expert Full time

    This is a remote position.Job Title: Big Data Solutions EngineerReporting to: Director, Product ManagementLocation: India (Remote)Our Ideal CandidateOur company is seeking a talented Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Awign Expert Full time

    This is a remote positionJob Title:Big Data Solutions EngineerReporting to: Director, Product ManagementLocation: India (Remote)Our Ideal CandidateOur company is seeking a talented Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution...

  • Big Data Engineer

    1 month ago


    Bengaluru, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big Data Engineer

    4 weeks ago


    Bengaluru, India Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Big Data Engineer

    4 days ago


    Bengaluru, India NetApp Full time

    Title: Big Data EngineerLocation:Bangalore, Karnataka, IN, 560071Requisition ID: 126725Job SummaryAs a Software Engineer at NetApp India’s R&D division, you will be responsible for the design, development and validation of software for Big Data Engineering across both cloud and on-premises environments. You will be part of a highly skilled technical team...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionThis is a remote position.Create and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open source and fintech ka experience MUST.Develop, implement, and standardize ETL processes to transform and cleanse data for pipeline development and...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Evnek Technologies Pvt Ltd Full time

    This is a remote positionDuration:6 MonthLocation:RemoteTimings: Full Time (As per company timings)Notice Period: within 15 days or immediate joinerExperience: 4-6 YearsResponsibilitiesCreate and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open source and...

  • Big data engineer

    3 days ago


    Bengaluru, India Virtusa Full time

    Big data engineer - CREQ191311 DescriptionPosition: Big data engineerPrimary skills: Big data, hadoop, pysparkLocation: Hyderabad &BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...

  • Big Data Engineer

    6 days ago


    Bengaluru, India NetApp Full time

    Title: Big Data Engineer Location: Bangalore, Karnataka, IN, 560071 Requisition ID: 126725 Job SummaryAs a Software Engineer at NetApp India’s R&D division, you will be responsible for the design, development and validation of software for Big Data Engineering across both cloud and on-premises environments. You will be part of a highly skilled...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)ROLES & RESPONSIBILITIESResponsibilities:Strong experience of minimum 5+ years in Snowflake & Snowpipe having over all 9 to 12 years of experience as a data engineer, database developer, or similar...

  • Big Data Engineer

    7 days ago


    Bengaluru, India Adobe Full time

    Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India WEN Full time

    Role : Big Data Engineer (Scala)Responsibilities : Develop and maintain scalable data pipelines using Spark and Hive within the Hadoop ecosystem Utilize Scala programming language to implement efficient data processing solutions Collaborate with crossfunctional teams to understand data requirements and deliver optimal solutions Implement best practices for...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: June 07, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities: Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    1 week ago


    Bengaluru, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)ROLES & RESPONSIBILITIESStrong experience of 9 to 12 years as a data engineer, database developer, or similar role, focusing on data warehousing and analytics.Minimum 5 years of experience in...

  • Big Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIES Strong experience ofoverall 9 to 12 yearsof experience as a data engineer, database developer, or...