Big Data Engineer

4 days ago

Bengaluru, India NetApp Full time
Title: Big Data Engineer

Location:

Bangalore, Karnataka, IN, 560071Requisition ID: 126725Job Summary

As a Software Engineer at NetApp India’s R&D division, you will be responsible for the design, development and validation of software for Big Data Engineering across both cloud and on-premises environments. You will be part of a highly skilled technical team named NetApp Active IQ.The Active IQ DataHub platform processes over 10 trillion data points per month that feeds a multi-Petabyte DataLake. The platform is built using Kafka, a serverless platform running on Kubernetes, Spark and various NoSQL databases. This platform enables the use of advanced AI and ML techniques to uncover opportunities to proactively protect and optimize NetApp storage, and then provides the insights and actions to make it happen. We call this “actionable intelligence”You will be working closely with a team of senior software developers and a technical director. You will be responsible for contributing to the design, and development and testing of code. The software applications you build will be used by our internal product teams, partners, and customers.We are looking for a hands-on lead engineer who is familiar with Spark and Scala, Java and/or Python. Any cloud experience is a plus. You should be passionate about learning, be creative and have the ability to work with and mentor junior engineers.

Job Requirements

Your Responsibility• Design and build our Big Data Platform, and understand scale, performance and fault-tolerance• Interact with Active IQ engineering teams across geographies to leverage expertise and contribute to the tech community.• Identify the right tools to deliver product features by performing research, POCs and interacting with various open-source forums• Build and deploy products both on-premises and in the cloud• Work on technologies related to NoSQL, SQL and in-memory databases• Develop and implement best-in-class monitoring processes to enable data applications meet SLAs• Should be able to mentor junior engineers technically.• Conduct code reviews to ensure code quality, consistency and best practices adherence.Our Ideal Candidate• You have a deep interest and passion for technology• You love to code. An ideal candidate has a github repo that demonstrates coding proficiency• You have strong problem solving, and excellent communication skills• You are self-driven and motivated with the desire to work in a fast-paced, results-driven agile environment with varied responsibilities

Education

• 5+ years of Big Data hands-on development experience• Demonstrate up-to-date expertise in Data Engineering, complex data pipeline development.• Design, develop, implement and tune distributed data processing pipelines that process large volumes of data; focusing on scalability, low -latency, and fault-tolerance in every system built• Awareness of Data Governance (Data Quality, Metadata Management, Security, etc.)• Experience with one or more of Python/Java/Scala• Proven, working expertise with Big Data Technologies Hadoop, HDFS, Hive, Spark Scala/Spark, and SQL• Knowledge and experience with Kafka, Storm, Druid, Cassandra or Presto is an added advantage

Job Segment:

Test Engineer, Cloud, Testing, Software Engineer, Developer, Engineering, Technology

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India TalentPulse Consultant Full time

    Role : Big Data Engineer Job Description : We are currently seeking a highly skilled Big Data Engineer to join our team on a remote basis. The ideal candidate will have at least 5 years of experience in Big Data technologies and a strong proficiency in Python, Spark, and Scala. This is an active position with a high priority, offering a competitive rate...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Virtusa Full time

    Big Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Awign Expert Full time

    This is a remote position.Job Title: Big Data Solutions EngineerReporting to: Director, Product ManagementLocation: India (Remote)Our Ideal CandidateOur company is seeking a talented Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    This is a remote positionJob Title:Big Data Solutions EngineerReporting to: Director, Product ManagementLocation: India (Remote)Our Ideal CandidateOur company is seeking a talented Big Data Solutions Engineer to join our team.The ideal candidate will be responsible for designing, developing, and implementing our proprietary Bigdata-powered Fin Crime solution...

  • Big Data Engineer

    4 weeks ago

    Bengaluru, India Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and...

  • Big Data Engineer

    1 month ago

    Bengaluru, India Awign Expert Full time

    This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our proprietary...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionThis is a remote position.Create and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open source and fintech ka experience MUST.Develop, implement, and standardize ETL processes to transform and cleanse data for pipeline development and...

  • Big data engineer

    4 days ago

    Bengaluru, India Virtusa Full time

    Big data engineer - CREQ191311 Description Position: Big data engineer Primary skills: Big data, hadoop, pyspark Location: Hyderabad &BLR Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Awign Expert Full time

    Job Description This is a remote position. Job Title: Big Data Solutions Engineer Reporting to: Director, Product Management Location: India (Remote) Our Ideal Candidate Our company is seeking a talented Big Data Solutions Engineer to join our team. The ideal candidate will be responsible for designing, developing, and implementing our...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Evnek Technologies Pvt Ltd Full time

    This is a remote positionDuration:6 MonthLocation:RemoteTimings: Full Time (As per company timings)Notice Period: within 15 days or immediate joinerExperience: 4-6 YearsResponsibilitiesCreate and maintain data pipelines that transfer data from select locations (maintaining security protocols) into our Big Data financial crime solution.Open source and...

  • Big data engineer

    3 days ago

    Bengaluru, India Virtusa Full time

    Big data engineer - CREQ191311 DescriptionPosition: Big data engineerPrimary skills: Big data, hadoop, pysparkLocation: Hyderabad &BLRExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster with all services. Experience with Nosql Databases and Messaging systems like...

  • Big Data Engineer

    6 days ago

    Bengaluru, India NetApp Full time

    Title: Big Data Engineer Location: Bangalore, Karnataka, IN, 560071 Requisition ID: 126725 Job SummaryAs a Software Engineer at NetApp India’s R&D division, you will be responsible for the design, development and validation of software for Big Data Engineering across both cloud and on-premises environments. You will be part of a highly skilled...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)ROLES & RESPONSIBILITIESResponsibilities:Strong experience of minimum 5+ years in Snowflake & Snowpipe having over all 9 to 12 years of experience as a data engineer, database developer, or similar...

  • Big Data Engineer

    7 days ago

    Bengaluru, India Adobe Full time

    Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India WEN Full time

    Role : Big Data Engineer (Scala)Responsibilities : Develop and maintain scalable data pipelines using Spark and Hive within the Hadoop ecosystem Utilize Scala programming language to implement efficient data processing solutions Collaborate with crossfunctional teams to understand data requirements and deliver optimal solutions Implement best practices for...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: June 07, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities: Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...

  • Big Data Engineer

    1 week ago

    Bengaluru, India Adobe Full time

    Our Company Changing the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)ROLES & RESPONSIBILITIESStrong experience of 9 to 12 years as a data engineer, database developer, or similar role, focusing on data warehousing and analytics.Minimum 5 years of experience in...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Infogain Full time

    Big Data Engineer (Senior) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIES Strong experience ofoverall 9 to 12 yearsof experience as a data engineer, database developer, or...