Data Engineer

1 month ago

Bangalore, India McAfee Full time

Role Overview:As a data and platform engineer within the Office of the CTO working on the AI Automation team at McAfee, you will play a vital role in providing our customers with cutting-edge protection and peace of mind. You will leverage McAfeeâs rich data ecosystems to create ML model training, validation, and approval pipelines to deliver incremental value in pursuit of providing the best protection in cybersecurity. Youâll have the opportunity to work with big data to identify potential improvements in our threat protection capabilities. Youâll have the ability to implement data pipelines as well as maintain and improve our AI automation platform to automate the end-to-end model development and deployment lifecycle. Youâll work closely with data scientists to set up model automation workflows to enable high-frequency retraining and deployment.

This is a remote position in India. We will only consider candidates currently in India and are not offering relocation assistance at this time.
Job Description:

About the role:

  • Apply subject matter expertise in PySpark and big data in developing and maintaining scalable pipelines for ML model training, validation, and approval.
  • Develop and maintain model training datasets.
  • Collaborate with data scientists to design, validate, deploy, monitor, and maintain production-scale ML models.
  • Build and maintain solutions on Databricks, AWS, EKS, and Kubeflow.
  • Scale up existing pipelines to work with larger datasets and optimize resource usage.
  • Build and maintain infrastructure as code (IaC) in the cloud that is resilient and can scale when needed.

About You:

  • You have 6â8 years of experience as a software engineer, with a minimum of 4 years as a data or platform engineer working on big data and building data pipelines. Work experience in the cybersecurity industry is a plus.
  • You have extensive experience with PySpark.
  • Significant coding skills in Python, with other languages being a plus.
  • Experience on platforms like Databricks and AWS.
  • Knowledge of Kubernetes/EKS, Kubeflow, Jenkins, Linux, Docker, and Terraform would be a plus.
  • Working experience in debugging computational bottlenecks, troubleshooting issues, and software testing.

#LI-Remote

Accommodations:

McAfee recognizes and supports its obligation to reasonably accommodate applicants and employees with disabilities. We are here to help. Please let us know if you need a reasonable accommodation for any part of the application, interviewing, hiring, or at any other time during the employment process. Please do not include personal medical information in the email.

Diversity is foundational for our business success. We want to be a workplace of choice for all people and we value the unique perspectives offered by a diverse workforce. McAfee does not unlawfully discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, citizenship, disability, protected veteran status, age, ancestry, medical condition, genetic information, marital status, pregnancy, or any other legally protected status. This principle applies to all areas of employment: recruitment and hiring, training, performance evaluations, promotions and transfers, compensation and benefits, and social and recreational programs.

McAfee desires to be an employer of choice with an inclusive environment for all individuals. As part of this goal and in compliance with various laws and regulations, McAfee provides reasonable accommodation to applicants and employees. Requests for reasonable accommodation for applicants and employees are evaluated on a case-by-case basis.

Posting Statement:

McAfee prohibits discrimination based on race, color, religion, gender, national origin, age, disability, veteran status, marital status, pregnancy, gender expression or identity, sexual orientation or any other legally protected status.

  • Aptus Data Labs

    4 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    1 month ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Data Engineer

    1 week ago

    bangalore, India ANZ Full time

    About the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe. The Australia Data tribe sits within our Australia Commercial division and our mission is...

  • Data Engineer, IN Data Engineering

    1 month ago

    bangalore, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses.IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified...

  • Data Engineer

    4 days ago

    bangalore, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role Description This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehousing, and data analytics. The role is based in Bengaluru, with flexibility for...

  • Data Engineer

    1 week ago

    bangalore, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data Engineer Data Engineer Req ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: Bengaluru About the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join...

  • Data Engineer

    1 month ago

    bangalore, India Analog Devices Full time

    Gather business and functional requirements and translate into robust scalable, solutions aligned to the Data Architecture guidelines Hands on development work on all aspects of data analysis, data provisioning, Data modeling, performance tuning and optimization Design, implement and operate large scale, high volume, high performance data structures for...

  • Data Engineer

    2 days ago

    bangalore, India Joveo Full time

    Role: Data Engineer Location: Hybrid (Bangalore/Hyderabad) About Joveo Joveo was founded in 2017 by a group of visionary entrepreneurs and enthusiastic problem solvers who foresaw the need for greater transparency and predictability in recruitment marketing. The focus was on building a cutting-edge technology platform that uses data and...

  • Data Engineer

    1 week ago

    bangalore, India Aryng Full time

    Welcome! You made it to the job description page! Aryng is looking for a Senior Data Engineer with experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficient Data Engineer who is an expert in theimplementation of a large-scale, highly efficient data platform,...

  • Data Engineer

    1 month ago

    bangalore, India Yara Full time

    Responsibilities Participate in designing and building data pipelines to collect, manage and store data across different solutions and tools where the data resides for the YAA teams. Monitor, manage and maintain data pipelines as part of the day-to-day data operations. Build data mart tables for various use cases by working with the different data...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    1 month ago

    Bangalore, India Magna Hire Full time

    Responsibilities : Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards. Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases. Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 days ago

    bangalore, India RaaGaa Value Add Technologies. Full time

    Key Responsibilities: 1.Design, develop, and maintain scalable data pipelines and ETL processes to extract, transform, and load large volumes of structured and unstructured data from diverse sources in Batch and Real-time processing. 2.Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to...

  • Data Engineer

    1 month ago

    bangalore, India Recro Full time

    Job Description:We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in data engineering, with a focus on Google Cloud Platform (GCP), particularly BigQuery, data integration, and building robust data pipelines. This role will involve working with various data sources, designing data models, and...

  • Aptus Data Labs

    1 month ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description : Qualifications : - Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out) - knowledge in developing modular...

  • Aptus Data Labs

    4 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description :Qualifications :- Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out)- knowledge in developing modular...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description : Qualifications : - Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out) - knowledge in developing...

  • Data Engineer

    4 weeks ago

    Bangalore, India Danaher Full time

    As a Data Engineer you will be responsible for designing, implementing, and managing our data architecture, pipelines, and business systems. You will join a Center of Excellence and collaborate closely with data scientists, analysts, leaders, and other stakeholders to ensure data availability, quality, and reliability. Your work will be instrumental in...

  • Data Engineer

    4 weeks ago

    bangalore, India Klub Full time

    Responsibilities Responsiblefor setting up a scalable DataWarehouse and building data pipelinemechanisms to integrate the data from various sources for all ofKlub s data. Setup data as a service to exposethe needed data as part of Apis. Have a goodunderstanding on how the finance dataworks. Standardise and optimise design thinkingacross the technology...