Data Engineer II

1 month ago

Bangalore, India Wayfair Full time

Please note that this is an ML Engineering role, not a Scientist role. The focus for the position will be on ML pipeline development, deployment, and management.

Who we are:

Wayfair runs the largest custom e-commerce large parcel network in the United States, approximately 1.6 million square meters of logistics space. The nature of the network is inherently a highly variable ecosystem that requires flexible, reliable, and resilient systems to operate efficiently.

At Wayfair we are well on the way to becoming the world’s number one, online destination for all things home. Our core belief is that everyone should live in a home they love. We make this possible by ensuring our 24 million customers have all the technology and innovation they need at their fingertips, to give them access to our more than 33 million products which are provided by our 23,000 awesome global suppliers.

Wayfair is moving the world so that anyone can live in a home they love – a journey enabled by more than 3,000 Wayfair engineers and a data-centric culture. Wayfair’s Data Science Marketing team builds algorithmic systems that drive our business, enhance customer experience, and improve customer loyalty. You will be part of a cross-functional, collaborative team driving development of world-class ML systems that improve our customer understanding and marketing decisions.

What you’ll do:

  • Own and contribute to the ML Pipeline development lifecycle from Data wrangling, feature development, training and tuning ML model with Data Scientist, deploy and manage the Inference Pipeline.
  • Develop a reusable code and pattern to scale the ML Pipeline to new business use cases and create a self service platform.
  • Partner closely with the ML Platform team, Infrastructure team, and similar teams to ensure the Data science org has the data, computing resources, and workflows/abstractions needed to do our best work.
  • Create jobs for human annotations on 3rd party vendors like LabelBox, Snorkel, etc. Partner with them to support new features as needed.
  • Define and advance MLOps best practices within data science, engineering and Platforms teams.
  • Contribute to SME initiative and code review in support of spreading best practices

We Are a Match Because You Have:

  • 6+ years experience as a ML Engineer with strong engineering skills and a passion for working on turning reference implementations into production-ready software.
  • Proficiency in at least one high-level programming language (Python, Java, Scala or equivalent) used both for ML and automation tasks.
  • Experience with Python ML ecosystem (numpy, pandas, sklearn, XGBoost, etc.) and Apache Spark Ecosystem (Spark SQL, MLlib/Spark ML)
  • Hands-on experience building scalable ML & big data processing pipelines with big data tools such as Hadoop, Hive, SQL, Spark and GCP cloud services such as DataProc, BigQuery, GCS etc.
  • Experience with automated data pipeline and workflow management tools, i.e. Airflow.
  • Experience with basic software engineering tools, e.g., git, CI/CD environment (such as Jenkins or Buildkite), PyPi, Docker, Kubernetes, unit testing, and general object-oriented design.

It’s Great if You Have:

  • Masters or Bachelors in Computer Science / Operations Research / Statistics or other quantitative fields
  • Experience with common ML frameworks/libraries such as Vowel wabbit, Tensorflow, PyTorch is preferred.
  • Experience with Kubernetes and micro-services is preferred.
  • Experience with Cloud Services such as GCP AI Platform.
  • Deploying and scaling ML solutions using open-source frameworks (MLFlow, TFX, H2O, etc.)

  • Software Development Engineer II

    4 weeks ago

    Bangalore, India HEVO DATA Full time

    About Hevo : Ever wondered, what's common between Zepto, Napster, Curefit, Groww, Jumio, Cars24 ? They all super-charge their business growth with Hevo Data Pipelines. How? 2 of every 3 modern day companies are unable to take data driven decision making due to fragmented data across 100s business software. Hevo is a simple, intuitive, and powerful...

  • Data Engineer II

    2 weeks ago

    Bangalore/Pune/Mumbai/Coimbatore/Delhi NCR/Delhi/Navi Mumbai, India Concept Management Full time

    Job Title: Data Engineer IICompany Overview: Concept Management is a leading organization in the field of data engineering, and we are seeking a highly skilled Data Engineer II to join our team. As a key member of our team, you will play a critical role in maintaining, improving, cleaning, and manipulating data in our business operational and analytics...

  • Data Engineer II

    3 weeks ago

    Bangalore/Pune/Mumbai/Coimbatore/Delhi NCR/Delhi/Navi Mumbai, India Concept Management Full time

    At Concept Management, we are seeking a highly skilled Data Engineer II to join our team. This role is a critical part of our data infrastructure and will play a key role in maintaining, improving, cleaning, and manipulating data in our operational and analytics databases.

  • Clinical Data Programmer Ii

    6 months ago

    Bangalore Urban District, Karnataka, India Novotech Asia Full time

    **Brief Position Description**: The core responsibility for this position is as a member of the Data Management department at Novotech. The Clinical Data Programmer-II (CDP-II) will be responsible for programming activities on clinical trial projects and to ensure compliance with Good Clinical Data Management Practices (GCDMP). **Minimum Qualifications &...

  • Data scientist-ii

    2 months ago

    Bangalore, India Rebel Foods Full time

    About the job Company Description: Rebel Foods, formerly known as Faasos, is the world's largest chain of Online Restaurants. Today we operate 25+ own brands such as Behrouz Biryani, Ovenstory Pizza, Faasos, Sweet Truth on our proprietary operating system, a mix of culinary craft and technology infrastructure. We are now a network of 4000+ Restaurants...

  • Data Scientist-II

    2 months ago

    bangalore, India Rebel Foods Full time

    About the jobCompany Description:Rebel Foods, formerly known as Faasos, is the world's largest chain of Online Restaurants. Today we operate 25+ own brands such as Behrouz Biryani, Ovenstory Pizza, Faasos, Sweet Truth on our proprietary operating system, a mix of culinary craft and technology infrastructure. We are now a network of 4000+ Restaurants across...

  • Data Scientist-II

    3 months ago

    bangalore, India Rebel Foods Full time

    About the job Company Description: Rebel Foods, formerly known as Faasos, is the world's largest chain of Online Restaurants. Today we operate 25+ own brands such as Behrouz Biryani, Ovenstory Pizza, Faasos, Sweet Truth on our proprietary operating system, a mix of culinary craft and technology infrastructure. We are now a network of 4000+ Restaurants...

  • Data Scientist-II

    2 months ago

    bangalore, India Rebel Foods Full time

    About the job Company Description: Rebel Foods, formerly known as Faasos, is the world's largest chain of Online Restaurants. Today we operate 25+ own brands such as Behrouz Biryani, Ovenstory Pizza, Faasos, Sweet Truth on our proprietary operating system, a mix of culinary craft and technology infrastructure. We are now a network of 4000+ Restaurants...

  • Data scientist i/ii

    2 weeks ago

    Bangalore, India Akaike Technologies Full time

    Role: Data Scientist I/II Location: Bengaluru (Hybrid) Experience: 1-3 years Akaike Technologies, Greater Bengaluru Area Company Overview: Akaike Technologies is a dynamic and innovative AI-driven company dedicated to building impactful solutions across various domains. Our mission is to empower businesses by harnessing the power of data and...

  • Data Engineer-II

    1 month ago

    bangalore, India TMRW House of Brands Full time

    ResponsibilitiesCreate, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning.Develop and maintain core data framework and key infrastructuresCreate and support the ETL pipeline to get the data flowing correctly from the existing and new sources to our data warehouse.Data Warehouse design and...

  • Data Engineer-II

    4 months ago

    bangalore, India TMRW House of Brands Full time

    ResponsibilitiesCreate, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning.Develop and maintain core data framework and key infrastructuresCreate and support the ETL pipeline to get the data flowing correctly from the existing and new sources to our data warehouse.Data Warehouse design and...

  • Data Engineer-II

    3 months ago

    bangalore, India TMRW House of Brands Full time

    ResponsibilitiesCreate, implement and operate the strategy for robust and scalable data pipelines for business intelligence and machine learning.Develop and maintain core data framework and key infrastructuresCreate and support the ETL pipeline to get the data flowing correctly from the existing and new sources to our data warehouse.Data Warehouse design and...

  • Hevo Data

    2 days ago

    Bangalore/Bangalore, India HEVO DATA Full time

    This role provides a great opportunity to own and build highly scalable and fault-tolerant platform services that will help support thousands of customers' data pipelines and load data reliability to the different cloud warehouses. These services are the core of the Hevo platform that helps provide building no code-low pipeline. Also, makes a huge...

  • Data Engineer I

    2 months ago

    Bangalore, India tsworks Full time

    Who We Are tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions, and thought leadership to empower businesses to thrive in a digital world. We value our employees and take pride in providing best value in customer...

  • Data engineer i

    2 months ago

    Bangalore, India Tsworks Full time

    Who We Are tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions, and thought leadership to empower businesses to thrive in a digital world. We value our employees and take pride in providing best value in...

  • Data Engineer I

    2 months ago

    bangalore, India tsworks Full time

    Who We Aretsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions, and thought leadership to empower businesses to thrive in a digital world. We value our employees and take pride in providing best value in customer...

  • Data Engineer I

    7 months ago

    bangalore, India tsworks Full time

    Who We Aretsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions, and thought leadership to empower businesses to thrive in a digital world. We value our employees and take pride in providing best value in customer...

  • Data Scientist I/II

    1 month ago

    Bangalore, India Akaike Technologies Full time

    Role: Data Scientist I/II Location: Bengaluru (Hybrid) Experience: 1-3 years Akaike Technologies, Greater Bengaluru Area Company Overview: Akaike Technologies is a dynamic and innovative AI-driven company dedicated to building impactful solutions across various domains. Our mission is to empower businesses by harnessing the power of data and...

  • Data Engineer I

    2 months ago

    bangalore, India tsworks Full time

    Who We Are tsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions, and thought leadership to empower businesses to thrive in a digital world. We value our employees and take pride in providing best value in customer...

  • Data Engineer I

    3 months ago

    bangalore, India tsworks Full time

    Who We Aretsworks Technologies India Private Limited (subsidiary of The Software Works, Inc, USA) is a technology product and services company. Our mission is to provide domain expertise, innovative solutions, and thought leadership to empower businesses to thrive in a digital world. We value our employees and take pride in providing best value in customer...