See more Collapse

DataWeave - Senior Data Engineer

1 month ago


Bengaluru, Karnataka, India timesjobs Full time
# Senior Data Engineer

## About DataWeave
DataWeave Digital Commerce capabilities are fundamental to winning todays shoppers.

The pandemic has accelerated eCommerce adoption across the globe with multiple options for consumers to research, compare and buy products.

Solutions that provide actionable data-driven insights have become fundamental to eCommerce growth and critical in optimizing these investments.


DataWeave is a leading provider of advanced sales optimization solutions for Digital Commerce businesses, consumer brands, delivery intermediaries, and marketplaces.

Our machine learning-enabled SaaS platform provides over 400 global brands and retailers with streamlined access to Digital Shelf Analytics and Dynamic Pricing solutions used to develop data-driven growth strategies and to make high-frequency business decisions that accelerate revenue growth and drive profitability.


Our actionable, Digital Market Intelligence is generated by aggregating and analyzing data captured daily on over 100 million products found on the Web, tracking competitive KPI performance within critical business areas like Pricing, Promotions, Content Audits, Product Availability, Merchandising, Search and Media, Sales and Market Share, and Ratings and Reviews.

## Data Engineering & Delivery @DataWeave

We the Delivery / Data engineering team at DataWeave, deliver the Intelligence with actionable data to the customer.

One part of the work is to write effective crawler bots to collect data over the web, which calls for reverse engineering and writing scalable python code.

Other part of the job is to crunch data with our big data stack / pipeline.

Underpinnings are:
Tooling, domain awareness, fast-paced delivery, and pushing the envelope.

## Roles & Responsibilities

  • Inclined towards working in a startup environment
  • Comfort with frequent, incremental code testing and deployment, Data management skills
  • Design and Build robust and scalable data engineering solutions for structured and unstructured data for delivering business insights, reporting and analytics
  • Expertise in troubleshooting, debugging, data completeness and quality issues and scaling overall system performance
  • Build robust API s that powers our delivery points (Dashboards, Visualizations and other integrations)
## Skills & Requirements

  • Good communication and collaboration skills with 47 years of experience
  • Ability to code and script with strong grasp of CS fundamentals, excellent problem solving abilities
  • Comfort with frequent, incremental code testing and deployment, Data management skills
  • Good understanding of RDBMS
  • Experience in building Data pipelines and processing large datasets
  • Knowledge of building crawlers and data mining is a plus
  • Working knowledge of open source tools such as mysql, Solr, ElasticSearch, Cassandra ( data stores ) would be a plus
  • Expert in Python programming
## Advantages

### How we work?


It's hard to tell what we love more, problems or solutions Every day, we choose to address some of the hardest data problems that there are.

We are in the business of making sense of messy public data on the web. At serious scale Read more on [Become a DataWeaver](link).

### What do we offer?

  • Some of the most challenging data problems
  • Huge text and image datasets that you can play with
  • Ability to see the impact of your work and the value you're adding to our customers almost immediately
  • Opportunity to work on different problems and explore a wide variety of tools to figure out what really excites you
  • A culture of openness
  • Fun work environment
  • A flat hierarchy
  • Organization wide visibility
  • Flexible working hours
  • Learning opportunities with courses and tech conferences
  • Mentorship from seniors in the team
  • Competitive salary packages and fastpaced growth opportunities
## Job Location
Bangalore, India

## Address
InfoWeave Analytics Pvt Ltd,
Office # 206, Regus Supreme (Jayanagar) Supreme Overseas Exports Building,
44/1, 1ST & 2ND Floor, 16th cross, Jayanagar 7th block (west), KR Road,
Bengaluru 560070

We have other current jobs related to this field that you can find below


  • Bengaluru, Karnataka, India Dataweave Full time

    About DataWeave: DataWeave is a cutting-edge SaaS-based digital commerce analytics platform that empowers retailers with competitive intelligence and equips consumer brands with digital shelf analytics on a global scale. By harnessing the power of DataWeave, retailers gain the ability to make smarter pricing and merchandising decisions, while consumer brands...


  • Bengaluru, Karnataka, India Dataweave Full time

    We, the Products team at DataWeave, build data products that provide timely insights that are readily consumable and actionable, at scale. Our underpinnings are: scale, impact, engagement, and visibility. We help businesses take datadriven decisions everyday. We also give them insights for longterm strategy'. We are focussed on creating value for our...


  • Bengaluru, Karnataka, India Dataweave Full time

    About Us: DataWeave provides Digital Shelf Analytics and Dynamic Pricing solutions to Digital Commerce businesses that enable them to grow their revenues and compete profitably. Powered by AI, we provide easily consumable and actionable intelligence by aggregating and analysing billions of publicly available data points on the Web to help businesses develop...


  • Bengaluru, Karnataka, India Dataweave Full time

    Roles & Responsibilities : Inclined towards working in a startup environment. Comfort with frequent, incremental code testing and deployment, Data management skills Design and Build robust and scalable data engineering solutions for structured and unstructured data for delivering business insights, reporting and analytics. Expertise in troubleshooting,...


  • Bengaluru, Karnataka, India timesjobs Full time

    Technical Product ManagerAbout DataWeaveDigital Commerce capabilities are fundamental to winning today's shoppers. The pandemic has accelerated eCommerce adoption across the globe with multiple options for consumers to research, compare, and buy products. Solutions that provide actionable data-driven insights have become fundamental to eCommerce growth and...


  • Bengaluru, Karnataka, India DataWeave Full time

    "We kindly ask that applicants for this role have a mandatory requirement for proficiency in Spanish language communication."JOB DESCRIPTIONDataWeave provides Digital Shelf Analytics and Dynamic Pricing solutions to Digital Commerce businesses that enable them to grow their revenues and compete profitably. Powered by AI, we provide easily consumable and...


  • Bengaluru, Karnataka, India DataWeave Full time

    ABOUT USDataWeave provides Digital Shelf Analytics and Dynamic Pricing solutions to Digital Commerce businesses that enable them to grow their revenues and compete profitably. Powered by AI, we provide easily consumable and actionable intelligence by aggregating and analysing billions of publicly available data points on the Web to help businesses develop...


  • Bengaluru, Karnataka, India DataWeave Full time

    ABOUT US DataWeave provides Digital Shelf Analytics and Dynamic Pricing solutions to Digital Commerce businesses that enable them to grow their revenues and compete profitably. Powered by AI, we provide easily consumable and actionable intelligence by aggregating and analysing billions of publicly available data points on the Web to help businesses develop...


  • Bengaluru, Karnataka, India timesjobs Full time

    # ## Engineer (Web Automation and Web Scraping)About DataWeaveDataWeave Digital Commerce capabilities are fundamental to winning today's shoppers. The pandemic has accelerated eCommerce adoption across the globe with multiple options for consumers to research, compare and buy products. Solutions that provide actionable data-driven insights have become...


  • Bengaluru, Karnataka, India Dataweave Full time

    Roles & Responsibilities :We are seeking an experienced Engineer to join our team. The ideal candidate will have a solid understanding of web automation and web scraping techniques and be able to apply this knowledge to develop and maintain our web scraping and automation projects. Design and develop web scraping and automation projects using and Python...


  • Bengaluru, Karnataka, India Dataweave Full time

    Responsible for : Be fully responsible for the quality of code for which the team is responsible (either through personal review or thoughtful delegation) Take full responsibility for delivering solutions into production (working through operations teams) Be responsible for training and mentoring developers on the team and recommending actions around...


  • Bengaluru, Karnataka, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.Manpower Planning.Preparing of Project Cost.Schedule wise work execution.As Drawing & quality work execution.Client & Third Party Manage.Working Team Manage & Review.Reporting to Management.ROB & FOB Fabrication & Erection Work Knowledge.

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Concentrix Full time

    Job Description:Experience: 4 Years 8 YearsJob Location: PAN IndiaNotice Period: Immediate/ 15 DaysShift Timings: 03:00 PM to 12:00 AM (IST)Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & pythonJob Description:We are seeking an experienced Data Engineer to join our team. The ideal candidate should have a strong...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Concentrix Full time

    Job Description:Experience:4 Years - 8 YearsJob Location:PAN IndiaNotice Period:Immediate/ 15 DaysShift Timings:03:00 PM to 12:00 AM (IST)Skills:Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & pythonJob Description:We are seeking an experienced Data Engineer to join our team. The ideal candidate should have a strong...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Concentrix Full time

    Job Description:Experience: 4 - 8 YearsLocation: PAN IndiaNotice Period: Immediate/ 15 DaysShift Timings: 03:00 PM to 12:00 AM (IST)Skills: Data Engineering; Data Pipeline; ETL; AWS (and frameworks); PySpark/Scala; SQL & PythonWe are looking for a skilled Data Engineer to join our team. The perfect candidate must have a solid experience in data...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Concentrix Full time

    Job Description: Experience: 4 Years - 8 Years Job Location: PAN India Notice Period: Immediate/ 15 Days Shift Timings: 03:00 PM to 12:00 AM (IST) Skills: Data Engineering; data Pipeline; ETL, AWS (and frameworks), Pyspark/ scala; SQL & python Job Description: We are seeking an experienced Data Engineer to join our team. The ideal candidate should have a...

  • Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Concentrix Full time

    Job Description:Experience: 3Years - 6 YearsJob Location:PAN IndiaNotice Period:Immediate/ 15 DaysShift Timings:03:00 PM to 12:00 AM (IST)Skills:Data Engineer; MuleSoft;AWS(EC2, S3, Lambda, Athena, DymanoDB, OpenSearch, CloudWatch, GLUE, Bedrock, SageMaker)Job Description:We are seeking an experienced Data Engineer to join our team. The ideal candidate...


  • Bengaluru, Karnataka, India DataWeave Full time

    About Us Data Weave provides Digital Shelf Analytics and Dynamic Pricing solutions to Digital Commerce businesses that enable them to grow their revenues and compete profitably.Powered by AI, we provide easily consumable and actionable intelligence by aggregating and analysing billions of publicly available data points on the Web to help businesses develop...


  • Bengaluru, Karnataka, India DataWeave Full time

    About UsDataWeave provides Digital Shelf Analytics and Dynamic Pricing solutions to Digital Commerce businesses that enable them to grow their revenues and compete profitably. Powered by AI, we provide easily consumable and actionable intelligence by aggregating and analysing billions of publicly available data points on the Web to help businesses develop...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...