Data Engineer

4 days ago

bangalore, India OWOW Full time

Data Engineer – AI-Powered Marketing Personalization Platform We’re seeking an experienced Data Engineer to help build and scale our next-generation AI-powered marketing personalization platform (V2.0) . You’ll design and implement a robust multi-database infrastructure that enables real-time personalization, vector search, graph analytics, and large-scale data processing. This is a greenfield opportunity to architect data pipelines from the ground up using vector and graph databases and LLM-based systems . You’ll play a key role in migrating our existing platform while creating a scalable foundation powering AI agents across thousands of marketing campaigns. Core Responsibilities Data Architecture & Infrastructure (40%) Design and implement multi-database systems (MongoDB, Redis, Milvus, Neo4j, BigQuery) Build scalable real-time pipelines and ETL/ELT workflows Implement data governance, quality, and high-throughput optimization Vector & Graph Systems (25%) Optimize Milvus collections for semantic search Design Neo4j schemas for customer journeys and relationships Develop hybrid search (vector + graph + text) with performance tuning ML Data Infrastructure (20%) Build data pipelines for LLM fine-tuning and GNN training Manage data versioning, lineage, and A/B testing systems Implement real-time feature computation for contextual models Analytics & Monitoring (15%) Create BigQuery schemas and real-time dashboards Implement observability (Prometheus, Grafana) and anomaly detection Optimize data costs across cloud environments Tech Stack Databases: MongoDB, Redis, Milvus, Neo4j, BigQuery Processing: Airflow/Prefect, Pandas/Polars, dbt, Spark ML Pipeline: vLLM, MLflow, Sentence Transformers, PyTorch, TensorFlow Cloud & Infra: GCP, Docker, Kubernetes, Terraform, GitHub Actions Languages: Python (3.10+), SQL, Bash Requirements Must-Have 5+ years of data engineering experience in production systems Advanced Python and SQL expertise Experience with 3+ database types (SQL, NoSQL, Vector, Graph) Proven ability to build high-scale data pipelines (>1M records/day) Strong data modeling, validation, and optimization skills Experience with cloud data warehouses (BigQuery, Redshift, or Snowflake) Preferred Experience with Milvus, Pinecone, or Weaviate Graph databases (Neo4j, Neptune) and embedding-based search ML/Feature store experience Background in marketing technology or CDPs Key Projects Phase 1 – Foundation: Migrate 10M+ vectors, implement MongoDB schemas, Neo4j models, and BigQuery warehouse Phase 2 – Optimization: Build data quality monitoring, caching (Redis), and

  • Enterprise Data Architect

    1 week ago

    bangalore, India Aptus Data Labs Full time

    Company DescriptionAptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...

  • Enterprise Data Architect

    1 week ago

    bangalore, India Aptus Data Labs Full time

    Company Description Aptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...

  • Fid Federal Risk Applications Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 341952 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Duties Team Profile Our...

  • Fid Federal Risk Applications Data Engineer

    18 hours ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 341951 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Duties Team Profile Our...

  • Senior DevOps Engineer

    22 hours ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior DevOps Engineer

    3 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior Data Scientist

    6 days ago

    bangalore, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior Data Scientist

    2 weeks ago

    bangalore, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior DevOps Engineer

    3 weeks ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior Leader – Data Architecture

    2 days ago

    bangalore, India Role: Senior Leader – Data Architecture Full time

    We are looking for a *highly seasoned Data Architecture leader* to head our enterprise data architecture function. The ideal candidate is someone who has built and scaled large-scale data platforms and can drive the vision, strategy, and execution of data architecture across the organization.*Key Requirements*1. Deep Technical Expertise in Large-Scale...