Data Engineer
4 weeks ago
Data Engineer – AI-Powered Marketing Personalization Platform We’re seeking an experienced Data Engineer to help build and scale our next-generation AI-powered marketing personalization platform (V2.0) . You’ll design and implement a robust multi-database infrastructure that enables real-time personalization, vector search, graph analytics, and large-scale data processing. This is a greenfield opportunity to architect data pipelines from the ground up using vector and graph databases and LLM-based systems . You’ll play a key role in migrating our existing platform while creating a scalable foundation powering AI agents across thousands of marketing campaigns. Core Responsibilities Data Architecture & Infrastructure (40%) Design and implement multi-database systems (MongoDB, Redis, Milvus, Neo4j, BigQuery) Build scalable real-time pipelines and ETL/ELT workflows Implement data governance, quality, and high-throughput optimization Vector & Graph Systems (25%) Optimize Milvus collections for semantic search Design Neo4j schemas for customer journeys and relationships Develop hybrid search (vector + graph + text) with performance tuning ML Data Infrastructure (20%) Build data pipelines for LLM fine-tuning and GNN training Manage data versioning, lineage, and A/B testing systems Implement real-time feature computation for contextual models Analytics & Monitoring (15%) Create BigQuery schemas and real-time dashboards Implement observability (Prometheus, Grafana) and anomaly detection Optimize data costs across cloud environments Tech Stack Databases: MongoDB, Redis, Milvus, Neo4j, BigQuery Processing: Airflow/Prefect, Pandas/Polars, dbt, Spark ML Pipeline: vLLM, MLflow, Sentence Transformers, PyTorch, TensorFlow Cloud & Infra: GCP, Docker, Kubernetes, Terraform, GitHub Actions Languages: Python (3.10+), SQL, Bash Requirements Must-Have 5+ years of data engineering experience in production systems Advanced Python and SQL expertise Experience with 3+ database types (SQL, NoSQL, Vector, Graph) Proven ability to build high-scale data pipelines (>1M records/day) Strong data modeling, validation, and optimization skills Experience with cloud data warehouses (BigQuery, Redshift, or Snowflake) Preferred Experience with Milvus, Pinecone, or Weaviate Graph databases (Neo4j, Neptune) and embedding-based search ML/Feature store experience Background in marketing technology or CDPs Key Projects Phase 1 – Foundation: Migrate 10M+ vectors, implement MongoDB schemas, Neo4j models, and BigQuery warehouse Phase 2 – Optimization: Build data quality monitoring, caching (Redis), and
-
Data Engineering Subject Matter Expert
2 weeks ago
bangalore, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...
-
Data Engineering Subject Matter Expert
1 week ago
bangalore, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & Databricks Remote | Part Time | Flexible Timings | Pay: $600 – $1000/Monthly About the Opportunity We are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms. What We're Looking For Minimum 9-15 years of experience in...
-
Data Engineer
3 days ago
bangalore, India Engineer Master Labs Pvt. Ltd™ Full timeCompany Description Engineer Master Labs Pvt. Ltd™ is an IT service provider located in Indore, India, specializing in a range of services including website development, logo designing, mobile app development for both hybrid and native platforms, and animation. The company is dedicated to delivering creative and innovative solutions to meet client needs....
-
Data/ML Ops Engineer
4 days ago
bangalore, India NTT DATA, Inc. Full timeWe are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines.You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...
-
Data/ML Ops Engineer
4 days ago
bangalore, India NTT DATA, Inc. Full timeWe are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines. You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...
-
Data/ML Ops Engineer
6 days ago
bangalore, India NTT DATA, Inc. Full timeWe are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines. You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...
-
Data/ML Ops Engineer
6 days ago
Bangalore, India NTT DATA, Inc. Full timeWe are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines. You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...
-
Data/ML Ops Engineer
6 days ago
Bangalore Urban, India NTT DATA, Inc. Full timeWe are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines.You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...
-
Data/ML Ops Engineer
5 days ago
Bangalore Urban, India NTT DATA, Inc. Full timeWe are looking for a MLOps Engineer / DataOps Engineer with Cloud / Databricks experience. The role will be responsible for seamless flow of information throughout the company, maintaining and managing the production data pipelines. You will be working across a variety of tasks, primarily cloud engineering, establishing best practice and building out our...
-
Data Engineering
2 weeks ago
Bangalore, Karnataka, India NTT DATA Full timeReq ID 345813 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Data Engineering Analytics Architect to join our team in Bangalore Karn taka IN-KA India IN Role Own the strategy governance...