Data Engineer
24 hours ago
Data Engineer – AI-Powered Marketing Personalization PlatformWe’re seeking an experienced Data Engineer to help build and scale our next-generation AI-powered marketing personalization platform (V2.0). You’ll design and implement a robust multi-database infrastructure that enables real-time personalization, vector search, graph analytics, and large-scale data processing.This is a greenfield opportunity to architect data pipelines from the ground up using vector and graph databases and LLM-based systems. You’ll play a key role in migrating our existing platform while creating a scalable foundation powering AI agents across thousands of marketing campaigns.Core ResponsibilitiesData Architecture & Infrastructure (40%)Design and implement multi-database systems (MongoDB, Redis, Milvus, Neo4j, BigQuery)Build scalable real-time pipelines and ETL/ELT workflowsImplement data governance, quality, and high-throughput optimizationVector & Graph Systems (25%)Optimize Milvus collections for semantic searchDesign Neo4j schemas for customer journeys and relationshipsDevelop hybrid search (vector + graph + text) with performance tuningML Data Infrastructure (20%)Build data pipelines for LLM fine-tuning and GNN trainingManage data versioning, lineage, and A/B testing systemsImplement real-time feature computation for contextual modelsAnalytics & Monitoring (15%)Create BigQuery schemas and real-time dashboardsImplement observability (Prometheus, Grafana) and anomaly detectionOptimize data costs across cloud environmentsTech StackDatabases: MongoDB, Redis, Milvus, Neo4j, BigQuery Processing: Airflow/Prefect, Pandas/Polars, dbt, Spark ML Pipeline: vLLM, MLflow, Sentence Transformers, PyTorch, TensorFlow Cloud & Infra: GCP, Docker, Kubernetes, Terraform, GitHub Actions Languages: Python (3.10+), SQL, BashRequirementsMust-Have5+ years of data engineering experience in production systemsAdvanced Python and SQL expertiseExperience with 3+ database types (SQL, NoSQL, Vector, Graph)Proven ability to build high-scale data pipelines (>1M records/day)Strong data modeling, validation, and optimization skillsExperience with cloud data warehouses (BigQuery, Redshift, or Snowflake)PreferredExperience with Milvus, Pinecone, or WeaviateGraph databases (Neo4j, Neptune) and embedding-based searchML/Feature store experienceBackground in marketing technology or CDPsKey ProjectsPhase 1 – Foundation: Migrate 10M+ vectors, implement MongoDB schemas, Neo4j models, and BigQuery warehouse Phase 2 – Optimization: Build data quality monitoring, caching (Redis), and
-
Data Engineer
1 week ago
Belgaum, India Veca Consulting Pvt Ltd Full timeRole Name: Data EngineerExperience : 3+ YearsLocation : Bangalore(No relocation)Notice Period : 20-30 days(who are currently serving)Mode : HybridType : FulltimeJob Description: As a Data Engineer on our team, you will work on our Hadoop-based data warehouse, contributing to scalable and reliable big data solutions for analytics and business insights. This...
-
Data Engineer
4 weeks ago
Belgaum, India Fornax Full timeWho is this forIf solving business challenges drives you. This is the place to be. Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a skilled Data Engineer who has worked in a Retail/D2C domain. The ideal candidate will possess a strong blend of functional...
-
Data Engineer
4 weeks ago
Belgaum, India Fornax Full timeWho is this forIf solving business challenges drives you. This is the place to be. Fornax is a team of cross-functional individuals who solve critial business challenges using core concept of analytics, critical thinking.We are seeking a skilled Data Engineer who has worked in a Retail/D2C domain. The ideal candidate will possess a strong blend of functional...
-
Freelance Data Engineer
4 days ago
Belgaum, India Whatjobs IN C2 Full timeLooking for a Freelance Data Engineer to join a team of rockstar developers. The candidate should have a minimum of 8+ yrs. of experience. There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...
-
Data Engineering Leadership Position
17 hours ago
belgaum, India beBeeProjectManagement Full timeJob Opportunity:The role of a Technical Project Manager involves overseeing the delivery of data engineering and analytics projects. This includes managing cross-functional teams to execute initiatives aligned with business goals, ensuring timely completion.Key Responsibilities:Strategize, execute, and deliver technical projects within scope, on time, and...
-
▷ [Apply Now] Data Engineer
4 weeks ago
Belgaum, India SatSure Full timeAs a Data Engineer specializing in geospatial data, your primary responsibility is to design, build, and maintain data infrastructure and systems that handle geospatial information effectively. You will work closely with cross-functional teams, including data scientists, geospatial analysts, and software engineers, to ensure that geospatial data is...
-
Data Administrator
1 week ago
Belgaum, India NexionPro Services Full timeExperience Required: 7+ YearsWork Location: Bangalore / Chennai / HyderabadRole Overview:We are seeking an experienced Databricks Administrator to manage, optimize, and maintain our Databricks platform across multiple environments. The ideal candidate will have a strong background in data engineering infrastructure, cluster management, security, governance,...
-
Chief Data Strategist
17 hours ago
belgaum, India beBeeData Full timeSenior Data ArchitectJob Description:We are seeking a highly experienced Senior Data Architect to lead the design and implementation of scalable data pipelines that power our large language model development. As a senior individual contributor, you will be responsible for architecting, building, and owning robust data systems that transform massive datasets...
-
Lead Python Data Engineer _ Exp: 7+ Years
1 week ago
Belgaum, India Atyeti Inc Full timeBachelor’s or Master’s degree in Computer Science or equivalent experience5+ years of hands-on experience as an Application Developer or in similar software engineering rolesAdvanced skills in Python; strong SQL and cloud-native development experience (AWS)Proven expertise in architecting scalable data pipelines (ETL/ELT) OR experience working with...
-
Procurement Data Manager
2 weeks ago
Belgaum, India Asenium Consulting Full timeFor one of my customer we are looking for a Procurement Data consultant with experience in Sievo. Duration: 4+ months(renewable) Location: 100% remote(european time zone) Description: This person will be responsible to maintain existing Sievo reports using procurement data from ERP/SCUPA. They’ll translate numbers into business insights for buyers, not...
