Data Engineer

5 days ago

uttar pradesh, India OWOW Full time

Data Engineer – AI-Powered Marketing Personalization PlatformWe’re seeking an experienced Data Engineer to help build and scale our next-generation AI-powered marketing personalization platform (V2.0). You’ll design and implement a robust multi-database infrastructure that enables real-time personalization, vector search, graph analytics, and large-scale data processing.This is a greenfield opportunity to architect data pipelines from the ground up using vector and graph databases and LLM-based systems. You’ll play a key role in migrating our existing platform while creating a scalable foundation powering AI agents across thousands of marketing campaigns.Core ResponsibilitiesData Architecture & Infrastructure (40%)Design and implement multi-database systems (MongoDB, Redis, Milvus, Neo4j, BigQuery)Build scalable real-time pipelines and ETL/ELT workflowsImplement data governance, quality, and high-throughput optimizationVector & Graph Systems (25%)Optimize Milvus collections for semantic searchDesign Neo4j schemas for customer journeys and relationshipsDevelop hybrid search (vector + graph + text) with performance tuningML Data Infrastructure (20%)Build data pipelines for LLM fine-tuning and GNN trainingManage data versioning, lineage, and A/B testing systemsImplement real-time feature computation for contextual modelsAnalytics & Monitoring (15%)Create BigQuery schemas and real-time dashboardsImplement observability (Prometheus, Grafana) and anomaly detectionOptimize data costs across cloud environmentsTech StackDatabases: MongoDB, Redis, Milvus, Neo4j, BigQuery Processing: Airflow/Prefect, Pandas/Polars, dbt, Spark ML Pipeline: vLLM, MLflow, Sentence Transformers, PyTorch, TensorFlow Cloud & Infra: GCP, Docker, Kubernetes, Terraform, GitHub Actions Languages: Python (3.10+), SQL, BashRequirementsMust-Have5+ years of data engineering experience in production systemsAdvanced Python and SQL expertiseExperience with 3+ database types (SQL, NoSQL, Vector, Graph)Proven ability to build high-scale data pipelines (>1M records/day)Strong data modeling, validation, and optimization skillsExperience with cloud data warehouses (BigQuery, Redshift, or Snowflake)PreferredExperience with Milvus, Pinecone, or WeaviateGraph databases (Neo4j, Neptune) and embedding-based searchML/Feature store experienceBackground in marketing technology or CDPsKey ProjectsPhase 1 – Foundation: Migrate 10M+ vectors, implement MongoDB schemas, Neo4j models, and BigQuery warehouse Phase 2 – Optimization: Build data quality monitoring, caching (Redis), and

  • Only 24h Left: Mid Data Science

    3 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 312499 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Mid Data Science AIML GenAI Lead Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job Duties Job Title Data...

  • Ai/ml and Data Analytics Mentor

    6 days ago

    New Palasia, Indore, Madhya Pradesh, India Engineer Sahab Full time

    **About Us -** Engineer Sahab Education is a leading institute that provides quality education and career guidance to aspiring students. We specialize in UI/UX Design, Web Development, and Digital Marketing courses and help students make informed career choices to achieve their academic and professional goals. **Location-**Indore **Role Overview**: We are...

  • Data Engineer

    2 weeks ago

    uttar pradesh, India CloudKeeper Full time

    DescriptionAbout CLOUDKEEPER :CloudKeeper is a cloud cost optimization partner that combines the power of group buying & commitments management, expert cloud consulting & support, and an enhanced visibility & analytics platform to reduce cloud cost & help businesses maximize the value from AWS, Microsoft Azure, & Google Cloud. A certified AWS Premier...

  • Data Engineer

    2 weeks ago

    uttar pradesh, India TalentOnLease Full time

    Job Description We are looking for a Data Engineer with strong skills in AWS and data engineering tools to support and monitor our data pipelines and systems. The candidate will be responsible for monitoring, troubleshooting, and ensuring smooth execution of ETL/ELT workflows. Key Responsibilities Monitor and maintain AWS services like Redshift, S3, RDS,...

  • Systems Engineering Specialist

    1 week ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Systems Engineering Specialist to join our team At NTT DATA we know that with the right people on board anything is possible The quality...

  • Data Engineer

    1 day ago

    uttar pradesh, India Talentiser Full time

    Hiring for a leading Marketing CompanyJob Title : Data EngineerLocation: Mumbai, Noida, Gurgaon or HyderabadExperience: 8+ YearsTHE ROLEEssential Skills:• 8 years of professional experience in data engineering or a similar role.• Hands-on experience with Google Cloud Platform (GCP) services (BigQuery, Cloud Run, cheduler).• Proficiency in SQL for data...

  • Data Warehouse Engineer

    3 days ago

    uttar pradesh, India Umanist Staffing Full time

    Job Summary:We are looking for a skilled Data Warehouse Engineer to design, build, and optimize large-scale data warehouse and analytics solutions. The candidate must have deep expertise in data modeling, ETL development, SQL optimization, and cloud-based data platforms.Key Responsibilities:Design and develop data warehouse architecture, ETL pipelines, and...

  • Big Data Engineer

    3 days ago

    uttar pradesh, India Umanist Staffing Full time

    Job Summary:We are hiring an experienced Big Data Engineer to design, build, and maintain high-performance data processing systems. The role requires strong expertise in Hadoop ecosystem, Spark, and cloud-based data pipelines with a focus on scalability, reliability, and performance.Key Responsibilities:Design and develop end-to-end big data pipelines for...

  • Senior Data Engineer

    5 days ago

    uttar pradesh, India Tata Consultancy Services Full time

    TCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply. Senior Data Engineer Location: Noida/Bhubaneswar or Kochi Exp. Needed: Min 8 to 12 years of exp. Must Have Skills :: Data Engineer, Apache Spark, ScalaRole Summary: We're...

  • Senior Data Engineer

    4 days ago

    uttar pradesh, India Tata Consultancy Services Full time

    TCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply. Senior Data Engineer Location: Noida/Bhubaneswar or Kochi Exp. Needed: Min 8 to 12 years of exp. Must Have Skills :: Data Engineer, Apache Spark, Scala Role Summary: We're...