Senior Data Engineer

22 hours ago

Chennai GPO Chennai Tamil Nadu, India Urgent openingShree Dhanya Info for the post of the Data Entry Operator Full time

Data Engineer (LLM Data Pipeline)

Description :

Location: India (Remote/Hybrid)

Experience: 3–6 years in Data Engineering

Role Overview:

You will own the data pipeline powering our LLM training and fine-tuning. This includes ingestion,

cleaning, deduplication, and building high-quality datasets from structured/unstructured sources.

Responsibilities:

  • Design ETL pipelines for text, PDFs, and structured data.
  • Implement data deduplication, filtering (toxicity, PII), and normalization.
  • Train and manage tokenizers (SentencePiece/BPE).
  • Build datasets for supervised fine-tuning and evaluation.
  • Work closely with domain experts to generate instruction/response pairs.

Requirements:

  • Strong in Python, SQL, and data wrangling frameworks (Pandas, Spark).
  • Experience with large text datasets, cleaning, preprocessing.
  • Familiarity with NLP-specific preprocessing (chunking, embeddings).
  • Knowledge of cloud data storage (S3/GCS/Blob).
  • Bonus: Prior experience in AI/ML pipelines.

Job Type: Permanent

Pay: ₹469, ₹1,812,611.94 per year

  • Senior Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India AstraZeneca Full time

    Job Title Senior Data Engineer Career Level D3 Introduction to role Are you ready to disrupt an industry and change lives We are seeking a seasoned Senior Data Engineer to join our innovative team With a focus on modern data tools and cloud platforms you ll play a pivotal role in transforming our ability to develop life-changing medicines If you have...

  • Senior Data scientist

    2 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...

  • Data Engineer

    7 days ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...

  • Senior Data Scientist

    9 hours ago

    tamil nadu, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Software Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...

  • Senior Data Engineer

    1 week ago

    tamil nadu, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Saaki Argus Averil Consulting Full time

    Job Title Senior Data Engineer Data ProductsLocation Chennai IndiaOpen Roles 2Mode HybridAbout the RoleAre you a hands-on data engineer who thrives on solving complex data challenges and building modern cloud-native solutions We re looking for two experienced Senior Data Engineers to join our growing Data Engineering team This is an exciting...

  • Senior data engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior data engineer

    2 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior Data Scientist

    5 hours ago

    Chennai, India Crayon Data Full time

    Role: Sr Data Scientist Experience level: 5 to 7 years Location: Chennai Why Crayon? Why now? Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space. We're building an organization where AI is not a department—it’s a way of...