
Senior Data Engineer
22 hours ago
Data Engineer (LLM Data Pipeline)
Description :
Location: India (Remote/Hybrid)
Experience: 3–6 years in Data Engineering
Role Overview:
You will own the data pipeline powering our LLM training and fine-tuning. This includes ingestion,
cleaning, deduplication, and building high-quality datasets from structured/unstructured sources.
Responsibilities:
- Design ETL pipelines for text, PDFs, and structured data.
- Implement data deduplication, filtering (toxicity, PII), and normalization.
- Train and manage tokenizers (SentencePiece/BPE).
- Build datasets for supervised fine-tuning and evaluation.
- Work closely with domain experts to generate instruction/response pairs.
Requirements:
- Strong in Python, SQL, and data wrangling frameworks (Pandas, Spark).
- Experience with large text datasets, cleaning, preprocessing.
- Familiarity with NLP-specific preprocessing (chunking, embeddings).
- Knowledge of cloud data storage (S3/GCS/Blob).
- Bonus: Prior experience in AI/ML pipelines.
Job Type: Permanent
Pay: ₹469, ₹1,812,611.94 per year
-
Senior Data Engineer
2 weeks ago
Chennai, Tamil Nadu, India AstraZeneca Full timeJob Title Senior Data Engineer Career Level D3 Introduction to role Are you ready to disrupt an industry and change lives We are seeking a seasoned Senior Data Engineer to join our innovative team With a focus on modern data tools and cloud platforms you ll play a pivotal role in transforming our ability to develop life-changing medicines If you have...
-
Senior Data scientist
2 weeks ago
Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per yearSenior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...
-
Data Engineer
7 days ago
Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per yearWe are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...
-
Senior Data Scientist
9 hours ago
tamil nadu, India Crayon Data Full timeRole: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...
-
Senior Software Engineer
2 weeks ago
Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per yearSenior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...
-
Senior Data Engineer
1 week ago
tamil nadu, India Eucloid Data Solutions Full timeJob DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...
-
Senior Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Saaki Argus Averil Consulting Full timeJob Title Senior Data Engineer Data ProductsLocation Chennai IndiaOpen Roles 2Mode HybridAbout the RoleAre you a hands-on data engineer who thrives on solving complex data challenges and building modern cloud-native solutions We re looking for two experienced Senior Data Engineers to join our growing Data Engineering team This is an exciting...
-
Senior data engineer
2 weeks ago
Chennai, India Eucloid Data Solutions Full timeJob DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...
-
Senior data engineer
2 weeks ago
Chennai, India Eucloid Data Solutions Full timeJob DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...
-
Senior Data Scientist
5 hours ago
Chennai, India Crayon Data Full timeRole: Sr Data Scientist Experience level: 5 to 7 years Location: Chennai Why Crayon? Why now? Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space. We're building an organization where AI is not a department—it’s a way of...