Senior Data Engineer

14 hours ago

New Delhi, India MyRemoteTeam Inc Full time

About UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Position: Senior Data Engineer (Python Coder)Location: India ( Remote )Work Commitment: 40 Hrs / Week (full-time)Contract Duration: 3 - 6 MonthsClient: Wipro ( Google )BGV: YESRole: Senior Data Engineer (Python Coder)Exp: Min. 8 YearsRole SummaryWe are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC), you will be the team's expert on data ingestion, processing, and quality for all AI training.Your primary mission is to build scalable, automated systems that transform massive, raw datasets into pristine, model-ready formats. While your focus will be on data engineering, your expertise will be valued in collaborating on model training runs and experiments. You're the perfect fit if you are a Python expert who thrives on solving large-scale data challenges and enjoys working at the intersection of data engineering and machine learning.Key ResponsibilitiesArchitect & Build: Design, develop, and own robust, scalable, and automated ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets.Data Quality: Implement rigorous data cleaning, deduplication, filtering, and normalization strategies. Define and enforce data quality standards to ensure the highest integrity for model training.Data Transformation: Efficiently structure and format diverse datasets (JSON, Parquet, etc.) for consumption by LLM training frameworks.Collaboration: Work closely with our team of AI researchers and ML engineers to understand data requirements, define metrics, and support the model training lifecycle.Optimization: Continuously optimize data processing workflows for speed, cost, and reliability.ML Support (Secondary): Occasionally assist in launching, monitoring, and debugging data-related issues during model training runs.Required Qualifications- 8+ years of professional experience in data engineering, data processing, or backend software engineering. - Expert-level proficiency in Python and its data ecosystem (e.g., Pandas, NumPy, Dask, Polars). - Proven experience building and maintaining large-scale data pipelines. - Deep understanding of data structures, data modeling, and software engineering best practices (Git, CI/CD, testing). - Experience handling and parsing diverse data formats (JSON, CSV, XML, Parquet) at scale. - Excellent problem-solving skills and a meticulous attention to detail. - Strong communication and collaboration skills, with experience working in a team environment.Preferred Qualifications (Nice-to-Haves)- Hands-on experience with the data preprocessing pipeline for an LLM (e.g., LLaMA, BERT, GPT-family). - Strong experience with big data frameworks like Apache Spark or Ray. - Experience with Hugging Face libraries (Transformers, Datasets, Tokenizers). - Familiarity with ML frameworks like PyTorch or TensorFlow. - Proficiency with cloud platforms (AWS, GCP, Azure) and their data/storage services.

  • Senior Data Engineer

    4 days ago

    New Delhi, India Eucloid Data Solutions Full time

    Job Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data Scientist

    4 weeks ago

    New Delhi, India Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Senior Data Engineer

    3 weeks ago

    New Delhi, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...

  • Senior Data Engineer

    1 week ago

    New Delhi, India People Tech Group Inc Full time

    Role : Senior Data EngineerLocation : HyderabadExperience : 6+YearsWe're Hiring: Senior Data Engineer – Ontology & Knowledge Graph SystemsAre you passionate about building intelligent data systems that power AI and analytics?We're looking for a Senior Data Engineer to lead the design and implementation of a semantic data layer that connects complex data...

  • Senior Data Engineer

    15 hours ago

    New Delhi, India Elements HR Services Pvt Ltd Full time

    Senior Data EngineerTitle Senior Data EngineerDepartment ISSLocation BengaluruReports To Data Engineers – LeadLevel 4,5,6We share a commitment to making things better for clients and each other. We continually explore new technology and different ways of working to put our clients first. So, bring your boldest ideas to our (name of team/business area) team...

  • Senior Software Engineer

    4 weeks ago

    New Delhi, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: HybridWho are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Senior Data Engineer

    4 days ago

    New Delhi, India Elements HR Services Pvt Ltd Full time

    Senior Data EngineerTitle Senior Data Engineer Department ISS Location Bengaluru Reports To Data Engineers – Lead Level 4,5,6We share a commitment to making things better for clients and each other. We continually explore new technology and different ways of working to put our clients first. So, bring your boldest ideas to our (name of team/business area)...

  • Senior Software Engineer

    3 weeks ago

    New Delhi, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform, maya.ai,...

  • Senior Data Engineer

    1 week ago

    Delhi, India Eucloid Data Solutions Full time

    Job Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data Engineer

    14 hours ago

    New Delhi, India Tata Consultancy Services Full time

    Role**: Senior Data Engineer Required Technical Skill Set: Senior Data Engineer Desired Experience Range: 7 - 12 yrs Notice Period: Immediate to 90Days only Location of Requirement:Bangalore We are currently planning to do a VirtualInterviewJob Description:Primary Skills (Java, Python, etc.) Python, Scala/Java, Spark, SQL, Snowflake, BDD, Databricks, AWSKey...