Senior Data Engineer

1 day ago

Vellore, India MyRemoteTeam Inc Full time

About UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Position: Senior Data Engineer (Python Coder)Location: India ( Remote )Work Commitment: 40 Hrs / Week (full-time)Contract Duration: 3 - 6 MonthsClient: Wipro ( Google ) BGV: YESRole: Senior Data Engineer (Python Coder)Exp: Min. 8 Years Role SummaryWe are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC), you will be the team's expert on data ingestion, processing, and quality for all AI training. Your primary mission is to build scalable, automated systems that transform massive, raw datasets into pristine, model-ready formats. While your focus will be on data engineering, your expertise will be valued in collaborating on model training runs and experiments. You're the perfect fit if you are a Python expert who thrives on solving large-scale data challenges and enjoys working at the intersection of data engineering and machine learning. Key ResponsibilitiesArchitect & Build: Design, develop, and own robust, scalable, and automated ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets.Data Quality: Implement rigorous data cleaning, deduplication, filtering, and normalization strategies. Define and enforce data quality standards to ensure the highest integrity for model training.Data Transformation: Efficiently structure and format diverse datasets (JSON, Parquet, etc.) for consumption by LLM training frameworks.Collaboration: Work closely with our team of AI researchers and ML engineers to understand data requirements, define metrics, and support the model training lifecycle.Optimization: Continuously optimize data processing workflows for speed, cost, and reliability.ML Support (Secondary): Occasionally assist in launching, monitoring, and debugging data-related issues during model training runs. Required Qualifications8+ years of professional experience in data engineering, data processing, or backend software engineering.Expert-level proficiency in Python and its data ecosystem (e.g., Pandas, NumPy, Dask, Polars).Proven experience building and maintaining large-scale data pipelines.Deep understanding of data structures, data modeling, and software engineering best practices (Git, CI/CD, testing).Experience handling and parsing diverse data formats (JSON, CSV, XML, Parquet) at scale.Excellent problem-solving skills and a meticulous attention to detail.Strong communication and collaboration skills, with experience working in a team environment. Preferred Qualifications (Nice-to-Haves)Hands-on experience with the data preprocessing pipeline for an LLM (e.g., LLaMA, BERT, GPT-family).Strong experience with big data frameworks like Apache Spark or Ray.Experience with Hugging Face libraries (Transformers, Datasets, Tokenizers).Familiarity with ML frameworks like PyTorch or TensorFlow.Proficiency with cloud platforms (AWS, GCP, Azure) and their data/storage services.

  • Senior data engineer

    3 weeks ago

    Vellore, India AIQU Full time

    We are hiring for Senior Data Engineer to join one of our major clients based out of KSA.Job Details:Role: Senior Data EngineerWork Location: RemoteEmployment Type: Contract – 12 months & extendableRole Summary:The Senior Data Engineer plays a lead role in designing, building, optimizing, and governing data pipelines and architectures that power analytics,...

  • Data Engineer

    1 day ago

    Vellore, India HISH IT SERVICES Full time

    We have a new urgent GCP Data Engineer opportunity open to support a migration initiative from Teradata to Cerebro (BigQuery). This role requires a hands-on developer who can collaborate closely with our data and reporting teams to ensure smooth repointing and validation of Power BI reports. Request Details: - Title: GCP Data Engineer - Seniority: Mid to...

  • Senior Kepware Engineer

    1 week ago

    Vellore, India 9NEXUS Full time

    Job Title: Senior Kepware EngineerLocation: RemoteExperience: 6+ YearsRole OverviewWe are seeking an experienced Senior Kepware Engineer to lead IT–OT integration initiatives and manage connectivity across industrial automation systems. The role involves working with diverse PLC environments, enabling seamless data exchange between shopfloor systems and...

  • Data Scientist

    1 week ago

    Vellore, India FactEntry Data Solutions Pvt Ltd Full time

    **Python NLP Engineer - Machine Learning** **Skills**: - Python developer - 3+yrs - Elastic Search - 1+yrs - Database - SQL, MongoDB 3+yrs - AWS or cloud / web hosting - 1+yrs **Desired Qualification**: - Proficient knowledge of programming in Python - Ability to wrangle both Unstructured and Structured data. - Work on research problems in information...

  • Senior Ai Engineer

    6 days ago

    Vellore, India Whatjobs IN C2 Full time

    Company Description Salesmantu is a revenue operations advisory and a technology company. We are looking to support a client to fill a role for them in AI space. The Role We’re looking for a Senior AI Engineer to design and build Nova’s intelligence core - the models, pipelines, and adaptive agents that drive candidate-role matching, behavioural scoring,...

  • Senior Data Engineer

    3 weeks ago

    Vellore, India Manuh Technologies Full time

    Key ResponsibilitiesStrong in AWSDevelop automation scripts and tools using Python for data integration, validation, and transformation.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Implement best practices for data governance, security, and monitoring.Optimize data pipelines for...

  • Senior Data Engineer

    3 weeks ago

    Vellore, India Manuh Technologies Full time

    Key ResponsibilitiesStrong in AWSDevelop automation scripts and tools using Python for data integration, validation, and transformation.Collaborate with data analysts, data scientists, and business stakeholders to ensure data availability and reliability.Implement best practices for data governance, security, and monitoring.Optimize data pipelines for...

  • ▷ Urgent Search: Senior Signal Processing Engineer

    3 weeks ago

    Vellore, India Paras Anti-Drone Technologies Pvt Ltd Full time

    Company Description Paras Anti-Drone Technologies Private Limited, a subsidiary of Paras Defense and Space Technologies Limited, specializes in innovative RF system solutions including antennas, radars, software-defined radios, and drone detection & jamming systems. With extensive experience in the defense and aerospace industries, we are dedicated to...

  • Vp - data science

    4 weeks ago

    Vellore, India Capri Global Capital Ltd. Full time

    The VP - Data Science will oversee the development and implementation of data-driven solutions across the organization. The role involves leading a team of data scientists, collaborating with cross-functional teams, and delivering actionable insights to support business decisions. The ideal candidate will have a deep understanding of machine learning,...

  • Senior Software Engineer

    4 weeks ago

    Vellore, India Whatjobs IN C2 Full time

    We are seeking a highly skilled Senior Software Engineer to execute our strategy preferably experienced in Financial Services/Procurement domain , to build a modern SaaS platform using latest technologies like ReactJS, Angular, Django, Python with Postgres and AWS as the platform. Athena, Lambda, Python, Spark and PowerBI. As a Full Stack Engineer, you’ll...