Data Scientist

4 days ago


Guwahati, India Whatjobs IN C2 Full time

About Us MyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Position: Senior Data Engineer (Python Coder) Location: India ( Remote ) Work Commitment: 40 Hrs / Week (full-time) Contract Duration: 3 - 6 Months Client: Wipro ( Google ) BGV: YES Role: Senior Data Engineer (Python Coder) Exp: Min. 8 Years Role Summary We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC) , you will be the team's expert on data ingestion, processing, and quality for all AI training. Your primary mission is to build scalable, automated systems that transform massive, raw datasets into pristine, model-ready formats. While your focus will be on data engineering, your expertise will be valued in collaborating on model training runs and experiments. You're the perfect fit if you are a Python expert who thrives on solving large-scale data challenges and enjoys working at the intersection of data engineering and machine learning. Key Responsibilities Architect & Build: Design, develop, and own robust, scalable, and automated ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets. Data Quality: Implement rigorous data cleaning, deduplication, filtering, and normalization strategies. Define and enforce data quality standards to ensure the highest integrity for model training. Data Transformation : Efficiently structure and format diverse datasets (JSON, Parquet, etc.) for consumption by LLM training frameworks. Collaboration: Work closely with our team of AI researchers and ML engineers to understand data requirements, define metrics, and support the model training lifecycle. Optimization: Continuously optimize data processing workflows for speed, cost, and reliability. ML Support (Secondary): Occasionally assist in launching, monitoring, and debugging data-related issues during model training runs. Required Qualifications 8+ years of professional experience in data engineering, data processing, or backend software engineering. Expert-level proficiency in Python and its data ecosystem (e.G., Pandas, NumPy, Dask, Polars). Proven experience building and maintaining large-scale data pipelines. Deep understanding of data structures, data modeling, and software engineering best practices (Git, CI/CD, testing). Experience handling and parsing diverse data formats (JSON, CSV, XML, Parquet) at scale. Excellent problem-solving skills and a meticulous attention to detail. Strong communication and collaboration skills, with experience working in a team environment. Preferred Qualifications (Nice-to-Haves) Hands-on experience with the data preprocessing pipeline for an LLM (e.G., LLaMA, BERT, GPT-family). Strong experience with big data frameworks like Apache Spark or Ray. Experience with Hugging Face libraries (Transformers, Datasets, Tokenizers). Familiarity with ML frameworks like PyTorch or TensorFlow. Proficiency with cloud platforms (AWS, GCP, Azure) and their data/storage services.


  • Data Scientist

    4 days ago


    Guwahati, India Whatjobs IN C2 Full time

    We are looking for a passionate and skilled Data Scientists to join our team and lead the development of cutting-edge Artificial Intelligence solutions tailored for the Retail industry. The ideal candidate will have hands-on experience building and deploying AI models that enhance customer experience, optimize operations, and drive data-driven...

  • Senior Data Scientist

    2 weeks ago


    Guwahati, India ValueMatrix.AI Full time

    A Behavioural sciences DeepTech company.Role Description This is a full-time remote role for a Senior Data Scientist. The Senior Data Scientist will be responsible for performing data analysis, data visualization, and developing data science models. The role involves designing and implementing statistical models, providing insights through data analytics,...

  • PySpark Developer

    4 days ago


    Guwahati, India Xped pvt Ltd Full time

    Description :Key Responsibilities :- As part of the Infosys delivery team your primary role would be to interface with the client for quality assurance issue resolution and ensuring high customer satisfaction- You will understand requirements create and review designs validate the architecture and ensure high levels of service offerings to clients in the...


  • Guwahati, India Whatjobs IN C2 Full time

    Job Title: Senior Full Stack Developer & Data Engineer Location : Remote Duration : Full-time - unlimited Apply : About Us : AIRE is a dynamic PropTech startup revolutionizing the real estate market in the Middle East and Africa. We leverage cutting-edge technology and data-driven insights to create innovative solutions that streamline development...


  • Guwahati, India Whatjobs IN C2 Full time

    Introduction to role: Are you ready to take on a pivotal role in shaping the future of enterprise integration at AstraZeneca? As a Director- Enterprise Integration Architect, you'll be at the forefront of developing and implementing innovative API products and technologies. Our Global Enterprise Architect (GEA) Team is dedicated to driving innovation across...