Senior data engineer

17 hours ago

Tiruppur, India MyRemoteTeam Inc Full time

About Us My Remote Team, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better. Position: Senior Data Engineer (Python Coder) Location: India ( Remote ) Work Commitment: 40 Hrs / Week (full-time) Contract Duration: 3 - 6 Months Client: Wipro ( Google ) BGV: YES Role: Senior Data Engineer (Python Coder) Exp: Min. 8 Years Role Summary We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC) , you will be the team's expert on data ingestion, processing, and quality for all AI training. Your primary mission is to build scalable, automated systems that transform massive, raw datasets into pristine, model-ready formats. While your focus will be on data engineering, your expertise will be valued in collaborating on model training runs and experiments. You're the perfect fit if you are a Python expert who thrives on solving large-scale data challenges and enjoys working at the intersection of data engineering and machine learning. Key Responsibilities Architect & Build: Design, develop, and own robust, scalable, and automated ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets. Data Quality: Implement rigorous data cleaning, deduplication, filtering, and normalization strategies. Define and enforce data quality standards to ensure the highest integrity for model training. Data Transformation : Efficiently structure and format diverse datasets (JSON, Parquet, etc.) for consumption by LLM training frameworks. Collaboration: Work closely with our team of AI researchers and ML engineers to understand data requirements, define metrics, and support the model training lifecycle. Optimization: Continuously optimize data processing workflows for speed, cost, and reliability. ML Support (Secondary): Occasionally assist in launching, monitoring, and debugging data-related issues during model training runs. Required Qualifications 8+ years of professional experience in data engineering, data processing, or backend software engineering. Expert-level proficiency in Python and its data ecosystem (e.g., Pandas, Num Py, Dask, Polars). Proven experience building and maintaining large-scale data pipelines. Deep understanding of data structures, data modeling, and software engineering best practices (Git, CI/CD, testing). Experience handling and parsing diverse data formats (JSON, CSV, XML, Parquet) at scale. Excellent problem-solving skills and a meticulous attention to detail. Strong communication and collaboration skills, with experience working in a team environment. Preferred Qualifications (Nice-to-Haves) Hands-on experience with the data preprocessing pipeline for an LLM (e.g., LLa MA, BERT, GPT-family). Strong experience with big data frameworks like Apache Spark or Ray. Experience with Hugging Face libraries (Transformers, Datasets, Tokenizers). Familiarity with ML frameworks like Py Torch or Tensor Flow. Proficiency with cloud platforms (AWS, GCP, Azure) and their data/storage services.

  • Azure Data Engineering

    2 weeks ago

    Tiruppur, India LTIMindtree Full time

    Let's Connect!!! We are hiring for ADB +ADF +Py spark +SQL +Synapse Roles: Specialist - Data Engineering 5 to 8 Yrs Senior Specialist - Data Engineering 8 to 12 yrs Location: Coimbatore & Indore Please apply in below link https://forms.Office.Com/r/jqakpaGaWD

  • AWS, Snowflake, DBT, Terraform- Senior Data Engineer

    2 days ago

    Tiruppur, India COREDATA CONSULTANCY Full time

    Role DescriptionWe are seeking a Senior Data Engineer with expertise in AWS, Snowflake, DBT, and Terraform. This is 1 year extendable contractual role where you will design, build, and optimize scalable data solutions. Your responsibilities will include creating and maintaining data pipelines, developing data models, implementing ETL processes, and ensuring...

  • Data Product Engineer

    3 weeks ago

    Tiruppur, India Excelloit Consultancy Services Full time

    Data Product Engineer – Full Stack (2 Openings)📍 Location Preference: Nagpur | Pune | Indore | Jabalpur | Raipur | Mumbai🕒 Experience: 4–6 years (Engineer) | 6+ years (Senior Engineer)🧑 💻 Work Mode: RemoteSalary: Max 22 LPA to Max 28 LPA 🧠 Key Responsibilities🔸 Full Stack DevelopmentDesign and develop end-to-end web applications using...

  • Learning Support Specialist

    1 week ago

    Tiruppur, India Emeritus Full time

    About Emeritus:Emeritus is committed to teaching the skills of the future by making high-quality education accessible and affordable to individuals, companies, and governments around the world. It does this by collaborating with more than 50 top-tier universities across the United States, Europe, Latin America, Southeast Asia, India and China.Emeritus’...

  • Manager, data scientist and machine learning engineer

    1 week ago

    Tiruppur, India Ocwen Financial Solutions Pvt. Ltd. - APAC Full time

    Position Summary: We’re seeking a Data Scientist to support the development and deployment of machine learning models and analytics solutions that improve decision-making across the mortgage lifecycle—from acquisition to servicing. In this hands-on role, you’ll contribute to building predictive models, customer segmentation tools, and automation...

  • SAP Data Engineer

    4 weeks ago

    Tiruppur, India Sapphire Software Solutions Inc Full time

    HI Folks Please check the JD and share your updated resume to my email and ping me on whatsapp ( ) along with your resume SAP Data Engineer Location: Remote in India Duration: 12-month contract with extensions Candidates' Core Skillset Must Be: DataSphere S4 Hana SAC BW Data Modeling Plusses: SAP ABAP, HANA/AMDP/CDS, SOAP/OData/Rest API’s etc. Job...

  • Data scientist

    4 weeks ago

    Tiruppur, India BeGig Full time

    Job Role- Data ScientistJob Type- ContractDuration- 3 months with possible extension as per the performance.Work mode- onsite(5.5 days in a week)Location - HyderabadWe’re looking for a multi-skilled Data Scientist. This strategic role involves driving digital transformation initiatives across sales, procurement, supply chain, and CXO-level decision...

  • Senior Vapt Engineer

    3 weeks ago

    Tiruppur, India Whatjobs IN C2 Full time

    Summary role description: Hiring a Senior VAPT Engineer for one of the leading enterprise IT solutions and digital transformation services provider. Company description: Our client is a well-established global technology and digital transformation company specializing in Predictive Analytics, Digital Experience, and Digital Supply Chain Management. They have...

  • Backend engineer — data

    3 days ago

    Tiruppur, India Branch International Full time

    Branch OverviewImagine a world where every person has improved access to financial services. People could start new businesses, pay for their children’s education, cover their emergency medical bills – the possibilities to improve life are endless.Branch is a global technology company revolutionizing financial access for millions of underserved banking...

  • AI/ML & Data Engineer

    3 weeks ago

    Tiruppur, India Mindfire Solutions Full time

    About the JobWe are looking for an experienced AI/ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional teams to deliver AI-driven solutions, integrate large language models (LLMs), and optimize data workflows while ensuring security, scalability, and...