Data Engineer
1 day ago
Job Title: Data Engineer – Python Expert(Freelance Role)Location: Remote / HybridEmployment Type: Contract/ FreelanceRole Summary We are looking for a seasoned Senior Data Engineer to architect, build, and own the data pipelines that power our large language model (LLM) development. As a senior Individual Contributor (IC), you will be the team's expert on data ingestion, processing, and quality for all AI training. Your primary mission is to build scalable, automated systems that transform massive, raw datasets into pristine, model-ready formats. While your focus will be on data engineering, your expertise will be valued in collaborating on model training runs and experiments. You're the perfect fit if you are a Python expert who thrives on solving large-scale data challenges and enjoys working at the intersection of data engineering and machine learning.Key Responsibilities Architect & Build: Design, develop, and own robust, scalable, and automated ETL/ELT pipelines in Python for ingesting and processing terabyte-scale text datasets. Data Quality: Implement rigorous data cleaning, deduplication, filtering, and normalization strategies. Define and enforce data quality standards to ensure the highest integrity for model training.Data Transformation: Efficiently structure and format diverse datasets (JSON, Parquet, etc.) for consumption by LLM training frameworks. Collaboration: Work closely with our team of AI researchers and ML engineers to understand data requirements, define metrics, and support the model training lifecycle. Optimization: Continuously optimize data processing workflows for speed, cost, and reliability.ML Support (Secondary): Occasionally assist in launching, monitoring, and debugging data-related issues during model training runs.Required Qualifications 8+ years of professional experience in data engineering, data processing, or backend software engineering. Expert-level proficiency in Python and its data ecosystem (e.g., Pandas, NumPy, Dask, Polars). Proven experience building and maintaining large-scale data pipelines. Deep understanding of data structures, data modeling, and software engineering best practices (Git, CI/CD, testing). Experience handling and parsing diverse data formats (JSON, CSV, XML, Parquet) at scale. Excellent problem-solving skills and a meticulous attention to detail. Strong communication and collaboration skills, with experience working in a team environment.Preferred Qualifications (Nice-to-Haves) Hands-on experience with the data preprocessing pipeline for an LLM (e.g., LLaMA, BERT, GPT-family). Strong experience with big data frameworks like Apache Spark or Ray. Experience with Hugging Face libraries (Transformers, Datasets, Tokenizers). Familiarity with ML frameworks like PyTorch or TensorFlow. Proficiency with cloud platforms (AWS, GCP, Azure) and their data/storage services.Why Join UsOpportunity to lead cutting-edge AI and ML projects.Collaborative and innovative team culture.Competitive compensation with continuous learning opportunities.📩 If you are interested, please share your updated CV to sharmila@aceolution.com along with your expected rate per hour.
-
Data Engineer
2 days ago
Bikaner, India YO HR Consultancy Full timeData Engineer/Senior Data EngineerLocation: ChennaiExperience: 2 - 8 YearsRole DescriptionThe Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large...
-
Data engineer
6 days ago
Bikaner, India DraconX Full timeCompany Description Dracon X specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises. As pioneers in AI business automation and Saa S platforms, we excel in building MVPs, custom software, and automation systems that simplify operations and enhance decision-making. Leveraging expertise in...
-
Data Engineer
5 days ago
Bikaner, India DraconX Full timeCompany Description DraconX specializes in creating intelligent, scalable digital solutions that drive growth and innovation for startups and enterprises. As pioneers in AI business automation and SaaS platforms, we excel in building MVPs, custom software, and automation systems that simplify operations and enhance decision-making. Leveraging expertise in...
-
Azure data engineer
4 weeks ago
Bikaner, India InfoSpruce Technologies Private Limited Full time???? We’re Hiring: Azure Data Engineer | 5+ Years Experience | Full-Time (FTE) ???? Locations (Hybrid Work Model): Chennai | Mumbai | Pune | Ahmedabad | Gurgaon | Noida ⏰ Experience: 5+ Years ???? Role Type: Full-Time | Hybrid ???? Notice Period: Immediate to 15 Days preferred???? About the RoleWe are looking for a results-driven Azure Data Engineer with...
-
Senior data engineer
4 weeks ago
Bikaner, India People Prime Worldwide Full timeAbout Company : Our Client is a leading Indian multinational IT services and consulting firm. It provides digital transformation, cloud computing, data analytics, enterprise application integration, infrastructure management, and application development services. The company caters to over 700 clients across industries such as banking and financial services,...
-
Bikaner, India Gravity Infosolutions, Inc. Full timeRole: Data Engineer with Snowflake & Data Vault 2.0 ExperienceType: ContractDuration: 6 months+ ExtendableExperience: 5+ YearsLocation: RemoteShift: UK ShiftJob DescriptionProject Details:The project involves setting up a new software tool to meet audit requirements and is therefore critical.Most data to be migrated is already in Snowflake; some will be...
-
Data scientist
1 week ago
Bikaner, India 72 Dragons Full timeAbout the company 72 Dragons is a global worldwide production company as well as a set of global services in production, social media, software, data science, design, and curation. We are based and work in China, India, Qatar, and USA. Our company has 3 core areas of business - Art Film Health Job Description We are looking for a Data Analyst with strong...
-
Data & AI Architect
3 weeks ago
Bikaner, India Delphi Consulting Middle East Full timeReady to embark on a journey where your growth is intertwined with our commitment to making a positive impact? Join the Delphi family - where Growth Meets Values.AtDelphi Consulting Pvt. Ltd. , we foster a thriving environment with ahybrid work modelthat lets you prioritize what matters most. Interviews and onboarding are conducted virtually, reflecting...
-
Bikaner, India Infotechtion Full timeSolution & Data Architect - Azure ApplicationsLocation: India (Remote) | Employment Type: Full-time | Senior - 8-11+ Years of experienceAbout the Role We are seeking an accomplished Solution and Data Architect specializing in Azure-based applications. In this role, you will be responsible for designing secure, scalable, and robust...
-
AI Engineer
2 days ago
Bikaner, India Sutra.AI Full timeRole: AI EngineerAbout Sutra.AISutra.AI is a rapidly growing AI Enterprise SaaS Platform company focused on building data-to-decision automation at scale.Our mission is to help enterprises transform raw data into intelligent, actionable insights through AI, automation, and decision intelligence.Role SummaryWe’re seeking an AI Engineer who is passionate...
