Data Engineer-

4 weeks ago

Vadodara, India MyRemoteTeam Inc Full time

About UsMyRemoteTeam, Inc is a fast-growing distributed workforce enabler, helping companies scale with top global talent. We empower businesses by providing world-class software engineers, operations support, and infrastructure to help them grow faster and better.Position: Python Coder – Data Processing Client: Wipro (Google Project) Location: Remote – India Commitment: 40 hrs/week | Contract: 3–6 Months Experience: 8+ YearsJob DescriptionWe are looking for an experienced Python professional with strong expertise in large-scale data processing. This role involves building and maintaining automated data pipelines that process massive text datasets used for AI and LLM training. The ideal candidate will have deep hands-on experience in Python, strong data engineering skills, and the ability to work closely with ML and AI teams.Key ResponsibilitiesDesign and develop scalable ETL/ELT pipelines using Python.Ingest, process, clean, deduplicate, and normalize large text datasets.Work with diverse data formats such as JSON, CSV, XML, and Parquet.Ensure high data quality and establish quality-check standards.Optimize pipelines for speed, cost efficiency, and reliability.Collaborate with AI/ML teams on data requirements and training workflows.Support model training by investigating data-related issues when required.Required Skills8+ years in data engineering, backend engineering, or data processing roles.Strong expertise in Python and libraries like Pandas, NumPy, Dask, Polars.Experience building large-scale data pipelines.Strong understanding of data structures, data modeling, and best coding practices.Hands-on experience with JSON/CSV/XML/Parquet formats.Excellent debugging and problem-solving skills.Good to HaveExperience in LLM/AI data preprocessing (LLaMA, GPT, BERT, etc.).Knowledge of big data frameworks (Spark, Ray).Experience with Hugging Face libraries (Transformers, Datasets, Tokenizers).Familiarity with PyTorch or TensorFlow.Experience working on cloud platforms (AWS, GCP, Azure).

  • Data Engineer

    3 days ago

    Vadodara, India IntraEdge Full time

    We are seeking a highly skilled Data Engineer with strong experience in Python, PySpark, Snowflake, and AWS Glue to join our growing data team. You will be responsible for building scalable and reliable data pipelines that drive business insights and operational efficiency. This role requires a deep understanding of data modeling, ETL frameworks, and...

  • Data Engineer

    3 weeks ago

    Vadodara, India CIEL HR Full time

    Job Title Data Engineer Location Ahmedabad Gujarat Project Summary The Data Engineer will support the SEWA tech team in the enterprise design and implementation of new data lake metadata structures reporting and analytics products and services and application integration to support data integration across the organisation Key accountabilities of position...

  • Data Engineer

    2 weeks ago

    Vadodara, Gujarat, India Drevol Full time ₹ 12,00,000 - ₹ 16,00,000 per year

    Location:VadodaraDepartment:Data EngineeringJob SummaryWe are seeking a versatileData, Analytics & MLOps Engineerto join our growing AI Engineering team. The ideal candidate is an expert in designing robust data pipelines (ETL pipeline), managing data lakes (Data lake Architect), building enterprise-grade dashboards, and enabling automation and AI/ML...

  • Data Engineer

    7 days ago

    Vadodara, Gujarat, India Sharedpro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description :Roles and Responsibilities:Description of Skills/Needs :Duties and Responsibilities Design, build, and deliver efficient data models and products that align with business needs. Understand requirements fully and come up with robust data models and products while developing solutions tailored to analytical and consumption requirements....

  • Data Engineer

    2 weeks ago

    Vadodara, Gujarat, India Atlas Copco Group Full time ₹ 8,00,000 - ₹ 18,00,000 per year

    Your roleAbout UsAtlas Copco is a Swedish multinational industrial company that was founded in 1873 headquartered in Nacka, Sweden. We are world leaders in Compressors, We also manufactur industrial tools and equipments.We are an IT Service Provider company within Atlas Copco Group called Global IT Hub (India). We are also focusing on Digital transformation...

  • Senior Data Engineer

    3 days ago

    vadodara, India beBeeDataEngineer Full time

    Job Title: Senior Data EngineerJob DescriptionWe are seeking a highly skilled data engineer to design and develop scalable data pipelines, ensuring seamless integration of diverse data sources.Required Skills and QualificationsData engineering-modelling and managing multi-dimensional entities and graphsExperience with graph databases and data lake...

  • Data Engineer

    6 days ago

    Vadodara, Gujarat, India Kiash Solutions LLP Full time ₹ 67,20,000 - ₹ 3,12,20,000 per year

    1. Data Architecture Design      Design end-to-end data architectures using Azure services (e.g., Azure Synapse Analytics, Azure Data Lake, Azure SQL Database, Cosmos DB).      Define data models, data flows, and integration patterns aligned with business and technical requirements.      Ensure solutions support scalability, reliability,...

  • Data Engineer

    5 days ago

    vadodara, India Quess IT Staffing Full time

    · 10+ years' experience, with 3+ years in a technical leadership role.· Lead the design and implementation of scalable data pipelines for ingesting, transforming, and activating customer data.· Develop and orchestrate workflows using Apache Airflow and Spark.· Leverage AWS services (e.g., S3, Glue, Athena, Redshift, EMR) to manage and optimize...

  • Data Engineering Intern

    7 days ago

    vadodara, India beBeeDataEngineer Full time

    Data Engineer OpportunitiesAre you passionate about designing and building scalable data pipelines? Do you want to gain hands-on experience in a fast-paced startup environment?This role is an excellent opportunity for someone looking to develop skills that matter in today's data-driven world. As a Data Engineer, you will play a key role in delivering client...

  • Senior Data Engineer

    1 day ago

    Vadodara, India Ironbook AI Full time

    Role SummaryWe are looking for a Senior Data Engineer to design, build, and optimize high-performance data pipelines and data systems. The ideal candidate will have strong experience with cloud platforms, modern ETL/ELT tools, and deep technical skills in Python, SQL, and distributed data frameworks.Key Responsibilities- Design, develop, and maintain...