Principal Data Engineer

4 weeks ago

India KYFEX Full time
About KYFEX: KYFEX is a leading AI consulting firm, dedicated to harnessing the power of artificial intelligence to revolutionize business operations across the globe.

Our expertise in Large Language Models (LLMs) positions us at the cutting edge of AI technology, enabling us to offer unparalleled solutions to our clients.

As we continue to grow, we're seeking a skilled Remote Principal Data Engineer to lead our efforts in managing and optimizing data processes for LLM training.

Job Responsibilities: Lead the design and implementation of scalable data pipelines for the training of open-source LLMs.

Work closely with AI researchers and engineers to understand data requirements and ensure efficient data processing for AI model training.

Develop and maintain robust data storage solutions, ensuring data integrity, security, and compliance.

Optimize data retrieval and processing techniques to reduce training time and improve model performance.

Implement monitoring, logging, and alert systems to ensure high availability and performance of data systems.

Collaborate with cross-functional teams to integrate LLM solutions into client projects, providing expert advice on data engineering best practices.

Stay abreast of the latest developments in data engineering and LLM technologies, continuously improving KYFEX's data strategies.

Minimum Requirements: Bachelor's degree in Computer Science, Engineering, or a related field.5+ years of experience in data engineering, with a proven track record of building and managing large-scale data pipelines.

Strong proficiency in programming languages such as Python or Scala.

Extensive experience with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud services (AWS, Google Cloud, Azure).

Demonstrated experience in data modeling, ETL development, and data warehousing.

Knowledge of machine learning concepts and experience supporting data needs for AI/ML projects.

Excellent problem-solving skills and the ability to work independently in a fully remote environment.

Preferred Skills: Master's degree or Ph.

D.

in a related field.

Experience with open-source LLMs and understanding of NLP data processing.

Familiarity with containerization and orchestration technologies (Docker, Kubernetes).

Experience in implementing data security and privacy practices.

Strong communication skills, with the ability to lead teams and collaborate effectively with stakeholders.

Why Join KYFEX?Work at the forefront of AI technology with a team of experts passionate about innovation.

Enjoy the flexibility and benefits of a fully remote position.

Engage in challenging and meaningful projects that have a real-world impact.

Benefit from a culture of continuous learning, professional development, and collaborative achievement.

To Apply: Interested candidates are invited to submit their resume, a cover letter detailing their experience with LLMs, and any relevant project samples or Git Hub links to careers@kyfex.com with "Remote Principal Data Engineer Application" as the subject line.

KYFEX is committed to diversity and inclusion and encourages applications from all qualified individuals, including those from diverse backgrounds and underrepresented groups.

  • 3 Days Left) Principal Engineer

    2 weeks ago

    India Amazon Music Full time

    Job DescriptionDESCRIPTIONPrincipal Engineers provide technical leadership at Amazon.com. They help establish technical standards and drive Amazon's overall technical architecture, engineering practices, and engineering methodologies. They work on our hardest problems, building high quality, architecturally sound systems that are aligned with our business...

  • Principal Software Engineer

    2 days ago

    India Microsoft Full time

    Job DescriptionAre you looking for an opportunity to change the way businesses digitally transform in a mobile first, cloud first world If so, we've got the job for you The Business and Industry Co-pilot group is responsible for the Microsoft Dynamics 365 suite of products, Microsoft Flow, PowerApps, and Power BI in addition to other products and services...

  • Principal Python Backend Engineer 32425

    3 weeks ago

    India Stealth AI Startup Full time

    Compensation: Up to $300,000 USD annually + Equity Type: Full-time | Remote A cutting-edge AI company is seeking a Principal Python Backend Engineer to lead backend architecture for distributed AI systems.You'll design scalable infrastructure supporting real-time inference, model management, and AI application workflows.Responsibilities: Architect and scale...

  • Senior Data Engineer

    3 weeks ago

    India Aptus Data Labs Full time

    Job Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...

  • Data Engineer

    4 weeks ago

    India Centrilogic Full time

    Data EngineerPurpose:Over 15 years, we have become a premier global provider of multi-cloud management, cloud-native application development solutions, and strategic end-to-end digital transformation services.Headquartered in Canada and with regional headquarters in the U.S. and the United Kingdom, Centrilogic delivers smart, streamlined solutions to clients...

  • Principal Verification Engineer

    2 days ago

    India Mulya Technologies Full time

    Principal Verification Engineer ( RISC-V Processor ) Location: Bangalore / Pune /Work From Home (WFH ) Ventana is at the forefront of the two hottest trends that are revolutionizing the semiconductor industry: RISC-V and Chiplet Architecture. We are well-funded and backed by some of the largest strategic investors in the industry with the goal of building...

  • Ea to Principal

    2 weeks ago

    India One World International School Full time

    India - Permanent - 8th Jan 2025 **Qualifications** - BA (Hons) **Overview** - To provide the assistance to the Principal in the day - to day activities in an organized & confidential manner. **Responsibilities** - Managing day-to-day transactional activities of the Principal. - Scheduling & setting up travel, meetings, calendar and other appointments for...

  • Principal Statistical Programming Lead

    3 weeks ago

    India Johnson & Johnson Full time

    At Johnson Johnson we believe health is everything Our strength in healthcare innovation empowers us to build a world where complex diseases are prevented treated and cured where treatments are smarter and less invasive and solutions are personal Through our expertise in Innovative Medicine and MedTech we are uniquely positioned to innovate across...

  • Principal System Architect

    4 weeks ago

    India Mobio Transfers Full time

    Job DescriptionWe&aposre Hiring: Principal Architect Event-Driven SystemsRemote | Full-time | Global OpportunityMobio Transfers is building the brain of modern movement. Our real-time platform powers dynamic ride-hailing and delivery logistics with live tracking, intelligent matching, and instant communication. Think Uber or Careem but smarter, leaner, and...

  • Senior Azure Databricks Engineer

    4 weeks ago

    India Quant-data Full time

    We're Hiring: Senior Azure Databricks Engineer (Remote | Full-Time) Join us to build scalable, cloud-native data solutions using cutting-edge technologiesWe're looking for an experienced and driven Senior Azure Databricks Engineer to join our growing team. This role is ideal for professionals with 6–10 years of experience in the data engineering space,...