Senior Engineer

2 days ago


Pune, India Attentions AI Full time
Greetings From Attentions.ai
Job Description for Senior Engineer - PyTorch to TensorRT Conversion & CUDA Expert.
Title: Senior Engineer - PyTorch to TensorRT Conversion & CUDA Expert
Location : Pune
Job Type: Permanent
About Us:
At Attentions.ai, we're at the forefront of digital interaction and cognitive service development. We are committed to innovation and excellence, providing a dynamic work environment where creativity thrives. Join us to push the boundaries of UI technology.
Role Summary:
This role is ideal for someone passionate about pushing the limits of AI model performance and working with state-of-the-art GPU technology. Join us in revolutionizing how AI models are deployed in production --- This job description can be tailored further based on your company's specific requirements.
Job Description:
We are seeking a highly skilled Senior Engineer with deep expertise in converting PyTorch models into optimized TensorRT models and extensive experience in NVIDIA CUDA development. You will be responsible for building high-performance inference pipelines, focusing on maximising speed and efficiency through CUDA graphs and TensorRT-compiled models.
This role is crucial for accelerating our AI models in production environments and ensuring the scalability of inference workloads.
Key Responsibilities:
PyTorch to TensorRT Conversion: - Convert and optimize PyTorch models into TensorRT to achieve low-latency, high-throughput performance. Troubleshoot conversion issues and ensure compatibility between model frameworks and inference environments.
NVIDIA CUDA Optimization:
Develop high-performance inference pipelines leveraging CUDA for efficient GPU utilization. Write and optimize CUDA kernels to accelerate specific model operations when needed. Design and implement CUDA graphs to maximize inference speed.
Inference Pipeline Development:
Build scalable and high-speed model inference pipelines integrating TensorRT-compiled models.
Profile and optimize inference workloads, ensuring minimal latency and maximum throughput. Work closely with data scientists and machine learning engineers to productionize models.
Performance Tuning: Optimize memory usage, resource management, and load balancing for multi-GPU systems.
Use advanced techniques for model quantization, pruning, and graph optimizations to reduce model size and improve performance.
Collaboration:
Work with the ML research and deployment teams to integrate optimized models into production systems.
Collaborate on architecture decisions and deployment strategies for large-scale AI inference systems.
Technical Expertise:
Strong hands-on experience with PyTorch, including model training and optimization.
In-depth knowledge of TensorRT and experience in converting models from PyTorch or other frameworks (e.g., TensorFlow) into TensorRT.
Advanced proficiency in NVIDIA CUDA programming and development.
Experience with CUDA Graphs and optimizing models for low-latency inference.
Experience: Minimum of 5 years of hands-on experience in deep learning model optimization, focusing on GPU-based model acceleration.
Proven experience in building real-time inference pipelines using TensorRT and CUDA. Familiarity with NVIDIA profiling tools such as Nsight, and experience with model debugging and optimization.
Solid understanding of multi - GPU architectures and distributed computing frameworks.
Programming Skills:
Proficiency in C++ and Python, with strong debugging and problem-solving skills. Familiarity with libraries like cuDNN, cuBLAS, and other CUDA ecosystem components.
Performance Optimization: Expertise in profiling, benchmarking, and improving model inference latency and throughput.
Experience with techniques like model quantization, pruning, and compression to reduce computational load.
Preferred Qualifications:
Experience working with cloud-based AI inference systems (AWS, GCP, Azure).
Knowledge of containerization technologies like Docker, and orchestration tools like Kubernetes.
Understanding of other machine learning frameworks (TensorFlow, ONNX).
Contributions to open-source deep learning or GPU-acceleration projects.
What We Offer: Competitive salary and performance bonuses.
Work with cutting-edge AI and GPU technologies.
Collaborative and innovative work environment.
Opportunities for career advancement and skill development.
Flexible work hours and a comprehensive benefits package.
Application Process:
Please submit your resume, along with a cover letter detailing your relevant experience in PyTorch to TensorRT conversion, CUDA optimization, and high-performance inference pipeline development. Links to projects, GitHub repositories, or published papers are a plus.
Company Culture and Values:
Creativity, innovation, and a pursuit of excellence define our ethos. We are dedicated to fostering an environment where professionals can grow and contribute to cutting-edge technology. At Attentions, we value teamwork, continuous learning, and the drive to develop impactful solutions.
  • Advocate

    4 months ago


    Baner, Pune, Maharashtra, India ENGINEER HORIZON Full time

    **Job Title**: Mid-Senior Legal Draftsman **Location**: Baner, Pune **Experience**: 4-8years **Education**:Bachelor's degree in law, and active licensure to practice law. **Roles & Responsibilities**: Draft and review legal documents, including contracts, agreements, leases, deeds, and other real state-related documents. Ensure the accuracy and...

  • Senior Sales Engineer

    3 weeks ago


    pune, India Parson Adhesives India Pvt. Ltd. Full time

    Company DescriptionParson Adhesives India Pvt. Ltd., a business unit of Parson Adhesives, Inc.-USA, is a research-based adhesive manufacturer based in Vadodara. We specialize in manufacturing high-performance anaerobics, cyanoacrylates, UV curable, epoxy, polyurethane, methacrylates adhesives, and silicone sealants. Our wide range of products caters to...

  • Senior Sales Engineer

    1 month ago


    Pune, India Infinity Automated Solutions Pvt. Ltd Full time

    Company DescriptionInfinity Automated Solutions Pvt. Ltd in Pune is a leading innovator in secondary packaging automation, offering a diverse range of end-of-line packaging solutions. As an ISO 9001:2015 certified company, we prioritize quality management systems and customer satisfaction through high-quality products. Our state-of-the-art machinery enhances...

  • Senior Sales Engineer

    2 weeks ago


    Pune, India Parson Adhesives India Pvt. Ltd. Full time

    Company Description Parson Adhesives India Pvt. Ltd., a business unit of Parson Adhesives, Inc.-USA, is a research-based adhesive manufacturer based in Vadodara. We specialize in manufacturing high-performance anaerobics, cyanoacrylates, UV curable, epoxy, polyurethane, methacrylates adhesives, and silicone sealants. Our wide range of products caters to...

  • Senior Sales Engineer

    3 weeks ago


    Pune, India Parson Adhesives India Pvt. Ltd. Full time

    Company DescriptionParson Adhesives India Pvt. Ltd., a business unit of Parson Adhesives, Inc.-USA, is a research-based adhesive manufacturer based in Vadodara. We specialize in manufacturing high-performance anaerobics, cyanoacrylates, UV curable, epoxy, polyurethane, methacrylates adhesives, and silicone sealants. Our wide range of products caters to...

  • Senior Sales Engineer

    3 weeks ago


    Pune, India Parson Adhesives India Pvt. Ltd. Full time

    Company DescriptionParson Adhesives India Pvt. Ltd., a business unit of Parson Adhesives, Inc.-USA, is a research-based adhesive manufacturer based in Vadodara. We specialize in manufacturing high-performance anaerobics, cyanoacrylates, UV curable, epoxy, polyurethane, methacrylates adhesives, and silicone sealants. Our wide range of products caters to...

  • Senior Sales Engineer

    3 weeks ago


    Pune, India Parson Adhesives India Pvt. Ltd. Full time

    Company Description Parson Adhesives India Pvt. Ltd., a business unit of Parson Adhesives, Inc.-USA, is a research-based adhesive manufacturer based in Vadodara. We specialize in manufacturing high-performance anaerobics, cyanoacrylates, UV curable, epoxy, polyurethane, methacrylates adhesives, and silicone sealants. Our wide range of products caters to...


  • Pune, India TechHost Services Full time

    Job Details:Position: Senior Platform EngineeringExperience: 4yearsWork Mode: HybridLocation: PuneShift: Time zone overlap time with US 8:30 pm to 11:30 pm ISTExperienced working in multiple cloud or PaaS environments such as AWS Azure Heroku etc.Effectively communicates with stakeholders. Works with developers architects and tech leads to arrive at...

  • Senior Data Engineer

    3 months ago


    Pune, India KONE Full time

    Senior Data Engineer (24/7 Intelligence Analytics)  We are searching for Senior Data Engineers. Our 24/7 Intelligence Analytics team develops and maintains the predictive maintenance solutions for KONE’s 24/7 Connected Services.  In the Senior Data Engineer roles, you will be doing various data engineering tasks in the telemetry and maintenance data...

  • Senior Sales Engineer

    2 weeks ago


    Pune, India Infinity Automated Solutions Pvt. Ltd Full time

    Company Description Infinity Automated Solutions Pvt. Ltd in Pune is a leading innovator in secondary packaging automation, offering a diverse range of end-of-line packaging solutions. As an ISO 9001:2015 certified company, we prioritize quality management systems and customer satisfaction through high-quality products. Our state-of-the-art machinery...

  • Senior Sales Engineer

    1 month ago


    Pune, India Infinity Automated Solutions Pvt. Ltd Full time

    Company Description Infinity Automated Solutions Pvt. Ltd in Pune is a leading innovator in secondary packaging automation, offering a diverse range of end-of-line packaging solutions. As an ISO 9001:2015 certified company, we prioritize quality management systems and customer satisfaction through high-quality products. Our state-of-the-art machinery...

  • Senior Sales Engineer

    1 month ago


    Pune, India Infinity Automated Solutions Pvt. Ltd Full time

    Company Description Infinity Automated Solutions Pvt. Ltd in Pune is a leading innovator in secondary packaging automation, offering a diverse range of end-of-line packaging solutions. As an ISO 9001:2015 certified company, we prioritize quality management systems and customer satisfaction through high-quality products. Our state-of-the-art machinery...

  • Senior Sales Engineer

    1 month ago


    Pune, India Infinity Automated Solutions Pvt. Ltd Full time

    Company Description Infinity Automated Solutions Pvt. Ltd in Pune is a leading innovator in secondary packaging automation, offering a diverse range of end-of-line packaging solutions. As an ISO 9001:2015 certified company, we prioritize quality management systems and customer satisfaction through high-quality products. Our state-of-the-art machinery...


  • pune, India Dar Al-Handasah Consultants (Shair and Partners) Full time

    Senior Electrical Engineer   We are currently seeking to recruit a  Senior Electrical Engineer  to join our team in  Bengaluru  or Pune . Responsibilities : Design prestige projects and coordinate/work closely with Architects, Engineers, and other stakeholders to optimize the project design and resolving design technical issues. Design various types of...


  • pune, India Dar Al-Handasah Consultants (Shair and Partners) Full time

    Senior Electrical Engineer   We are currently seeking to recruit a  Senior Electrical Engineer  to join our team in  Bengaluru  or Pune . Responsibilities : Design prestige projects and coordinate/work closely with Architects, Engineers, and other stakeholders to optimize the project design and resolving design technical issues. Design various types of...

  • Senior QA Engineer

    2 months ago


    Pune, India virtusa consulting services pvt. ltd. Full time

    Apply for Senior QA Engineer, Career Progress Consultants in Pune for 5 - 8 Year of Experience on TimesJobs.com.

  • Senior Data Engineer

    3 weeks ago


    Pune, India NutaNXT Technologies Full time

    Senior Data EngineerExp: 5 - 8 yearsLocation: Pune (Hybrid)About NutaNXTNutaNXTis a Next-gen software product engineering services provider with a singular focus on building innovative Data-first products using Snowflake, AI/ML, Data Engineering, Analytics, and Cloud technologies. Our mission is to help clients leverage our specialized Data and AI...


  • Pune, India Mastercard Full time

    Our PurposeWe work to connect and power an inclusive, digital economy that benefits everyone, everywhere by making transactions safe, simple, smart and accessible. Using secure data and networks, partnerships and passion, our innovations and solutions help individuals, financial institutions, governments and businesses realize their greatest potential. Our...

  • Senior Data Engineer

    3 weeks ago


    pune, India NutaNXT Technologies Full time

    Senior Data EngineerExp: 5 - 8 yearsLocation: Pune (Hybrid)About NutaNXTNutaNXT is a Next-gen software product engineering services provider with a singular focus on building innovative Data-first products using Snowflake, AI/ML, Data Engineering, Analytics, and Cloud technologies. Our mission is to help clients leverage our specialized Data and AI...

  • Senior QA Engineer

    2 weeks ago


    pune, India Virtusa Full time

    Senior QA Engineer - CREQ193558 Description Senior QA Engineer Tier: 3 Job Description:Responsibilities: QA software testing including Test Planning, Functional and Regression testing and System testing(Unit testing, SIT Support)Required Skills: Very Good in functional testing.Good Automation skills with SeleniumKnowledge of SQL / database...