5mo ago

AI Specialist (AI Engineering)

Chinamid

OtherAi Specialist

1 views0 saves0 applied

Apply Now

Quick Summary

Overview

We are looking for an AI Specialist Engineer to enhance the performance of large language and vision models for on-device inference. Your expertise will be crucial in developing and deploying cutting-edge AI solutions, ensuring optimal efficiency across diverse hardware architectures.

Key Responsibilities

Compress and optimize large language and vision models for on-device inference. Develop pipelines for model distillation and hardware-specific compilation. Benchmark performance across various NPU/GPU architectures.

Requirements Summary

Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques. Hands-on experience with TensorRT, ONNX Runtime, and edge deployment. Strong C++ and Python skills.

Technical Tools

cpppython

Responsibilities

~1 min read

→Compress and optimize large language and vision models for on-device inference.
→Develop pipelines for model distillation and hardware-specific compilation.
→Benchmark performance across various NPU/GPU architectures.

Requirements

~1 min read

Expertise in model distillation, pruning, and 4-bit/8-bit quantization techniques.
Hands-on experience with TensorRT, ONNX Runtime, and edge deployment.
Strong C++ and Python skills.