Resources and Industry Insights

Learn practical techniques to reduce AI model memory usage on NVIDIA Jetson using TensorRT, FP16 and INT8 quantization, static input shapes, pruning, and other deployment optimizations, while improving inference performance.

Learn how to optimize memory on NVIDIA Jetson using quantization techniques and TensorRT to run AI and LLM models with lower GPU memory requirements.

Learn to run the OpenAI's open source GPT OSS 120b in the NVIDIA DGX Spark computer with our step-by-step guide.

Learn how to deploy PyTorch models on Raspberry Pi AI Camera with step-by-step optimization, compilation, and packaging for real-time AI inference.

Learn how to set up and use the Raspberry Pi AI Camera with real-time object detection, step by step.

Deploy a GStreamer inference pipeline on Axelera AI hardware using the Voyager SDK. Learn how to build, run, and extract AI results step-by-step.

Learn how to set up the Hailo-8 AI accelerator on a Raspberry Pi 5 and run real-time inference with minimal setup. This step-by-step guide covers hardware connection, software installation, and executing sample AI pipelines, perfect for anyone starting with edge AI.

Want to deploy your ONNX model on the Hailo-8L AI accelerator? This step-by-step guide walks you through converting ONNX models to Hailo8L format using the Hailo SDK. Learn how to parse, calibrate, quantize, and compile your models into HEF files ready for real-time inference on edge devices like the Raspberry Pi. Perfect for developers working in embedded AI.

Learn how to set up the Hailo-8 AI accelerator on any x86 PC. From connector choices to running your first inference—step-by-step guide & tips.

Learn how to set up and run AI models using the Axelera Metis M.2 on Raspberry Pi 5.