All News | Boards | Chips | Devices | Software | LinuxDevices.com Archive | About | Contact | Subscribe
Follow LinuxGizmos:
Twitter Facebook Pinterest RSS feed
*   get email updates   *

Axon Platform Featuring RockChip RK3588S and Support for LLM Frameworks

Feb 6, 2025 — by Giorgio Mendoza 279 views

The Axon platform, powered by the RockChip RK3588S processor, combines an 8-core CPU and an NPU delivering up to 6 TOPS of AI performance. Designed for advanced computing tasks, it supports various LLMs, including Llama, Qwen, and DeepSeek, with benchmarks showcasing performance for AI workloads.

The Axon platform is built on the RockChip RK3588S system-on-chip, which incorporates an 8-core 64-bit architecture with four Cortex-A76 cores and four Cortex-A55 cores. Manufactured using an 8nm process, the processor operates at speeds of up to 2.4GHz.

— ADVERTISEMENT —


Axon top view
(click image to enlarge)

The platform includes the ARM Mali-G610 MP4 GPU, which supports OpenGL ES3.2, OpenCL 2.2, and Vulkan 1.1. With a processing power of 450 GFLOPS, the GPU is capable of handling high-resolution graphics rendering. An integrated neural processing unit provides up to 6 TOPS of computing power for machine learning tasks, supporting mixed precision operations for INT4, INT8, and INT16, and compatibility with AI frameworks such as TensorFlow, MXNet, PyTorch, and Caffe.

The memory configuration includes options for 4GB, 8GB, and 16GB of LPDDR4x, with an optional upgrade to 32GB of LPDDR5. Storage options range from 16GB to 128GB eMMC, with support for expansion via a MicroSD card slot or an M.2 interface. The M.2 slot is compatible with PCIe 2.0 NVMe SSDs, providing additional storage options.

Axon LLM benchmarks
(click image to enlarge)

Video processing features include support for 8K video decoding at 60 frames per second for formats such as H.265, VP9, and AVS2. The platform also supports video encoding at up to 8K resolution at 30 frames per second, with compatibility for formats like H.264. Display options include HDMI 2.1, MIPI-DSI, and DP1.4 outputs, enabling resolutions up to 8K and multi-screen configurations.

Connectivity options include dual-band WiFi for 2.4GHz and 5GHz networks, as well as Bluetooth 4.2. Wired networking is supported through a gigabit Ethernet port. USB connectivity includes USB 3.0, multiple USB 2.0 ports, and a USB-C multifunction interface. Camera connectivity is provided via dual MIPI-CSI lanes or a single four-lane MIPI-CSI configuration.

Axon main features
(click image to enlarge)

The Axon platform supports operating systems such as Android 12 and Ubuntu 22.04 Jammy, with plans for Debian and community-driven operating system images in development according to their Wiki pages.

The Axon GitHub repository offers instructions for setting up the Axon platform’s NPU to run AI, ML, and DL models. It includes guides for converting CNN models to RKNN format and LLMs from Hugging Face or GGUF formats to RKLLM, along with benchmarks and optimization steps.

Specifications for the Axon Board:

  • SoC:
    • RockChip RK3588S
  • CPU:
    • 8-core 64-bit (4x Cortex-A76 + 4x Cortex-A55), up to 2.4GHz
  • GPU:
    • ARM Mali-G610 MP4 quad-core GPU, 450 GFLOPS
    • Supports OpenGL ES3.2, OpenCL 2.2, Vulkan 1.1
  • NPU:
    • Up to 6 TOPS
    • Supports INT4, INT8, INT16 mixed operations
    • Compatible w/ TensorFlow, MXNet, PyTorch, Caffe
  • ISP:
    • Integrated 48MP ISP w/ HDR and DNR
  • VPU:
    • Video Decoding:
      • 8K@60fps (H.265, VP9, AVS2)
      • 8K@30fps (H.264 AVC/MVC)
      • 4K@60fps (AV1)
      • 1080P@60fps (MPEG-2/-1/VC-1/VP8)
    • Video Encoding:
      • 8K@30fps (H.265/H.264)
      • Up to 32-channel 1080P@30fps decoding
      • 16-channel 1080P@30fps encoding
  • RAM:
    • Options: 4GB, 8GB, 16GB (LPDDR4x)
    • Expandable to 32GB (LPDDR5)
  • Storage:
    • Options: 16GB, 32GB, 64GB, 128GB eMMC
    • Expandable via:
      • M.2 interface (SATA3.0 and PCIe 2.0 NVMe SSD)
      • MicroSD card
  • Wireless Connectivity:
    • 2.4GHz and 5GHz dual-band WiFi
    • 802.11 a/b/g/n/ac
    • Bluetooth 4.2 (BLE)
  • Display Outputs:
    • 1x HDMI 2.1 (8K@60fps or 4K@120fps)
    • 2x MIPI-DSI (4K@60fps)
    • 1x DP1.4 (8K@30fps)
    • Supports up to four-screen output with different displays
  • Ethernet:
    • 1x 1000Mbps Ethernet (RJ45)
  • Camera:
    • 2x 2-lane MIPI-CSI or 1x 4-lane MIPI-CSI
  • Audio:
    • Audio Output:
      • 3.5mm audio jack
      • HDMI 2.1 audio output
      • DP1.4 audio output
    • Audio Input:
      • 1x microphone input
  • PCIe Interface:
    • 1x M.2 (PCIe 2.0)
  • USB Ports:
    • 1x USB 3.0
    • 3x USB 2.0
    • 1x USB-C multifunction interface (USB3.0 OTG/DP1.4)
  • Mechanical:
    • 72 x 100mm

Further information

As of the publication date, this device with 8GB RAM + 32GB eMMC is available only on the Vicharak store via Amazon India for ₹16,461 (~$188.20).

(advertise here)


PLEASE COMMENT BELOW

Please comment here...