AIG

KR260 Robotics AI Developer Challenge

Current Status

• Authors:

  • Somayeh Rahimipour (srahimip, DAT)

  • Damoder Mogilipaka (damoderm, AIG-AI)

  • Dachang Li (dachang, AIG-AI)

  • Daniele Bagni (danieleb, SAIS)

• Target board: KR260

• Tools: Vitis 2023.1 & Vitis-AI 3.5 releases

• Last update: 05 Dec. 2023

Table of Contents

Robotics AI with KR260

1 Introduction

2 Getting Started with KR260

3 INSTALL PYNQ DPU

4 Test PYNQ DPU with Python or C++ VART APIs

5 INSTALL ROS2

6 ROSAI Application

Appendix

Acknowledgements

License

Robotics AI with KR260

Overview

The integration of AI techniques into robotics has gained immense traction sparking increased research, investment, and practical applications across different sectors. AI in robotics empowers robots to emulate human-like abilities through machine learning, computer vision, natural language processing and more. This integration holds immense potential for revolutionizing industries like manufacturing, healthcare, transportation, and more by enhancing robots’ capabilities and adaptability.

The AMD Kria™ KR260 Robotics Starter Kit is a Kria SOM-based development platform for robotics and factory automation applications and enables roboticists and industrial developers without FPGA expertise to develop hardware accelerated applications for robotics, machine vision, and industrial communication and control. Developers benefit with greater flexibility from native ROS 2 and Ubuntu support.  The pre-built interfaces and accelerated applications make the KR260 an ideal platform to accelerate robotics AI innovation.   

This Repo:

The focus of this repo is for AI vision-guided robotics applications using camera inputs and control output with ROS and AI targeting the Kria™ KR260 SOM and PYNQ/Vitis-AI software platform.  

Application Examples:

1. Human Assist AI enabled robotics
2. New experiences in mobility and human-machine interfacing
3. Highly optimized embedded AI model architectures (image, voice)

Requirements:

1. Use the AMD Kria SOM KR260.
2. Use either Vitis-AI or PYNQ software development stacks.

1 Introduction

This document explains how getting started with the Kria KR260 Robotics Starter Kit, which includes the following accessories inside the box:

• power supply and its adapters,
• Ethernet cable,
• USB A-male to micro B cable,
• a micro-SD card with adapter, possibly with size greater than 32GB (64GB is certainly a very good choice).

You will need the following accessories to utilize the KR260 desktop environment:

• USB Keyboard,
• USB Mouse,
• DisplayPort Cable (for connecting to a monitor),
• an HDTV (1920x1080 as minimum resolution) monitor with DisplayPort connector.

File truncated at 100 lines see the full file