Cyborg Documentation

Introduction

1.1.1 Background Story

OpenStack Acceleration Discussion Started from Telco Requirements:

• High level requirements first drafted in the standard organization ETSI NFV ISG
• High level requirements transformed into detailed requirements in OPNFV DPACC project.
• New project called Nomad established to address the requirements.
• BoF discussions back in OpenStack Austin Summit.

Transition to Cyborg Project:

• From a long period of conversation and discussion within the OpenStack community, we found that the initial goal of Nomad project to address acceleration management in Telco is too limited. From design summit session in Barcelona Summit, we have developers from Scientific WG help us understanding the need for acceleration management in HPC cloud, and we also had a lot of discussion on the Public Cloud support of accelerated instances.
• We decide to formally establish a project that will work on the management framework for dedicated devices in OpenStack, and there comes the Cyborg Project.

1.1.2 Definition Breakdown General Management Framework:

• Acceleration Resource Discovery
• Life Cycle Management

Accelerators:

• Software: dpdk/spdk, pmem,
• Hardware: FPGA, GPU, ARM SoC, NVMe SSD, CCIX based Caches,

1.2 Cyborg architecture 

Cyborg design can be described by following diagram:

cyborg-api – cyborg-api is a cyborg service that provides REST API interface for the Cyborg project. It supports POST/PUT/DELETE/GET operations and interacts with cyborg-agent and cyborg-db via cyborg-conductor.

cyborg-conductor – cyborg-conductor is a cyborg service that coordinates interaction, DB access be- tween cyborg-api and cyborg-agent.

cyborg-agent – cyborg-agent is a cyborg service that is responsible for interaction with accelerator back- ends via the Cyborg Driver. For now the only implementation in play is the Cyborg generic Driver. It will also handle the communication with the Nova placement service. Cyborg-Agent will also write to a local cache for local accelerator events.

Vendor drivers – Cyborg can be integrated with drivers for various accelerator device types, such as FPGA, GPU, NIC, and so forth. You are welcome to extend your own driver for a new type of accelerator device.