Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -57,7 +57,7 @@ Akida 1 and Akida 2 examples are available today; more Akida 2 models can be fou
| --- | --- | --- | --- |
| **Chip** | AKD1500 | AKD2500 | — |
| **Typical use cases** | Image classification, keyword spotting, object detection | Larger models, higher accuracy targets | Always-on sensing, edge inference |
| **Examples in this repo** | [Image Classification (PlantVillage)](akida1/model_zoo/plant_village) · [ImageNet / AkidaNet](akida1/model_zoo/imagenet_akidanet) · [Visual Wake Words](akida1/model_zoo/vww) · [Keyword Spotting](akida1/model_zoo/speech_commands) · [ECG Arrhythmia](akida1/model_zoo/arrhythmia_classification) | [Visual Wake Words](akida2/model_zoo/vww) · [Image Classification (PlantVillage)](akida2/model_zoo/plant_village) · [Keyword Spotting](akida2/model_zoo/speech_commands) | 🔜 Coming soon |
| **Examples in this repo** | [Image Classification (PlantVillage)](akida1/model_zoo/plant_village) · [ImageNet / AkidaNet](akida1/model_zoo/imagenet_akidanet) · [Visual Wake Words](akida1/model_zoo/vww) · [Keyword Spotting](akida1/model_zoo/speech_commands) · [ECG Arrhythmia](akida1/model_zoo/arrhythmia_classification) | [Visual Wake Words](akida2/model_zoo/vww) · [Image Classification (PlantVillage)](akida2/model_zoo/plant_village) · [Keyword Spotting](akida2/model_zoo/speech_commands) · [Gesture Recognition (Jester)](akida2/model_zoo/jester) | 🔜 Coming soon |

---

Expand Down
31 changes: 31 additions & 0 deletions akida2/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -165,6 +165,37 @@ benchmarks for every mapping, and the steps to reproduce them.
</tbody>
</table>

### Video

<table>
<thead>
<tr>
<th>Task</th>
<th>Category</th>
<th>Dataset</th>
<th>Variant</th>
<th>Performance</th>
<th>Mapping</th>
<th>Latency @ 25 MHz FPGA (ms)</th>
<th>Projected @ 1 GHz AKD2500 (ms)</th>
<th>Notes</th>
</tr>
</thead>
<tbody>
<tr>
<td><a href="model_zoo/jester">Hand gesture recognition</a></td>
<td>Classification</td>
<td>Jester (BrainChip subset)</td>
<td>8-bit</td>
<td>94.64% clip acc.</td>
<td>HwPr</td>
<td align="right">168.036</td>
<td align="right">4.201</td>
<td>TENN spatiotemporal, streaming; latency per frame</td>
</tr>
</tbody>
</table>

### Audio

<table>
Expand Down
462 changes: 462 additions & 0 deletions akida2/model_zoo/jester/README.md

Large diffs are not rendered by default.

64 changes: 64 additions & 0 deletions akida2/model_zoo/jester/colab_setup.py
Original file line number Diff line number Diff line change
@@ -0,0 +1,64 @@
# Copyright 2026 Brainchip Holdings Ltd. Apache 2.0 License
"""Colab setup for the Jester TENN (Akida 2) notebooks.

IF YOU ARE RUNNING THIS LOCALLY: you can ignore this file completely.
It exists solely to make the "Open in Colab" badge work, and does nothing
on a normal local run. It is not part of the example code (see
jester_data.py, jester_model.py and
jester_eval.py for that).

If you ARE on Colab, this is the file that gets you running:
- Clones this repo and fetches this example's Git LFS model weights, which
the notebooks need
- Points Python at the right folders (repo root for brainchip_utils,
this example's folder for the local modules)
- Installs akida_models, tf_keras and quantizeml

There is no dataset step here: the data module downloads the BrainChip Jester
subset and the calibration pack from BrainChip's dataset mirror on first use.

Called from the notebook's first cell like:
import colab_setup
colab_setup.setup()
"""
import os
import subprocess
import sys

REPO_URL = 'https://github.com/Brainchip-Inc/brainchip_devhub.git'
REPO_DIR = 'brainchip_devhub'
EXAMPLE_SUBDIR = 'akida2/model_zoo/jester'


def _run(cmd):
print(f'$ {cmd}')
subprocess.run(cmd, shell=True, check=True)


def setup():
"""Set up a fresh Colab session to run this notebook. No-op if not on Colab."""
if 'google.colab' not in sys.modules:
print('Not running on Colab — nothing to do. (This step only matters '
'for Colab; local runs already have everything they need.)')
return

if not os.path.exists(REPO_DIR):
# Clone without LFS files, then pull only this example's models, to keep
# the download small.
os.environ['GIT_LFS_SKIP_SMUDGE'] = '1'
_run(f'git clone --depth 1 {REPO_URL} {REPO_DIR}')
_run(f'cd {REPO_DIR} && git lfs pull --include "{EXAMPLE_SUBDIR}/pretrained_models/*"')

os.chdir(os.path.join(REPO_DIR, EXAMPLE_SUBDIR))

# Repo root on sys.path for `brainchip_utils`; example folder for the local
# jester_* modules imported later in the notebook.
repo_root = os.path.abspath(os.path.join(os.getcwd(), '..', '..', '..'))
sys.path.insert(0, repo_root)
sys.path.insert(0, os.getcwd())

_run('pip install -q akida_models==1.14.0 tf_keras quantizeml')

print(f'Colab setup complete. Working directory: {os.getcwd()}')
print('If TensorFlow was just installed/upgraded, restart the runtime '
'(Runtime > Restart session) and re-run this cell before continuing.')
4 changes: 4 additions & 0 deletions akida2/model_zoo/jester/data/.gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
# Git to Ignore everything in this directory
*
# Except this .gitignore file
!.gitignore
Loading