477: One Thousand New Instructions

Kwabena Agyeman joined Chris and Elecia to talk about optimization, cameras, machine learning, and vision systems. 

Kwabena is the head of OpenMV (openmv.io), an open source and open hardware system that runs machine learning algorithms on vision data. It uses MicroPython as a development environment so getting started is easy. 

Their github repositories are under github.com/openmv. You can find some of the SIMD details we talked about on the show:

Kwabena has been creating a spreadsheet of different algorithms in camera frames per second (FPS) for Arm processors: Performance Benchmarks - Google Sheets. As time moves on, it will grow. Note: this is a link on the OpenMV website under About. When M55 stuff hits the market expect 4-8x speed gains.

The OpenMV YouTube channel is also a good place to get more information about the system (and vision algorithms).

Kwabena spoke with us about (the beginnings of) OpenMV on Embedded 212: You Are in Seaworld.

Transcript

Elecia is giving a free talk for O'Reilly to advertise her Making Embedded Systems, 2nd Edition book. The talk will be an introduction to embedded systems, geared towards software engineers who are suddenly holding a device and want to program it. The talk is May 23, 2024 at 9:00 AM PDT. Sign up here. A video will be available afterward for folks who sign up. 



253: We’ll Pay Them in Fun (Repeat)

We spoke with Kathleen Tuite (@kaflurbaleen) about augmented reality, computer vision, games with a purpose, and meetups.

Kathleen’s personal site (filled with many interesting projects we didn’t talk about) is SuperFireTruck.com. Her graduate work was in using photogrammetry to build models.

Kathleen works for GrokStyle, a company that lets you find furniture you like based on what you see. GrokStyle is used in the Augmented Reality try-it-at-home IKEA Place app.

253: We’ll Pay Them in Fun

We spoke with Kathleen Tuite (@kaflurbaleen) about augmented reality, computer vision, games with a purpose, and meetups.

Kathleen’s personal site (filled with many interesting projects we didn’t talk about) is SuperFireTruck.com. Her graduate work was in using photogrammetry to build models.

Kathleen works for GrokStyle, a company that lets you find furniture you like based on what you see. GrokStyle is used in the Augmented Reality try-it-at-home IKEA Place app.

212: You Are in Seaworld

Kwabena Agyeman joined us to talk about making OpenMV (@OpenMVCam), an easy-to-use camera and control module with built-in machine vision functions, all interfaced via MicroPython.

To learn more about computer vision, Kwabena suggested looking at PyImageSearch or reading the April tags code as it is a good introduction to image manipulation and matrix operations.

Some other interesting links:

161: Magenta Doesn’t Exist

Kat Scott (@kscottz) gave us an introduction to computer vision. She co-authored the O'Reilly Python book Practical Computer Vision with SimpleCV: The Simple Way to Make Technology See. The book's website is SimpleCV.org. Kat also suggested looking at the samples in the OpenCV Github repo. 

To integrate computer vision into a robot or manufacturing system, Kat mentioned ROS (Robot Operating System, ROS.org).

Buzzfeed had an article about SnapChat Filters.

Kat works at Planet. And they are still hiring.