project-image

OpenCV AI Kit

Created by OpenCV

Open Source Spatial AI From The Biggest Name in Computer Vision.

Latest Updates from Our Project:

Most OAK-1-POE and OAK-D-POE Have Shipped!
almost 3 years ago – Tue, Jul 13, 2021 at 02:57:23 AM

Hi POE Fans,


There are over 600 shipments of POE models (OAK-D-POE or OAK-1-POE, or both) in progress right now.  Here are the stats:

  • 582 - In Transit to Customer
  • 14 - Processing at Warehouse (most are simply waiting for the courier to pick them up)
  • 7 - Courier-Rejected Address (we are contacting you if this is the case)
  • 3 - Delivered (these must have been folks local in Hong Kong, as shipping started today)
POE Model Shipment Information

(And yes, if you want numbers to match up as much as we do, that chart from EasyShip is frustrating.  It does not have bar-graphs for all categories, so the bar graphs shown do not sum to the "Shipments in Progress" total.)


We're excited for you all to receive your POE devices; we think you will enjoy them quite a bit (POE is so satisfying).


As we mentioned in the previous POE post, we are NOT including POE injectors with these shipments (as 99% of them end up in a landfill if we do), so please reach out to us via [email protected] with your shipping address and contact phone if you would like a POE injector, and we'll have one shipped to you.

OAK-D-POE (left) and OAK-1-POE (right)

Cheers,

The OpenCV and Luxonis Team




[Built with OAK] | Bluebox Co-Pilot KickStarter Launch
almost 3 years ago – Thu, Jul 08, 2021 at 01:54:03 PM

Hi everyone,


This is the first in the "Built with OAK" series, which will highlight products built using the OpenCV AI Kit's open source hardware, software, and AI ecosystem.


And with that, we're excited to share Co-Pilot, below:


Co-Pilot is a spatial AI dash-camera that is fully DepthAI compatible, with LTE and full vehicle CAN access (including vehicle diagnostics).


Among the myriad things you can do with this (pun, intended), here's a quick list:

  • Automatically save video and the license plate of that aggressive driver that almost caused a pile-up.
  • Get the real-time speed and trajectory of other vehicles.
  • Detect driver drowsiness and keep you alert.
  • Yell at you when you are using your phone and driving.
  • Generate driving datasets easily/quickly as part of your normal drives. 
  • Keep your vehicle safe by using AI to look out for sketchy behavior.
  • Use geaxgx's MoveNet to automatically rate your car-dancing.

And importantly, you can run anything you (or anyone else) has written for your OAK models, on your dashboard, with a built-in ARM64 host, as well as built-in cell connectivity and CAN access to your car.  


You can learn more about Co-Pilot, right here on KickStarter.  We already backed it.   :-)


Cheers,

Luxonis and the OpenCV Team

POE Models Update
almost 3 years ago – Tue, Jul 06, 2021 at 07:01:27 AM

Hi POE Backers (and POE Curious),

  • The POE models are now produced, and packed into their gift-boxes; see below.  
  • Tomorrow they are being trucked to UFL for inbounding into their warehouse.  
  • We don't know how long the inbounding process will take (as it varies quite a bit on other things going on in the warehouse), but we expect it to be shorter than 2 weeks.  So our hope is that if you ordered a POE model that you should be getting a tracking number for your shipment during the week of July 19th.
The OAK POE Models in their Giftboxes!
OAK-1-POE and OAK-D-POE in their gift-boxes being packed into cartons

So what should I do in the meantime?

Get your POE switches ready.  As these things are fun to play with, and you don't want to be caught with your OAK-D-POE and/or OAK-1-POE in-hand and without a POE switch.  Sure, you could use a POE Injector, but powering from a switch is just so much cleaner (and the whole point of POE in the first place).


What if I don't have a POE Switch?

Our strong recommendation is to get a POE switch.  They're great.  They're a good life choice.  So if you don't have one and are convinced that you should get one, but don't know which to get, see below for our recommendation.  A disclaimer in full candor though: We may or may have not worked on the UniFi team at Ubiquiti, and either way are huge fans of Ubiquiti/UniFi.  It's hard not to be.  

So, the list below is entirely UniFi:

  • US-8-60W (here) - This switch has 4x 802.3af ports, so can power up to 4x OAK POE devices.
  • US-8-150W (here) - This switch has 8x 802.3at ports, so it can power up to 8x OAK POE devices.
  • US-16-150W (here) - 16x 802.3at ports, so it can power up to 16x OAK POE devices.
  • US-24-250W (here) - 24x 802.3at ports; 24 OAK POE devices.
  • US-48-500W (here) - 48x 802.3at ports, 48 OAK POE devices.

So that's right, with the US-48-500W you can power and run 48 OAK-D-POE off of a single switch.  And this switch actually has dual 10gbps fiber ports, for a total of 20gbps upload, so plenty of bandwidth, particularly given that OAK can encode onboard, so a 4K stream is only ~25mbps.  

I've gone ahead and installed a US-16-150W in my attic and plan to install OAK POE models under the eaves of my house, with wiring already run.  Hopefully this weekend the 20-foot laddering to install the OAKs will go well.


What if I don't have and don't want to buy a POE Switch?

We'll send you one of these POE Injectors.   We decided to not include them by default, as at least from our team's experience, some 99% of these injectors that are included with POE devices are thrown away.  So we decided it would be best to just drop-ship to those that _need_ (and/or want) them instead of shipping all these bricks, 99% of which would be thrown away.


So if you want one of these, and ordered an OAK-1-POE or OAK-D-POE, reach out to us and we'll get one of these POE injectors shipped (separately) to you.


Where should I learn more about PoE?

We have a brief primer about PoE as it pertains to the OAK devices, here.  But beyond that, the Wikipedia article on it, here, is great.  


What if I want to build my own PoE (DepthAI) device?

You're in luck.  We've designed and open-sourced WAY more models than promised in the KickStarter stretch goal.  See below:


  1. OAK-D-POE; 3 onboard cameras: https://github.com/luxonis/depthai-hardware/tree/master/SJ2088POE_PoE_Board#sj2088poe-oak-d-poe-with-ip67-enclosure
  2. OAK-1-POE; 1 onboard camera: https://github.com/luxonis/depthai-hardware/tree/master/SJ2096POE_R0M0E0#sj2096poe-ldc-1-poe-board-in-ip67-enclosure
  3. Modular-camera POE, with POE passthrough; 3 modular cameras: https://github.com/luxonis/depthai-hardware/pull/70
  4. POE with built-in Pi CM4; 3 onboard cameras: https://github.com/luxonis/depthai-hardware/pull/54

What's the latest from the DepthAI API?

Glad you asked.  We did yet another release today even, release here, and release highlights below:

  • Added EdgeDetector node, using 3x3 HW sobel filter, demo here
  • Added support for SpatialCalculator on RGB-depth aligned frames; Note: RGB ISP and depth frame must have the same output resolution (e.g. 1280x720), maximum frame width of 1920 pixels is supported
  • Added bilateral filter on depth frame
  • Added median filter after stereo LR-check
  • Added runtime configuration for stereo node: confidence threshold, LR-check threshold, bilateral sigma, median filter
  • Added calibration mesh support for fisheye lenses
  • Bumped c++ standard to c++14

What's new in the DepthAI Universe?

A lot.  But in particular we'd like to highlight that we have:

  • Initial AR0234 (global shutter color 1920x1200; 60fps) support working with DepthAI, a video recorded of it working is here (thanks to ArduCam, who makes the AR0234 module and recorded that video).  
  • Initial OV9782 (global shutter color 1280x800) support in DepthAI, same optics as OV9282, but with color.  ArduCam, here.
  • Scripting node support coming, which geaxgx has used to improve multi-stage neural pipeline performance, while reducing USB load and host load, here

We'll leave it there for now.  


Cheers,

Luxonis and OpenCV



POE Model Update (OAK-1-POE and OAK-D-POE)
almost 3 years ago – Mon, Jun 28, 2021 at 02:30:18 AM

Hi POE Fans!

TL;DR version is we are on the same schedule as of the last update here:

  • OAK-D-POE production and test are complete, calibration is underway; expected shipping to backers mid July.
  • OAK-1-POE production is complete, test is underway (OAK-1-POE is not calibrated); expected shipping to backers late July.
  • Initial Ethernet API ready and working.

With the summary out of the way, let's move to how awesome POE is.  It's so convenient.  

POE is Awesome

Here's OAK-D-POE working over POE to my Mac:

DepthAI API working over gigabit Ethernet with OAK-D-POE

It's extremely satisfying to use, as you can plug it into any port on your POE LAN.  You can use your camera with hundreds of feet of cable, have them scattered all over a building, and the cables themselves are field-repairable/service-able.

Here's some initial testing of the stability of the Ethernet version of the DepthAI API:

OAK-D-POE and OAK-1-POE being tested on a UniFi US-48-750W POE Switch

So there are a slew plugged in here, but that's actually not all.  There are a couple more elsewhere, not pictured, which were being tested in parallel.  Here's what it looks like on my Mac:

Some number of OAK-*-POE running in parallel. Notice ~690mbps of throughput from these cameras over the network

Here's a view of the standard OAK-D and the OAK-D-POE running in parallel:

OAK-D (USB3) compared with OAK-D-POE.

And here's an OAK-D-POE PCBA running from an old UAP-IW in our kids' playroom:

OAK-D-POE PCBA running off a UniFi in-wall AP.

IP67 Testing

One of the great things about POE is that there are all sorts of outdoor-rated Ethernet cables you can get, and it's often used outdoors - on agriculture equipment, communication towers, security solutions,  industrial settings, and all sorts of other applications.  And POE allows you to use just one cable for both data and power, at hundreds of feet, at 1gbps.


So given that POE is used so often outdoors, we figured that the enclosures for OAK-D-POE and OAK-1-POE should be IP67 rated.  So we took a stab at it.  First though, for folks who don't know what IP67 is, here's a great table courtesy of Blue Sea Systems (here):

IP67 means dust-proof and capable of being submerged in shallow water for 30 minutes.

So how'd we do on the IP67 effort?

First, the photos:

Tank used to test OAK-1-POE and OAK-D-POE IP rating
OAK-D-POE and OAK-1-POE in ~1 meter of water.
OAK-D-POE passes 30 minute/40cm water submersion, but fails at 30 minute/100cm submersion
OAK-1-POE Exceeds IP67 rating, passing the 30 minute/100cm submersion test (and 2 hours/100cm, just out of curiosity).
  • OAK-D-POE: 30 minutes at 40cm with no leak.  At 1 meter/30 minutes it does leak.  In-between is untested.
  • OAK-1-POE: 30 minutes at 100cm with no leak.  (We actually tested to 2 hours with no leak; just out of curiosity)

So OAK-D-POE did not fully pass IP67 testing - landing somewhere in-between (as it exceeds the 15cm level required of IP67, but fails at the 1 meter level).  OAK-1-POE seems to fully pass IP67.  


So we do not recommend submerging OAK-D-POE (well, we just generally don't recommend submerging any of them, if you can avoid it), but both OAK-D-POE and OAK-1-POE seem like they'll be well-suited for deployment to any outdoor location, as they are both at least IP66 rated.


We think we can actually get OAK-D-POE to the same level of performance as 

OAK-1-POE (well exceeding IP67) by using a different O-ring.  We are attempting to source it, but if we cannot source it in time (i.e. this week), we will stick with the O-ring used so far, which results in OAK-D-POE passing a 30 minute submersion at 0.4 meters.


OAK-D-POE and OAK-1-POE Photos

OAK-D-POE on the OpenCV AI Kit Tripod (not included)
OAK-D-POE (and OAK-1-POE) have 4x M3 mounting holes on the back, in addition to a "tripod" 1/4-20 mounting hold on the bottom.
OAK-1-POE (and OAK-D-POE) have 4x M3 holes for panel-mounting on the back, in addition to a 1/4-20 "tripod mount" on the bottom.
OAK-D-POE and OAK-1-POE powered by a UniFi Switch

And as a final closing note, we'd like to share a tidbit on the chip shortage.  We previously shared here, here, and here about our errors on mechanical design/tooling/etc. that were causing delays.  And explained the delays in detail.

They all did not end up mattering.  The chip shortage is so sever, and the delivery of Ethernet components was so delayed, that it ended up trumping all of these errors.  We only, last-week, received the remainder of the essential Ethernet/POE components we ordered now over a year ago.  They arrived last week half a year late.  Crazy times. 


That's all for this update.  We're working as quick as we can to get these finished and shipped out to our shipping partner.  We'll keep everyone updated.  


- Luxonis and OpenCV

Community-Designed Enclosures and Mounts for OAK-D-WIFI
almost 3 years ago – Fri, Jun 18, 2021 at 11:28:07 PM

Hi OAK-D-WIFI backers,

We'd like to thank everyone again for the backing, and in particular thank those who made and shared OAK-D-WIFI enclosure designs.  The details of which are shared below.

But before getting into the details of each, it is worth mentioning that depending on the material used to print, the flatness of the actual enclosure or mount, and other variables - the quality of the depth results may be negatively impacted when mounting OAK-D-WIFI into an enclosure or onto a mount.  The `why` is that the enclosure may have bend relative to OAK-D-WIFI, which can bend the board and impact (negatively) the depth calibration.

So it is advised to check the depth quality prior to mounting OAK-D-WIFI into an enclosure, and then check it again after (e.g. taking a screenshot of the depth view).

T Kamoi (design below) did a great job illustrating this, so we are replicating his figure here:

If the depth changes (too much), you can recalibrate OAK-D-WIFI using our calibration system here.

And with that, we'd like to share the designs from four backers who kindly shared their enclosure designs with us.  Thank you all!  (And if we did not cover your enclosure here, please let us know via [email protected] and we will add it to our depthai-hardware repo.)


 T Kamoi design:

  • Design files here 

This figure does a great job explaining why flatness of the enclosure/print matters and why it's important to make sure the printed enclosure is flat and free from debris.  If you enclosure is not flat, and does impact depth quality (and as long as it's not so bent that it breaks something) you can recalibrate your OAK-D-WIFI here.

About T Kamoi:

Hi, I am a mechanical engineer in Tokyo.

I'd be happy if my design helped you. Let's enjoy together!

I usually enjoy handicrafts with my three daughters. Paper-crafts, robots, woodworking, glassblowing…

See updates in Thingiverse and YouTube

https://www.youtube.com/channel/UC2Sdd0ZSvBzO8hzHX5etd-g


Thomas Höfler design:

  • Design files here 

About Thomas:

Hi, My name is Thomas, I am from Austria.

In my spare time I am interested in electronics, 3D Printing (3D Printers), CNC Milling and Tuning (2 small self-built machines), 2D and 3D constructions and modeling.

And of course in AI and open CV.  Actually I built a small autonomous Robot. Therefore I need the depth information for navigating and a Gripper Arm and 2D object detection.

I've used Open CV and computer vision for ~ 3 years now. But with a Jetson Nano or a Raspi and an Intel compute Stick.

So I was very happy that the oak came out!!

I would appreciate if you would use my design.  It is easy for me to change things if there is anything I need to.


 Xplicator (Gerrit Kolb) design:

  • Design files here 

About Xplicator:

xplicator develops platforms for parameter-driven 3D printable production. They love using CV2, and Python-driven AI. Some of their sites includehttps://customphonemount.com for personalized phone mount production (the OAD-D mount uses its thread base),  https://brickplicator.com for generating individual LEGO Models, andhttps://craftplicator.com for all those Minecraft tech lovers that never grew old. 

Xplicator is using OAK-D for their development of a highly portable affordable 3D laser scanner.


 Carlos Alvarenga design:

  • Design files here 

 About Carlos:

* Computer Vision developer and entrepreneur

* Working on an augmented reality gaming system: https://www.youtube.com/watch?v=6DfzHUPisXw

* With the OAK-D, I hope to turn the prototype of my augmented reality gaming system into a portable system.

* I have an interview with Google later this month, June 2021. I am very exited for this.

Thanks!

On behalf of the whole team, thank you to everyone in the community who has submitted designs.  And we'd like to note that although we are highlighting the enclosures above, there are countless others who have submitted bug reports, enhancements, pull requests, great ideas, and help to other community members across Discord, Github, and on our Forum.  Thank you to all of you!  

We will inevitably not be able to highlight all of your contributions, but please know that we have seen and appreciated all of them!

Best,

OpenCV and the Luxonis teams