Mijn winkelwagen
0 productenUS$ 0,00

Pixy2 CMUcam5 Smart Vision Sensor

Robot Vision made easier

Pixy2 can be taught to detect objects by the press of a button. It is equipped with a new line detection algorithm to use on line-following robots. It can learn to recognize intersection and follow road signs.

Normale prijs US$ 79,00

Ledenprijs US$ 71,00


Dit product heeft een levertijd van 5 dagen


Pixy2 is the second version of Pixy, a vision sensor for DIY robotics and similar applications. But it's faster, smaller and more capable than the original Pixy, adding line tracking/following algorithms as well as other features. Here are the added features:

  • Pixy2 detects lines, intersections and small barcodes, intended for line-following robots
  • Improved framerate – 60 frames-per-second
  • Tracking algorithms have been added to color-based object detection
  • Improved and simplified libraries for Arduino, Raspberry Pi and other controllers
  • Integrated light source

And Pixy2 is capable of everything that the original Pixy can do:

  • Small, fast, easy-to-use, low-cost, readily-available vision system
  • Learns to detect objects that you teach it
  • Connects to Arduino with included cable. Also works with Raspberry Pi, BeagleBone and similar controllers
  • All libraries for Arduino, Raspberry Pi, etc. are provided
  • C/C++ and Python are supported
  • Communicates via one of several interfaces: SPI, I2C, UART, USB or analog/digital output
  • Configuration utility runs on Windows, MacOS and Linux
  • All software/firmware is open-source GNU-licensed
  • All hardware documentation including schematics, bill of materials, PCB layout, etc. are provided

If you want to provide your robot with the ability to pick up an object, chase a ball, locate a charging station, etc., a good solution is to use a vision (image) sensor. But there are two drawbacks with image sensors: 1) they output lots of data, dozens of megabytes per second, and 2) processing this amount of data can overwhelm many processors. And if the processor can keep up with the data, much of its processing power won’t be available for other tasks.

Pixy2 addresses these problems by pairing a powerful dedicated processor with the image sensor. Pixy2 processes images from the image sensor and only sends the useful information to your microcontroller. And it does this at frame rate 60 Hz. The information is available through one of several interfaces: UART serial, SPI, I2C, USB, or digital/analog output. So your Arduino or other microcontrollers can talk easily with Pixy2 and still have plenty of CPU available for other tasks.

Pixy2 processes an entire image frame every 1/60th of a second (16.7 milliseconds). This means that you get a complete update of all detected objects’ positions every 16.7 ms. At this rate, tracking the path of falling/bouncing ball is possible. If your robot is performing line following, your robot will typically move a small fraction of an inch between frames.

Teach Pixy2 the objects you want it to detect

Pixy2 is unique because you can physically teach it what you are interested in sensing. A blue cube? Place the cube in front of Pixy2 and press the button. It’s easy, and it’s fast.

More specifically, you teach Pixy2 by holding the object in front of its lens while holding down the button located on top. While doing this, the RGB LED under the lens provides feedback regarding which object it is looking at directly. For example, the LED turns orange when an orange ball is placed directly in front of Pixy2. Release the button and Pixy2 generates a statistical model of the colors contained in the object and stores them in flash. It will then use this statistical model to find objects with similar color signatures in its frame from then on.

Tracking function

Once Pixy2 detects a new object, it will add it to a table of objects that it is currently tracking and assign it a tracking index. It will then attempt to find the object (and every object in the table) in the next frame by finding its best match. Each tracked object receives an index between 0 and 255 that it will keep until it either leaves Pixy2's field-of-view, or Pixy2 can no longer find the object in subsequent frames.

Line-tracking for line-following

Pixy2 has added the ability to detect and track lines. Line-following is a popular robotics demo/application because it is relatively simple to implement and gives a robot simple navigation abilities. Most robots use discrete photosensors as a solution, but the problem is that it works best with only thick lines.

Pixy2 attempts to solve the more general problem of line-following by using its image (array) sensor. Each of Pixy2's camera frames takes in information about the line being followed, its direction, other lines, and any intersections that these lines may form.

Pixy2 comes with various cables so that you can connect it with an Arduino or a Raspberry Pi out of the box. Furthermore, the I/O port offers several interfaces (SOI, I²C, UART, USB) to plug your Pixy2 in most boards.

Here you can find different project ideas to get you started and here is the software and libraries you will need to programme your Pixy2.

Integrated light source

Pixy2 has an integrated light source for when the lighting needs a boost. The light source is particularly useful when your robot is performing line-following. It gives Pixy2 plenty of light regardless of the level of ambient light and it reduces motion blur, which can be an issue when your robot is going fast and the ground is zipping by underneath it. The integrated light source emits around 20 lumens, about twice the amount an iPhone in flashlight mode emits.

See everything Pixy2 sees with PixyMon

PixyMon is an application that runs on Windows, MacOs and Linux. It allows you to see what Pixy2 sees, either as raw or processed video. It also allows you to configure your Pixy2, set the output port and manage color signatures. PixyMon communicates with Pixy2 over a standard mini USB cable.

Technical details

  • Processor: NXP LPC4330, 204 MHz, dual core
  • Image sensor: Aptina MT9M114, 1296 × 976 resolution with integrated image flow processor
  • Lens field-of-view: 60 degrees horizontal, 40 degrees vertical
  • Power consumption: 140 mA typical
  • Power input: USB input (5 V) or unregulated input (6 V to 10 V)
  • RAM: 264 KBs
  • Flash: 2 MBs
  • Available data outputs: UART serial, SPI, I2C, USB, digital, analog
  • Dimensions:1.5” x 1.65” x 0.6”
  • Weight: 10 grams
  • Integrated light source, approximately 20 lumens
Artikelnummer 18693
Fabrikant Charmed Labs


Schrijf uw eigen review

Hoe waardeert u dit artikel? *

1 2 3 4 5
  • Reload captcha