SVEN CV - the computer vision software used for SVEN - is now available to the public. The features and interface were designed specifically for the SVEN project, so the interface isn't what you might expect from user-friendly, general purpose software. However, we hope it can be useful for other public space projects, as it is specifically designed to track people in uncontrolled public settings, as opposed to a gallery or stage where lighting, background, clothing, etc., can be controlled.
Download SVEN CV Windows executable (4MB) Download SVEN CV Windows source code (59KB)
About SVEN CV...
SVEN CV is a software application for real time tracking of pedestrians, using OpenCV. Its robust build has features for tracking several individuals with all kinds of foreground and background occlusions. It also provides real-time subjective features such as face detection and expression; hair and clothing color; segmentation of the body to give positions for head, shoulders, and torso; direction of movement and more. It transfers the data including the coordinates of the person's outline (matte) to a specified IP address or the local machine via a UDP port. It supports input from both live camera and AVI files.
There are already several computer vision applications available geared toward "artists." So why did we bother to develop our own?
1) We wanted some specific features that weren't available in existing software. These may or may not be of use to you. But more importantly...
2) We wanted it to work in public space. The SVEN project deals with surveillance, and surveillance happens in public places: corridors, storefronts, outside on the street, etc. The computer vision applications for artists we found tended to assume a controlled setting like a gallery or stage, where changes in lighting and background wouldn't be a problem. While the best results with SVEN CV are still obtained with minimal background changes and reasonably flat, constant lighting, SVEN CV is designed to adapt to changes in background and applies heuristics to eliminate as much as possible errors due to shadows and lighting changes.
Hardware and software requirements
SVEN CV runs real time (30 fps) at 320x240 on a Pentium 4 with 256 MB of RAM. (Real time at 640x480 has been achieved using an Intel Core 2 Duo processor with 1 GB RAM.) SVEN CV requires minimal hard disk space of 4 MB. It requires a firewire or USB camera or digitizer to run in camera mode.
SVEN CV requires Windows XP with Service Pack 2. It has not been tested on Vista, and the current version is likely to not be fully functional with it. (Please contact the authors if you are trying to run it under Vista.)
Open Computer Vision Library (OpenCV) version 1.0 must be installed in order to run SVEN CV. You can download OpenCV 1.0 for free from Sourceforge. (We have received reports that OpenCV 1.1 doesn't work with SVEN).
SVEN CV requires that Windows XP be updated with the .NET 2.0 framework. You may already have this update. But if you get an error when you run SVEN CV that says, "The system cannot execute the specified program," it's probably because you need the update. You can download and install it from the Windows Update website (choose Custom update, then on the left side menu choose Software, Optional.)
Complete licensing information is included in the Readme. But in general, SVEN CV and its source code can be used freely for educational, research and non-profit purposes; however permission must be obtained for commercial use.
This software was created by Vincent Rabaud.
Feature Suggestions, Bug Reports, Questions, and even Flattering Comments to:
Vincent Rabaud vrabaud-at-cs-dot-ucsd-dot-edu (Questions and comments on the source code and algorithms)
Amy Alexander ajalexander-at-ucsd-dot-edu (Questions and comments on features, usage, hardware and documentation)
(If in doubt - mail us both.)
|Home |||How it Works |||Live Shows |||About SVEN |||SVEN CV Software|