The two greatest forces driving the security industry are money and technology. Saving as much of the former as possible while advancing the latter is the delicate balance security directors and manufacturers serving the industry must strike. The fulcrum of the scale is the industry’s reliance on robust R&D that can feed the constant demand for new technologies in cost-effective ways.
A number of labs and universities around the world conduct R&D in an effort to bring high-technology solutions to bear on the challenges of the security marketplace. One such facility is MERL, Mitsubishi Electric Research Laboratory, owned by Mitsubishi Electric. Located in Cambridge, MA, MERL conducts application-motivated basic research in computer and communications technologies. Although it can leverage the size and power of its corporate parent, it remains independent enough to be flexible.
Heavily involved in the global R&D community and active in the various standards processes, the lab maintains long-standing cooperative relationships with a number of research universities including MIT, CMU, Georgia Tech, Princeton, Columbia, University of Paris, Dublin City University, ETH Zurich, and the City University of London. The goals of MERL’s activities are to publish papers, file patents and create prototypes for the company and to take the technology to the groups within the larger company that can benefit from that work.
From Data to Video
Research efforts at MERL focus on five technology areas: computer vision, digital communications, digital video, off-the-desktop interaction and display (interface concepts), and sensor and data systems. Each of these areas is split up into two parts: the research lab, where the blue-sky conceptualization occurs, and the tech lab, where the concepts are refined into technology.
“From the research level, we then develop software libraries which the different divisions can evaluate for use in their products,” said Jay Thornton, computer vision applications group manager. The interested divisions plug the software into their prototypes, then test it. “They will then get back to us and tell us where they need improvements before it’s viable for the marketplace.”
Most of the research and resulting products that impact the security industry emanate from within the computer vision section. This includes 3-D face recognition, audio-visual event detection, camera network calibration and object detection and tracking. The security marketplace has recently gravitated toward human movement and behavior tracking, and MERL has made strides here, according to Dr. Kent Wittenburg, the lab’s vice president and director. “The lab has extended its efforts in tracking objects from background subtraction to active object detection techniques that happen in the foreground,” he said. “This extension helps in low-light conditions and also when the camera is moving.”
Face Recognition Research
The face recognition program started at MERL as face detection, in which software would analyze video frame by frame to determine if a face was present. The application for this in a security installation is a situation in which a camera is focused on an area where nobody is supposed to be. If a face is detected, the system will alarm the operator that somebody is there.
Through feedback from the divisions and continuing research using advanced machine learning techniques, that technology advanced to include face classification, wherein the software can detect a male or female face and differentiate between a happy or sad expression, for example. The next step is face recognition of individual people, an area that has proved elusive.
“The face recognition software library is currently in its fourth iteration,” explained Thornton, “because we often get feedback from the product divisions to improve performance in real-world conditions.”
Access control applications exemplify the challenge of such real-world conditions. If someone steps up to a door, face forward in a well-lit area, the software can recognize the face from an existing database and authorize entry. The difficulty comes where the person isn’t directly facing the camera and where poor lighting influences image analysis. These problems have taken the researchers back to the drawing board.
“We have now identified 5,000 characteristics for identifying faces,” Thornton said, “and we apply that with a set of rules applied 200,000 times in every frame of video to determine if those characteristics are present. These include areas of dark above light, for example, which would be the eyes above cheeks. We can do this at 30 frames per second.”
Not only can the software detect and recognize faces in video, but it can index as well, so an operator can search a database of video with specific queries. Say you have a series of frames that include an image of a person, and you want the best view of that person for identification—for example, a view looking up with their eyes open. The software can do that. The work continues, but Mitsubishi Digital Electronics America Inc., a division of the company that makes security-related products like the DXTL5000U DVR, is eyeing the developments in the area to include in a future version of its control software.
Audio-Video Partnership
There are numerous areas of development that influence the security industry, one of which is audio event detection in association with video. A system already in use recognizes and records traffic accidents based on sound detection. Since it would be impractical to perpetually store all traffic video, the software detects audio that fits into a class of crashing sounds and records video 30 seconds before the accident through 30 seconds after. This kind of technology has applications in the security industry, since the software can detect classes of sounds such as breaking glass or gunshots and distinguish them from slamming doors or other sounds.
The list of technologies that will make their way into the security market as useful products continues to grow at this active research lab in Cambridge. Wherever it happens, bringing together both brainpower and money should help security directors looking for cost-effective technology that can be applied to today’s security systems challenges.
Travis McGee is an account executive at Griffin Public Relations & Marketing in New York City.
