Scholarly record
VIDEO - BASED HUMAN BEHAVIOUR INTERPRETATION AND MODELLING WITH THE STATBOX CONCEPT
Abstract
Detecting people in videos or images in order to interpret their behaviour is nowadays an important part of safety and security monitoring. Detection of persons in videos is more challenging than detection of any other moving objects, be it animals or vehicles. This paper reviews the recent work on a developing tool - STATBOX for spatial analysis and modelling. STATBOX concept is based on the video data collection for a given territory, which can be taken using different devices such as mobile phones, surveillance video cameras, as well as statistical data obtained from video files. Each video must contain geolocalization data and time information as well as other markers, which make it possible to determine the precise direction of information flow in the video. All information about moving objects in the video is extracted from each video frame. The extracted information on all determined objects contains their contours, proportions, textures, and markers, as well as the geolocalization information пїЅ spatial data and time data. Further on, this information is compared with information collected by other devices using a classification engine, and this allows for reconstruction of the object movements in the given territory. Using STATBOX minimizes spatial analysis costs in the urban environment, and it has a flexibility of creation automated adequate geosimulation models - agent based modelling on GAML patterns and GIS. So far the STATBOX concept was successfully used in pedestrian counting with recognition in the city park for flows simulation and analysis, as well as in campus for student behaviour analysis and movement flow simulation. This shows that the STATBOX concept can be used for better understanding of human behaviour based on video data, and its enhanced automation can bring great benefits in the areas such as public security surveillance, traffic control and pedestrian flow analysis, crisis management and similar.
Publication Impact Profile
Publication details
References13
Hu WC., Chen CH., Chen CM., Chen TY. Effective Moving Object Detection from Videos Captured by a Moving Camera. In: Pan JS., Snasel V., Corchado E., Abraham A., Wang SL. (Eds) Intelligent Data analysis and its Applications, Volume I. Advances in Intelligent Systems and Computing, Taiwan, 297. Springer, 2014
Wren C., Azarbayejani A., Darrell T., Pentland A. Pfinder: Real time tracking of the human body. IEEE Transactions on Pattern Analysis and Machine Intelligence, USA, Vol. 19, No.7, pp.780-785, 1997.
Mohan A., Papageorgiou C, Poggio. Example-Based Object Detection in Images by Components. IEEE Transactions on Pattern Analysis and Machine Intelligence, USA Vol. 23, No.4, pp. 349-361, 2001.
Kalirajan K., Sudha M., Rajeshkumar V., Jamaesha S.S. Adaptive visual tracking system using artificial intelligence, in Proceedings of the IEEE/OSA/IAPR International Conference on Informatics, Electronics and Vision (ICIEV '12), Bangladesh, pp. 954 957, IEEE, 2012.
Schwartz W. R., Kembhavi A., Harwood D., Davis L.S. Human Detection Using Partial Least Squares Analysis. IEEE 12th International Conference on Computer Vision, USA, pp.24-31, 2009.
Dalal N. & Triggs B. Histogram of oriented gradient for human detection. Cordelia Schmid and Stefano Soatto and Carlo Tomasi. International Conference on Computer Vision & Pattern Recognition (CVPR '05), USA. IEEE Computer Society, 1, pp.886- 893, 2005,
Arun P. A CNN hybrid approach towards automatic image registration. Geodesy and Cartography. 39 (3), Lithuania, pp.121-128, 2013.
WyawahareM.V., Patil P.M., Abhyankar H.K. Image registration techniques an overview. International journal of Signal Processing, Image Processing and Pattern Recognition, India, Vol 2(3), pp.11-28, 2009.
Helbing D., Molnar P., Farkas I., Bolay K. Self-Organizing Pedestrian Movement. Environment and Planning B: Urban Analytics and City Science. Germany, Vol 28, Issue 3, pp. 361-383, 2001.
Batty M., Jiang B., Thurstain-Goodwin M. Local movement: agent-based models of pedestrian flows. (CASA Working Papers 4), Centre of Advanced Spatial Analysis (UCL), UK, pp.87, 1998.
Benenson I., Torrens P.M. Geosimulation: Automata - based Modeling of Urban Phenomena. John Wiley & SONS LTD., ISBN 10: 0-470-84349-7 (H/B), USA, pp.283, 2005.
Ajoy, R., & Acharya, T. (2005). Image Processing Principles and Applications. New Jersey, USA: John Wiley & Sons, Inc., Hoboken.
P. Taillandier and A. Drogoul, "From GIS Data to GIS Agents, Modelling with the GAMA simulation platform.," Technical Forum Group on Agent and Multi-agent-based Simulation, 1st meeting, Paris, France, 2010.
View or Download full articleAccess options
SWS access login
Login as SWS Scientific CommitteeLogin as SWS Scientific PartnerLogin as SWS AuthorAuthors and approved SWS contributors will read and export their own linked papers after identity matching by SWS profile, email and SGEM GlobalID.
For librarian assistance: [email protected]
Purchase Instant Access
- Article can be downloaded after successful payment.
- Article may be used according to SWS library access terms.
- Article cannot be redistributed.
