Authors:
Jorge Ivan Rivalcoba Rivas
1
;
Oriam De Gyves
1
;
Isaac Rudomín
2
and
Nuria Pelechano
3
Affiliations:
1
Tecnológico de Monterrey, Mexico
;
2
Barcelona Supercomputing Center, Spain
;
3
Universitat Politècnica de Catalunya, Spain
Keyword(s):
Crowd simulation, Computer vision, Semantic Local Binary Patterns (S-LBP), Computer graphics, Motion control.
Related
Ontology
Subjects/Areas/Topics:
Advanced User Interfaces
;
Animation and Simulation
;
Augmented, Mixed and Virtual Environments
;
Biomedical Engineering
;
Biomedical Signal Processing
;
Computer Vision, Visualization and Computer Graphics
;
Crowd Simulation
;
Hardware Technologies for Augmented, Mixed and Virtual Environments
;
Interactive Environments
;
Motion Control
Abstract:
Our objective with this paper is to show how we can couple a group of real people and a simulated crowd of virtual humans. We attach group behaviors to the simulated humans to get a plausible reaction to real people. We use a two stage system: in the first stage, a group of people are segmented from a live video, then a human detector algorithm extracts the positions of the people in the video, which are finally used to feed the second stage, the simulation system. The positions obtained by this process allow the second module to render the real humans as avatars in the scene, while the behavior of additional virtual humans is determined by using a simulation based on a social forces model. Developing the method required three specific contributions: a GPU implementation of the codebook algorithm that includes an auxiliary codebook to improve the background subtraction against illumination changes; the use of semantic local binary patterns as a human descriptor; the parallelization
of a social forces model, in which we solve a case of agents merging with each other. The experimental results show how a large virtual crowd reacts to over a dozen humans in a real environment.
(More)