Sensor-Actuator System
To design an ambient information system for the representation of human behavior and arousal, we developed a Sensor-Actuator System. Using the software MaxMSP, we set up a technical environment that allowed the acquired data streams to be mapped to physical parameters in real time and the signals to be recorded for later analysis. Behavior and arousal were captured by sensor measurements of:
- position tracking (camera-based color tracking of red hat: x, y coordinates),
- head movement (3-axis accelerometer fixed to red hat: sum of delta values),
- wrist movement (3-axis accelerometer sensor in E4 Empatica wristband: sum of delta values),
- heart rate (pulse sensor in E4 Empatica wristband: beats per minute (bpm).
Some sensors were wired, others transmitted data via xBee or bluetooth wireless protocols. The measured data was processed and different actuator parameters were controlled according to a rule-based system:
- light by different types of lamps (brightness, hue, saturation, interval),
- sound by speakers (source, volume, audio effects),
- vibration by contact speakers (source, intensity, interval),
- and airflow by a ventilator (strength, interval).