Sensing SDK

The Sensing SDK is Trillboards' on-device computer-vision package, the engine behind every buyer-grade audience signal we ship. The SDK runs continuously while the screen is playing ads. Each frame from the screen's front-facing camera passes through a detection pipeline: face detection, person counting, head-pose regression, gaze estimation, and (for screens with sufficient compute) emotion classification and demographic estimation.

Detection runs on the device. The SDK sends the Trillboards API a record for each detected person (estimated age range, gender, dominant emotion, dwell time and gaze time) and, on the Full profile, a face-identity template that recognises the same person across screens and days. Selected frames go to a cloud model for the semantic signals, and Trillboards keeps those frames for 400 days.

The model stack is intentionally modular. Small screens (budget Android tablets, the long tail of Trillboards inventory) run a Lite profile: face detect + person count + attention bucket. High-spec screens run the Full profile: adds FaceXFormer-based age/gender estimation, emotion classification, and gaze direction. The platform supports OTA model download so model upgrades roll without firmware updates.

Output schema: face_count, person_count, attention_level (low/medium/high), dwell_seconds, gaze_seconds, plus the cloud-emitted cohort composition, attire archetype, and intent stage. See /support/developers/sensing-sdk for the full field reference.