General HUSKYLENS

Can i detect a smile or other facial expression with Huskylens?

userHead Thomas.Rogenmoser 2024-11-24 08:22:00 10 Views0 Replies

I want to detect if a single person is smiling / not smiling.

(could also be another facial expression like raising eyebrows or showing teeth). 
If i can achieve the detection, want to use that to trigger an event.

 

What i tried:

I created 2 videos of me, one smiling, one not smiling.
I set HL face recognition to “learn multiple” and did learn from both videos.

It seemed to learn faces id0 and id1, but afterwards mostly detected id1 from both videos.
Trying again, i was not able to learn two different faces from the two videos at all… maybe i did misinterpret my first attempt and it never worked at all.
 

Should i try a different approach, or is the dectection of a facial expression not possible with HL?

I see there are 3 treshold-parameters to tune face recognition (detect, NMS, recognize)… but did not find any description, so it's not clear if and how i should try altering those.

 

I feel what i would need would be a way to explicitly tell HL in training “you are now seeing faceIDx”, but that seems not possible, at least through the UI. Maybe when controlling HL from a controller?