The library right now works great for detecting faces, but the landmarks are clearly poorly trained. They are by no means accurate and are often not even close to being in the right spot.
I had a look through the training code, and I didn't see any code performing rotations for augmentation purposes. I was thinking that might be because of the question "How does one rotate a bounding box to generate a new ground truth bounding box label?", but in the end that seems like a very trivial thing to solve, given that faces are mostly ovals within the bounding box. One could rotate the bounding box around the rotated oval.
Anyway, I was wondering if there are plans on training this network architecture with rotations or other types of distortions to improve the landmark positions?
By the way: thanks for this cool work! It's again an impressive achievement of how NNs can be used in performance critical applications, which I greatly appreciate from a research point of view.
The library right now works great for detecting faces, but the landmarks are clearly poorly trained. They are by no means accurate and are often not even close to being in the right spot.
I had a look through the training code, and I didn't see any code performing rotations for augmentation purposes. I was thinking that might be because of the question "How does one rotate a bounding box to generate a new ground truth bounding box label?", but in the end that seems like a very trivial thing to solve, given that faces are mostly ovals within the bounding box. One could rotate the bounding box around the rotated oval.
Anyway, I was wondering if there are plans on training this network architecture with rotations or other types of distortions to improve the landmark positions?
By the way: thanks for this cool work! It's again an impressive achievement of how NNs can be used in performance critical applications, which I greatly appreciate from a research point of view.