在JavaScript中旋转人脸Node.js 10

问题描述

我正在使用面部识别算法，但是我需要旋转所有面部以使其垂直对齐其矩形。

脸部矩形不旋转（角度为0），它包含已识别的整个脸部。有时将面部旋转“ faceAngle”度，所以我实现的功能是将面部（矩形）的“ -faceAngle”度以面部矩形的中心作为枢轴点（参考点）旋转。

Pd：人脸由20个地标识别。

这是矩形矩形的外观：https://docs.microsoft.com/es-es/azure/cognitive-services/face/images/face.detection.jpg

这是我的代码：

  function rotateFace(face) {
      /*
        This function rotate the face to the rectangle based on the head pose attributes
      */

      // Get the face information
      const { faceRectangle,faceLandmarks,faceAttributes } = face;

      // Head pose's roll value acts directly as the face angle.
      const faceAngle = faceAttributes.headPose.roll; // In degrees

      // The pivot point will be the center of the face rectangle
      const pivotPoint = {
        x: faceRectangle.width / 2,y: faceRectangle.height / 2,};

      // Rotate each face landmark '-faceAngle' degrees
      const rotatedLandmarks = {};
      for (const [landMark,point] of Object.entries(faceLandmarks)) {
        // Rotate the point and save it in the new rotated landMarks object
        rotatedLandmarks[landMark] = rotatePoint(pivotPoint,point,-faceAngle);
      }

      // Return the rotated face
      return { ...face,faceLandmarks: rotatedLandmarks };

      function rotatePoint(pivotPoint,angle) {
        const { x: px,y: py } = pivotPoint;
        const { x,y } = point;

        var radians = (Math.PI / 180) * angle,cos = Math.cos(radians),sin = Math.sin(radians),nx = cos * (x - px) + sin * (y - py) + px,ny = cos * (y - py) - sin * (x - px) + py;

        return { x: nx,y: ny };
      }
  }

我遇到的问题是，有时旋转后的脸的某些部分不在脸矩形的外面。有人知道我的算法做得不好吗？或有任何想法使此操作变得更容易？

我认为枢轴点不应该是我选择的那个，但对我而言很有意义...

谢谢。

示例

对于这张照片https://scstylecaster.files.wordpress.com/2017/03/emma-watson-1.jpg

我得到这个脸部矩形：

faceRectangle: {
   top: 90,left: 309,width: 510,height: 510 
}

因此，相对于矩形的脸部界标对于X轴应该在[0，510]范围内，对于Y轴应该在[0，510]范围内

但是我得到的是：

{
  "eyebrowRightInner": { "x": 257.16357408506883,"y": 37.89185642687593 },"underLipTop": { "y": 306.6951578378977,"x": 326.5280833858301 },"mouthRight": { "x": 413.55677612276986,"y": 257.5870460792551 },"eyebrowLeftInner": { "y": 67.10580836435113,"x": 168.71276847994784 },"noseTip": { "y": 206.5354065431846,"x": 289.9445594907593 },"noseRootLeft": { "y": 112.52684633627678,"x": 204.9452029765821 },"noseRightAlarTop": { "x": 311.41755898744964,"y": 159.77912041377596 },"pupilRight": { "x": 315.13546073674706,"y": 48.933158797745136 },"pupilLeft": { "x": 106.47397872844112,"y": 137.8818851860268 },"upperLipTop": { "y": 280.73055222306243,"x": 312.3126250651826 },"eyeRightOuter": { "y": 37.448988851675836,"x": 371.07188751438275 },"eyebrowRightOuter": { "y": -16.27549040986449,"x": 413.1946880869507 },// <------------------ error
  "eyeLeftOuter": { "y": 154.79417336302782,"x": 82.3579154382175 },"upperLipBottom": { "y": 302.33231999033967,"x": 324.86506026034 },"noseLeftAlarOutTip": { "y": 244.55778079547065,"x": 220.11663487446322 },"noseLeftAlarTop": { "x": 220.08119281608163,"y": 200.35236547267908 },"eyeLeftBottom": { "y": 154.39022448200217,"x": 120.07378511268632 },"noseRightAlarOutTip": { "x": 350.8688839396136,"y": 182.97767553082463 },"eyebrowLeftOuter": { "x": 12.151092571862137,"y": 146.8442033623165 },"eyeRightBottom": { "x": 337.62439624997774,"y": 64.52859978162735 },"eyeLeftTop": { "y": 124.33543005444903,"x": 103.84081459224478 },"underLipBottom": { "y": 332.64619899450827,"x": 341.8614934073455 },"noseRootRight": { "y": 86.3352712525471,"x": 268.4137100854889 },"eyeLeftInner": { "x": 154.06657444677165,"y": 128.0195917006581 },"eyeRightInner": { "x": 294.24199118290403,"y": 71.94256839474764 },"eyeRightTop": { "x": 320.5652039630463,"y": 34.94002160494745 },"mouthLeft": { "y": 346.12770549550777,"x": 220.09672435462016 }
}

解决方法

我发现了错误...这是因为地标是相对于图像而不是相对于矩形的，所以我必须在旋转之前更改它们，因为枢轴点是相对于矩形的。 / p>

在旋转矩形之前，请确保已获得每个相对于矩形的地标的位置。其他解决方案是采用矩形的中心，而不是相对于矩形，而不是相对于矩形，并使用原始的（相对于图像）界标。