W11: Is quality subjective or objective? /진신

 I think: Subjective quality vs objective indicators. (references)

Taking photos and videos as examples, the evaluation of photo quality is subdivided into subjectivity and objectivity.

For subjective feelings, we can usually measure the quality of the evaluation index itself based on the accuracy, consistency, stability, and monotony of the prediction. The so-called accuracy refers to the similarity between subjective evaluation scores and objective evaluation index scores; consistency refers to that it should not only perform well for certain types of videos/images but should perform well for all types of videos/images; stable; Sexuality means that the value of each evaluation of the same video/image should be the same or the error should be within the acceptable range; monotonicity means that the evaluation score should show a corresponding single increase or decrease as the MOS score increases or decreases.

From an objective evaluation point of view, we usually use numerical values ​​to classify evaluation indicators based on errors, evaluation indicators based on perception models and image structure information, and evaluation indicators based on machine learning. Based on the error evaluation index, the compressed image is compared with the original image, and the difference (called noise or error) between the two images is calculated. Representative indicators are Mean square error (MSE) and Peak signal noise ratio (PSNR). Based on the perception model and image structure evaluation index, the human visual system (HVS) is introduced to transform the image quality degradation into changes in perceptual structure information and changes in some perceptual phenomena (brightness, contrast, viewing distance), and mathematically how humans perceive these errors Modeling, Structure similarity Index (SSIM), Just Noticeable Difference (JND). Evaluation indicators based on machine learning are commonly used to measure long-term videos. Starting from a certain trainable model, the results of error-based evaluation indicators or perceptual evaluation indicators are compared with subjective MOS score, and the model is fine-tuned to make it follow suit. An improvement over time, or the fusion of multiple evaluation index systems. These multiple indicators include indicators that measure image quality and indicators that measure time quality. The typical evaluation indicators based on machine learning are Visual Multimethod Assessment Fusion(VMAF).

Combining the above two methods of evaluation, I believe that quality is subjective, while the objective one should be known as an indicator. What is your view on this?

Comments

Popular posts from this blog

W4: What are the pros and cons of using Naver vs Google for research purposes?

W2 : After watching Mitch Resnick’s TED video

W13/After reading “Categorization”/HARI KIM