hqx

In image processing, hqx ("high quality scale") is one of the pixel art scaling algorithms developed by Maxim Stepin, used in emulators such as Nestopia, FCEUX, higan, Snes9x, ZSNES and many more. There are three hqx filters defined: hq2x, hq3x, and hq4x, which magnify by factor of 2, 3, and 4 respectively. For other magnification factors, this filter is used with nearest-neighbor scaling.

Algorithm

First, the color of each of the 8 pixels around the source pixel is compared to the color of the source pixel. Shapes are detected by checking for pixels of similar color according to a threshold. This gives total of 28 = 256 combinations of similar or dissimilar neighbors. To expand the single pixel into a 2×2, 3×3, or 4×4 block of pixels, the arrangement of neighbors is looked up in a predefined table which contains the necessary interpolation patterns.[1]

Hqx uses the YUV color space to calculate color differences, so that differences in brightness is weighted higher to mimic human perception. It is possible to use a look-up table for the color space conversion if the source image is 16 bit per pixel.[1]

The interpolation data in the lookup tables are constrained by the requirement that continuity of line segments must be preserved, while optimizing for smoothness. Generating these 256-filter lookup tables is relatively slow, and is the major source of complexity in the algorithm: the render stage is very simple and fast, and designed to be capable of being performed in real time on a MMX-capable CPU.[1]

In the source code, the interpolation data is represented as preprocessor macros to be inserted into switch case statements, and there is no source code leading to the generation of a lookup table. The author describes the process of generating a look-up table as:[1]

... for each combination the most probable vector representation of the area has to be determined, with the idea of edges between the different colored areas of the image to be preserved, with the edge direction to be as close to a correct one as possible. That vector representation is then rasterised with higher (3x) resolution using anti-aliasing, and the result is stored in the lookup table.

Implementations

  • The original algorithm has been ported to DevIL (but kept in the C language).[1]
  • Ports to Java and C# languages are available. These implementations expand the macros.[2][3]
  • A C++ port by byuu, the author of bsnes, which encodes the LUT in a space-efficient way. Byuu exploited the symmetry of patterns to make such an encoding, and wrote some notes on interpreting the original look up tables.[4]
  • libretro implements two families of shaders in Slang/HLSL, GLSL, and Cg:
    • The hqx family, which is true hqx.[5] As it runs on modern GPUs, lookup tables are substituted by textures.[6] The textures were generated by interrogating a modified version of hqx for its switch/case.
    • The scalehq family, which is frequently confused with hqx. It is not related to hqx, but is rather a generic upscaling-smoothing algorithm.[7]
  • hqx has also been implemented in ffmpeg for upscaling images and videos 2x, 3x, or 4x. An account of the production of the translation for ffmpeg is here: http://blog.pkh.me/p/19-butchering-hqx-scaling-filters.html and usage may be something like: ffmpeg -i %1 -filter_complex hqx=2 hqx2-%1 to produce a 2x image or video.

See also

References

  1. Zemek, Cameron (6 May 2019). "hqx README (grom358 port)". Cite journal requires |journal= (help)
  2. Garcia, Edu (6 March 2019). "hqx-java". GitHub.
  3. Tamschi. "hqxsharp". bitbucket.
  4. Byuu. Release announcement Accessed 2011-08-14. public domain implementation released on pastebin
  5. "hqx". Libretro Docs.
  6. Blok, Jules (12 April 2019). "hqx-shader". GitHub.
  7. K, Hunter (20 June 2014). "Filthy Pants: A Computer Blog: True Hq2x Shader Comparison With xBR". Filthy Pants.
This article is issued from Wikipedia. The text is licensed under Creative Commons - Attribution - Sharealike. Additional terms may apply for the media files.