Reiser4
Reiser4 is a computer file system, successor to the ReiserFS file system, developed from scratch by Namesys and sponsored by DARPA as well as Linspire. Reiser4 was named after its former lead developer Hans Reiser. As of 2019, the Reiser4 patch set is still being maintained,[3][4] but according to Phoronix, it is unlikely to be merged into mainline Linux without corporate backing.[5]
Developer(s) | Edward Shishkin and others[1] |
---|---|
Full name | Reiser4 |
Introduced | 2004Linux | with
Partition identifier | Apple_UNIX_SVR2 (Apple Partition Map) 0x83 (MBR) |
Structures | |
Directory contents | Dancing B*-tree |
Limits | |
Max. file size | 8 TiB on x86 |
Max. filename length | 3976 bytes |
Allowed characters in filenames | All bytes except NULL and '/' |
Features | |
Dates recorded | modification (mtime), metadata change (ctime), access (atime) |
Date range | 64-bit timestamps[2] |
Forks | No |
File system permissions | Unix permissions |
Transparent compression | Yes |
Transparent encryption | No |
Data deduplication | No |
Other | |
Supported operating systems | Linux |
Website | reiser4.wiki.kernel.org |
Repository | github.com/edward6/reiser4 |
Features
Some of the goals of the Reiser4 file system are:
- Atomicity (filesystem operations either complete, or they do not, and they do not corrupt due to partially occurring)
- Different transaction models: journaling, write-anywhere (copy-on-write), hybrid transaction model[6]
- More efficient journaling through wandering logs
- More efficient support of small files, in terms of disk space and speed through block suballocation
- Liquid items (or virtual keys) – a special format of records in the storage tree, which completely resolves the problem of internal fragmentation
- EOTTL (extents on the twig level) – fully balanced storage tree, meaning that all paths to objects are of equal length
- Faster handling of directories with large numbers of files
- Transparent compression: Lempel-Ziv-Oberhumer (LZO), zlib
- Plugin infrastructure
- Dynamically optimized disk-layout through allocate-on-flush (also called delayed allocation in XFS)
- Delayed actions (tree balancing, compression, block allocation, local defragmentation)
- R and D (Rare and Dense) caches, synchronized at commit time
- Transactions support for user-defined integrity
- Metadata and inline-data checksums[7]
- Mirrors and failover[8]
- Precise discard support[9] with delayed issuing of discard requests for SSD devices[10]
Some of the more advanced Reiser4 features (such as user-defined transactions) are also not available because of a lack of a VFS API for them.
At present Reiser4 lacks a few standard file system features, such as an online repacker (similar to the defragmentation utilities provided with other file systems). The creators of Reiser4 say they will implement these later, or sooner if someone pays them to do so.[11]
Performance
Reiser4 uses B*-trees in conjunction with the dancing tree balancing approach, in which underpopulated nodes will not be merged until a flush to disk except under memory pressure or when a transaction completes. Such a system also allows Reiser4 to create files and directories without having to waste time and space through fixed blocks.
As of 2004, synthetic benchmarks performed by Namesys in 2003 show that Reiser4 is 10 to 15 times faster than its most serious competitor ext3 working on files smaller than 1 KiB. Namesys's benchmarks suggest it is typically twice the performance of ext3 for general-purpose filesystem usage patterns.[12] Other benchmarks from 2006 show results of Reiser4 being slower on many operations.[13] Benchmarks conducted in 2013 with Linux Kernel version 3.10 show that Reiser4 is considerably faster in various tests compared to in-kernel filesystems ext4, btrfs and XFS.[14]
Integration with Linux
Reiser4 has patches for Linux 2.6, 3.x, 4.x and 5.x.,[15][3] but as of 2019, Reiser4 has not been merged into the mainline Linux kernel[3] and consequently is still not supported on many Linux distributions; however, its predecessor ReiserFS v3 has been widely adopted. Reiser4 is also available from Andrew Morton's -mm kernel sources, and from Zen patch set. Linux kernel developers claim that Reiser4 does not follow Linux coding standards,[16] but Hans Reiser suggested political reasons.[17] Latest released reiser4 kernel patches and tools can be downloaded from reiser4 project page at sourceforge.net [4]
History of Reiser4
Hans Reiser was convicted of murder on April 28, 2008, leaving the future of Reiser4 uncertain. After his arrest, employees of Namesys were assured they would continue to work and that the events would not slow down the software development in the immediate future. In order to afford increasing legal fees, Hans Reiser announced on December 21, 2006, that he was going to sell Namesys;[18] as of March 26, 2008, it had not been sold, although the website was unavailable. In January 2008, Edward Shishkin, an employee of and programmer for Namesys, was quoted in a CNET interview saying, "Commercial activity of Namesys has stopped." Shishkin and others continued the development of Reiser4,[19] making source code available from Shishkin's web site,[20] later relocated to kernel.org.[21] Since 2008, Namesys employees have received 100% of their sponsored funding from DARPA.[22][23][24]
In 2010, Phoronix wrote that Edward Shishkin was exploring options to get Reiser4 merged into Linux kernel mainline.[25] As of 2019, the file system is still being updated for new kernel releases, but has not been submitted for merging.[3] In 2015, Michael Larabel mentioned it is unlikely to happen without corporate backing,[26] and then he suggested in April 2019 that the main obstacle could be the renaming of Reiser4 to avoid reference to the initial author who was convicted of murder.[3]
Shishkin announced a Reiser5 filesystem on December 31, 2019.[27]
References
- "Credits - Reiser4 FS Wiki". reiser4.wiki.kernel.org. Retrieved 2019-08-05.
- Documentation/filesystems/reiser4.txt from a reiser4-patched kernel source, "By default file in reiser4 have 64-bit timestamps."
- Larabel, Michael (2019-04-13). "Reiser4 Brought To The Linux 5.0 Kernel - Phoronix". Phoronix. Retrieved 2019-08-04.
- http://reiser4.sourceforge.net/
- https://phoronix.com/scan.php?page=news_item&px=Linux-4.10-Ten-Missing-Features
- "Reiser4 transaction models". Reiser4 wiki.
- "Reiser4 checksums". Reiser4 wiki.
- "Reiser4 Mirrors and Failover". Reiser4 wiki.
- "Precise Discard". Reiser4 wiki.
- "Reiser4 discard support". Reiser4 wiki.
- Reiser, Hans (2004-09-16). "Re: Benchmark: ext3 vs reiser4 and effects of fragmentation". Namesys, ReiserFS mailing list. Retrieved 2009-10-03.
- Hans Reiser (November 20, 2003). "Benchmarks Of ReiserFS Version 4". Namesys. Archived from the original on September 29, 2007. Retrieved 2014-01-18.
- Justin Piszcz (January 2006). "Benchmarking Filesystems Part II". Retrieved 2006-04-23.
- Michael Larabel (July 31, 2013). "Reiser4 File-System Shows Decent Performance On Linux 3.10". Phoronix. Retrieved 2013-07-31.
- "Reiser4 file system for Linux OS - Browse Files at SourceForge.net". sourceforge.net. Retrieved 2019-08-04.
- "Linux: Why Reiser4 Is Not in the Kernel". Kerneltrap. September 19, 2005. Archived from the original on 2007-04-23.
- Reiser, Hans (21 July 2006). "The "'official' point of view" expressed by kernelnewbies.org regarding reiser4 inclusion". Retrieved 2008-03-01.
- "Murder Suspect Selling Namesys". Wired News. 2006-12-21. Retrieved 2006-12-30.
- Namesys vanishes, but ReiserFS project lives on. http://www.news.com/8301-13580_3-9851703-39.html CNet (January 16, 2008). Retrieved on 2008-01-26.
- "Namesys things". Chichkin_i.zelnet.ru. Archived from the original on 2010-03-24. Retrieved 2010-02-08.
- New location of Namesys software Linux Kernel Mailing List post, 2008-08-04
- "Re: we got the DARPA grant to add views to Reiser4". Mail-archive.com. 2004-04-10. Retrieved 2010-02-08.
- "Bug 114785 – reiserfs won't mount with usrquota option". Red Hat Bugzilla.
- "Reports - ext3 or ReiserFS? Hans Reiser Says Red Hat's Move Is Understandable - Red Hat's Decision is Conservative, Not Radical". LinuxPlanet. Retrieved 2010-02-08.
- "Reiser4 May Go For Mainline Inclusion In 2010". Phoronix. 2009-11-10. Retrieved 2010-02-08.
- Michael Larabel (23 February 2015). "KDBUS & Other Features You Won't Find In The Linux 4.0 Kernel". Phoronix.
- "[ANNOUNCE] Reiser5 (Format Release 5.X.Y)". Linux Weekly News. 2019-12-31.
External links
- ReiserFS and Reiser4 wiki
- Current Reiserfs4 patches as Namesys' website is down
- Reiserfs v4 utilities
- Introduction to Reiser4 on kuro5hin
- Reiser4 transaction design document
- Trees in the Reiser4 Filesystem, Part I from Linux Journal
- Trees in the Reiser4 Filesystem, Part II from Linux Journal
- Hans Reiser: The Reiser4 Filesystem Hans Reiser's lecture at Google
- Why Reiser4 is not in the Linux Kernel at kernelnewbies.org and Hans Reiser's response to Kernelnewbies' criticism
- Reiser4 and the Politics of the Kernel by Bruce Byfield on Linux.com
- The Reiser4 Filesystem: Ways In Which Extra Rigor In Scientific Methodology Can Consume Years Of Your Life, And How The Result Can Be So Very Worthwhile - lecture given by Hans Reiser at Stanford University (video archive).
- Reiser4 Gentoo FAQ
- Metztli Reiser4 – a Debian installer including Reiser4