distcc
In software development, distcc is a tool for speeding up compilation of source code by using distributed computing over a computer network. With the right configuration, distcc can dramatically reduce a project's compilation time.[3]
Original author(s) | Martin Pool |
---|---|
Developer(s) | Fergus Henderson |
Stable release | |
Repository | |
Written in | C, C++, Python |
Operating system | Cross-platform |
Type | Compiler |
License | GNU General Public License |
Website | distcc |
It is designed to work with the C programming language (and its derivatives like C++ and Objective-C) and to use GCC as its backend, though it provides varying degrees of compatibility with the Intel C++ Compiler and Sun Microsystems' Sun Studio Compiler Suite.[4] Distributed under the terms of the GNU General Public License, distcc is free software.
Design
distcc is designed to speed up compilation by taking advantage of unused processing power on other computers. A machine with distcc installed can send code to be compiled across the network to a computer which has the distccd daemon and a compatible compiler installed.[5]
distcc works as an agent for the compiler. A distcc daemon has to run on each of the participating machines. The originating machine invokes a preprocessor to handle header files, preprocessing directives (such as #ifdef
) and the source files and sends the preprocessed source to other machines over the network via TCP either unencrypted or using SSH. Remote machines compile those source files without any local dependencies (such as libraries, header files or macro definitions) to object files and send them back to the originator for further compilation.[6]
distcc version 3 supports a mode (called pump mode) in which included header files are sent to the remote machines, so that preprocessing is also distributed.
Related software
ccache is another tool aimed to reduce the compilation time by caching the output from the same input source files. ccache can also use distcc as its backend, providing distributed compiling if it is not already cached by using the CCACHE_PREFIX environment variable.
distcc was an option for distributed builds in versions of Apple's Xcode development suite prior to 4.3, but has been removed.
icecream was created by SUSE based on distcc. Like distcc, icecream takes compile jobs from a build and distributes it among remote machines allowing a parallel build. But unlike distcc, icecream uses a central server that dynamically schedules the compile jobs to the fastest free server.[7]
See also
References
- "Releases". Retrieved 26 April 2018 – via GitHub.
- "distcc/NEWS at master". Retrieved 26 April 2018.
- Laurence Bonney (2004-07-22). "Reduce compile time with distcc". IBM. Retrieved 2011-08-24.
- Martin Pool (2007-02-23). "distcc frequently asked questions". Distcc.googlecode.com. Archived from the original on 2009-09-07. Retrieved 2009-10-19.
- Daniel Robbins (2004-02-01). "Distcc & Distributed Computing". Dr.Dobb's. Retrieved 2011-08-24.
- V. L. Simpson (October 2004). "Speed Compiling with Distcc". linuxgazette.net. Retrieved 2011-08-25.
- icecream: Distributed compiler with a central scheduler to share build load, icecc, 2017-12-27, retrieved 2017-12-27