Distcc

distcc
Original author(s)	Martin Pool
Developer(s)	Fergus Henderson
Stable release	3.4 / 11 May 2021; 3 years ago
Repository	github.com/distcc/distcc ;
Written in	C, C++, Python
Operating system	Cross-platform
Type	Compiler
License	GNU General Public License
Website	distcc.org

In software development, distcc is a tool for speeding up compilation of source code by using distributed computing over a computer network. With the right configuration, distcc can dramatically reduce a project's compilation time.^[2]

It is designed to work with the C programming language (and its derivatives like C++ and Objective-C) and to use GCC as its backend, though it provides varying degrees of compatibility with the Intel C++ Compiler and Sun Microsystems' Sun Studio Compiler Suite.^[3] Distributed under the terms of the GNU General Public License, distcc is free software.

Design

distcc is designed to speed up compilation by taking advantage of unused processing power on other computers. A machine with distcc installed can send code to be compiled across the network to a computer which has the distccd daemon and a compatible compiler installed.^[4]

distcc works as an agent for the compiler. A distcc daemon has to run on each of the participating machines. The originating machine invokes a preprocessor to handle header files, preprocessing directives (such as #ifdef) and the source files and sends the preprocessed source to other machines over the network via TCP either unencrypted or using SSH. Remote machines compile those source files without any local dependencies (such as libraries, header files or macro definitions) to object files and send them back to the originator for further compilation.^[5]

distcc version 3 supports a mode (called pump mode) in which included header files are sent to the remote machines, so that preprocessing is also distributed.

Related software

distcc was an option for distributed builds in versions of Apple's Xcode development suite prior to 4.3, but has been removed.

Goma

Goma is a similar tool made by Google to replace distcc & ccache in compiling chromium.

Ccache

ccache is another tool aimed to reduce the compilation time by caching the output from the same input source files. ccache can also use distcc as its backend, providing distributed compiling if it is not already cached by using the CCACHE_PREFIX environment variable.

Icecream

icecream was created by SUSE based on distcc. Like distcc, icecream takes compile jobs from a build and distributes it among remote machines allowing a parallel build. But unlike distcc, icecream uses a central server that dynamically schedules the compile jobs to the fastest free server.^[6]

References

^ "Release 3.4". 11 May 2021. Retrieved 21 May 2021.
^ Laurence Bonney (2004-07-22). "Reduce compile time with distcc". IBM. Retrieved 2011-08-24.
^ Martin Pool (2007-02-23). "distcc frequently asked questions". Distcc.googlecode.com. Archived from the original on 2009-09-07. Retrieved 2009-10-19.
^ Daniel Robbins (2004-02-01). "Distcc & Distributed Computing". Dr.Dobb's. Retrieved 2011-08-24.
^ V. L. Simpson (October 2004). "Speed Compiling with Distcc". linuxgazette.net. Retrieved 2011-08-25.
^ icecream: Distributed compiler with a central scheduler to share build load, icecc, 2017-12-27, retrieved 2017-12-27

External links

[wikidata-0cd215bc39413914bf3ce84b1089c54a42c40909-v18-1] "Release 3.4". 11 May 2021. Retrieved 21 May 2021.

[2] Laurence Bonney (2004-07-22). "Reduce compile time with distcc". IBM. Retrieved 2011-08-24.

[3] Martin Pool (2007-02-23). "distcc frequently asked questions". Distcc.googlecode.com. Archived from the original on 2009-09-07. Retrieved 2009-10-19.

[drdobbs-4] Daniel Robbins (2004-02-01). "Distcc & Distributed Computing". Dr.Dobb's. Retrieved 2011-08-24.

[linuxgazette-5] V. L. Simpson (October 2004). "Speed Compiling with Distcc". linuxgazette.net. Retrieved 2011-08-25.

[6] icecream: Distributed compiler with a central scheduler to share build load, icecc, 2017-12-27, retrieved 2017-12-27

[1]

[2]

[3]

[4]

[5]

[6]