Comparison of cluster software

The following tables compare general and technical information for notable computer cluster software. This software can be grossly separated in four categories: Job scheduler, nodes management, nodes installation and integrated stack (all the above).

General information

Software Maintainer Category Development status Latest release ArchitectureOCS High-Performance / High-Throughput Computing License Platforms supported Cost
Paid support
available
Amoeba No active development MIT
Base One Foundation Component Library Proprietary
DIET INRIA, SysFera, Open Source All in one GridRPC, SPMD, Hierarchical and distributed architecture, CORBA HTC/HPC CeCILL Unix-like, Mac OS X, AIX Free
DxEnterprise DH2i Nodes management Actively developed v23.0 Proprietary Windows 2012R2/2016/2019/2022 and 8+, RHEL 7/8/9, CentOS 7, Ubuntu 16.04/18.04/20.04/22.04, SLES 15.4 Cost Yes
Enduro/X Mavimax, Ltd. Job/Data Scheduler Actively developed SOA Grid HTC/HPC/HA GPLv2 or Commercial Linux, FreeBSD, MacOS, Solaris, AIX Free / Cost Yes
Ganglia Monitoring Actively developed 3.7.6[1]Edit this on Wikidata 21 February 2024; 13 months ago (21 February 2024) BSD Unix, Linux, Microsoft Windows NT/XP/2000/2003/2008, FreeBSD, NetBSD, OpenBSD, DragonflyBSD, Mac OS X, Solaris, AIX, IRIX, Tru64, HPUX. Free
Grid MP Univa (formerly United Devices) Job Scheduler No active development Distributed master/worker HTC/HPC Proprietary Windows, Linux, Mac OS X, Solaris Cost
Apache Mesos Apache Actively developed Apache license v2.0 Linux Free Yes
Moab Cluster Suite Adaptive Computing Job Scheduler Actively developed HPC Proprietary Linux, Mac OS X, Windows, AIX, OSF/Tru-64, Solaris, HP-UX, IRIX, FreeBSD & other UNIX platforms Cost Yes
NetworkComputer Runtime Design Automation Actively developed HTC/HPC Proprietary Unix-like, Windows Cost
OpenHPC OpenHPC project all in one Actively developed v2.61 February 2, 2023; 2 years ago (2023-02-02) HPC Linux (CentOS / OpenSUSE Leap) Free No
OpenLava None. Formerly Teraproc Job Scheduler Halted by injunction Master/Worker, multiple admin/submit nodes HTC/HPC Illegal due to being a pirated version of IBM Spectrum LSF Linux Not legally available No
PBS Pro Altair Job Scheduler Actively developed Master/worker distributed with fail-over HPC/HTC AGPL or Proprietary Linux, Windows Free or Cost Yes
Proxmox Virtual Environment Proxmox Server Solutions Complete Actively developed AGPL v3 Linux, Windows, other operating systems are known to work and are community supported Free Yes
Rocks Cluster Distribution Open Source/NSF grant All in one Actively developed 7.0[2] Edit this on Wikidata (Manzanita) 1 December 2017; 7 years ago (1 December 2017) HTC/HPC Open source CentOS Free
Popular Power
ProActive INRIA, ActiveEon, Open Source All in one Actively developed Master/Worker, SPMD, Distributed Component Model, Skeletons HTC/HPC GNU GPL Unix-like, Windows, Mac OS X Free
RPyC Tomer Filiba Actively developed MIT License *nix/Windows Free
SLURM SchedMD Job Scheduler Actively developed v23.11.3 January 24, 2024; 14 months ago (2024-01-24) HPC/HTC GNU GPL Linux/*nix Free Yes
Spectrum LSF IBM Job Scheduler Actively developed Master node with failover/exec clients, multiple admin/submit nodes, Suite addOns HPC/HTC Proprietary Unix, Linux, Windows Cost and Academic - model - Academic, Express, Standard, Advanced and Suites Yes
Oracle Grid Engine (Sun Grid Engine, SGE) Altair Job Scheduler active Development moved to Altair Grid Engine Master node/exec clients, multiple admin/submit nodes HPC/HTC Proprietary *nix/Windows Cost
Some Grid Engine / Son of Grid Engine / Sun Grid Engine daimh Job Scheduler Actively developed (stable/maintenance) Master node/exec clients, multiple admin/submit nodes HPC/HTC SISSL *nix Free No
SynfiniWay Fujitsu Actively developed HPC/HTC ? Unix, Linux, Windows Cost
Techila Distributed Computing Engine Techila Technologies Ltd. All in one Actively developed Master/worker distributed HTC Proprietary Linux, Windows Cost Yes
TORQUE Resource Manager Adaptive Computing Job Scheduler Actively developed Proprietary Linux, *nix Cost Yes
TrinityX ClusterVision All in one Actively developed v15 February 27, 2025; 51 days ago (2025-02-27) HPC/HTC GNU GPL v3 Linux/*nix Free Yes
UniCluster Univa All in One Functionality and development moved to UniCloud (see above) Free Yes
UNICORE
Xgrid Apple Computer
Warewulf Provision and clusters management Actively developed v4.4.1 July 6, 2023; 21 months ago (2023-07-06) HPC Open source Linux Free
xCAT Provision and clusters management Actively developed v2.16.5 March 7, 2023; 2 years ago (2023-03-07) HPC Eclipse Public License Linux Free
Software Maintainer Category Development status Latest release Architecture High-Performance/ High-Throughput Computing License Platforms supported Cost
Paid support
available

Table explanation

  • Software: The name of the application that is described

Technical information

Software Implementation Language Authentication Encryption Integrity Global File System Global File System + Kerberos Heterogeneous/ Homogeneous exec node Jobs priority Group priority Queue type SMP aware Max exec node Max job submitted CPU scavenging Parallel job Job checkpointing
Python
interface
Enduro/X C/C++ OS Authentication GPG, AES-128, SHA1 None Any cluster Posix FS (gfs, gpfs, ocfs, etc.) Any cluster Posix FS (gfs, gpfs, ocfs, etc.) Heterogeneous OS Nice level OS Nice level SOA Queues, FIFO Yes OS Limits OS Limits Yes Yes No No
HTCondor C++ GSI, SSL, Kerberos, Password, File System, Remote File System, Windows, Claim To Be, Anonymous None, Triple DES, BLOWFISH None, MD5 None, NFS, AFS Not official, hack with ACL and NFS4 Heterogeneous Yes Yes Fair-share with some programmability basic (hard separation into different node) tested ~10000? tested ~100000? Yes MPI, OpenMP, PVM Yes Yes[3]
PBS Pro C/Python OS Authentication, Munge Any, e.g., NFS, Lustre, GPFS, AFS Limited availability Heterogeneous Yes Yes Fully configurable Yes tested ~50,000 Millions Yes MPI, OpenMP Yes Yes[4]
OpenLava C/C++ OS authentication None NFS Heterogeneous Linux Yes Yes Configurable Yes Yes, supports preemption based on priority Yes Yes No
Slurm C Munge, None, Kerberos Heterogeneous Yes Yes Multifactor Fair-share Yes tested 120k tested 100k No Yes Yes Yes[5]
Spectrum LSF C/C++ Multiple - OS Authentication/Kerberos Optional Optional Any - GPFS/Spectrum Scale, NFS, SMB Any - GPFS/Spectrum Scale, NFS, SMB Heterogeneous - HW and OS agnostic (AIX, Linux or Windows) Policy based - no queue to computenode binding Policy based - no queue to computegroup binding Batch, interactive, checkpointing, parallel and combinations Yes and GPU aware (GPU License free) > 9.000 compute hots > 4 mio jobs a day Yes, supports preemption based on priority, supports checkpointing/resume Yes, fx parallel submissions for job collaboration over fx MPI Yes, with support for user, kernel or library level checkpointing environments Yes[6]
Torque C SSH, munge None, any Heterogeneous Yes Yes Programmable Yes tested tested Yes Yes Yes Yes[7]
Software Implementation Language Authentication Encryption Integrity Global File System Global File System + Kerberos Heterogeneous/ Homogeneous exec node Jobs priority Group priority Queue type SMP aware Max exec node Max job submitted CPU scavenging Parallel job Job checkpointing
Python
interface

Table Explanation

  • Software: The name of the application that is described
  • SMP aware:
    • basic: hard split into multiple virtual host
    • basic+: hard split into multiple virtual host with some minimal/incomplete communication between virtual host on the same computer
    • dynamic: split the resource of the computer (CPU/Ram) on demand

See also

References

  1. ^ "Release 3.7.6".
  2. ^ "Rocks 7.0 is Released". 1 December 2017. Retrieved 17 November 2022.
  3. ^ https://github.com/dasayan05/condor, and native Python Binding
  4. ^ https://github.com/prisms-center/pbs
  5. ^ PySlurm
  6. ^ https://github.com/IBMSpectrumComputing/lsf-python-api
  7. ^ https://github.com/jkitchin/python-torque
Index: pl ar de en es fr it arz nl ja pt ceb sv uk vi war zh ru af ast az bg zh-min-nan bn be ca cs cy da et el eo eu fa gl ko hi hr id he ka la lv lt hu mk ms min no nn ce uz kk ro simple sk sl sr sh fi ta tt th tg azb tr ur zh-yue hy my ace als am an hyw ban bjn map-bms ba be-tarask bcl bpy bar bs br cv nv eml hif fo fy ga gd gu hak ha hsb io ig ilo ia ie os is jv kn ht ku ckb ky mrj lb lij li lmo mai mg ml zh-classical mr xmf mzn cdo mn nap new ne frr oc mhr or as pa pnb ps pms nds crh qu sa sah sco sq scn si sd szl su sw tl shn te bug vec vo wa wuu yi yo diq bat-smg zu lad kbd ang smn ab roa-rup frp arc gn av ay bh bi bo bxr cbk-zam co za dag ary se pdc dv dsb myv ext fur gv gag inh ki glk gan guw xal haw rw kbp pam csb kw km kv koi kg gom ks gcr lo lbe ltg lez nia ln jbo lg mt mi tw mwl mdf mnw nqo fj nah na nds-nl nrm nov om pi pag pap pfl pcd krc kaa ksh rm rue sm sat sc trv stq nso sn cu so srn kab roa-tara tet tpi to chr tum tk tyv udm ug vep fiu-vro vls wo xh zea ty ak bm ch ny ee ff got iu ik kl mad cr pih ami pwn pnt dz rmy rn sg st tn ss ti din chy ts kcg ve
Prefix: a b c d e f g h i j k l m n o p q r s t u v w x y z 0 1 2 3 4 5 6 7 8 9

Portal di Ensiklopedia Dunia

Portal : Agama
Agama
Portal : Bahasa
Bahasa
Portal : Biografi
Biografi
Portal : Budaya
Budaya
Portal : Ekonomi
Ekonomi
Portal : Elektronika
Elektronika
Portal : Film
Film
Portal : Filsafat
Filsafat
Portal : Geografi
Geografi
Portal : Indonesia
Indonesia
Portal : Ilmu
Ilmu
Portal : Lingkungan
Lingkungan
Portal : Masyarakat
Masyarakat
Portal : Matematika
Matematika
Portal : Militer
Militer
Portal : Mitologi
Mitologi
Portal : Musik
Musik
Portal : Olahraga
Olahraga
Portal : Pendidikan
Pendidikan
Portal : Politik
Politik
Portal : Sastra
Sastra
Portal : Sejarah
Sejarah
Portal : Seni
Seni
Portal : Teknologi
Teknologi

Kembali kehalaman sebelumnya