The development of GraphBLAS and its various implementations is an ongoing community effort, including representatives from industry, academia, and government research labs.[4][5]
Background
Graph algorithms have long taken advantage of the idea that a graph can be represented as a matrix, and graph operations can be performed as linear transformations and other linear algebraic operations on sparse matrices.[6]: xxv–xxvi For example, matrix-vector multiplication can be used to perform a step in a breadth-first search.[6]: 32–33
The GraphBLAS specification (and the various libraries that implement it) provides data structures and functions to compute these linear algebraic operations. In particular, GraphBLAS specifies sparse matrix objects which map well to graphs where vertices are likely connected to relatively few neighbors (i.e. the degree of a vertex is significantly smaller than the total number of vertices in the graph). The specification also allows for the use of different semirings to accomplish operations in a variety of mathematical contexts.
Originally motivated by the need for standardization in graph analytics, similar to its namesake BLAS,[7] the GraphBLAS standard has also begun to interest people outside the graph community, including researchers in machine learning,[8] and bioinformatics.[9] GraphBLAS implementations have also been used in high-performance graph database applications such as RedisGraph.[10][11][12][13][14]
Specification
The GraphBLAS specification has been in development since 2013,[15] and has reached version 2.1.0 as of December 2023.[16] While formally a specification for the C programming language, a variety of programming languages have been used to develop implementations in the spirit of GraphBLAS, including C++,[17]Java,[18] and Nvidia CUDA.[19]
Compliant implementations and language bindings
There are currently two fully-compliant reference implementations of the GraphBLAS specification.[20][21] Bindings assuming a compliant specification exist for the Python,[22]MATLAB,[23] and Julia[24][25] programming languages.
Linear algebraic foundations
Computing a single step in a breadth-first search of a graph. Matrix-vector multiplication can be used to compute the outbound neighbors (vertices 1 and 3, shown in blue) of a given source vertex (shown in red). Note that the matrix is the adjacency matrix of the graph shown to the left, with outbound edges (4,1) and (4,3) shown in green.
Note that the zero element (i.e. the element that represents the absence of an edge in the graph) can also be reinterpreted.[26]: "VII. 0-Element: No Graph Edge" For example, the following algebras can be implemented in GraphBLAS:
While the GraphBLAS specification generally allows significant flexibility in implementation, some functionality and implementation details are explicitly described:
GraphBLAS objects, including matrices and vectors, are opaque data structures.[16]: 2.4 GraphBLAS Opaque Objects
Non-blocking execution mode, which permits lazy or asynchronous evaluation of certain operations.[16]: 2.5.1 Execution modes
Masked assignment, denoted , which assigns elements of matrix to matrix only in positions where the mask matrix is non-zero.[16]: 3.5.4 Masks
The GraphBLAS specification also prescribes that library implementations be thread-safe.[16]: 2.5.2 Multi-threaded execution
#include<stdlib.h>#include<stdio.h>#include<stdint.h>#include<stdbool.h>#include"GraphBLAS.h"/* * Given a boolean n x n adjacency matrix A and a source vertex s, performs a BFS traversal * of the graph and sets v[i] to the level in which vertex i is visited (v[s] == 1). * If i is not reachable from s, then v[i] = 0 does not have a stored element. * Vector v should be uninitialized on input. */GrB_InfoBFS(GrB_Vector*v,GrB_MatrixA,GrB_Indexs){GrB_Indexn;GrB_Matrix_nrows(&n,A);// n = # of rows of AGrB_Vector_new(v,GrB_INT32,n);// Vector<int32_t> v(n)GrB_Vectorq;// vertices visited in each levelGrB_Vector_new(&q,GrB_BOOL,n);// Vector<bool> q(n)GrB_Vector_setElement(q,(bool)true,s);// q[s] = true, false everywhere else/* * BFS traversal and label the vertices. */int32_tlevel=0;// level = depth in BFS traversalGrB_Indexnvals;do{++level;// next level (start with 1)GrB_apply(*v,GrB_NULL,GrB_PLUS_INT32,GrB_SECOND_INT32,q,level,GrB_NULL);// v[q] = levelGrB_vxm(q,*v,GrB_NULL,GrB_LOR_LAND_SEMIRING_BOOL,q,A,GrB_DESC_RC);// q[!v] = q ||.&& A; finds all the // unvisited successors from current qGrB_Vector_nvals(&nvals,q);}while(nvals);// if there is no successor in q, we are done.GrB_free(&q);// q vector no longer neededreturnGrB_SUCCESS;}
^Vu, Linda. "GraphBLAS: Building Blocks for High Performance Graph Analytics". crd.lbl.gov. Retrieved 8 November 2019. In subsequent years, various research collaborations created a variety of BLAS libraries for different tasks. Realizing the benefits to users, vendors also worked with researchers to optimize these building blocks to run on their hardware. GraphBLAS is essentially a continuation of this BLAS heritage.
^Kepner, Jeremy; Kumar, Manoj; Moreira, José; Pattnaik, Pratap; Serrano, Mauricio; Tufo, Henry (12–14 September 2017). "Enabling massive deep neural networks with the GraphBLAS". 2017 IEEE High Performance Extreme Computing Conference (HPEC). pp. 1–10. arXiv:1708.02937. Bibcode:2017arXiv170802937K. doi:10.1109/HPEC.2017.8091098. ISBN978-1-5386-3472-1. S2CID3632940. In this paper we have shown that the key [deep neural network] computations can be represented in GraphBLAS, a library interface defined for sparse matrix algebra. Furthermore, we have shown that the key step of forward propagation, with ReLU as the nonlinearity, can be performed much more efficiently with GraphBLAS implementation as compared to BLAS implementation when the weight matrices are sparse.
^"Redis Labs Introduces RedisGraph and Streams to Support a Zero Latency Future". DevOps.com. 16 November 2018. Retrieved 10 November 2019. Built on GraphBLAS, an open-source library that employs linear algebra including matrix multiplication, RedisGraph can complete calculations up to 600 times faster than any alternate graph solution according to benchmark results.
^Woodie, Alex (28 September 2018). "Redis Speeds Towards a Multi-Model Future". Datanami. Retrieved 10 November 2019. One of the newest modules to emerge from Redis Labs turns the key value store into a graph database. The module, called RedisGraph, will be based on the GraphBLAS technology that emerged out of academia and industry.
^Dsouza, Melisha (20 November 2018). "RedisGraph v1.0 released, benchmarking proves its 6-600 times faster than existing graph databases". Packt. Retrieved 10 November 2019. RedisGraph is a Redis module that adds a graph database functionality to Redis. RedisGraph delivers a fast and efficient way to store, manage and process graphs, around 6 to 600 times faster than existing graph databases. RedisGraph represents connected data as adjacency matrices and employs the power of GraphBLAS which is a highly optimized library for sparse matrix operations.
^Mattson, Tim; Bader, David; Berry, Jon; Buluç, Aydin; Dongarra, Jack; Faloutsos, Christos; Feo, John; Gilbert, John; Gonzalez, Joseph; Hendrickson, Bruce; Kepner, Jeremy; Leiserson, Charles; Lumsdaine, Andrew; Padua, David; Poole, Stephen; Reinhardt, Steve; Stonebraker, Mike; Wallach, Steve; Yoo, Andrew (10–12 September 2013). "Standards for graph algorithm primitives". 2013 IEEE High Performance Extreme Computing Conference (HPEC). pp. 1–2. arXiv:1408.0393. doi:10.1109/HPEC.2013.6670338. ISBN978-1-4799-1365-7. S2CID12099965. It is our view that the state of the art in constructing a large collection of graph algorithms in terms of linear algebraic operations is mature enough to support the emergence of a standard set of primitive building blocks. This paper is a position paper defining the problem and announcing our intention to launch an open effort to define this standard.
^ abcdefBrock, Benjamin; Buluç, Aydın; Kimmerer, Raye; Kitchen, Jim; Kumar, Manoj; Mattson, Timothy; McMillan, Scott; Moreira, José; Pelletier, Michel; Welch, Erik. "The GraphBLAS C API Specification: Version 2.1.0"(PDF). Retrieved 22 December 2023.
^"GraphBLAST". GitHub.com. Retrieved 8 November 2019.
^Davis, Timothy. "SuiteSparse:GraphBLAS". Retrieved 11 November 2019. SuiteSparse:GraphBLAS is a full implementation of the GraphBLAS standard (graphblas.org), which defines a set of sparse matrix operations on an extended algebra of semirings using an almost unlimited variety of operators and types.
^Moreira, Jose; Horn, Bill. "ibmgraphblas". GitHub.com. Retrieved 19 November 2019.