Barrier (computer science)

This article needs additional citations for verification. Please help improve this article by adding citations to reliable sources. Unsourced material may be challenged and removed. (December 2009)

Threads synchronization primitive [edit]

In parallel computing, a barrier is a type of synchronization method. A barrier for a group of threads or processes in the source code means any thread/process must stop at this point and cannot proceed until all other threads/processes reach this barrier.

Many collective routines and directive-based parallel languages impose implicit barriers. For example, a parallel do loop in Fortran with OpenMP will not be allowed to continue on any thread until the last iteration is completed. This is in case the program relies on the result of the loop immediately after its completion. In message passing, any global communication (such as reduction or scatter) may imply a barrier.

See also

Rendezvous (Plan 9).

Dynamic Barriers [edit]

Classic barrier constructs define the set of participating processes/threads statically. This is usually done either at program startup or when a barrier like the Pthreads barrier is instantiated. This restricts the possible applications for which barriers can be used.

To support more dynamic programming paradigms like fork/join parallelism, the sets of participants have to be dynamic. Thus, the set of processes/threads participating in a barrier operation needs to be able to change over time. X10 introduced the concept of clocks for that purpose, which provide a dynamic barrier semantic. Building on clocks, phasers^[1] have been proposed to add even more flexibility to barrier synchronization. With phasers it is possible to express data dependencies between the participating processes explicitly to avoid unnecessary over-synchronization.

Processor and compiler barriers [edit]

Memory barrier is a class of instructions which cause a processor to enforce an ordering constraint on memory operations issued before and after the barrier instruction.

A barrier can also be a high level programming language statement which prevents the compiler from reordering other operations over the barrier statement during optimization passes. Such statements can potentially generate processor barrier instructions. Different classes of barrier exist and may apply to a specific set of operations only.

References [edit]

v t e Parallel computing General Cloud computing High-performance computing Cluster computing Distributed computing Grid computing Levels Bit Instruction Data Task Threads Superthreading Hyperthreading Theory Amdahl's law Gustafson's law Cost efficiency Karp–Flatt metric slowdown speedup Elements Process Thread Fiber PRAM Instruction window Coordination Multiprocessing Multithreading (computer architecture) Memory coherency Cache coherency Cache invalidation Barrier Synchronization Application checkpointing Programming Models Implicit parallelism Explicit parallelism Concurrency Flynn's taxonomy SISD SIMD MISD MIMD SPMD Thread (computer science) Non-blocking algorithm Hardware Multiprocessor Symmetric Asymmetric Memory NUMA COMA distributed shared distributed shared SMT MPP Superscalar Vector processor Supercomputer Beowulf APIs Ateji PX POSIX Threads OpenMP OpenHMPP OpenACC PVM MPI UPC Intel Threading Building Blocks Intel Cilk Plus Boost.Thread Global Arrays Charm++ Cilk Coarray Fortran OpenCL CUDA Dryad C++ AMP Problems Embarrassingly parallel Software lockout Scalability Race condition Deadlock Livelock Starvation Deterministic algorithm Parallel slowdown Category: parallel computing Media related to parallel computing at Wikimedia Commons

This computer science article is a stub. You can help Wikipedia by expanding it. v t e