|
cannam@95
|
1 <html lang="en">
|
|
cannam@95
|
2 <head>
|
|
cannam@95
|
3 <title>Distributed-memory FFTW with MPI - FFTW 3.3.3</title>
|
|
cannam@95
|
4 <meta http-equiv="Content-Type" content="text/html">
|
|
cannam@95
|
5 <meta name="description" content="FFTW 3.3.3">
|
|
cannam@95
|
6 <meta name="generator" content="makeinfo 4.13">
|
|
cannam@95
|
7 <link title="Top" rel="start" href="index.html#Top">
|
|
cannam@95
|
8 <link rel="prev" href="Multi_002dthreaded-FFTW.html#Multi_002dthreaded-FFTW" title="Multi-threaded FFTW">
|
|
cannam@95
|
9 <link rel="next" href="Calling-FFTW-from-Modern-Fortran.html#Calling-FFTW-from-Modern-Fortran" title="Calling FFTW from Modern Fortran">
|
|
cannam@95
|
10 <link href="http://www.gnu.org/software/texinfo/" rel="generator-home" title="Texinfo Homepage">
|
|
cannam@95
|
11 <!--
|
|
cannam@95
|
12 This manual is for FFTW
|
|
cannam@95
|
13 (version 3.3.3, 25 November 2012).
|
|
cannam@95
|
14
|
|
cannam@95
|
15 Copyright (C) 2003 Matteo Frigo.
|
|
cannam@95
|
16
|
|
cannam@95
|
17 Copyright (C) 2003 Massachusetts Institute of Technology.
|
|
cannam@95
|
18
|
|
cannam@95
|
19 Permission is granted to make and distribute verbatim copies of
|
|
cannam@95
|
20 this manual provided the copyright notice and this permission
|
|
cannam@95
|
21 notice are preserved on all copies.
|
|
cannam@95
|
22
|
|
cannam@95
|
23 Permission is granted to copy and distribute modified versions of
|
|
cannam@95
|
24 this manual under the conditions for verbatim copying, provided
|
|
cannam@95
|
25 that the entire resulting derived work is distributed under the
|
|
cannam@95
|
26 terms of a permission notice identical to this one.
|
|
cannam@95
|
27
|
|
cannam@95
|
28 Permission is granted to copy and distribute translations of this
|
|
cannam@95
|
29 manual into another language, under the above conditions for
|
|
cannam@95
|
30 modified versions, except that this permission notice may be
|
|
cannam@95
|
31 stated in a translation approved by the Free Software Foundation.
|
|
cannam@95
|
32 -->
|
|
cannam@95
|
33 <meta http-equiv="Content-Style-Type" content="text/css">
|
|
cannam@95
|
34 <style type="text/css"><!--
|
|
cannam@95
|
35 pre.display { font-family:inherit }
|
|
cannam@95
|
36 pre.format { font-family:inherit }
|
|
cannam@95
|
37 pre.smalldisplay { font-family:inherit; font-size:smaller }
|
|
cannam@95
|
38 pre.smallformat { font-family:inherit; font-size:smaller }
|
|
cannam@95
|
39 pre.smallexample { font-size:smaller }
|
|
cannam@95
|
40 pre.smalllisp { font-size:smaller }
|
|
cannam@95
|
41 span.sc { font-variant:small-caps }
|
|
cannam@95
|
42 span.roman { font-family:serif; font-weight:normal; }
|
|
cannam@95
|
43 span.sansserif { font-family:sans-serif; font-weight:normal; }
|
|
cannam@95
|
44 --></style>
|
|
cannam@95
|
45 </head>
|
|
cannam@95
|
46 <body>
|
|
cannam@95
|
47 <div class="node">
|
|
cannam@95
|
48 <a name="Distributed-memory-FFTW-with-MPI"></a>
|
|
cannam@95
|
49 <a name="Distributed_002dmemory-FFTW-with-MPI"></a>
|
|
cannam@95
|
50 <p>
|
|
cannam@95
|
51 Next: <a rel="next" accesskey="n" href="Calling-FFTW-from-Modern-Fortran.html#Calling-FFTW-from-Modern-Fortran">Calling FFTW from Modern Fortran</a>,
|
|
cannam@95
|
52 Previous: <a rel="previous" accesskey="p" href="Multi_002dthreaded-FFTW.html#Multi_002dthreaded-FFTW">Multi-threaded FFTW</a>,
|
|
cannam@95
|
53 Up: <a rel="up" accesskey="u" href="index.html#Top">Top</a>
|
|
cannam@95
|
54 <hr>
|
|
cannam@95
|
55 </div>
|
|
cannam@95
|
56
|
|
cannam@95
|
57 <h2 class="chapter">6 Distributed-memory FFTW with MPI</h2>
|
|
cannam@95
|
58
|
|
cannam@95
|
59 <p><a name="index-MPI-344"></a>
|
|
cannam@95
|
60 <a name="index-parallel-transform-345"></a>In this chapter we document the parallel FFTW routines for parallel
|
|
cannam@95
|
61 systems supporting the MPI message-passing interface. Unlike the
|
|
cannam@95
|
62 shared-memory threads described in the previous chapter, MPI allows
|
|
cannam@95
|
63 you to use <em>distributed-memory</em> parallelism, where each CPU has
|
|
cannam@95
|
64 its own separate memory, and which can scale up to clusters of many
|
|
cannam@95
|
65 thousands of processors. This capability comes at a price, however:
|
|
cannam@95
|
66 each process only stores a <em>portion</em> of the data to be
|
|
cannam@95
|
67 transformed, which means that the data structures and
|
|
cannam@95
|
68 programming-interface are quite different from the serial or threads
|
|
cannam@95
|
69 versions of FFTW.
|
|
cannam@95
|
70 <a name="index-data-distribution-346"></a>
|
|
cannam@95
|
71
|
|
cannam@95
|
72 <p>Distributed-memory parallelism is especially useful when you are
|
|
cannam@95
|
73 transforming arrays so large that they do not fit into the memory of a
|
|
cannam@95
|
74 single processor. The storage per-process required by FFTW's MPI
|
|
cannam@95
|
75 routines is proportional to the total array size divided by the number
|
|
cannam@95
|
76 of processes. Conversely, distributed-memory parallelism can easily
|
|
cannam@95
|
77 pose an unacceptably high communications overhead for small problems;
|
|
cannam@95
|
78 the threshold problem size for which parallelism becomes advantageous
|
|
cannam@95
|
79 will depend on the precise problem you are interested in, your
|
|
cannam@95
|
80 hardware, and your MPI implementation.
|
|
cannam@95
|
81
|
|
cannam@95
|
82 <p>A note on terminology: in MPI, you divide the data among a set of
|
|
cannam@95
|
83 “processes” which each run in their own memory address space.
|
|
cannam@95
|
84 Generally, each process runs on a different physical processor, but
|
|
cannam@95
|
85 this is not required. A set of processes in MPI is described by an
|
|
cannam@95
|
86 opaque data structure called a “communicator,” the most common of
|
|
cannam@95
|
87 which is the predefined communicator <code>MPI_COMM_WORLD</code> which
|
|
cannam@95
|
88 refers to <em>all</em> processes. For more information on these and
|
|
cannam@95
|
89 other concepts common to all MPI programs, we refer the reader to the
|
|
cannam@95
|
90 documentation at <a href="http://www.mcs.anl.gov/research/projects/mpi/">the MPI home page</a>.
|
|
cannam@95
|
91 <a name="index-MPI-communicator-347"></a><a name="index-MPI_005fCOMM_005fWORLD-348"></a>
|
|
cannam@95
|
92
|
|
cannam@95
|
93 <p>We assume in this chapter that the reader is familiar with the usage
|
|
cannam@95
|
94 of the serial (uniprocessor) FFTW, and focus only on the concepts new
|
|
cannam@95
|
95 to the MPI interface.
|
|
cannam@95
|
96
|
|
cannam@95
|
97 <ul class="menu">
|
|
cannam@95
|
98 <li><a accesskey="1" href="FFTW-MPI-Installation.html#FFTW-MPI-Installation">FFTW MPI Installation</a>
|
|
cannam@95
|
99 <li><a accesskey="2" href="Linking-and-Initializing-MPI-FFTW.html#Linking-and-Initializing-MPI-FFTW">Linking and Initializing MPI FFTW</a>
|
|
cannam@95
|
100 <li><a accesskey="3" href="2d-MPI-example.html#g_t2d-MPI-example">2d MPI example</a>
|
|
cannam@95
|
101 <li><a accesskey="4" href="MPI-Data-Distribution.html#MPI-Data-Distribution">MPI Data Distribution</a>
|
|
cannam@95
|
102 <li><a accesskey="5" href="Multi_002ddimensional-MPI-DFTs-of-Real-Data.html#Multi_002ddimensional-MPI-DFTs-of-Real-Data">Multi-dimensional MPI DFTs of Real Data</a>
|
|
cannam@95
|
103 <li><a accesskey="6" href="Other-Multi_002ddimensional-Real_002ddata-MPI-Transforms.html#Other-Multi_002ddimensional-Real_002ddata-MPI-Transforms">Other Multi-dimensional Real-data MPI Transforms</a>
|
|
cannam@95
|
104 <li><a accesskey="7" href="FFTW-MPI-Transposes.html#FFTW-MPI-Transposes">FFTW MPI Transposes</a>
|
|
cannam@95
|
105 <li><a accesskey="8" href="FFTW-MPI-Wisdom.html#FFTW-MPI-Wisdom">FFTW MPI Wisdom</a>
|
|
cannam@95
|
106 <li><a accesskey="9" href="Avoiding-MPI-Deadlocks.html#Avoiding-MPI-Deadlocks">Avoiding MPI Deadlocks</a>
|
|
cannam@95
|
107 <li><a href="FFTW-MPI-Performance-Tips.html#FFTW-MPI-Performance-Tips">FFTW MPI Performance Tips</a>
|
|
cannam@95
|
108 <li><a href="Combining-MPI-and-Threads.html#Combining-MPI-and-Threads">Combining MPI and Threads</a>
|
|
cannam@95
|
109 <li><a href="FFTW-MPI-Reference.html#FFTW-MPI-Reference">FFTW MPI Reference</a>
|
|
cannam@95
|
110 <li><a href="FFTW-MPI-Fortran-Interface.html#FFTW-MPI-Fortran-Interface">FFTW MPI Fortran Interface</a>
|
|
cannam@95
|
111 </ul>
|
|
cannam@95
|
112
|
|
cannam@95
|
113 <!-- -->
|
|
cannam@95
|
114 </body></html>
|
|
cannam@95
|
115
|
