[Mpi3-rma] RMA window attributes for locking

Jeff Hammond jeff.science at gmail.com
Mon Mar 8 12:10:15 CST 2010

I will try to participate when not on other conference calls :|

One addition to lock types is MPI_WIN_ASSOCIATIVE_LOCK, which would
obviate the need for locks on the window.  Such a window would only
permit access via Get/Copy OR Acc (and no non-MPI access), since these
operations are invariant with respect to re-ordering.  My motivation
for this feature is that read-only and accumulate-only are ubiquitous
usage patterns in application codes (over 90% of all GA/ARMCI calls in
codes I work with act within these epochs) and there are a variety of
optimizations that can occur if this window attribute is explicitly

For read-only and accumulate-only operations, message ordering within
the lifetime of the window (with this attribute active) is irrelevant
and there is almost no need for internal consistency checking.
Get/Copy calls can be completely overlapped in the implementation and
Acc calls can be overlapped as long as the accumulate function is

Alternatively, if Acc is bad for non-cache-coherent then
MPI_WIN_READONLY_LOCK provides half of what I want and allows for even
more optimization in a heterogeneous context.  Local memory attached
to a read-only window could be migrated to memory banks closer to the
NIC to prevent bus contention I observe on NUMA nodes.  For a
Cell/GPU-like node where the window was on the attached processor (I
assume this will soon be possible), then such an optimization would be
very valuable.

Hopefully this idea isn't too stupid.  If I need to provide more
justification, please let me know.


On Sun, Mar 7, 2010 at 6:42 PM, Rajeev Thakur <thakur at mcs.anl.gov> wrote:
> For those who will not be present at the Forum meeting, you can
> participate via telecon. Below are the numbers to dial.
> One set of slides (Pavan's) is attached. Torsten will mail you his
> slides separately.
> Rajeev
> Monday: 1.00-5.00pm Pacific
> Tel: (866) 432-9903  OR  (408) 525-6800
> Meeting Number: 202 751 887
> Tuesday: 4.15-7.00pm Pacific
> Tel: (866) 432-9903  OR  (408) 525-6800
> Meeting Number: 200 438 253
> _______________________________________________
> mpi3-rma mailing list
> mpi3-rma at lists.mpi-forum.org
> http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-rma

Jeff Hammond
Argonne Leadership Computing Facility
jhammond at mcs.anl.gov / (630) 252-5381

More information about the mpiwg-rma mailing list