<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<head>
<meta http-equiv="Content-Type" content="text/html; charset=us-ascii">
<meta name="Generator" content="Microsoft Word 14 (filtered medium)">
<base href="x-msg://171/"><style><!--
/* Font Definitions */
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Helvetica;
panose-1:2 11 6 4 2 2 2 2 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
p.MsoAcetate, li.MsoAcetate, div.MsoAcetate
{mso-style-priority:99;
mso-style-link:"Balloon Text Char";
margin:0in;
margin-bottom:.0001pt;
font-size:8.0pt;
font-family:"Tahoma","sans-serif";}
span.apple-converted-space
{mso-style-name:apple-converted-space;}
span.EmailStyle18
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
span.BalloonTextChar
{mso-style-name:"Balloon Text Char";
mso-style-priority:99;
mso-style-link:"Balloon Text";
font-family:"Tahoma","sans-serif";}
.MsoChpDefault
{mso-style-type:export-only;
font-size:10.0pt;}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
</head>
<body lang="EN-US" link="blue" vlink="purple">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Hi all,<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I have updated the MQS draft incorporating most of John’s feedbacks. There are still a few items here and there and I plan to get it done by the end of today
so we can send it out to the forum before Friday noon as we promised. <o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">I’m sending this now since I need feedbacks on some of the new definitions provided in chapter 3. Please look at Chapter 3. Note that due to our definition
of mqs_image, the document will use \emph{mqs_image} in place of image (this is one part that I will go through and make sure I change them). \variable{mqs_image} will be used when referring to the type mqs_image of the interface.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">--Anh
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"><o:p> </o:p></span></p>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> mpi3-tools-bounces@lists.mpi-forum.org [mailto:mpi3-tools-bounces@lists.mpi-forum.org]
<b>On Behalf Of </b>Kathryn Mohror<br>
<b>Sent:</b> Wednesday, May 22, 2013 2:16 PM<br>
<b>To:</b> mpi3-tools@lists.mpi-forum.org<br>
<b>Subject:</b> Re: [Mpi3-tools] latest draft of mqs<o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">Comments inline</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<div style="border:none;border-top:solid #B5C4DF 1.0pt;padding:3.0pt 0in 0in 0in">
<div>
<p class="MsoNormal"><b><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif"">From:</span></b><span class="apple-converted-space"><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""> </span></span><span style="font-size:10.0pt;font-family:"Tahoma","sans-serif""><a href="mailto:mpi3-tools-bounces@lists.mpi-forum.org"><span style="color:purple">mpi3-tools-bounces@lists.mpi-forum.org</span></a><span class="apple-converted-space"> </span>[mailto:mpi3-<a href="mailto:tools-bounces@lists.mpi-forum.org"><span style="color:purple">tools-bounces@lists.mpi-forum.org</span></a>]<span class="apple-converted-space"> </span><b>On
Behalf Of<span class="apple-converted-space"> </span></b>Kathryn Mohror<br>
<b>Sent:</b><span class="apple-converted-space"> </span>Wednesday, May 22, 2013 1:44 PM<br>
<b>To:</b><span class="apple-converted-space"> </span><a href="mailto:mpi3-tools@lists.mpi-forum.org">mpi3-tools@lists.mpi-forum.org</a><br>
<b>Subject:</b><span class="apple-converted-space"> </span>Re: [Mpi3-tools] latest draft of mqs</span><o:p></o:p></p>
</div>
</div>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Hi Ahn,<o:p></o:p></p>
</div>
<div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">comments inline: <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Page 2, Comment JD4<br>
John's comments about lots of hyphenated identifiers at end of line. Some of it are artifacts of converting PDF -> Word, but I think this is a common (and widely accepted) problems of latex documents. So we will probably have to live with it unless there're
some magic way to make it nicer.<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal">I searched the standard (with PDF viewer search) and didn't see any broken hyphenated identifiers at the ends of lines. I noted that in the standard type and function names are like so: MPI\_COMM\_WORLD while in MPIR and MQS they are like
so: MPI\_\-COMM\_\-WORLD. If you remove the \- will it do the right thing? I am not a Latex guru so I don't know. <o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="color:#1F497D">[anhvo]: Yes, I think I mainly followed the practice of the latex in MPIR and put the \- there, it basically tells Latex it can break off the lines there. Not sure which one is more desirable?</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
</blockquote>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">I don't care either way really, except I think it looks bad if words go past the end of the margin if LaTeX doesn't know what to do with the word. There's probably some magic to fix that but I don't know it. <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">Page 9 (Page 14 in Word), Comment JD18<br>
John recommended the formatted table similar to what the MPIR document had. For example:<br>
<br>
Char MPIR_dll_name[]<br>
Definition is required<br>
Definition is contained within the address space of the MPI process<br>
Variable is written by the MPI process, and read by the tool<br>
<br>
I thought I did ask about this in the conf call at some point (or maybe it was an email, I can't remember the exact time and place) and we agreed that we would not be using that format because many people in the forum thought it was weird looking.<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal">Well, my opinion is that it should be consistent with what is in MPIR since it's supposed to be part of the same document. I don't remember the 'weird looking' comment, but I wouldn't be surprised if someone made it.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D">[anhvo] I think Jeff mentioned this in the scanned PDF he sent back to me. And I agreed with Jeff so I removed it. I might be in the minority but I don’t necessarily
agree that we should have similar format with the MPIR Document. They’re both side documents but they’re quite different. In MPIR there are many variables so it’s quite important to mention where they should stay and who is writing, reading it. In MQS we separate
callbacks by debugger and DLL so it’s quite clear who should define what</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">Maybe a compromise is to put this sort of information at the top of each section.subsection that defines a set of variables? You already say it in the text, but pulling it out somehow may be helpful to people new to the interface. It's
just an idea… I'm not married to it.<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><br>
<br>
<o:p></o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal">Page 15 (Page 21 in Word),Comment JD26<br>
Should we include semicolon at the end of the typedef definition? When I first created the document, I also debated a bit between this. I ended up following the style of the MPI standard where it lists the C declaration without any ; I'm fine either way, but
would like to hear others' opinions on this.<o:p></o:p></p>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<p class="MsoNormal">I think the standard does use ; . At least I didn't see any -- did I miss what you mean?<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="color:#1F497D">[anhvo]: The standard does not put semicolon after a C definition. Randomly picking: page 38, C definition of MPI_BSend:</span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="color:#1F497D">int MPI_Bsend(…) (no semicolon at the end)</span><o:p></o:p></p>
</div>
</div>
</div>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<p class="MsoNormal">Oh, yes I see what you mean. Okay, given that I would vote for no ; <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
<div>
<p class="MsoNormal">Kathryn<br>
<br>
<o:p></o:p></p>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D"> </span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Thanks for your hard work Ahn!<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal">Kathryn<o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<div>
<blockquote style="margin-top:5.0pt;margin-bottom:5.0pt">
<div>
<p class="MsoNormal"><br>
I'm leaving for lunch now. More comments after I'm back. In the meantime, if folks can comments on what I've sent so far, that'd be great!!<br>
<br>
Thanks<br>
Anh<br>
<br>
-----Original Message-----<br>
From:<span class="apple-converted-space"> </span><a href="mailto:mpi3-tools-bounces@lists.mpi-forum.org"><span style="color:purple">mpi3-tools-bounces@lists.mpi-forum.org</span></a><span class="apple-converted-space"> </span>[mailto:mpi3-<a href="mailto:tools-bounces@lists.mpi-forum.org"><span style="color:purple">tools-bounces@lists.mpi-forum.org</span></a>]
On Behalf Of Anh Vo<br>
Sent: Wednesday, May 22, 2013 8:10 AM<br>
To:<span class="apple-converted-space"> </span><a href="mailto:mpi3-tools@lists.mpi-forum.org"><span style="color:purple">mpi3-tools@lists.mpi-forum.org</span></a><br>
Subject: Re: [Mpi3-tools] latest draft of mqs<br>
<br>
The definitions John provide look great for me. Unless there are other opinions, I will use those.<br>
<br>
--Anh<span class="apple-converted-space"> </span><br>
<br>
-----Original Message-----<br>
From:<span class="apple-converted-space"> </span><a href="mailto:mpi3-tools-bounces@lists.mpi-forum.org"><span style="color:purple">mpi3-tools-bounces@lists.mpi-forum.org</span></a><span class="apple-converted-space"> </span>[mailto:mpi3-<a href="mailto:tools-bounces@lists.mpi-forum.org"><span style="color:purple">tools-bounces@lists.mpi-forum.org</span></a>]
On Behalf Of Ahn, Dong H.<br>
Sent: Wednesday, May 22, 2013 7:54 AM<br>
To:<span class="apple-converted-space"> </span><a href="mailto:mpi3-tools@lists.mpi-forum.org"><span style="color:purple">mpi3-tools@lists.mpi-forum.org</span></a><br>
Subject: Re: [Mpi3-tools] latest draft of mqs<br>
<br>
Hi John,<br>
<br>
This works for me and should clarify a few things in the current draft.<span class="apple-converted-space"> </span><br>
<br>
Best,<br>
Dong<br>
<br>
<br>
<br>
<o:p></o:p></p>
</div>
<div>
<p class="MsoNormal">-----Original Message-----<br>
From:<span class="apple-converted-space"> </span><a href="mailto:mpi3-tools-bounces@lists.mpi-forum.org"><span style="color:purple">mpi3-tools-bounces@lists.mpi-forum.org</span></a><br>
[mailto:mpi3-<a href="mailto:tools-bounces@lists.mpi-forum.org"><span style="color:purple">tools-bounces@lists.mpi-forum.org</span></a>] On Behalf Of John<span class="apple-converted-space"> </span><br>
DelSignore<br>
Sent: Wednesday, May 22, 2013 9:55 AM<br>
To:<span class="apple-converted-space"> </span><a href="mailto:mpi3-tools@lists.mpi-forum.org"><span style="color:purple">mpi3-tools@lists.mpi-forum.org</span></a><br>
Subject: Re: [Mpi3-tools] latest draft of mqs<br>
<br>
I prefer to not muddy up the "standard definitions" (or maybe<span class="apple-converted-space"> </span><br>
"common-sense definitions") of commonly used term, such as "image<span class="apple-converted-space"> </span><br>
file", to make them conform to the MQD interface. Instead, I like to define the MQD typedefs in terms of the standard definitions. So, WRT to the document, I think we should include the following definitions:<br>
<br>
* An "image file" is an executable or shared library file, that may contain symbol definitions needed by the MQD interface.<br>
<br>
* An "MPI process" consists of an "address space" and a collection of execution contexts (threads or lightweight processes).<br>
<br>
* An "address space" is a region of memory that consists of executable<span class="apple-converted-space"> </span><br>
code and data, and is partially composed of a collection of image<span class="apple-converted-space"> </span><br>
files. The collection of image files may change at any point during the execution of the MPI process, and image files may be relocated at runtime within the address space at the point they are loaded into memory.<br>
<br>
Then we can say:<br>
<br>
* An "mqs_image" is an abstract concept that represents the collection<span class="apple-converted-space"> </span><br>
of image files loaded into the address space of the MPI process at any<span class="apple-converted-space"> </span><br>
given time, and is debugger implementation defined. In static<span class="apple-converted-space"> </span><br>
execution environments, where shared libraries are not supported, an<span class="apple-converted-space"> </span><br>
mqs_image can represent an executable image file. However, in dynamic<span class="apple-converted-space"> </span><br>
execution environments, where shared libraries, dynamically loaded shared libraries, and runtime relocation of shared libraries are supported, an mqs_image should represent the collection of image files loaded into the address space of the MPI process at any
given point in time; in this situation, mqs_image may in fact represent the MPI process itself.<br>
<br>
Cheers, John D.<br>
<br>
<br>
Anh Vo wrote:<br>
<br>
<br>
<o:p></o:p></p>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt">Thanks Kathryn for starting up the discussion.<br>
<br>
<br>
<br>
I'll start with my existing definition of mqs_image in the document,<span class="apple-converted-space"> </span><br>
which definitely is not adequate.<br>
<br>
<br>
<br>
Existing definition:<br>
<br>
An image is an executable file that was loaded into memory when<br>
<br>
a process is started. For SIMD-style programs, all MPI processes<span class="apple-converted-space"> </span><br>
have<br>
<br>
the same image. For MIMD-style programs, MPI processes might have<br>
<br>
different images.<br>
<br>
<br>
<br>
Dong's comments:<br>
<br>
The definition of "Image" isn't all that rigorous here. I think this<span class="apple-converted-space"> </span><br>
creates some confusion somewhere down this document. Is an image<span class="apple-converted-space"> </span><br>
really an executable file? Which typically means the base<span class="apple-converted-space"> </span><br>
executable or does this refer to both the based executable and DSOs<span class="apple-converted-space"> </span><br>
being loaded into the process address space? Though it sounds<span class="apple-converted-space"> </span><br>
hair-splitting, even the SPMD remark, the statement is only true if<span class="apple-converted-space"> </span><br>
the image is defined to be the base executable.<br>
<br>
<br>
<br>
John's comments:<br>
<br>
I think we should be more general with the term "image" to mean<span class="apple-converted-space"> </span><br>
executable or shared library. The reason is that we do not want to<span class="apple-converted-space"> </span><br>
require symbols to reside in the executable. We should allow symbols<span class="apple-converted-space"> </span><br>
to reside in shared libraries.<br>
<br>
Also, I think we need to define the "address space" of a process,<span class="apple-converted-space"> </span><br>
and an "image list" as a collection of image files that have been<span class="apple-converted-space"> </span><br>
loaded in the address space, and possibly relocated at runtime.<br>
<br>
<br>
<br>
I think I agree with both comments. Image should not refer to a<span class="apple-converted-space"> </span><br>
single executable image (a.out or a.exe), but rather the base<span class="apple-converted-space"> </span><br>
executable and the shared libraries that were loaded into the process address space.<br>
<br>
<br>
<br>
So how about this new definition:<br>
<br>
An image represents the executable (e.g., a.out) and the collection<span class="apple-converted-space"> </span><br>
of dynamically loaded libraries that were loaded into the process<span class="apple-converted-space"> </span><br>
address space.<br>
<br>
<br>
<br>
--Anh<br>
<br>
*From:*<span class="apple-converted-space"> </span><a href="mailto:mpi3-tools-bounces@lists.mpi-forum.org"><span style="color:purple">mpi3-tools-bounces@lists.mpi-forum.org</span></a><br>
[mailto:mpi3-<a href="mailto:tools-bounces@lists.mpi-forum.org"><span style="color:purple">tools-bounces@lists.mpi-forum.org</span></a>] *On Behalf Of<span class="apple-converted-space"> </span><br>
*Kathryn Mohror<br>
*Sent:* Tuesday, May 21, 2013 6:27 PM<br>
*To:*<span class="apple-converted-space"> </span><a href="mailto:mpi3-tools@lists.mpi-forum.org"><span style="color:purple">mpi3-tools@lists.mpi-forum.org</span></a><br>
*Subject:* Re: [Mpi3-tools] latest draft of mqs<br>
<br>
<br>
<br>
Hi John,<br>
<br>
<br>
<br>
Thank you for the extensive feedback and help with the document! I'm<span class="apple-converted-space"> </span><br>
sure you will get the 'nod' you referred to on page 1 :-)<br>
<br>
<br>
<br>
For the definition of mqs_image, I agree that it needs work. Dong<span class="apple-converted-space"> </span><br>
Ahn also mentioned that it needed to be more rigorously defined.<br>
However if possible, I think it would be beneficial if we could at<span class="apple-converted-space"> </span><br>
least start the conversation before next week so that we have a<span class="apple-converted-space"> </span><br>
better chance of having it nailed down in advance of the next meeting.<br>
<br>
<br>
<br>
So, that said -- does anyone want to take a first stab at a<span class="apple-converted-space"> </span><br>
definition to get us started?<br>
<br>
<br>
<br>
Kathryn<br>
<br>
<br>
<br>
On May 21, 2013, at 2:18 PM, John DelSignore<span class="apple-converted-space"> </span><br>
<<a href="mailto:John.DelSignore@roguewave.com"><span style="color:purple">John.DelSignore@roguewave.com</span></a><span class="apple-converted-space"> </span><br>
<<a href="mailto:John.DelSignore@roguewave.com"><span style="color:purple">mailto:John.DelSignore@roguewave.com</span></a>>><br>
wrote:<br>
<br>
<br>
<br>
Hi,<br>
<br>
Attached are my edits and comments on the MPI Message Queue<br>
document. Anh provided me with a Word document generated from the<br>
LaTex, so the formatting is funky in some places. I enabled change<br>
tracking in Word before making my edits, and I added many comments<br>
to the document in places where I think we have more work to do.<br>
Unfortunately, I think the changes might be somewhat extensive.<br>
<br>
The volume of edits and comments aside, I think Anh did a great job!<br>
The first draft of the document closely reflects the 10+ year-old<br>
description of the interface pretty well. Unfortunately, the<br>
original interface has some problem that we need to resolve, most<br>
critically, we have to resolve how to describe the concept of<br>
"mqs_image". We can talk about this during the next concall.<br>
<br>
Cheers, John D.<br>
<br>
<br>
Anh Vo wrote:<br>
<br>
Hi all,<br>
<br>
As mentioned on the tool WG call today, I'm re-sending the<br>
latest draft.<br>
Feedbacks are appreciated. We'll send this one out to the wider<br>
audience<br>
on Tuesday 5/21 to meet the requirement for first reading in<span class="apple-converted-space"> </span><br>
June<br>
<br>
<br>
<br>
--Anh<br>
<br>
<MPI-MQD-JVD-2013-05-17.doc>_______________________________________________<br>
Mpi3-tools mailing list<br>
<a href="mailto:Mpi3-tools@lists.mpi-forum.org"><span style="color:purple">Mpi3-tools@lists.mpi-forum.org</span></a><span class="apple-converted-space"> </span><<a href="mailto:Mpi3-tools@lists.mpi-forum.org"><span style="color:purple">mailto:Mpi3-tools@lists.mpi-forum.org</span></a>><br>
<a href="http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools"><span style="color:purple">http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools</span></a><br>
<br>
<br>
<br>
______________________________________________________________<br>
Kathryn Mohror,<span class="apple-converted-space"> </span><a href="mailto:kathryn@llnl.gov"><span style="color:purple">kathryn@llnl.gov</span></a><br>
<<a href="mailto:kathryn@llnl.gov"><span style="color:purple">mailto:kathryn@llnl.gov</span></a>>,<span class="apple-converted-space"> </span><a href="http://people.llnl.gov/mohror1"><span style="color:purple">http://people.llnl.gov/mohror1</span></a><span class="apple-converted-space"> </span>CASC
@<span class="apple-converted-space"> </span><br>
Lawrence Livermore National Laboratory, Livermore, CA, USA<br>
<br>
<br>
<br>
<br>
<br>
<br>
<br>
<o:p></o:p></p>
<div>
<p class="MsoNormal">_______________________________________________<br>
Mpi3-tools mailing list<br>
<a href="mailto:Mpi3-tools@lists.mpi-forum.org"><span style="color:purple">Mpi3-tools@lists.mpi-forum.org</span></a><br>
<a href="http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools"><span style="color:purple">http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools</span></a><o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"><br>
_______________________________________________<br>
Mpi3-tools mailing list<br>
<a href="mailto:Mpi3-tools@lists.mpi-forum.org"><span style="color:purple">Mpi3-tools@lists.mpi-forum.org</span></a><br>
<a href="http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools"><span style="color:purple">http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools</span></a><br>
<br>
<br>
<br>
<br>
_______________________________________________<br>
Mpi3-tools mailing list<br>
<a href="mailto:Mpi3-tools@lists.mpi-forum.org"><span style="color:purple">Mpi3-tools@lists.mpi-forum.org</span></a><br>
<a href="http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools"><span style="color:purple">http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools</span></a><br>
<br>
<br>
<msgq.pdf>_______________________________________________<br>
Mpi3-tools mailing list<br>
<a href="mailto:Mpi3-tools@lists.mpi-forum.org"><span style="color:purple">Mpi3-tools@lists.mpi-forum.org</span></a><br>
<a href="http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools"><span style="color:purple">http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools</span></a><o:p></o:p></p>
</div>
</blockquote>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
<div>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Helvetica","sans-serif"">______________________________________________________________<br>
Kathryn Mohror, <a href="mailto:kathryn@llnl.gov"><span style="color:purple">kathryn@llnl.gov</span></a>, <a href="http://people.llnl.gov/mohror1"><span style="color:purple">http://people.llnl.gov/mohror1</span></a><br>
CASC @ Lawrence Livermore National Laboratory, Livermore, CA, USA</span><o:p></o:p></p>
</div>
</div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Helvetica","sans-serif""> </span><o:p></o:p></p>
</div>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"> <o:p></o:p></p>
</div>
<div>
<p class="MsoNormal"> <o:p></o:p></p>
</div>
</div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Helvetica","sans-serif"">_______________________________________________<br>
Mpi3-tools mailing list<br>
<a href="mailto:Mpi3-tools@lists.mpi-forum.org">Mpi3-tools@lists.mpi-forum.org</a><br>
<a href="http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools"><span style="color:purple">http://lists.mpi-forum.org/mailman/listinfo.cgi/mpi3-tools</span></a><o:p></o:p></span></p>
</div>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
<div>
<div>
<div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Helvetica","sans-serif";color:black">______________________________________________________________<br>
Kathryn Mohror, <a href="mailto:kathryn@llnl.gov">kathryn@llnl.gov</a>, <a href="http://people.llnl.gov/mohror1">http://people.llnl.gov/mohror1</a><br>
CASC @ Lawrence Livermore National Laboratory, Livermore, CA, USA<o:p></o:p></span></p>
</div>
<div>
<p class="MsoNormal"><span style="font-size:13.5pt;font-family:"Helvetica","sans-serif";color:black"><o:p> </o:p></span></p>
</div>
</div>
<p class="MsoNormal" style="margin-bottom:12.0pt"><o:p> </o:p></p>
</div>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</body>
</html>