<!DOCTYPE html>
<!-- BaNnErBlUrFlE-BoDy-start -->
<!-- Preheader Text : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;height:0px;max-height:0px;opacity:0;overflow:hidden;">
Multi-device collectives are something we need to look into. Endpoints seem a good starting point. Was there ever a full proposal for it? A quick search only brought up Jim's 2014 paper [1] and some related papers. I put it on the list of topics</div>
<!-- Preheader Text : END -->
<!-- Email Banner : BEGIN -->
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerStart</div>
<!--[if ((ie)|(mso))]>
<table border="0" cellspacing="0" cellpadding="0" width="100%" style="padding: 16px 0px 16px 0px; direction: ltr" ><tr><td>
<table border="0" cellspacing="0" cellpadding="0" style="padding: 0px 10px 5px 6px; width: 100%; border-radius:4px; border-top:4px solid #90a4ae;background-color:#D0D8DC;"><tr><td valign="top">
<table align="left" border="0" cellspacing="0" cellpadding="0" style="padding: 4px 8px 4px 8px">
<tr><td style="color:#000000; font-family: 'Arial', sans-serif; font-weight:bold; font-size:14px; direction: ltr">
This Message Is From an External Sender
</td></tr>
<tr><td style="color:#000000; font-weight:normal; font-family: 'Arial', sans-serif; font-size:12px; direction: ltr">
This message came from outside your organization.
</td></tr>
</table>
</td></tr></table>
</td></tr></table>
<![endif]-->
<![if !((ie)|(mso))]>
<div dir="ltr" id="pfptBannerqzk7jov" style="all: revert !important; display:block !important; text-align: left !important; margin:16px 0px 16px 0px !important; padding:8px 16px 8px 16px !important; border-radius: 4px !important; min-width: 200px !important; background-color: #D0D8DC !important; background-color: #D0D8DC; border-top: 4px solid #90a4ae !important; border-top: 4px solid #90a4ae;">
<div id="pfptBannerqzk7jov" style="all: unset !important; float:left !important; display:block !important; margin: 0px 0px 1px 0px !important; max-width: 600px !important;">
<div id="pfptBannerqzk7jov" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-weight:bold !important; font-weight:bold; font-size:14px !important; line-height:18px !important; line-height:18px">
This Message Is From an External Sender
</div>
<div id="pfptBannerqzk7jov" style="all: unset !important; display:block !important; visibility: visible !important; background-color: #D0D8DC !important; color:#000000 !important; color:#000000; font-weight:normal; font-family: 'Arial', sans-serif !important; font-family: 'Arial', sans-serif; font-size:12px !important; line-height:18px !important; line-height:18px; margin-top:2px !important;">
This message came from outside your organization.
</div>
</div>
<div style="clear: both !important; display: block !important; visibility: hidden !important; line-height: 0 !important; font-size: 0.01px !important; height: 0px"> </div>
</div>
<![endif]>
<div style="display:none !important;display:none;visibility:hidden;mso-hide:all;font-size:1px;color:#ffffff;line-height:1px;max-height:0px;opacity:0;overflow:hidden;">ZjQcmQRYFpfptBannerEnd</div>
<!-- Email Banner : END -->
<!-- BaNnErBlUrFlE-BoDy-end -->
<html>
<head><!-- BaNnErBlUrFlE-HeAdEr-start -->
<style>
#pfptBannerqzk7jov { all: revert !important; display: block !important;
visibility: visible !important; opacity: 1 !important;
background-color: #D0D8DC !important;
max-width: none !important; max-height: none !important }
.pfptPrimaryButtonqzk7jov:hover, .pfptPrimaryButtonqzk7jov:focus {
background-color: #b4c1c7 !important; }
.pfptPrimaryButtonqzk7jov:active {
background-color: #90a4ae !important; }
</style>
<!-- BaNnErBlUrFlE-HeAdEr-end -->
<meta charset="UTF-8"></head><body><pre style="font-family: sans-serif; font-size: 100%; white-space: pre-wrap; word-wrap: break-word">Multi-device collectives are something we need to look into. Endpoints
seem a good starting point. Was there ever a full proposal for it? A
quick search only brought up Jim's 2014 paper [1] and some related papers.
I put it on the list of topics on the wiki [2]. We'll go over it this
Wednesday.
Cheers
Joseph
[1] <a href="https://urldefense.us/v3/__https://dl.acm.org/doi/abs/10.1177/1094342014548772__;!!G_uCfscf7eWS!eSVtCXaTI6hHjR_d6d6R9hMm-qfa8Q1mC3ow2ZBgyL8zgM1iwroCtKpdLnqt62znkU6fIt69MuhsreKMSvdb_F0OP5IB0Ogr1XFH8bzSHnhfgxcQ$">https://urldefense.us/v3/__https://dl.acm.org/doi/abs/10.1177/1094342014548772__;!!G_uCfscf7eWS!eSVtCXaTI6hHjR_d6d6R9hMm-qfa8Q1mC3ow2ZBgyL8zgM1iwroCtKpdLnqt62znkU6fIt69MuhsreKMSvdb_F0OP5IB0Ogr1XFH8bzSHnhfgxcQ$</a>
[2] <a href="https://urldefense.us/v3/__https://github.com/mpiwg-hybrid/hybrid-issues/wiki*active-topics__;Iw!!G_uCfscf7eWS!eSVtCXaTI6hHjR_d6d6R9hMm-qfa8Q1mC3ow2ZBgyL8zgM1iwroCtKpdLnqt62znkU6fIt69MuhsreKMSvdb_F0OP5IB0Ogr1XFH8bzSHqTfa036$">https://urldefense.us/v3/__https://github.com/mpiwg-hybrid/hybrid-issues/wiki*active-topics__;Iw!!G_uCfscf7eWS!eSVtCXaTI6hHjR_d6d6R9hMm-qfa8Q1mC3ow2ZBgyL8zgM1iwroCtKpdLnqt62znkU6fIt69MuhsreKMSvdb_F0OP5IB0Ogr1XFH8bzSHqTfa036$</a>
On 10/11/25 04:55, Jeff Hammond wrote:
> I am curious if people have any appetite to bring back endpoints, not
> for the original purpose, but in order to support GPU ranks. This is
> one of the features that MPI lacks relative to NCCL that limit its use
> in some AI applications. Some AI users do not want to create >1
> process per node just to manage a GPU, because this makes their
> pre/post-processing much harder. They have multithreaded code for
> that already and don't want to rewrite it or play silly games with
> affinity to try to make the application efficient while idling GPU
> management processes.
>
> Jeff
>
> On Fri, Oct 10, 2025 at 5:34 PM Joseph Schuchart via mpiwg-hybridpm
> <mpiwg-hybridpm@lists.mpi-forum.org> wrote:
>> Hi all, With the September Forum meeting behind us we should pick us the meetings again. Please let me know if you have any topics you want to discuss. We plan to call for joint meeting with the RMA WG to discuss device-side operations but the
>> ZjQcmQRYFpfptBannerStart
>> This Message Is From an External Sender
>> This message came from outside your organization.
>>
>> ZjQcmQRYFpfptBannerEnd
>>
>> Hi all,
>>
>> With the September Forum meeting behind us we should pick us the
>> meetings again. Please let me know if you have any topics you want to
>> discuss.
>>
>> We plan to call for joint meeting with the RMA WG to discuss device-side
>> operations but the RMA WG first needs to go through the feedback from
>> the Forum meeting. Given that people are busy with SC prep, it will
>> probably slip into December.
>>
>> Other topics are of course welcome :)
>>
>> Thanks
>> Joseph
>>
>> _______________________________________________
>> mpiwg-hybridpm mailing list
>> mpiwg-hybridpm@lists.mpi-forum.org
>> <a href="https://urldefense.us/v3/__https://protect.checkpoint.com/v2/r01/___https:/*lists.mpi-forum.org/mailman/listinfo/mpiwg-hybridpm___.YzJ1OnN0b255YnJvb2s6YzpnOmU3MGE3NzE0ZTc3Yjk1NGQ1YzgxYzVkYWU1NGU4OTQ2Ojc6NTc0NTplZDExNjc0MjQyOTdkYjlhYTU2ODNlYWVmYTI2YTFiNTU4YmQ4MzEyN2JkNDEyNjczMTBmNmJjYzE4NWQ4MGNhOnA6VDpG__;Lw!!G_uCfscf7eWS!eSVtCXaTI6hHjR_d6d6R9hMm-qfa8Q1mC3ow2ZBgyL8zgM1iwroCtKpdLnqt62znkU6fIt69MuhsreKMSvdb_F0OP5IB0Ogr1XFH8bzSHnyXu4rr$">https://urldefense.us/v3/__https://protect.checkpoint.com/v2/r01/___https:/*lists.mpi-forum.org/mailman/listinfo/mpiwg-hybridpm___.YzJ1OnN0b255YnJvb2s6YzpnOmU3MGE3NzE0ZTc3Yjk1NGQ1YzgxYzVkYWU1NGU4OTQ2Ojc6NTc0NTplZDExNjc0MjQyOTdkYjlhYTU2ODNlYWVmYTI2YTFiNTU4YmQ4MzEyN2JkNDEyNjczMTBmNmJjYzE4NWQ4MGNhOnA6VDpG__;Lw!!G_uCfscf7eWS!eSVtCXaTI6hHjR_d6d6R9hMm-qfa8Q1mC3ow2ZBgyL8zgM1iwroCtKpdLnqt62znkU6fIt69MuhsreKMSvdb_F0OP5IB0Ogr1XFH8bzSHnyXu4rr$</a>
>
>
</pre></body></html>