From alexander.supalov at [hidden] Tue Apr 1 05:43:52 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Tue, 1 Apr 2008 11:43:52 +0100 Subject: [Mpi3-subsetting] Subsetting WG telecon: dates/time, last call Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20130AB25@swsmsx413.ger.corp.intel.com> Hi everybody, Thanks for your replies. I've got 7 of them. The opinion is evenly split between April 2 or 3, any time, on one hand, and April 9, any time, on the other hand. We need an additional tie breaker by noon PDT today, otherwise I'll make the decision myself. Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Friday, March 28, 2008 5:16 PM To: 'MPI 3.0 Sub-setting working group' Subject: Subsetting WG telecon: dates/time, proposal draft to write Hi everybody, It's time for us to meet again virtually and discuss how to move forward on the subsetting. Here's a list of dates/times that are free in my schedule in the coming two weeks. Please let me know whether you can make any of the following slots: Wednesday, April 2, 8:00 am PDT/10:00 CDT/12:00 pm EDT/17:00 CET yes/no/plan B Wednesday, April 2, 9:00 am PDT/11:00 CDT/ 1:00 pm EDT/18:00 CET yes/no/plan B Thursday, April 3, 9:00 am PDT/11:00 CDT/ 1:00 pm EDT/18:00 CET yes/no/plan B Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 pm EDT/17:00 CET yes/no/plan B Wednesday, April 9, 9:00 am PDT/11:00 CDT/ 1:00 pm EDT/18:00 CET yes/no/plan B Thursday, April 10, 9:00 am PDT/11:00 CDT/ 1:00 pm EDT/18:00 CET yes/no/plan B I hope that the transition to summer time is over next week, and we can count on the usual time difference as indicated above. A discussion of the subsetting relation to the structure of the MPI-3 standard is likely to come up again at the April Forum meeting, so we better start writing something up prior to the meeting. I will put together a first draft by early next week for starters and will ask everybody to contribute. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexander.supalov at [hidden] Tue Apr 1 13:59:17 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Tue, 1 Apr 2008 19:59:17 +0100 Subject: [Mpi3-subsetting] April telecon Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A2013387EC@swsmsx413.ger.corp.intel.com> Hi everybody, Our telecon will take place on Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST. The bridge details are as follows: Outside Intel: +1-916-356-2663, Inside Intel: 8-356-2663, Bridge: 5, Passcode: 2603880 Please send to me agenda items you want to discuss. The primary goal will be to go thru the draft proposal to be published later this week, and see what we can report to the Forum end of April. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexander.supalov at [hidden] Mon Apr 7 06:05:05 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Mon, 7 Apr 2008 12:05:05 +0100 Subject: [Mpi3-subsetting] Draft proposal in the Wiki: please comment/contribute Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A201360CC2@swsmsx413.ger.corp.intel.com> Hi everybody, I've created a draft proposal in the Wiki, see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets . That's about all I can do until the meeting on Wednesday. Please comment/contribute as appropriate. Sorry for the slip against the earlier promise - lots of urgent business came out of the blue last week. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexander.supalov at [hidden] Tue Apr 8 10:25:33 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Tue, 8 Apr 2008 16:25:33 +0100 Subject: [Mpi3-subsetting] telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20138BE57@swsmsx413.ger.corp.intel.com> Hi everybody, This is a reminder: the subsetting telecon will be held on Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST. The bridge details are as follows: Outside Intel: +1-916-356-2663, Inside Intel: 8-356-2663, Bridge: 5, Passcode: 2603880 The primary goal will be to go thru the draft proposal available in the Wiki (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets), and to see what we can report to the Forum end of April. Please send to me additional agenda items you want to discuss. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexander.supalov at [hidden] Tue Apr 8 11:19:32 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Tue, 8 Apr 2008 17:19:32 +0100 Subject: [Mpi3-subsetting] telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST In-Reply-To: <[Mpi3-subsetting] telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST> Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20138BEB3@swsmsx413.ger.corp.intel.com> Hi, An update, thanks to Rich for noticing this: Wednesday, April 9, 8:00 am PDT/10:00 am CDT/11:00 am EDT/17:00 CEST Sorry for bad math. Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 08, 2008 5:26 PM To: 'MPI 3.0 Sub-setting working group' Subject: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST Hi everybody, This is a reminder: the subsetting telecon will be held on Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST. The bridge details are as follows: Outside Intel: +1-916-356-2663, Inside Intel: 8-356-2663, Bridge: 5, Passcode: 2603880 The primary goal will be to go thru the draft proposal available in the Wiki (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets), and to see what we can report to the Forum end of April. Please send to me additional agenda items you want to discuss. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexander.supalov at [hidden] Wed Apr 9 11:23:12 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Wed, 9 Apr 2008 17:23:12 +0100 Subject: [Mpi3-subsetting] telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST In-Reply-To: <[Mpi3-subsetting] telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST> Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20138C60D@swsmsx413.ger.corp.intel.com> Hi everybody, Thanks for your time today. Here's what we discussed (I captured what I could, please add/modify): Present: Richard Graham, David Gingold, Keith Underwood, Alexander Supalov - Opens - Discussion of the proposal (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets) - Complexity needs to be defined. Discussion on the aspects: - Many people only use a few calls, don't need the rest; difficulty of learning is related to this - Sheer mass of the number of calls expected in MPI-3 may make complexity unmanageable, requires hierarchy - Performance implications are not considered primary motivation for subsetting, but removing them may help - E.g., extra cache effects may be induced by complexity (e.g., communicators) - This can in principle be defeated by prioritization of the hottest data fields - We'll add the existing laundry list of things that may affect performance - Inviting people to quantify the performance benefits may help to identify promising areas - We may need hard facts to gauge potential performance gains - We may need "fast stuff" subset people will safely be able to use - Making parts of the standard optional may be easier with subsets - Dynamic processes seem to be a good example - some may disagree - You may wait for the pull or create it; anyway, there's no big pull on this in the volume market yet - High end users are starting to use dynamic processes, though - Selection at compile- link-, and runtime - Compiler time is a little controversial, but there are already some measurements that quantify this - Link time comes in 3 forms - Static linker is smart and will pull out of the .a only those components the program uses - Dynamic linker is not smart, but there's chance to either - Do dlopen from within MPI to load extra modules (not everyone's favorite), or - Switch on/off parts of functionality in a bigger library - this is where runtime comes in - Runtime (MPI_Init and/or per-communicator basis) - E.g., disabling MPI_ANY_SOURCE on a communicator may speed up processing - Should a program that runs on a subset also run on a full MPI implementation? Probably, yes - There's need to convince the community that subsetting is a good idea, and portability will help - There should be one standard but flexibility for MPI to adapt to a particular set of applications - If applications are portable across MPI, they won't actually care of the rest of MPI - The shape of MPI-3 may be strongly influenced by subsets - The whole of the standard may be split into subsets, some of which might be optional - Vocal opponents may wrack subsets; we need hard data before we bring this matter up - Should subsets be predefined or should MPI provide a mechanism to define them - Think error handling: mechanism is there, as are several predefined handlers; this model works - Danger of proliferation of multiple mutually incompatible subsets will increase with the mechanism definition - Next steps - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 08, 2008 5:26 PM To: 'MPI 3.0 Sub-setting working group' Subject: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, This is a reminder: the subsetting telecon will be held on Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST. The bridge details are as follows: Outside Intel: +1-916-356-2663, Inside Intel: 8-356-2663, Bridge: 5, Passcode: 2603880 The primary goal will be to go thru the draft proposal available in the Wiki (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets), and to see what we can report to the Forum end of April. Please send to me additional agenda items you want to discuss. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexander.supalov at [hidden] Tue Apr 22 08:09:39 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Tue, 22 Apr 2008 14:09:39 +0100 Subject: [Mpi3-subsetting] no subset slot; action item I need your help with Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20143ED8C@swsmsx413.ger.corp.intel.com> Hi everybody, Due to scheduling constraints, we're not going to have a special subset slot during the coming MPI Forum meeting. For that we'll have about 2 hours to discuss MPI-3 structure where subsets should figure prominently. If there's interest to talk subsets beyond this opportunity, I suggest that we meet as a group at one of the dinners or 1:1 as we bump into each other. Now, the action items from the last telecon. I need your help on one of them: - Create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) I remember someone at the telecon had a very good suggestion about how to formulate this. Can you take over this task now? I'm about to engage on the following three and the final MPI-2.1 review: - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Wednesday, April 09, 2008 6:23 PM To: 'MPI 3.0 Sub-setting working group' Subject: RE: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, Thanks for your time today. Here's what we discussed (I captured what I could, please add/modify): Present: Richard Graham, David Gingold, Keith Underwood, Alexander Supalov - Opens - Discussion of the proposal (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets) - Complexity needs to be defined. Discussion on the aspects: - Many people only use a few calls, don't need the rest; difficulty of learning is related to this - Sheer mass of the number of calls expected in MPI-3 may make complexity unmanageable, requires hierarchy - Performance implications are not considered primary motivation for subsetting, but removing them may help - E.g., extra cache effects may be induced by complexity (e.g., communicators) - This can in principle be defeated by prioritization of the hottest data fields - We'll add the existing laundry list of things that may affect performance - Inviting people to quantify the performance benefits may help to identify promising areas - We may need hard facts to gauge potential performance gains - We may need "fast stuff" subset people will safely be able to use - Making parts of the standard optional may be easier with subsets - Dynamic processes seem to be a good example - some may disagree - You may wait for the pull or create it; anyway, there's no big pull on this in the volume market yet - High end users are starting to use dynamic processes, though - Selection at compile- link-, and runtime - Compiler time is a little controversial, but there are already some measurements that quantify this - Link time comes in 3 forms - Static linker is smart and will pull out of the .a only those components the program uses - Dynamic linker is not smart, but there's chance to either - Do dlopen from within MPI to load extra modules (not everyone's favorite), or - Switch on/off parts of functionality in a bigger library - this is where runtime comes in - Runtime (MPI_Init and/or per-communicator basis) - E.g., disabling MPI_ANY_SOURCE on a communicator may speed up processing - Should a program that runs on a subset also run on a full MPI implementation? Probably, yes - There's need to convince the community that subsetting is a good idea, and portability will help - There should be one standard but flexibility for MPI to adapt to a particular set of applications - If applications are portable across MPI, they won't actually care of the rest of MPI - The shape of MPI-3 may be strongly influenced by subsets - The whole of the standard may be split into subsets, some of which might be optional - Vocal opponents may wrack subsets; we need hard data before we bring this matter up - Should subsets be predefined or should MPI provide a mechanism to define them - Think error handling: mechanism is there, as are several predefined handlers; this model works - Danger of proliferation of multiple mutually incompatible subsets will increase with the mechanism definition - Next steps - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 08, 2008 5:26 PM To: 'MPI 3.0 Sub-setting working group' Subject: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, This is a reminder: the subsetting telecon will be held on Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST. The bridge details are as follows: Outside Intel: +1-916-356-2663, Inside Intel: 8-356-2663, Bridge: 5, Passcode: 2603880 The primary goal will be to go thru the draft proposal available in the Wiki (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets), and to see what we can report to the Forum end of April. Please send to me additional agenda items you want to discuss. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexander.supalov at [hidden] Fri Apr 25 12:57:21 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Fri, 25 Apr 2008 18:57:21 +0100 Subject: [Mpi3-subsetting] MPI3: Proposal to remove PMPI-Requirement In-Reply-To: <200803052115.00366.keller@hlrs.de> Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20148EF0F@swsmsx413.ger.corp.intel.com> Dear Rainer, Would you mind uploading your paper sent around on March 5 (see below) to the MPI Subsetting Wiki (http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/SubsettingWikiPage)? Alternatively, if you have a link to some more or less permanent Web location, please send it to me - I would like to use it as a reference in the subsetting proposal. Sorry for the broadcast - I don't appear to have your direct address. Best regards. Alexander -----Original Message----- From: mpi3-subsetting-bounces_at_[hidden] [mailto:mpi3-subsetting-bounces_at_[hidden]] On Behalf Of Rainer Keller Sent: Wednesday, March 05, 2008 9:15 PM To: MPI3-Subsetting_at_[hidden] Subject: [Mpi3-subsetting] MPI3: Proposal to remove PMPI-Requirement Dear Alexander, dear all, at the previous Chicago meeting, some of us (Rich Graham, Jeff Squyres, Hubert Ritzdorf) have been discussing about the MPI-Standard's requirement to provide PMPI-functions for each MPI-Call into the library (except MPI_Wtime, MPI_Wtick). This is in my eyes a limitation: there could be some gains for the common case of large-scale applications: - Not using PMPI-based tools (dynamically loaded in) - Not using MPI_PROC_NULL - Not using MPI_STATUS_IGNORE So, if this proposal would fit Your definition of MPI3-Subsets, I would like to discuss the removal of the PMPI-function requirement, allowing inlining of MPI-functions and, based on that, pre-processor hints, e.g. MPI_HINT_NO_THREADS or MPI_HINT_NO_ANY_SOURCE, so the compiler might be able to eliminate several if-statements in the fast-path, allowing inlining, allowing dead code elimination. (of course, there is a whole lot of further issues involved, here -- please see the last section in the document). I have included some timings with NetPipe on Open MPI using these hints (further information section 4 -- Ompi Patch availble upon request, as its work in progress). Please take the timings with a grain of salt. I would like to get better figures on a more well-defined cluster environment. Any comments would be welcome. With best regards, Rainer -- ---------------------------------------------------------------- Dipl.-Inf. Rainer Keller http://www.hlrs.de/people/keller HLRS Tel: ++49 (0)711-685 6 5858 Nobelstrasse 19 Fax: ++49 (0)711-685 6 5832 70550 Stuttgart email: keller_at_[hidden] Germany AIM/Skype:rusraink --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. From alexander.supalov at [hidden] Fri Apr 25 14:13:11 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Fri, 25 Apr 2008 20:13:11 +0100 Subject: [Mpi3-subsetting] no subset slot; action item I need your help with In-Reply-To: <[Mpi3-subsetting] no subset slot; action item I need your help with> Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20148EF2D@swsmsx413.ger.corp.intel.com> Hi everybody, I've done my action items to the best of ability and time available. See the updated proposal in the Wiki. Am still looking for a volunteer to organize the user and implementor surveys. I don't think we'll have a big report out - just a couple of slides on the real progress. I'll do them on the plane. See you in Chicago. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 22, 2008 3:10 PM To: 'MPI 3.0 Sub-setting working group' Subject: no subset slot; action item I need your help with Hi everybody, Due to scheduling constraints, we're not going to have a special subset slot during the coming MPI Forum meeting. For that we'll have about 2 hours to discuss MPI-3 structure where subsets should figure prominently. If there's interest to talk subsets beyond this opportunity, I suggest that we meet as a group at one of the dinners or 1:1 as we bump into each other. Now, the action items from the last telecon. I need your help on one of them: - Create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) I remember someone at the telecon had a very good suggestion about how to formulate this. Can you take over this task now? I'm about to engage on the following three and the final MPI-2.1 review: - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Wednesday, April 09, 2008 6:23 PM To: 'MPI 3.0 Sub-setting working group' Subject: RE: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, Thanks for your time today. Here's what we discussed (I captured what I could, please add/modify): Present: Richard Graham, David Gingold, Keith Underwood, Alexander Supalov - Opens - Discussion of the proposal (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets) - Complexity needs to be defined. Discussion on the aspects: - Many people only use a few calls, don't need the rest; difficulty of learning is related to this - Sheer mass of the number of calls expected in MPI-3 may make complexity unmanageable, requires hierarchy - Performance implications are not considered primary motivation for subsetting, but removing them may help - E.g., extra cache effects may be induced by complexity (e.g., communicators) - This can in principle be defeated by prioritization of the hottest data fields - We'll add the existing laundry list of things that may affect performance - Inviting people to quantify the performance benefits may help to identify promising areas - We may need hard facts to gauge potential performance gains - We may need "fast stuff" subset people will safely be able to use - Making parts of the standard optional may be easier with subsets - Dynamic processes seem to be a good example - some may disagree - You may wait for the pull or create it; anyway, there's no big pull on this in the volume market yet - High end users are starting to use dynamic processes, though - Selection at compile- link-, and runtime - Compiler time is a little controversial, but there are already some measurements that quantify this - Link time comes in 3 forms - Static linker is smart and will pull out of the .a only those components the program uses - Dynamic linker is not smart, but there's chance to either - Do dlopen from within MPI to load extra modules (not everyone's favorite), or - Switch on/off parts of functionality in a bigger library - this is where runtime comes in - Runtime (MPI_Init and/or per-communicator basis) - E.g., disabling MPI_ANY_SOURCE on a communicator may speed up processing - Should a program that runs on a subset also run on a full MPI implementation? Probably, yes - There's need to convince the community that subsetting is a good idea, and portability will help - There should be one standard but flexibility for MPI to adapt to a particular set of applications - If applications are portable across MPI, they won't actually care of the rest of MPI - The shape of MPI-3 may be strongly influenced by subsets - The whole of the standard may be split into subsets, some of which might be optional - Vocal opponents may wrack subsets; we need hard data before we bring this matter up - Should subsets be predefined or should MPI provide a mechanism to define them - Think error handling: mechanism is there, as are several predefined handlers; this model works - Danger of proliferation of multiple mutually incompatible subsets will increase with the mechanism definition - Next steps - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 08, 2008 5:26 PM To: 'MPI 3.0 Sub-setting working group' Subject: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, This is a reminder: the subsetting telecon will be held on Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST. The bridge details are as follows: Outside Intel: +1-916-356-2663, Inside Intel: 8-356-2663, Bridge: 5, Passcode: 2603880 The primary goal will be to go thru the draft proposal available in the Wiki (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets), and to see what we can report to the Forum end of April. Please send to me additional agenda items you want to discuss. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexander.supalov at [hidden] Sat Apr 26 03:41:05 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Sat, 26 Apr 2008 09:41:05 +0100 Subject: [Mpi3-subsetting] no subset slot; action item I need your help with In-Reply-To: <[Mpi3-subsetting] no subset slot; action item I need your help with> Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20148EF7C@swsmsx413.ger.corp.intel.com> Hi, Draft report-out is available for comments, see http://svn.mpi-forum.org/trac/mpi-forum-web/attachment/wiki/SubsettingWi kiPage/MPI-3%20subsetting%2C%20take%202.pdf . Protected PDF is used to meet Intel Legal requirement for external publications. Updated proposal, see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets, cites Jeff's and Dick's MPI_Init ideas. Am looking for a link to Rainer's paper for the compile time subsetting section. If no-one will take on the surveys soon, we'll have to drop this idea. Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Friday, April 25, 2008 9:13 PM To: 'MPI 3.0 Sub-setting working group' Subject: RE: no subset slot; action item I need your help with Hi everybody, I've done my action items to the best of ability and time available. See the updated proposal in the Wiki. Am still looking for a volunteer to organize the user and implementor surveys. I don't think we'll have a big report out - just a couple of slides on the real progress. I'll do them on the plane. See you in Chicago. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 22, 2008 3:10 PM To: 'MPI 3.0 Sub-setting working group' Subject: no subset slot; action item I need your help with Hi everybody, Due to scheduling constraints, we're not going to have a special subset slot during the coming MPI Forum meeting. For that we'll have about 2 hours to discuss MPI-3 structure where subsets should figure prominently. If there's interest to talk subsets beyond this opportunity, I suggest that we meet as a group at one of the dinners or 1:1 as we bump into each other. Now, the action items from the last telecon. I need your help on one of them: - Create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) I remember someone at the telecon had a very good suggestion about how to formulate this. Can you take over this task now? I'm about to engage on the following three and the final MPI-2.1 review: - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Wednesday, April 09, 2008 6:23 PM To: 'MPI 3.0 Sub-setting working group' Subject: RE: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, Thanks for your time today. Here's what we discussed (I captured what I could, please add/modify): Present: Richard Graham, David Gingold, Keith Underwood, Alexander Supalov - Opens - Discussion of the proposal (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets) - Complexity needs to be defined. Discussion on the aspects: - Many people only use a few calls, don't need the rest; difficulty of learning is related to this - Sheer mass of the number of calls expected in MPI-3 may make complexity unmanageable, requires hierarchy - Performance implications are not considered primary motivation for subsetting, but removing them may help - E.g., extra cache effects may be induced by complexity (e.g., communicators) - This can in principle be defeated by prioritization of the hottest data fields - We'll add the existing laundry list of things that may affect performance - Inviting people to quantify the performance benefits may help to identify promising areas - We may need hard facts to gauge potential performance gains - We may need "fast stuff" subset people will safely be able to use - Making parts of the standard optional may be easier with subsets - Dynamic processes seem to be a good example - some may disagree - You may wait for the pull or create it; anyway, there's no big pull on this in the volume market yet - High end users are starting to use dynamic processes, though - Selection at compile- link-, and runtime - Compiler time is a little controversial, but there are already some measurements that quantify this - Link time comes in 3 forms - Static linker is smart and will pull out of the .a only those components the program uses - Dynamic linker is not smart, but there's chance to either - Do dlopen from within MPI to load extra modules (not everyone's favorite), or - Switch on/off parts of functionality in a bigger library - this is where runtime comes in - Runtime (MPI_Init and/or per-communicator basis) - E.g., disabling MPI_ANY_SOURCE on a communicator may speed up processing - Should a program that runs on a subset also run on a full MPI implementation? Probably, yes - There's need to convince the community that subsetting is a good idea, and portability will help - There should be one standard but flexibility for MPI to adapt to a particular set of applications - If applications are portable across MPI, they won't actually care of the rest of MPI - The shape of MPI-3 may be strongly influenced by subsets - The whole of the standard may be split into subsets, some of which might be optional - Vocal opponents may wrack subsets; we need hard data before we bring this matter up - Should subsets be predefined or should MPI provide a mechanism to define them - Think error handling: mechanism is there, as are several predefined handlers; this model works - Danger of proliferation of multiple mutually incompatible subsets will increase with the mechanism definition - Next steps - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 08, 2008 5:26 PM To: 'MPI 3.0 Sub-setting working group' Subject: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, This is a reminder: the subsetting telecon will be held on Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST. The bridge details are as follows: Outside Intel: +1-916-356-2663, Inside Intel: 8-356-2663, Bridge: 5, Passcode: 2603880 The primary goal will be to go thru the draft proposal available in the Wiki (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets), and to see what we can report to the Forum end of April. Please send to me additional agenda items you want to discuss. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From keith.d.underwood at [hidden] Sat Apr 26 11:47:18 2008 From: keith.d.underwood at [hidden] (Underwood, Keith D) Date: Sat, 26 Apr 2008 11:47:18 -0500 Subject: [Mpi3-subsetting] no subset slot; action item I need your help with In-Reply-To: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20148EF7C@swsmsx413.ger.corp.intel.com> Message-ID: <1BABDF0B0BF60D428576BCC7646C0A8F01A3302D@rrsmsx411.amr.corp.intel.com> I thought the proposal for the surveys was more to open one discussion area for the implementers and one discussion area for the users? Did someone have something more in mind? Keith ________________________________ From: mpi3-subsetting-bounces_at_[hidden] [mailto:mpi3-subsetting-bounces_at_[hidden]] On Behalf Of Supalov, Alexander Sent: Saturday, April 26, 2008 2:41 AM To: MPI 3.0 Sub-setting working group Subject: Re: [Mpi3-subsetting] no subset slot;action item I need your help with Hi, Draft report-out is available for comments, see http://svn.mpi-forum.org/trac/mpi-forum-web/attachment/wiki/SubsettingWi kiPage/MPI-3%20subsetting%2C%20take%202.pdf . Protected PDF is used to meet Intel Legal requirement for external publications. Updated proposal, see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets, cites Jeff's and Dick's MPI_Init ideas. Am looking for a link to Rainer's paper for the compile time subsetting section. If no-one will take on the surveys soon, we'll have to drop this idea. Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Friday, April 25, 2008 9:13 PM To: 'MPI 3.0 Sub-setting working group' Subject: RE: no subset slot; action item I need your help with Hi everybody, I've done my action items to the best of ability and time available. See the updated proposal in the Wiki. Am still looking for a volunteer to organize the user and implementor surveys. I don't think we'll have a big report out - just a couple of slides on the real progress. I'll do them on the plane. See you in Chicago. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 22, 2008 3:10 PM To: 'MPI 3.0 Sub-setting working group' Subject: no subset slot; action item I need your help with Hi everybody, Due to scheduling constraints, we're not going to have a special subset slot during the coming MPI Forum meeting. For that we'll have about 2 hours to discuss MPI-3 structure where subsets should figure prominently. If there's interest to talk subsets beyond this opportunity, I suggest that we meet as a group at one of the dinners or 1:1 as we bump into each other. Now, the action items from the last telecon. I need your help on one of them: - Create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) I remember someone at the telecon had a very good suggestion about how to formulate this. Can you take over this task now? I'm about to engage on the following three and the final MPI-2.1 review: - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Wednesday, April 09, 2008 6:23 PM To: 'MPI 3.0 Sub-setting working group' Subject: RE: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, Thanks for your time today. Here's what we discussed (I captured what I could, please add/modify): Present: Richard Graham, David Gingold, Keith Underwood, Alexander Supalov - Opens - Discussion of the proposal (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets) - Complexity needs to be defined. Discussion on the aspects: - Many people only use a few calls, don't need the rest; difficulty of learning is related to this - Sheer mass of the number of calls expected in MPI-3 may make complexity unmanageable, requires hierarchy - Performance implications are not considered primary motivation for subsetting, but removing them may help - E.g., extra cache effects may be induced by complexity (e.g., communicators) - This can in principle be defeated by prioritization of the hottest data fields - We'll add the existing laundry list of things that may affect performance - Inviting people to quantify the performance benefits may help to identify promising areas - We may need hard facts to gauge potential performance gains - We may need "fast stuff" subset people will safely be able to use - Making parts of the standard optional may be easier with subsets - Dynamic processes seem to be a good example - some may disagree - You may wait for the pull or create it; anyway, there's no big pull on this in the volume market yet - High end users are starting to use dynamic processes, though - Selection at compile- link-, and runtime - Compiler time is a little controversial, but there are already some measurements that quantify this - Link time comes in 3 forms - Static linker is smart and will pull out of the .a only those components the program uses - Dynamic linker is not smart, but there's chance to either - Do dlopen from within MPI to load extra modules (not everyone's favorite), or - Switch on/off parts of functionality in a bigger library - this is where runtime comes in - Runtime (MPI_Init and/or per-communicator basis) - E.g., disabling MPI_ANY_SOURCE on a communicator may speed up processing - Should a program that runs on a subset also run on a full MPI implementation? Probably, yes - There's need to convince the community that subsetting is a good idea, and portability will help - There should be one standard but flexibility for MPI to adapt to a particular set of applications - If applications are portable across MPI, they won't actually care of the rest of MPI - The shape of MPI-3 may be strongly influenced by subsets - The whole of the standard may be split into subsets, some of which might be optional - Vocal opponents may wrack subsets; we need hard data before we bring this matter up - Should subsets be predefined or should MPI provide a mechanism to define them - Think error handling: mechanism is there, as are several predefined handlers; this model works - Danger of proliferation of multiple mutually incompatible subsets will increase with the mechanism definition - Next steps - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 08, 2008 5:26 PM To: 'MPI 3.0 Sub-setting working group' Subject: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, This is a reminder: the subsetting telecon will be held on Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST. The bridge details are as follows: Outside Intel: +1-916-356-2663, Inside Intel: 8-356-2663, Bridge: 5, Passcode: 2603880 The primary goal will be to go thru the draft proposal available in the Wiki (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets), and to see what we can report to the Forum end of April. Please send to me additional agenda items you want to discuss. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From alexander.supalov at [hidden] Sat Apr 26 12:02:40 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Sat, 26 Apr 2008 18:02:40 +0100 Subject: [Mpi3-subsetting] no subset slot; action item I need your help with In-Reply-To: <1BABDF0B0BF60D428576BCC7646C0A8F01A3302D@rrsmsx411.amr.corp.intel.com> Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20148EFA3@swsmsx413.ger.corp.intel.com> I guess this was it. I simply don't have the time to organize and run this show myself. ________________________________ From: mpi3-subsetting-bounces_at_[hidden] [mailto:mpi3-subsetting-bounces_at_[hidden]] On Behalf Of Underwood, Keith D Sent: Saturday, April 26, 2008 6:47 PM To: MPI 3.0 Sub-setting working group Subject: Re: [Mpi3-subsetting] no subset slot;action item I need your help with I thought the proposal for the surveys was more to open one discussion area for the implementers and one discussion area for the users? Did someone have something more in mind? Keith ________________________________ From: mpi3-subsetting-bounces_at_[hidden] [mailto:mpi3-subsetting-bounces_at_[hidden]] On Behalf Of Supalov, Alexander Sent: Saturday, April 26, 2008 2:41 AM To: MPI 3.0 Sub-setting working group Subject: Re: [Mpi3-subsetting] no subset slot;action item I need your help with Hi, Draft report-out is available for comments, see http://svn.mpi-forum.org/trac/mpi-forum-web/attachment/wiki/SubsettingWi kiPage/MPI-3%20subsetting%2C%20take%202.pdf . Protected PDF is used to meet Intel Legal requirement for external publications. Updated proposal, see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets, cites Jeff's and Dick's MPI_Init ideas. Am looking for a link to Rainer's paper for the compile time subsetting section. If no-one will take on the surveys soon, we'll have to drop this idea. Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Friday, April 25, 2008 9:13 PM To: 'MPI 3.0 Sub-setting working group' Subject: RE: no subset slot; action item I need your help with Hi everybody, I've done my action items to the best of ability and time available. See the updated proposal in the Wiki. Am still looking for a volunteer to organize the user and implementor surveys. I don't think we'll have a big report out - just a couple of slides on the real progress. I'll do them on the plane. See you in Chicago. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 22, 2008 3:10 PM To: 'MPI 3.0 Sub-setting working group' Subject: no subset slot; action item I need your help with Hi everybody, Due to scheduling constraints, we're not going to have a special subset slot during the coming MPI Forum meeting. For that we'll have about 2 hours to discuss MPI-3 structure where subsets should figure prominently. If there's interest to talk subsets beyond this opportunity, I suggest that we meet as a group at one of the dinners or 1:1 as we bump into each other. Now, the action items from the last telecon. I need your help on one of them: - Create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) I remember someone at the telecon had a very good suggestion about how to formulate this. Can you take over this task now? I'm about to engage on the following three and the final MPI-2.1 review: - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Wednesday, April 09, 2008 6:23 PM To: 'MPI 3.0 Sub-setting working group' Subject: RE: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, Thanks for your time today. Here's what we discussed (I captured what I could, please add/modify): Present: Richard Graham, David Gingold, Keith Underwood, Alexander Supalov - Opens - Discussion of the proposal (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets) - Complexity needs to be defined. Discussion on the aspects: - Many people only use a few calls, don't need the rest; difficulty of learning is related to this - Sheer mass of the number of calls expected in MPI-3 may make complexity unmanageable, requires hierarchy - Performance implications are not considered primary motivation for subsetting, but removing them may help - E.g., extra cache effects may be induced by complexity (e.g., communicators) - This can in principle be defeated by prioritization of the hottest data fields - We'll add the existing laundry list of things that may affect performance - Inviting people to quantify the performance benefits may help to identify promising areas - We may need hard facts to gauge potential performance gains - We may need "fast stuff" subset people will safely be able to use - Making parts of the standard optional may be easier with subsets - Dynamic processes seem to be a good example - some may disagree - You may wait for the pull or create it; anyway, there's no big pull on this in the volume market yet - High end users are starting to use dynamic processes, though - Selection at compile- link-, and runtime - Compiler time is a little controversial, but there are already some measurements that quantify this - Link time comes in 3 forms - Static linker is smart and will pull out of the .a only those components the program uses - Dynamic linker is not smart, but there's chance to either - Do dlopen from within MPI to load extra modules (not everyone's favorite), or - Switch on/off parts of functionality in a bigger library - this is where runtime comes in - Runtime (MPI_Init and/or per-communicator basis) - E.g., disabling MPI_ANY_SOURCE on a communicator may speed up processing - Should a program that runs on a subset also run on a full MPI implementation? Probably, yes - There's need to convince the community that subsetting is a good idea, and portability will help - There should be one standard but flexibility for MPI to adapt to a particular set of applications - If applications are portable across MPI, they won't actually care of the rest of MPI - The shape of MPI-3 may be strongly influenced by subsets - The whole of the standard may be split into subsets, some of which might be optional - Vocal opponents may wrack subsets; we need hard data before we bring this matter up - Should subsets be predefined or should MPI provide a mechanism to define them - Think error handling: mechanism is there, as are several predefined handlers; this model works - Danger of proliferation of multiple mutually incompatible subsets will increase with the mechanism definition - Next steps - Alexander will add the description of the complexity matter upfront to make readers see their favorite pain points - Alexander will add the existing laundry list of controllable features and ask for associated perf/footprint data - Alexander create two query pages - For users - what their minimum subset would look like (functionality, performance) - For implementors - what they can profit from (performance, footprint) - Alexander will prepare to participate in the MPI-3 structure discussion at the meeting Best regards. Alexander ________________________________ From: Supalov, Alexander Sent: Tuesday, April 08, 2008 5:26 PM To: 'MPI 3.0 Sub-setting working group' Subject: telecon, Wednesday, April 9, 8:00 am PDT/10:00 CDT/11:00 EDT/17:00 CEST Hi everybody, This is a reminder: the subsetting telecon will be held on Wednesday, April 9, 8:00 am PDT/10:00 CDT/12:00 EDT/17:00 CEST. The bridge details are as follows: Outside Intel: +1-916-356-2663, Inside Intel: 8-356-2663, Bridge: 5, Passcode: 2603880 The primary goal will be to go thru the draft proposal available in the Wiki (see http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/Subsets), and to see what we can report to the Forum end of April. Please send to me additional agenda items you want to discuss. Best regards. Alexander -- Dr Alexander Supalov Intel GmbH Hermuelheimer Strasse 8a 50321 Bruehl, Germany Phone: +49 2232 209034 Mobile: +49 173 511 8735 Fax: +49 2232 209029 --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies. * -------------- next part -------------- An HTML attachment was scrubbed... URL: From keller at [hidden] Mon Apr 28 13:44:11 2008 From: keller at [hidden] (Rainer Keller) Date: Mon, 28 Apr 2008 20:44:11 +0200 Subject: [Mpi3-subsetting] MPI3: Proposal to remove PMPI-Requirement In-Reply-To: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20148EF0F@swsmsx413.ger.corp.intel.com> Message-ID: <200804282044.11729.keller@hlrs.de> Dear Alexander, On Friday 25 April 2008 19:57, Supalov, Alexander wrote: > Would you mind uploading your paper sent around on March 5 (see below) > to the MPI Subsetting Wiki > (http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/SubsettingWikiPage)? Sure. Done, I put a short description under "Compile Time Selection" and a link to the preliminary document (a permanent web location)... Thanks, Rainer -- ---------------------------------------------------------------- Dipl.-Inf. Rainer Keller http://www.hlrs.de/people/keller HLRS Tel: ++49 (0)711-685 6 5858 Nobelstrasse 19 Fax: ++49 (0)711-685 6 5832 70550 Stuttgart email: keller_at_[hidden] Germany AIM/Skype:rusraink From alexander.supalov at [hidden] Mon Apr 28 13:45:53 2008 From: alexander.supalov at [hidden] (Supalov, Alexander) Date: Mon, 28 Apr 2008 19:45:53 +0100 Subject: [Mpi3-subsetting] MPI3: Proposal to remove PMPI-Requirement In-Reply-To: <200804282044.11729.keller@hlrs.de> Message-ID: <5ECAB1304A8B5B4CB3F9D6C01E4E21A20148F693@swsmsx413.ger.corp.intel.com> Thanks! -----Original Message----- From: Rainer Keller [mailto:keller_at_[hidden]] Sent: Monday, April 28, 2008 8:44 PM To: mpi3-subsetting_at_[hidden] Cc: Supalov, Alexander Subject: Re: [Mpi3-subsetting] MPI3: Proposal to remove PMPI-Requirement Dear Alexander, On Friday 25 April 2008 19:57, Supalov, Alexander wrote: > Would you mind uploading your paper sent around on March 5 (see below) > to the MPI Subsetting Wiki > (http://svn.mpi-forum.org/trac/mpi-forum-web/wiki/SubsettingWikiPage)? Sure. Done, I put a short description under "Compile Time Selection" and a link to the preliminary document (a permanent web location)... Thanks, Rainer -- ---------------------------------------------------------------- Dipl.-Inf. Rainer Keller http://www.hlrs.de/people/keller HLRS Tel: ++49 (0)711-685 6 5858 Nobelstrasse 19 Fax: ++49 (0)711-685 6 5832 70550 Stuttgart email: keller_at_[hidden] Germany AIM/Skype:rusraink --------------------------------------------------------------------- Intel GmbH Dornacher Strasse 1 85622 Feldkirchen/Muenchen Germany Sitz der Gesellschaft: Feldkirchen bei Muenchen Geschaeftsfuehrer: Douglas Lusk, Peter Gleissner, Hannes Schwaderer Registergericht: Muenchen HRB 47456 Ust.-IdNr. VAT Registration No.: DE129385895 Citibank Frankfurt (BLZ 502 109 00) 600119052 This e-mail and any attachments may contain confidential material for the sole use of the intended recipient(s). Any review or distribution by others is strictly prohibited. If you are not the intended recipient, please contact the sender and delete all copies.