<!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.0 Transitional//EN">
<HTML><HEAD>
<META http-equiv=Content-Type content="text/html; charset=gb2312">
<META content="MSHTML 6.00.6000.16915" name=GENERATOR>
<STYLE>@font-face {
        font-family: 宋体;
}
@font-face {
        font-family: Verdana;
}
@font-face {
        font-family: @宋体;
}
@page Section1 {size: 595.3pt 841.9pt; margin: 72.0pt 90.0pt 72.0pt 90.0pt; layout-grid: 15.6pt; }
P.MsoNormal {
        TEXT-JUSTIFY: inter-ideograph; FONT-SIZE: 10.5pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; TEXT-ALIGN: justify
}
LI.MsoNormal {
        TEXT-JUSTIFY: inter-ideograph; FONT-SIZE: 10.5pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; TEXT-ALIGN: justify
}
DIV.MsoNormal {
        TEXT-JUSTIFY: inter-ideograph; FONT-SIZE: 10.5pt; MARGIN: 0cm 0cm 0pt; FONT-FAMILY: "Times New Roman"; TEXT-ALIGN: justify
}
A:link {
        COLOR: blue; TEXT-DECORATION: underline
}
SPAN.MsoHyperlink {
        COLOR: blue; TEXT-DECORATION: underline
}
A:visited {
        COLOR: purple; TEXT-DECORATION: underline
}
SPAN.MsoHyperlinkFollowed {
        COLOR: purple; TEXT-DECORATION: underline
}
SPAN.EmailStyle17 {
        FONT-WEIGHT: normal; COLOR: windowtext; FONT-STYLE: normal; FONT-FAMILY: Verdana; TEXT-DECORATION: none; mso-style-type: personal-compose
}
DIV.Section1 {
        page: Section1
}
UNKNOWN {
        FONT-SIZE: 10pt
}
BLOCKQUOTE {
        MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px; MARGIN-LEFT: 2em
}
OL {
        MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
UL {
        MARGIN-TOP: 0px; MARGIN-BOTTOM: 0px
}
</STYLE>
</HEAD>
<BODY style="FONT-SIZE: 10pt; FONT-FAMILY: verdana">
<DIV><FONT face=Verdana color=#000080 size=2>Thanks,</FONT></DIV>
<DIV><FONT color=#000080>I know,</FONT></DIV>
<DIV><FONT color=#000080>It will be better if without restart the 
servers</FONT></DIV>
<DIV><FONT face=Verdana color=#000080 size=2></FONT>&nbsp;</DIV>
<DIV><FONT face=Verdana color=#000080 size=2></FONT>&nbsp;</DIV>
<DIV><FONT face=Verdana color=#c0c0c0 size=2>2009-10-22 </FONT></DIV><FONT 
face=Verdana color=#000080 size=2>
<HR style="WIDTH: 122px; HEIGHT: 2px" align=left SIZE=2>
</FONT>
<DIV><FONT face=Verdana color=#c0c0c0 size=2><SPAN>xiechangcai</SPAN> 
</FONT></DIV><FONT face=Verdana color=#000080 size=2>
<HR>
</FONT>
<DIV><FONT face=Verdana size=2><STRONG>发件人:</STRONG> Rob Ross </FONT></DIV>
<DIV><FONT face=Verdana size=2><STRONG>发送时间:</STRONG> 2009-10-22&nbsp; 11:46:39 
</FONT></DIV>
<DIV><FONT face=Verdana size=2><STRONG>收件人:</STRONG> xiechangcai </FONT></DIV>
<DIV><FONT face=Verdana size=2><STRONG>抄送:</STRONG> Chris Worley; pvfs2-users 
</FONT></DIV>
<DIV><FONT face=Verdana size=2><STRONG>主题:</STRONG> Re: [Pvfs2-users] File 
affinity and CPU resource scheduling concernswhen using compute node as a PVFS 
server </FONT></DIV>
<DIV><FONT face=Verdana size=2></FONT> </DIV>
<DIV><FONT face=Verdana size=2>
<DIV>Hi,</DIV>
<DIV></DIV>
<DIV>You&nbsp;must&nbsp;stop&nbsp;the&nbsp;servers&nbsp;and&nbsp;clients&nbsp;and&nbsp;modify&nbsp;the&nbsp;config&nbsp;file&nbsp;to&nbsp;&nbsp;</DIV>
<DIV>list&nbsp;the&nbsp;new&nbsp;server,&nbsp;yes.&nbsp;You&nbsp;will&nbsp;not&nbsp;lose&nbsp;any&nbsp;data&nbsp;on&nbsp;the&nbsp;original&nbsp;&nbsp;</DIV>
<DIV>servers.</DIV>
<DIV></DIV>
<DIV>Rob</DIV>
<DIV></DIV>
<DIV>On&nbsp;Oct&nbsp;21,&nbsp;2009,&nbsp;at&nbsp;8:32&nbsp;PM,&nbsp;xiechangcai&nbsp;wrote:</DIV>
<DIV></DIV>
<DIV>&gt;&nbsp;Hi,Rob</DIV>
<DIV>&gt;&nbsp;&nbsp;I'm&nbsp;a&nbsp;PVFS2&nbsp;user&nbsp;,</DIV>
<DIV>&gt;&nbsp;&nbsp;I&nbsp;have&nbsp;a&nbsp;question,&nbsp;when&nbsp;i&nbsp;add&nbsp;one&nbsp;more&nbsp;i/o&nbsp;data&nbsp;server,</DIV>
<DIV>&gt;&nbsp;&nbsp;I&nbsp;must&nbsp;change&nbsp;all&nbsp;the&nbsp;servers&nbsp;config&nbsp;file,and&nbsp;then&nbsp;restart&nbsp;pvfs2-&nbsp;</DIV>
<DIV>&gt;&nbsp;server&nbsp;on&nbsp;all&nbsp;servers?</DIV>
<DIV>&gt;&nbsp;&nbsp;is&nbsp;this&nbsp;true&nbsp;?</DIV>
<DIV>&gt;&nbsp;&nbsp;The&nbsp;original&nbsp;data&nbsp;on&nbsp;the&nbsp;I/O&nbsp;data&nbsp;servers&nbsp;can&nbsp;be&nbsp;lost&nbsp;?</DIV>
<DIV>&gt;</DIV>
<DIV>&gt;</DIV>
<DIV>&gt;&nbsp;2009-10-22</DIV>
<DIV>&gt;&nbsp;xiechangcai</DIV>
<DIV>&gt;&nbsp;发件人:&nbsp;Rob&nbsp;Ross</DIV>
<DIV>&gt;&nbsp;发送时间:&nbsp;2009-10-22&nbsp;&nbsp;02:08:05</DIV>
<DIV>&gt;&nbsp;收件人:&nbsp;Chris&nbsp;Worley</DIV>
<DIV>&gt;&nbsp;抄送:&nbsp;pvfs2-users</DIV>
<DIV>&gt;&nbsp;主题:&nbsp;Re:&nbsp;[Pvfs2-users]&nbsp;File&nbsp;affinity&nbsp;and&nbsp;CPU&nbsp;resource&nbsp;scheduling&nbsp;&nbsp;</DIV>
<DIV>&gt;&nbsp;concernswhen&nbsp;using&nbsp;compute&nbsp;node&nbsp;as&nbsp;a&nbsp;PVFS&nbsp;server</DIV>
<DIV>&gt;&nbsp;Hi&nbsp;Chris,</DIV>
<DIV>&gt;&nbsp;Yes,&nbsp;you&nbsp;can&nbsp;certainly&nbsp;run&nbsp;PVFS&nbsp;servers&nbsp;on&nbsp;compute&nbsp;nodes.&nbsp;That's&nbsp;what</DIV>
<DIV>&gt;&nbsp;we&nbsp;used&nbsp;to&nbsp;do&nbsp;all&nbsp;the&nbsp;time&nbsp;back&nbsp;in&nbsp;"the&nbsp;day",&nbsp;but&nbsp;it's&nbsp;still&nbsp;possible.</DIV>
<DIV>&gt;&nbsp;The&nbsp;file&nbsp;system&nbsp;does&nbsp;not&nbsp;migrate&nbsp;files.&nbsp;In&nbsp;part&nbsp;this&nbsp;is&nbsp;because&nbsp;it</DIV>
<DIV>&gt;&nbsp;would&nbsp;dramatically&nbsp;complicate&nbsp;metadata&nbsp;management,&nbsp;in&nbsp;part&nbsp;because&nbsp;we</DIV>
<DIV>&gt;&nbsp;are&nbsp;frequently&nbsp;running&nbsp;in&nbsp;environments&nbsp;where&nbsp;there's&nbsp;no&nbsp;locality&nbsp;to</DIV>
<DIV>&gt;&nbsp;exploit.</DIV>
<DIV>&gt;&nbsp;You&nbsp;can&nbsp;choose&nbsp;to&nbsp;distribute&nbsp;over&nbsp;fewer&nbsp;(or&nbsp;just&nbsp;one)&nbsp;node,&nbsp;and&nbsp;there</DIV>
<DIV>&gt;&nbsp;is&nbsp;functionality&nbsp;to&nbsp;discover&nbsp;where&nbsp;a&nbsp;file&nbsp;is&nbsp;stored,&nbsp;so&nbsp;you&nbsp;can&nbsp;map</DIV>
<DIV>&gt;&nbsp;your&nbsp;computation&nbsp;onto&nbsp;the&nbsp;storage.</DIV>
<DIV>&gt;&nbsp;Obviously&nbsp;yes,&nbsp;doing&nbsp;work&nbsp;on&nbsp;some&nbsp;other&nbsp;node&nbsp;will&nbsp;slow&nbsp;down</DIV>
<DIV>&gt;&nbsp;computation&nbsp;on&nbsp;that&nbsp;node,&nbsp;how&nbsp;much&nbsp;depends&nbsp;on&nbsp;many&nbsp;things.</DIV>
<DIV>&gt;&nbsp;Rob</DIV>
<DIV>&gt;&nbsp;On&nbsp;Oct&nbsp;21,&nbsp;2009,&nbsp;at&nbsp;12:40&nbsp;PM,&nbsp;Chris&nbsp;Worley&nbsp;wrote:</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;I&nbsp;haven't&nbsp;looked&nbsp;at&nbsp;PVFS&nbsp;for&nbsp;nearly&nbsp;a&nbsp;decade,&nbsp;so&nbsp;my&nbsp;understanding</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;could&nbsp;be&nbsp;way&nbsp;out&nbsp;of&nbsp;date.&nbsp;&nbsp;Sorry&nbsp;if&nbsp;this&nbsp;is&nbsp;a&nbsp;stupid&nbsp;question;&nbsp;I'm</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;hoping&nbsp;PVFS&nbsp;might&nbsp;fill&nbsp;some&nbsp;requirements&nbsp;I'm&nbsp;looking&nbsp;at.</DIV>
<DIV>&gt;&nbsp;&gt;</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;Is&nbsp;it&nbsp;typical&nbsp;to&nbsp;use&nbsp;compute&nbsp;nodes&nbsp;as&nbsp;PVFS&nbsp;file&nbsp;servers?&nbsp;&nbsp;Is&nbsp;it&nbsp;even</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;possible&nbsp;(i.e.&nbsp;it&nbsp;isn't&nbsp;w/&nbsp;Lustre)?</DIV>
<DIV>&gt;&nbsp;&gt;</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;If&nbsp;so,&nbsp;while&nbsp;striping&nbsp;across&nbsp;I/O&nbsp;nodes&nbsp;looks&nbsp;to&nbsp;be&nbsp;the&nbsp;default,&nbsp;is</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;there&nbsp;any&nbsp;provision&nbsp;for&nbsp;file&nbsp;affinity...&nbsp;i.e.&nbsp;files&nbsp;migrating&nbsp;to&nbsp;the</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;nodes&nbsp;using&nbsp;them?</DIV>
<DIV>&gt;&nbsp;&gt;</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;If&nbsp;striping&nbsp;is&nbsp;the&nbsp;only&nbsp;choice,&nbsp;and&nbsp;compute&nbsp;nodes&nbsp;serve&nbsp;the&nbsp;I/O&nbsp;too,</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;then&nbsp;a&nbsp;job&nbsp;running&nbsp;on&nbsp;one&nbsp;set&nbsp;of&nbsp;nodes&nbsp;could&nbsp;be&nbsp;using&nbsp;files&nbsp;striped</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;across&nbsp;another&nbsp;set&nbsp;of&nbsp;nodes&nbsp;in&nbsp;use&nbsp;by&nbsp;another&nbsp;job,&nbsp;causing&nbsp;both&nbsp;jobs</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;to&nbsp;loose&nbsp;performance,&nbsp;correct?</DIV>
<DIV>&gt;&nbsp;&gt;</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;Are&nbsp;there&nbsp;any&nbsp;links&nbsp;to&nbsp;PVFS&nbsp;performance&nbsp;over&nbsp;IB?</DIV>
<DIV>&gt;&nbsp;&gt;</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;Thanks,</DIV>
<DIV>&gt;&nbsp;&gt;</DIV>
<DIV>&gt;&nbsp;&gt;&nbsp;Chris</DIV>
<DIV>&gt;&nbsp;_______________________________________________</DIV>
<DIV>&gt;&nbsp;Pvfs2-users&nbsp;mailing&nbsp;list</DIV>
<DIV>&gt;&nbsp;Pvfs2-users@beowulf-underground.org</DIV>
<DIV>&gt;&nbsp;http://www.beowulf-underground.org/mailman/listinfo/pvfs2-users</DIV>
<DIV></DIV></FONT></DIV></BODY></HTML>