gitレポジトリの作成

  • サーバーにて


mkdir hoge.git
cd hoge.git
git --bare init

  • ローカルにて

下準備


emacs ~/.gitignore # gitで管理されないファイルのリスト作成(全プロジェクト共通)
git config --global core.excludesfile ~/.gitignore
git config --global user.name "hogehoge"
git config --global user.email "hogehoge@foovar.com"
レポジトリの初期化

git init
emacs .gitignore # gitで管理されないファイルのリスト作成
git add .
git commit -m "initial commit"
git remote add origin ssh://server/dir/hoge.git
git branch --set-upstream master origin/master
git push

量子力学でよく出てきそうな計算をboostで

試してはいない。間違いとかもっといい方法あれば教えてください。

  • Trace

{\text{Tr}[A]}


sum( matrix_vector_range(A, range(0, A.size1()), range(0, A.size2()) ) );
http://lists.boost.org/MailArchives/ublas/2007/06/2158.php

{\text{Tr}[AB]}


sum( prod( scalar_vector(A.size1(), 1.0), element_prod(A, trans(B)) ) );
sum( element_prod(A, trans(B)) );
http://lists.boost.org/MailArchives/ublas/2007/06/2159.php

{\text{Tr}[AB]} どっちかが対角行列の場合


inner_prod(matrix_vector_range(A, range(0, A.size1()), range(0, A.size2()) ), matrix_vector_range(B, range(0, B.size1()), range(0, B.size2()) ) )

  • IPR

{\sum_i |\langle i | u \rangle|^4}


vector tmp = real( element_prod(conj(u), u) );
inner_prod(u, u);

{\sum_i \langle i | A | i \rangle^2}


inner_prod(matrix_vector_range(A, range(0, A.size1()), range(0, A.size2()) ), matrix_vector_range(A, range(0, A.size1()), range(0, A.size2()) ) )

Scientific Linux 6.1でのinfiniband調子悪すぎ。。。

Infiniband経由でsshやrshを使って通信しようとすると以下のようなメッセージが出まくる。


Sep 16 02:02:11 tadpole2 kernel: rsh: page allocation failure. order:4, mode:0x20
Sep 16 02:02:11 tadpole2 kernel: Pid: 3241, comm: rsh Not tainted 2.6.32-131.12.1.el6.x86_64 #1
Sep 16 02:02:11 tadpole2 kernel: Call Trace:
Sep 16 02:02:11 tadpole2 kernel: [] ? __alloc_pages_nodemask+0x71e/0x8b0
Sep 16 02:02:11 tadpole2 kernel: [] ? kmem_getpages+0x62/0x170
Sep 16 02:02:11 tadpole2 kernel: [] ? fallback_alloc+0x1ba/0x270
Sep 16 02:02:11 tadpole2 kernel: [] ? cache_grow+0x2cf/0x320
Sep 16 02:02:11 tadpole2 kernel: [] ? ____cache_alloc_node+0x99/0x160
Sep 16 02:02:11 tadpole2 kernel: [] ? pskb_expand_head+0x5f/0x1e0
Sep 16 02:02:11 tadpole2 kernel: [] ? __kmalloc+0x199/0x230
Sep 16 02:02:11 tadpole2 kernel: [] ? pskb_expand_head+0x5f/0x1e0
Sep 16 02:02:11 tadpole2 kernel: [] ? skb_checksum+0x56/0x2e0
Sep 16 02:02:11 tadpole2 kernel: [] ? __pskb_pull_tail+0x2aa/0x360
Sep 16 02:02:11 tadpole2 kernel: [] ? dev_queue_xmit+0x34b/0x4d0
Sep 16 02:02:11 tadpole2 kernel: [] ? swiotlb_map_page+0x0/0x100
Sep 16 02:02:11 tadpole2 kernel: [] ? neigh_connected_output+0xbd/0x100
Sep 16 02:02:11 tadpole2 kernel: [] ? ip_finish_output+0x237/0x310
Sep 16 02:02:11 tadpole2 kernel: [] ? ip_output+0xb8/0xc0
Sep 16 02:02:11 tadpole2 kernel: [] ? ip_local_out+0x25/0x30
Sep 16 02:02:11 tadpole2 kernel: [] ? ip_queue_xmit+0x190/0x420
Sep 16 02:02:11 tadpole2 kernel: [] ? tcp_transmit_skb+0x3f1/0x790
Sep 16 02:02:11 tadpole2 kernel: [] ? tcp_write_xmit+0x1e7/0x9e0
Sep 16 02:02:11 tadpole2 kernel: [] ? __tcp_push_pending_frames+0x30/0xe0
Sep 16 02:02:11 tadpole2 kernel: [] ? tcp_data_snd_check+0x33/0x100
Sep 16 02:02:11 tadpole2 kernel: [] ? tcp_rcv_established+0x371/0x800
Sep 16 02:02:11 tadpole2 kernel: [] ? tcp_v4_do_rcv+0x2e3/0x430
Sep 16 02:02:11 tadpole2 kernel: [] ? tcp_write_xmit+0x76/0x9e0
Sep 16 02:02:11 tadpole2 kernel: [] ? kfree_skb+0x42/0x90
Sep 16 02:02:11 tadpole2 kernel: [] ? release_sock+0x65/0xe0
Sep 16 02:02:11 tadpole2 kernel: [] ? tcp_sendmsg+0x73c/0xa10
Sep 16 02:02:11 tadpole2 kernel: [] ? security_socket_sendmsg+0x9/0x20
Sep 16 02:02:11 tadpole2 kernel: [] ? sock_aio_write+0x151/0x160
Sep 16 02:02:11 tadpole2 kernel: [] ? do_sync_write+0xfa/0x140
Sep 16 02:02:11 tadpole2 kernel: [] ? autoremove_wake_function+0x0/0x40
Sep 16 02:02:11 tadpole2 kernel: [] ? security_file_permission+0x16/0x20
Sep 16 02:02:11 tadpole2 kernel: [] ? vfs_write+0x184/0x1a0
Sep 16 02:02:11 tadpole2 kernel: [] ? sys_write+0x51/0x90
Sep 16 02:02:11 tadpole2 kernel: [] ? system_call_fastpath+0x16/0x1b
Sep 16 02:02:11 tadpole2 kernel: Mem-Info:
Sep 16 02:02:11 tadpole2 kernel: Node 0 DMA per-cpu:
Sep 16 02:02:11 tadpole2 kernel: CPU 0: hi: 0, btch: 1 usd: 0
Sep 16 02:02:11 tadpole2 kernel: CPU 1: hi: 0, btch: 1 usd: 0
Sep 16 02:02:11 tadpole2 kernel: CPU 2: hi: 0, btch: 1 usd: 0
Sep 16 02:02:11 tadpole2 kernel: CPU 3: hi: 0, btch: 1 usd: 0
Sep 16 02:02:11 tadpole2 kernel: CPU 4: hi: 0, btch: 1 usd: 0
Sep 16 02:02:11 tadpole2 kernel: CPU 5: hi: 0, btch: 1 usd: 0
Sep 16 02:02:11 tadpole2 kernel: CPU 6: hi: 0, btch: 1 usd: 0
Sep 16 02:02:11 tadpole2 kernel: CPU 7: hi: 0, btch: 1 usd: 0
Sep 16 02:02:11 tadpole2 kernel: Node 0 DMA32 per-cpu:
Sep 16 02:02:11 tadpole2 kernel: CPU 0: hi: 186, btch: 31 usd: 27
Sep 16 02:02:11 tadpole2 kernel: CPU 1: hi: 186, btch: 31 usd: 59
Sep 16 02:02:11 tadpole2 kernel: CPU 2: hi: 186, btch: 31 usd: 138
Sep 16 02:02:11 tadpole2 kernel: CPU 3: hi: 186, btch: 31 usd: 163
Sep 16 02:02:11 tadpole2 kernel: CPU 4: hi: 186, btch: 31 usd: 174
Sep 16 02:02:11 tadpole2 kernel: CPU 5: hi: 186, btch: 31 usd: 180
Sep 16 02:02:11 tadpole2 kernel: CPU 6: hi: 186, btch: 31 usd: 184
Sep 16 02:02:11 tadpole2 kernel: CPU 7: hi: 186, btch: 31 usd: 55
Sep 16 02:02:11 tadpole2 kernel: Node 0 Normal per-cpu:
Sep 16 02:02:11 tadpole2 kernel: CPU 0: hi: 186, btch: 31 usd: 57
Sep 16 02:02:11 tadpole2 kernel: CPU 1: hi: 186, btch: 31 usd: 55
Sep 16 02:02:11 tadpole2 kernel: CPU 2: hi: 186, btch: 31 usd: 100
Sep 16 02:02:11 tadpole2 kernel: CPU 3: hi: 186, btch: 31 usd: 172
Sep 16 02:02:11 tadpole2 kernel: CPU 4: hi: 186, btch: 31 usd: 171
Sep 16 02:02:11 tadpole2 kernel: CPU 5: hi: 186, btch: 31 usd: 165
Sep 16 02:02:11 tadpole2 kernel: CPU 6: hi: 186, btch: 31 usd: 168
Sep 16 02:02:11 tadpole2 kernel: CPU 7: hi: 186, btch: 31 usd: 168
Sep 16 02:02:11 tadpole2 kernel: active_anon:29480 inactive_anon:7251 isolated_anon:0
Sep 16 02:02:11 tadpole2 kernel: active_file:312358 inactive_file:1524202 isolated_file:0
Sep 16 02:02:11 tadpole2 kernel: unevictable:0 dirty:0 writeback:0 unstable:0
Sep 16 02:02:11 tadpole2 kernel: free:39213 slab_reclaimable:41987 slab_unreclaimable:56115
Sep 16 02:02:11 tadpole2 kernel: mapped:3441 shmem:53 pagetables:2113 bounce:0
Sep 16 02:02:11 tadpole2 kernel: Node 0 DMA free:15672kB min:124kB low:152kB high:184kB active_anon:0kB inactive_anon:0kB active_file:0kB inactive_file:0kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:15272kB mlocked:0kB dirty:0kB writeback:0kB mapped:0kB shmem:0kB slab_reclaimable:0kB slab_unreclaimable:0kB kernel_stack:0kB pagetables:0kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? yes
Sep 16 02:02:11 tadpole2 kernel: lowmem_reserve[]: 0 2991 8041 8041
Sep 16 02:02:11 tadpole2 kernel: Node 0 DMA32 free:73152kB min:25096kB low:31368kB high:37644kB active_anon:15312kB inactive_anon:4084kB active_file:306252kB inactive_file:2477976kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:3063648kB mlocked:0kB dirty:0kB writeback:0kB mapped:36kB shmem:0kB slab_reclaimable:30916kB slab_unreclaimable:6976kB kernel_stack:56kB pagetables:312kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:32 all_unreclaimable? no
Sep 16 02:02:11 tadpole2 kernel: lowmem_reserve[]: 0 0 5050 5050
Sep 16 02:02:11 tadpole2 kernel: Node 0 Normal free:73980kB min:42360kB low:52948kB high:63540kB active_anon:102608kB inactive_anon:24920kB active_file:943180kB inactive_file:3613144kB unevictable:0kB isolated(anon):0kB isolated(file):0kB present:5171200kB mlocked:0kB dirty:0kB writeback:0kB mapped:13728kB shmem:212kB slab_reclaimable:137032kB slab_unreclaimable:217484kB kernel_stack:2616kB pagetables:8140kB unstable:0kB bounce:0kB writeback_tmp:0kB pages_scanned:0 all_unreclaimable? no
Sep 16 02:02:11 tadpole2 kernel: lowmem_reserve[]: 0 0 0 0
Sep 16 02:02:11 tadpole2 kernel: Node 0 DMA: 0*4kB 1*8kB 3*16kB 0*32kB 2*64kB 1*128kB 0*256kB 0*512kB 1*1024kB 1*2048kB 3*4096kB = 15672kB
Sep 16 02:02:11 tadpole2 kernel: Node 0 DMA32: 14806*4kB 275*8kB 16*16kB 18*32kB 15*64kB 13*128kB 12*256kB 5*512kB 5*1024kB 0*2048kB 0*4096kB = 75632kB
Sep 16 02:02:11 tadpole2 kernel: Node 0 Normal: 12409*4kB 110*8kB 78*16kB 60*32kB 76*64kB 50*128kB 16*256kB 6*512kB 0*1024kB 0*2048kB 1*4096kB = 76212kB
Sep 16 02:02:11 tadpole2 kernel: 1833648 total pagecache pages
Sep 16 02:02:11 tadpole2 kernel: 0 pages in swap cache
Sep 16 02:02:11 tadpole2 kernel: Swap cache stats: add 0, delete 0, find 0/0
Sep 16 02:02:11 tadpole2 kernel: Free swap = 8388600kB
Sep 16 02:02:11 tadpole2 kernel: Total swap = 8388600kB
Sep 16 02:02:11 tadpole2 kernel: 2097136 pages RAM
Sep 16 02:02:11 tadpole2 kernel: 50866 pages reserved
Sep 16 02:02:11 tadpole2 kernel: 330326 pages shared
Sep 16 02:02:11 tadpole2 kernel: 1645539 pages non-shared
一行目のメッセージでググるとメモリが足りないんだ、って出てきたんだけど、実際はそんなこともないみたい。ethernet経由なら問題ないし。うーん。。。
ちなみに、起動時に"PCIe errors handled by OS."てのが出てる。

Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:03.0: PCI bridge to [bus 01-01]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:03.0: PCI bridge, secondary bus 0000:01
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:03.0: bridge window [io disabled]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:03.0: bridge window [mem disabled]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:03.0: bridge window [mem pref disabled]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:02.0: PCI bridge to [bus 04-04]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:02.0: PCI bridge, secondary bus 0000:04
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:02.0: bridge window [io disabled]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:02.0: bridge window [0xfb300000-0xfb3fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:02.0: bridge window [0xf7800000-0xf7ffffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:04.0: PCI bridge to [bus 05-05]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:04.0: PCI bridge, secondary bus 0000:05
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:04.0: bridge window [0xc000-0xcfff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:04.0: bridge window [0xfb400000-0xfb4fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:04.0: bridge window [0xf8000000-0xf9ffffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:02:00.0: PCI bridge to [bus 03-05]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:02:00.0: PCI bridge, secondary bus 0000:03
Sep 15 03:21:43 tadpole2 kernel: pci 0000:02:00.0: bridge window [0xc000-0xcfff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:02:00.0: bridge window [0xfb300000-0xfb4fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:02:00.0: bridge window [0xf7800000-0xf9ffffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:05.0: PCI bridge to [bus 02-05]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:05.0: PCI bridge, secondary bus 0000:02
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:05.0: bridge window [0xc000-0xcfff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:05.0: bridge window [0xfb300000-0xfb4fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:05.0: bridge window [0xf7800000-0xf9ffffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.0: PCI bridge to [bus 06-06]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.0: PCI bridge, secondary bus 0000:06
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.0: bridge window [0x2000-0x2fff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.0: bridge window [0xc0000000-0xc01fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.0: bridge window [0xc0200000-0xc03fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.4: PCI bridge to [bus 07-07]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.4: PCI bridge, secondary bus 0000:07
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.4: bridge window [0xd000-0xdfff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.4: bridge window [0xfb500000-0xfb5fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.4: bridge window [0xc0400000-0xc05fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.5: PCI bridge to [bus 08-08]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.5: PCI bridge, secondary bus 0000:08
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.5: bridge window [0xe000-0xefff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.5: bridge window [0xfb600000-0xfb6fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.5: bridge window [0xc0600000-0xc07fffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1e.0: PCI bridge to [bus 09-09]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1e.0: PCI bridge, secondary bus 0000:09
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1e.0: bridge window [io disabled]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1e.0: bridge window [0xfb700000-0xfbffffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1e.0: bridge window [0xfa000000-0xfaffffff]
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:03.0: PCIe errors handled by OS.
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:03.0: ACPI _OSC control granted for 0x1c
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:03.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:05.0: PCIe errors handled by OS.
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:05.0: ACPI _OSC control granted for 0x1c
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:05.0: PCI INT A -> GSI 16 (level, low) -> IRQ 16
Sep 15 03:21:43 tadpole2 kernel: pci 0000:02:00.0: PCIe errors handled by OS.
Sep 15 03:21:43 tadpole2 kernel: pci 0000:02:00.0: ACPI _OSC control granted for 0x1c
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:02.0: PCIe errors handled by OS.
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:02.0: ACPI _OSC control granted for 0x1c
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:04.0: PCIe errors handled by OS.
Sep 15 03:21:43 tadpole2 kernel: pci 0000:03:04.0: ACPI _OSC control granted for 0x1c
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.0: PCIe errors handled by OS.
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.0: ACPI _OSC control granted for 0x1c
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.0: enabling device (0104 -> 0107)
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.0: PCI INT A -> GSI 17 (level, low) -> IRQ 17
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.4: PCIe errors handled by OS.
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.4: ACPI _OSC control granted for 0x1c
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.4: PCI INT A -> GSI 17 (level, low) -> IRQ 17
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.5: PCIe errors handled by OS.
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.5: ACPI _OSC control granted for 0x1c
Sep 15 03:21:43 tadpole2 kernel: pci 0000:00:1c.5: PCI INT B -> GSI 16 (level, low) -> IRQ 16
このerrorが出てるのはPCI Express portのよう。lspciでは以下のような感じ。Infinibandのカードが刺さってるのは当然このPCI ExpressスロットなのでBIOSの設定がいかんのかなぁ。

00:00.0 Host bridge: Intel Corporation Core Processor DMI (rev 11)
00:03.0 PCI bridge: Intel Corporation Core Processor PCI Express Root Port 1 (rev 11)
00:05.0 PCI bridge: Intel Corporation Core Processor PCI Express Root Port 3 (rev 11)
00:08.0 System peripheral: Intel Corporation Core Processor System Management Registers (rev 11)
00:08.1 System peripheral: Intel Corporation Core Processor Semaphore and Scratchpad Registers (rev 11)
00:08.2 System peripheral: Intel Corporation Core Processor System Control and Status Registers (rev 11)
00:08.3 System peripheral: Intel Corporation Core Processor Miscellaneous Registers (rev 11)
00:10.0 System peripheral: Intel Corporation Core Processor QPI Link (rev 11)
00:10.1 System peripheral: Intel Corporation Core Processor QPI Routing and Protocol Registers (rev 11)
00:1a.0 USB Controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 05)
00:1c.0 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 1 (rev 05)
00:1c.4 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 5 (rev 05)
00:1c.5 PCI bridge: Intel Corporation 5 Series/3400 Series Chipset PCI Express Root Port 6 (rev 05)
00:1d.0 USB Controller: Intel Corporation 5 Series/3400 Series Chipset USB2 Enhanced Host Controller (rev 05)
00:1e.0 PCI bridge: Intel Corporation 82801 PCI Bridge (rev a5)
00:1f.0 ISA bridge: Intel Corporation 3400 Series Chipset LPC Interface Controller (rev 05)
00:1f.2 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 4 port SATA IDE Controller (rev 05)
00:1f.3 SMBus: Intel Corporation 5 Series/3400 Series Chipset SMBus Controller (rev 05)
00:1f.5 IDE interface: Intel Corporation 5 Series/3400 Series Chipset 2 port SATA IDE Controller (rev 05)
02:00.0 PCI bridge: Integrated Device Technology, Inc. HIO524G2 PCI Express Gen2 Switch (rev 02)
03:02.0 PCI bridge: Integrated Device Technology, Inc. HIO524G2 PCI Express Gen2 Switch (rev 02)
03:04.0 PCI bridge: Integrated Device Technology, Inc. HIO524G2 PCI Express Gen2 Switch (rev 02)
04:00.0 InfiniBand: Mellanox Technologies MT26418 [ConnectX VPI PCIe 2.0 5GT/s - IB DDR / 10GigE] (rev a0)
05:00.0 RAID bus controller: 3ware Inc 9650SE SATA-II RAID PCIe (rev 01)
07:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
08:00.0 Ethernet controller: Intel Corporation 82574L Gigabit Network Connection
09:03.0 VGA compatible controller: Matrox Graphics, Inc. MGA G200eW WPCM450 (rev 0a)

NFS over RDMA

Redhat Enterprise Linux 6.1ではNFS over RDMAがサポートされるみたい。
http://docs.redhat.com/docs/en-US/Red_Hat_Enterprise_Linux/6/html/6.1_Technical_Notes/nfs-utils.html
これでようやくInfiniband関連でいちいちRPMを作ってインストールする手間が省けるようになるのかな。
CentOS6はまだ??

IPoIB on Fedora 15-Beta

Fedora 15-Betaをインストールしてみたが、IPoIBがうまく設定できない。/etc/sysconfig/network-scripts/ifcfg-ib0を作成してifup ib0としてもIP addressが設定されない。ipコマンドで直接IP addressを指定しようとしてもダメ。エラーメッセージが何か表示されていたが、既にアンインストールしてしまったのでわかりません。
2011/06/03追記。Fedora 15をインストールしてみたが、状況は同じ。下記のようなエラーが表示される。


# ifup ib0
Error: an inet prefix is expected rather than "192.168.1.101/".
Error adding address 192.168.1.101 for ib0.
bind: Cannot assign requested address
RTNETLINK answers: No such process
Ifconfig uses the ioctl access method to get the full address information, which limits hardware addresses to 8 bytes.
Because Infiniband address has 20 bytes, only the first 8 bytes are displayed correctly.
Ifconfig is obsolete! For replacement check ip.

snmpd error on Fedora 14

InfiniBandが含まれているシステムの場合、


ioctl 35123 returned -1
couldn't find ifIndex for '*', skipping
というメッセージが1分毎に/var/log/messagesに出力される。Fedora 14のnet-snmpのversionは5.5。ChangeLogによるとNet-SNMP-5.6ではこのバグは修正されたみたいだったので、Fedora 15-Betaのnet-snmp(versionは5.6.1)をインストールしてみた。たしかに、上記メッセージは表示されなくなったが、今度は

Wrong netlink message type 3
というメッセージが1分毎に出力される。特にInfiniBandをsnmpでモニタしているわけではないので、/etc/sysconfig/snmpdを

# snmpd command line options
# OPTIONS="-LS0-6d -Lf /dev/null -p /var/run/snmpd.pid"
OPTIONS="-LF0-6d -Lf /dev/null -p /var/run/snmpd.pid"
と書き換えてlogを止めてしまった。まぁ、外に公開しているマシンでは無いので問題は無いだろう。
2011/05/08追記。/etc/sysconfig/snmpdを上記のようにするとそもそもマシンが正常に起動できなくなってしまったので、OPTIONS="-p /var/run/snmpd.pid"としました。Logging optionsの指定の仕方がよくわかっておりません。はい。