|
Related YoLinux Tutorials:
°Linux Hardware components
°YoLinux Tutorials Index
Free Information Technology Magazines and Document Downloads
|
Clustered Filesystems:
Logical Volume Manager (LVM):
| High Performance Computational Clustering: |
Overview of all Linux clustering.
ClusteringTools:
- OSCAR - [sourceforge] - Installation, configuration, management, programming, and using clusters.
- SCALI.com: Manage:
Enterprise Cluster management solution (Installation, sys admin,
monitoring, workload management alarms and events, accounting,
heterogeneous, hardware management, central point management.)
Scheduling:
Message Passing Interface (MPI): Programmers API for software to coordinate tasks access multiple nodes.
IPC Communication Libraries:
- PVM (Parallel Virtual Machine):
- TIPC: Transparent Inter Process Communication: intra cluster IPC. High speed fault tolerant and redundant synchronous sockets and asynchronous network communication.
- UPC: Berkeley Unified Parallel C
- C language extension. Uniform programming model for both shared and
distributed memory hardware. Programmer is presented with a single
shared Partitioned Global Address Space (PGAS) where variables may be
read and written by any processor (SPMD: Single Program, Multiple
Data).
- Titanium: UC Berkeley developed Java "dialect" to support massively parallel supercomputers and distributed memory clusters.
- Co-Array FORTRAN: Extensions to FORTRAN 95 for shared and distributed memory computers and clusters. (to be added to FORTRAN standard)
- OpenMP.org: Older cross
platform API which supports shared memory and parallel programming in
C/C++ and FORTRAN for NUMA and SMP Multi-Processing (MP) systems.
| HA: High Availability Clusters |
Linux Journal: A High-Availability Cluster for Linux - by Phil Lewis June 29, 1999
- Project MegaGrind: Best Practices for Grid Computing
Most Cloud computing efforts are available as services purchased through vendors such as
Amazon Web Services (EC2: Elastic Computing Cloud) or
Google AppEngine.
Project Caroline is an open source project to provide cloud computing infrastructure.
- Myrinet - High speed low latency interconnection. Switch interconnect.
- Dolphin Interconnect
- Ring topology. Also 2D and 3D topologies. Traffic shared on ring. If
one node goes out, the ring is broken and communications stop.
- Quadrics - European vendor. Switched network. Premium high speed.
Infiniband:
High Performance / Low latency Gigabit Ethernet (GE):
- Ammasso - Uses Remote Direct Memory Access (RDMA). Hardware and software solution.
- Level5 - EtherFabric hardware and software solution.
- Precision IO - Software
Latency Comparison:
-
| Hardware |
Latency (microseconds) |
Bandwidth |
| Quadrics |
3 |
800 Mb/s (Elan 4) |
| Myrinet |
6 |
800 Mb/s (Rev E) |
| Infiniband 4X (MPI driver) |
6 |
1.8 Gb/s
(10 Gb/s Voltaire) |
| Level 5 Networks (Low latency GE NIC/driver) |
7 end to end MPI
13 with switch
9 TCP end to end |
|
| Ammasso (RDMA) |
16 end to end |
|
| Standard Ethernet (GE) TCP/IP |
65 MPICH over TCP/IP
80-100 TCP/IP |
60 - 80 Mb/s |
Source: Foundry Networks 2004
Network monitoring:
 Books: |
-
 |
"How to Build a Beowulf: A Guide to the Implementation and Application of PC Clusters"
by Thomas L. Sterling, John Salmon, Donald J. Becker, Savarese, Daniel F. Savarese
ISBN #026269218X, MIT Press
|
|
 |
"Linux Cluster Architecture"
by Alex Vremios
ISBN #0672323680, Sams 1st edition
|
|
 |
"Building Linux Clusters" (and CD)
by David H. M. Spector, Mark Stone
O'Reilly and Associates
ISBN #1565926250
|
|
 |
"Server Load Balancing"
by Tony Bourke
O'Reilly and Associates
ISBN #0596000502
|
|
 |
"In Search of Clusters"
by Gregory F. Pfister
ISBN #0138997098, Prentice Hall PTR
Theory and concepts.
|
|
 |
"Blueprints for High Availability"
by Evan Marcus, Hal Stem
ISBN #0471430269, Wiley
|
|
|
|
