DutchGrid

Large-Scale Distributed Computing in the Netherlands
DutchGrid
an overview
David Groep, NIKHEF
What is DutchGrid?
• collaboration of 12 organisations
• established in 2000
• functions as a platform,
getting manpower & hardware from partner orgs
• major contributors
Virtual Laboratory Project (ICES/KIS-II)
– ASCI (5 combined Dutch CS Faculties)
– Foundation NCF (NWO – natl research council)
– NIKHEF (EDG)
– WTCW
DutchGrid Sites
WCW
Amsterdam
ASTRON,
JIVE
NIKHEF
SARA
UvA
AMOLF
CWI
Amsterdam
Telin
Leiden
KNMI
Utrecht
Delft
Nijmegen
WCW
VU
DutchGrid site map 20021104
David Groep, NIKHEF
Resources
• ASCI DAS-2 (VU, UvA, Leiden, TUDelft, Utrecht)
– 200 dual P-III 1GHz CPUs
– homogeneous clusters, 5 locations
• NIKHEF DataGrid clusters
– 75 dual P-III ~ 1GHz
– 1Gb/s IPv4 + 1Gb/s IPv6
• NCF Grid
national computer facilities foundation from NWO
–
–
–
–
66 node dual AMD-K7 Fabric Research Cluster (NIKHEF)
32 node duals “production quality” cluster (SARA)*
10Gb/s optical “lambda” test bed†
…
• BioASP – various smaller O(10 node) clusters
Resources (cont.)
SARA – National HPC Centre
• Processing
– SGI 1024 processor MPP
• Mass storage
– StorageTek NearLine tape robot
– currently: 500 TByte
– will grow “indefinitely” (with funds from NCF)
• User expertise centre
In Total
Operations/deployment effort ~ 8 FTE available
Research effort O (40 FTE) over 12 organisations
Resource Usage
Networks
2xGbE
ONS
CHICAGO, IL
STAR
TAP
6509
2.5Gb lambda
BR1
CHI
7xGbE
SP
01
BR1
AMS
2.5G
POS
622Mb to “rest”
10GbE
10G POS Level3
UvA
NIKHEF
“NCSA”
“ANL”
OC48c
SR
GbE
622Mb L2 VPN
Star
Light
T640
Global Xing
AMSTERDAM
IGRID
18xGbE
GbE
ARGONNE
IL
SingAREN
TANet2
…
GbE’s
ONS
2xGbE
Star
Light
6509
GbE
Star
Light
RTR
ONS
622Mb “rest”
2x2.5Gb
2xGbE
OC48c lambda
RTR
15454
CERN,CH CERN
AR5
10G
POS
BR4
CR1-1
CR1-2
BR2
CR2-1
CR2-2
10G POS Tyco
ABILEN
E NY
NY
622M PO Prot.
Tyco/IEEAF
NIKHEF network load
Monthly graph NIKHEF-SURFnet5 IPv4 interconnect
October/November 2002
New Initiatives inside NL
NCFGrid
strengthening Grid Infrastructure in NL
• 4 partners (NIKHEF, ASCI, SARA, ASTRON)
• 600 kEUR funding
• hardware (3 clusters, 10Gb/s networking)
and people (1.5 FTE over 3 years)
• fabric research + production-quality grids
• new apps: bio informatics, astronomy
• approved August 2002
First cluster assembled and being tested…
New Initiatives inside NL (2)
Virtual Laboratory for e-Science
in planning stage
O (30-50 MEUR)
Dutch “knowledge infrastructure” project
• Higher-level services to efficiently use global resources
• Both “bottom-up” and “top-down” in same project
• 14 partners, 6 application domains
• middleware research programme
D.I.Sc. FoodInf BioInf
Large
Bio
Equip diversity
…
Test Bed
Int
Visual.
HPC
Inf.
Mngt
Intg Exp
Envs
UIs
SecAAA Networks
Scaling
&
Validation
What is happening where in NL?
DutchGrid Op Services
• Authentication Services (Certification Authority)
– EDG CACG “proper” CA
– Student and educational CA
– EDG “Tutorial” CA
• Regular coordination and info meetings
• Installation support
– Have been distributing EDG 1.2 till now
• User support
Principal Apps
• HEP: DØ, Atlas, LHCb, Alice
Monte-Carlo and Analysis
• OPERA – ozone monitoring
• WTCW Virtual Laboratory
visual analysis environment
for (small-scale) experimental science
– Chemo-physical surface analysis (PIXE,FT-IR,SIMS)
– BioASP – correlating “omics” databases
– Virtual Surgery (planning by-passes, artery repairs)
• EcoGrid
correlating bio-diversity information databases
• Radio Astronomy
LOFAR, AVO, VLBI – semi-online and offline processing
Research Areas in NL
• High-bandwidth networking
SURFnet, UvA, SARA, NIKHEF
• Generic AAA and `security’
UvA, NIKHEF
• Cluster, Storage Management & Monitoring
NIKHEF, SARA
• Adaptive programming environments
Free University Amsterdam
• Memory-processor co-allocation
TU Delft
• Federated Information & Content Management
UvA
• Interactive visualisation
CWI, UvA
Summary
• DutchGrid Platform started informally in 2000
• de-facto focus for Grid computing in NL
• ops (CA, web, …) supported by partners
• mix of people from all ‘layers’
networks, fabrics, security&AAA, prog. environments,
HPC visualisation, semantic DBs, applications