Hadoop on raad2
Jump to navigation
Jump to search
==
- Copy hadoop-template-config files to home directory - Copy hadoop-startup-scripts to home directory -
- Issue squeue -u username -l to find the running jobs and the node ids -
Features:
a. On-Demand ( For workloads from few hours upto one week ) b. Persistent ( For consistent workloads ) c. Scalable
On-Demand Cluster - Use Temp Storage
Persistent Cluster - Use Persistent Storage. - Use project reservation which will allow your cluster to stay up for upto 60 days.