Hi,
We would like to set up a Hadoop test environment under the following
scenario:
- 6 PCs
- Each PC has an Sata disk (2TB) and an SSD disk (256GB)
- OS: Ubuntu 12.04 Server LTS, which is installed in Sata drive
- SSD drive is mounted under /ssd
- Hadoop user name: hadoop
Goal:
- 1 PC: pure namenode
- Other 5 PCs: datanodes (1 of which also serves as secondary namenode)
- Sata disk with bigger size: common HDFS data storage
- SSD disk with smaller size but faster: temporary data storage when
processing map reduce jobs or doing data analyzing.
If this is the case, then am I right under the following cofiguration?
- In each node, configure hadoop.tmp.dir under core-site.xml and specify 1
path: /home/hadoop/db/hadoop-${user.name}
- In namenode, configure dfs.name.dir under hdfs-site.xml and specify 2
paths: ${hadoop.tmp.dir}/dfs/name,/ssd/hadoop/dfs/name
- In datanode, configure mapred.local.dir under mapred-site.xml and specify
1 path:
/ssd/hadoop/mapred/local
Is there anything that needs to be modified?
Any help would be greatly appreciated.
--
View this message in context:
http://lucene.472066.n3.nabble.com/Configuring-Hadoop-clusters-with-multiple-PCs-each-of-which-has-2-hard-disks-Sata-SSD-tp3994589.html
Sent from the Hadoop lucene-users mailing list archive at Nabble.com.
