我有没有 cygwin 的窗口和 mahout 的单元测试,并且这个测试在它期间启动 hadoop 作业我有下一个异常(exception):
Jul 9, 2013 5:21:23 AM org.apache.hadoop.util.NativeCodeLoader WARNING: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable Jul 9, 2013 5:21:23 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Build Clusters Input: file:/tmp/mahout1-TestClusterDumper-3279087666375853056/testdata Out: file:/tmp/mahout1-TestClusterDumper-3279087666375853056/output Measure: org.apache.mahout.common.distance.EuclideanDistanceMeasure@62c8769b t1: 8.0 t2: 4.0 Jul 9, 2013 5:21:24 AM org.slf4j.impl.JCLLoggerAdapter info INFO: Input: file:/tmp/mahout1-TestClusterDumper-3279087666375853056/testdata Clusters In: file:/tmp/mahout1-TestClusterDumper-3279087666375853056/output/clusters-0-final Out: file:/tmp/mahout1-TestClusterDumper-3279087666375853056/output/kmeans Distance: org.apache.mahout.common.distance.EuclideanDistanceMeasure Jul 9, 2013 5:21:24 AM org.slf4j.impl.JCLLoggerAdapter info INFO: convergence: 0.0010 max Iterations: 10
java.io.IOException: Failed to set permissions of path: C:\Users\Administrator\Desktop\mahout\mahout\integration\target\mahout-TestClusterDumper-5458229048736903168\hadoop0.5515906057710666\mapred\staging\Administrator-585933322.staging to 0700 at org.apache.hadoop.fs.FileUtil.checkReturnValue(FileUtil.java:689) at org.apache.hadoop.fs.FileUtil.setPermission(FileUtil.java:662) at org.apache.hadoop.fs.RawLocalFileSystem.setPermission(RawLocalFileSystem.java:509) ...
Jul 9, 2013 5:21:24 AM org.apache.hadoop.security.UserGroupInformation doAs SEVERE: PriviledgedActionException as:Administrator cause:java.io.IOException: Failed to set permissions of path: C:\Users\Administrator\Desktop\mahout\mahout\integration\target\mahout-TestClusterDumper-5458229048736903168\hadoop0.5515906057710666\mapred\staging\Administrator-585933322.staging to 0700
我不会用 cygwin!
最佳答案
Windows 和 Hadoop 并不是真正喜欢彼此,但如果我没记错的话,它与 JVM 有更多的关系。这是自 0.22.0 以上版本以来的 Hadoop 已知问题,但我不确定它是否已在最新版本中得到修复。
有/曾经有解决方法,但当我也遇到这个问题时,我记得它非常复杂。
我建议您使用 linux(虚拟)机器将 Mahout 与 Hadoop 结合使用。
哦!有一张 hadoop 票证 ( link ) 讨论了这个问题。
我也找到了这个(link)
关于windows - PriviledgedActionException 无法设置路径的权限,我们在Stack Overflow上找到一个类似的问题: https://stackoverflow.com/questions/17550242/