草庐IT

Datapipeline

全部标签

hadoop - AWS Datapipeline,运行配置单元脚本的 EmrActivity 步骤立即失败并显示 'No such file or directory'

我有一个简单的DataPipeline作业,它只有一个EmrActivity和一个尝试从我的s3存储桶执行配置单元脚本的步骤。EmrActivity的配置如下所示:{"name":"ExtractandTransform","id":"HiveActivity","type":"EmrActivity","runsOn":{"ref":"EmrCluster"},"step":["command-runner.jar,/usr/share/aws/emr/scripts/hive-script--run-hive-script--args-fs3://[bucket-name-remo