我正在尝试将 hadoop 流与 mongo-hadoop 和 python 一起使用。 从 mongodb 集合中读取有效，写入则不然。 如下所示，作业成功运行，但输出集合保持为空。
我尝试了 mongo-hadoop 的预构建 1.4.0 jar 和最新的 git 快照 (1.4.1)。 Hadoop Distribution 是带有 HDP 2.2.4.2 的 Hortonworks Sandbox，但 HDP 2.3 也不起作用。
mongo-hadoop wiki 已经有点过时了，因此我不确定是否使用了正确的参数、是否遗漏了某些内容或发现了错误。
$cat run_python.sh
#!/bin/bash
set -x
export LIBJARS="/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-core-1.4.0.jar","/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-streaming-1.4.0.jar","/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-java-driver-3.0.2.jar"
su hdfs - -m -c "hadoop jar /usr/hdp/2.2.4.2-2/hadoop-mapreduce/hadoop-streaming.jar \
-files /home/hdfs/example/video/python/mapper.py,/home/hdfs/example/video/python/reducer.py \
-D stream.io.identifier.resolver.class=com.mongodb.hadoop.streaming.io.MongoIdentifierResolver \
-D mongo.auth.uri=mongodb://hadoop:password@127.0.0.1:27017/admin \
-D mongo.input.uri=mongodb://hadoop:password@127.0.0.1:27017/hadoop.in \
-D mongo.output.uri=mongodb://hadoop:password@127.0.0.1:27017/hadoop.out \
-D mongo.job.verbose=true \
-libjars ${LIBJARS} \
-input /tmp/in \
-output /tmp/out \
-io mongodb \
-inputformat com.mongodb.hadoop.mapred.MongoInputFormat \
-outputformat com.mongodb.hadoop.mapred.MongoOutputFormat \
-mapper mapper.py \
-reducer reducer.py"
输出
[root@sandbox python]# ./run_python.sh
+ export LIBJARS=/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-core-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-streaming-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-java-driver-3.0.2.jar
+ LIBJARS=/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-core-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-streaming-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-java-driver-3.0.2.jar
+ su hdfs - -m -c 'hadoop jar /usr/hdp/2.2.4.2-2/hadoop-mapreduce/hadoop-streaming.jar -files /home/hdfs/example/video/python/mapper.py,/home/hdfs/example/video/python/reducer.py -D stream.io.identifier.resolver.class=com.mongodb.hadoop.streaming.io.MongoIdentifierResolver -D mongo.auth.uri=mongodb://hadoop:password@127.0.0.1:27017/admin -D mongo.input.uri=mongodb://hadoop:password@127.0.0.1:27017/hadoop.in -D mongo.output.uri=mongodb://hadoop:password@127.0.0.1:27017/hadoop.out -D mongo.job.verbose=true -libjars /usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-core-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-streaming-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-java-driver-3.0.2.jar -input /tmp/in -output /tmp/out -io mongodb -inputformat com.mongodb.hadoop.mapred.MongoInputFormat -outputformat com.mongodb.hadoop.mapred.MongoOutputFormat -mapper mapper.py -reducer reducer.py'
packageJobJar: [] [/usr/hdp/2.2.4.2-2/hadoop-mapreduce/hadoop-streaming-2.6.0.2.2.4.2-2.jar] /tmp/streamjob7732112681113565020.jar tmpDir=null
15/09/24 13:38:38 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
15/09/24 13:38:38 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8050
15/09/24 13:38:39 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
15/09/24 13:38:39 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8050
15/09/24 13:38:41 INFO driver.cluster: Cluster created with settings {hosts=[127.0.0.1:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500}
15/09/24 13:38:41 INFO driver.cluster: No server chosen by PrimaryServerSelector from cluster description ClusterDescription{type=UNKNOWN, connectionMode=SINGLE, all=[ServerDescription{address=127.0.0.1:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out
15/09/24 13:38:41 INFO driver.connection: Opened connection [connectionId{localValue:1, serverValue:1358}] to 127.0.0.1:27017
15/09/24 13:38:41 INFO driver.cluster: Monitor thread successfully connected to server with description ServerDescription{address=127.0.0.1:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 0, 5]}, minWireVersion=0, maxWireVersion=3, maxDocumentSize=16777216, roundTripTimeNanos=28894677}
15/09/24 13:38:42 INFO driver.connection: Opened connection [connectionId{localValue:2, serverValue:1359}] to 127.0.0.1:27017
15/09/24 13:38:42 INFO splitter.MongoSplitterFactory: Retrieved Collection stats:{ "ns" : "hadoop.in" , "count" : 100 , "size" : 148928 , "avgObjSize" : 1489 , "numExtents" : 3 , "storageSize" : 172032 , "lastExtentSize" : 131072.0 , "paddingFactor" : 1.0 , "paddingFactorNote" : "paddingFactor is unused and unmaintained in 3.0. It remains hard coded to 1.0 for compatibility only." , "userFlags" : 1 , "capped" : false , "nindexes" : 1 , "indexDetails" : { } , "totalIndexSize" : 8176 , "indexSizes" : { "_id_" : 8176} , "ok" : 1.0}
15/09/24 13:38:42 INFO driver.connection: Closed connection [connectionId{localValue:2, serverValue:1359}] to 127.0.0.1:27017 because the pool has been closed.
15/09/24 13:38:42 INFO mapred.MongoInputFormat: Using com.mongodb.hadoop.splitter.StandaloneMongoSplitter@1a43c7a0 to calculate splits. (old mapreduce API)
15/09/24 13:38:42 INFO driver.cluster: Cluster created with settings {hosts=[127.0.0.1:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500}
15/09/24 13:38:42 INFO splitter.StandaloneMongoSplitter: Running splitvector to check splits against mongodb://hadoop:password@127.0.0.1:27017/hadoop.in
15/09/24 13:38:42 INFO driver.cluster: No server chosen by ReadPreferenceServerSelector{readPreference=primary} from cluster description ClusterDescription{type=UNKNOWN, connectionMode=SINGLE, all=[ServerDescription{address=127.0.0.1:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out
15/09/24 13:38:42 INFO driver.connection: Opened connection [connectionId{localValue:3, serverValue:1360}] to 127.0.0.1:27017
15/09/24 13:38:42 INFO driver.cluster: Monitor thread successfully connected to server with description ServerDescription{address=127.0.0.1:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 0, 5]}, minWireVersion=0, maxWireVersion=3, maxDocumentSize=16777216, roundTripTimeNanos=27903847}
15/09/24 13:38:42 INFO driver.connection: Opened connection [connectionId{localValue:4, serverValue:1361}] to 127.0.0.1:27017
15/09/24 13:38:42 WARN splitter.StandaloneMongoSplitter: WARNING: No Input Splits were calculated by the split code. Proceeding with a *single* split. Data may be too small, try lowering 'mongo.input.split_size' if this is undesirable.
15/09/24 13:38:42 INFO splitter.MongoCollectionSplitter: Created split: min=null, max= null
15/09/24 13:38:42 INFO driver.connection: Closed connection [connectionId{localValue:4, serverValue:1361}] to 127.0.0.1:27017 because the pool has been closed.
15/09/24 13:38:43 INFO mapreduce.JobSubmitter: number of splits:1
15/09/24 13:38:43 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1443100485659_0008
15/09/24 13:38:44 INFO impl.YarnClientImpl: Submitted application application_1443100485659_0008
15/09/24 13:38:44 INFO mapreduce.Job: The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1443100485659_0008/
15/09/24 13:38:44 INFO mapreduce.Job: Running job: job_1443100485659_0008
15/09/24 13:38:52 INFO mapreduce.Job: Job job_1443100485659_0008 running in uber mode : false
15/09/24 13:38:52 INFO mapreduce.Job: map 0% reduce 0%
15/09/24 13:39:01 INFO mapreduce.Job: map 100% reduce 0%
15/09/24 13:39:09 INFO mapreduce.Job: map 100% reduce 100%
15/09/24 13:39:09 INFO mapreduce.Job: Job job_1443100485659_0008 completed successfully
15/09/24 13:39:10 INFO mapreduce.Job: Counters: 49
File System Counters
FILE: Number of bytes read=6506
FILE: Number of bytes written=257301
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=376
HDFS: Number of bytes written=3000
HDFS: Number of read operations=3
HDFS: Number of large read operations=0
HDFS: Number of write operations=1
Job Counters
Launched map tasks=1
Launched reduce tasks=1
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=5865
Total time spent by all reduces in occupied slots (ms)=5166
Total time spent by all map tasks (ms)=5865
Total time spent by all reduce tasks (ms)=5166
Total vcore-seconds taken by all map tasks=5865
Total vcore-seconds taken by all reduce tasks=5166
Total megabyte-seconds taken by all map tasks=1466250
Total megabyte-seconds taken by all reduce tasks=1291500
Map-Reduce Framework
Map input records=100
Map output records=100
Map output bytes=6300
Map output materialized bytes=6506
Input split bytes=376
Combine input records=0
Combine output records=0
Reduce input groups=100
Reduce shuffle bytes=6506
Reduce input records=100
Reduce output records=100
Spilled Records=200
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=152
CPU time spent (ms)=2150
Physical memory (bytes) snapshot=295743488
Virtual memory (bytes) snapshot=1995943936
Total committed heap usage (bytes)=262909952
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=0
15/09/24 13:39:10 INFO streaming.StreamJob: Output directory: /tmp/out
不过，使用相同的脚本并将输出存储为 bson 是可行的。
[root@sandbox python]# ./run_python_bson_output.sh
+ export LIBJARS=/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-core-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-streaming-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-java-driver-3.0.2.jar
+ LIBJARS=/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-core-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-streaming-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-java-driver-3.0.2.jar
+ su hdfs - -m -c 'hadoop jar /usr/hdp/2.2.4.2-2/hadoop-mapreduce/hadoop-streaming.jar -files /home/hdfs/example/video/python/mapper.py,/home/hdfs/example/video/python/reducer.py -D stream.io.identifier.resolver.class=com.mongodb.hadoop.streaming.io.MongoIdentifierResolver -D mongo.auth.uri=mongodb://hadoop:password@127.0.0.1:27017/admin -D mongo.input.uri=mongodb://127.0.0.1:27017/hadoop.in -D mongo.job.verbose=true -D mapreduce.output.fileoutputformat.outputdir=/tmp/output.bson -libjars /usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-core-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-hadoop-streaming-1.4.0.jar,/usr/hdp/2.2.4.2-2/hadoop/lib/mongo-java-driver-3.0.2.jar -input /tmp/in -output /tmp/videos_streaming -io mongodb -inputformat com.mongodb.hadoop.mapred.MongoInputFormat -outputformat com.mongodb.hadoop.mapred.BSONFileOutputFormat -mapper mapper.py -reducer reducer.py'
packageJobJar: [] [/usr/hdp/2.2.4.2-2/hadoop-mapreduce/hadoop-streaming-2.6.0.2.2.4.2-2.jar] /tmp/streamjob3257949526000997018.jar tmpDir=null
15/09/24 13:38:00 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
15/09/24 13:38:00 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8050
15/09/24 13:38:00 INFO impl.TimelineClientImpl: Timeline service address: http://sandbox.hortonworks.com:8188/ws/v1/timeline/
15/09/24 13:38:00 INFO client.RMProxy: Connecting to ResourceManager at sandbox.hortonworks.com/10.0.2.15:8050
15/09/24 13:38:01 INFO driver.cluster: Cluster created with settings {hosts=[127.0.0.1:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500}
15/09/24 13:38:01 INFO driver.cluster: No server chosen by PrimaryServerSelector from cluster description ClusterDescription{type=UNKNOWN, connectionMode=SINGLE, all=[ServerDescription{address=127.0.0.1:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out
15/09/24 13:38:02 INFO driver.connection: Opened connection [connectionId{localValue:1, serverValue:1352}] to 127.0.0.1:27017
15/09/24 13:38:02 INFO driver.cluster: Monitor thread successfully connected to server with description ServerDescription{address=127.0.0.1:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 0, 5]}, minWireVersion=0, maxWireVersion=3, maxDocumentSize=16777216, roundTripTimeNanos=24906864}
15/09/24 13:38:02 INFO driver.connection: Opened connection [connectionId{localValue:2, serverValue:1353}] to 127.0.0.1:27017
15/09/24 13:38:02 INFO splitter.MongoSplitterFactory: Retrieved Collection stats:{ "ns" : "hadoop.in" , "count" : 100 , "size" : 148928 , "avgObjSize" : 1489 , "numExtents" : 3 , "storageSize" : 172032 , "lastExtentSize" : 131072.0 , "paddingFactor" : 1.0 , "paddingFactorNote" : "paddingFactor is unused and unmaintained in 3.0. It remains hard coded to 1.0 for compatibility only." , "userFlags" : 1 , "capped" : false , "nindexes" : 1 , "indexDetails" : { } , "totalIndexSize" : 8176 , "indexSizes" : { "_id_" : 8176} , "ok" : 1.0}
15/09/24 13:38:02 INFO driver.connection: Closed connection [connectionId{localValue:2, serverValue:1353}] to 127.0.0.1:27017 because the pool has been closed.
15/09/24 13:38:02 INFO mapred.MongoInputFormat: Using com.mongodb.hadoop.splitter.StandaloneMongoSplitter@6e2cc310 to calculate splits. (old mapreduce API)
15/09/24 13:38:02 INFO driver.cluster: Cluster created with settings {hosts=[127.0.0.1:27017], mode=SINGLE, requiredClusterType=UNKNOWN, serverSelectionTimeout='30000 ms', maxWaitQueueSize=500}
15/09/24 13:38:02 INFO splitter.StandaloneMongoSplitter: Running splitvector to check splits against mongodb://127.0.0.1:27017/hadoop.in
15/09/24 13:38:02 INFO driver.cluster: No server chosen by ReadPreferenceServerSelector{readPreference=primary} from cluster description ClusterDescription{type=UNKNOWN, connectionMode=SINGLE, all=[ServerDescription{address=127.0.0.1:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out
15/09/24 13:38:02 INFO driver.connection: Opened connection [connectionId{localValue:3, serverValue:1354}] to 127.0.0.1:27017
15/09/24 13:38:02 INFO driver.cluster: Monitor thread successfully connected to server with description ServerDescription{address=127.0.0.1:27017, type=STANDALONE, state=CONNECTED, ok=true, version=ServerVersion{versionList=[3, 0, 5]}, minWireVersion=0, maxWireVersion=3, maxDocumentSize=16777216, roundTripTimeNanos=32114805}
15/09/24 13:38:03 INFO driver.connection: Opened connection [connectionId{localValue:4, serverValue:1355}] to 127.0.0.1:27017
15/09/24 13:38:03 WARN splitter.StandaloneMongoSplitter: WARNING: No Input Splits were calculated by the split code. Proceeding with a *single* split. Data may be too small, try lowering 'mongo.input.split_size' if this is undesirable.
15/09/24 13:38:03 INFO splitter.MongoCollectionSplitter: Created split: min=null, max= null
15/09/24 13:38:03 INFO driver.connection: Closed connection [connectionId{localValue:4, serverValue:1355}] to 127.0.0.1:27017 because the pool has been closed.
15/09/24 13:38:03 INFO mapreduce.JobSubmitter: number of splits:1
15/09/24 13:38:03 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1443100485659_0007
15/09/24 13:38:03 INFO impl.YarnClientImpl: Submitted application application_1443100485659_0007
15/09/24 13:38:03 INFO mapreduce.Job: The url to track the job: http://sandbox.hortonworks.com:8088/proxy/application_1443100485659_0007/
15/09/24 13:38:03 INFO mapreduce.Job: Running job: job_1443100485659_0007
15/09/24 13:38:12 INFO mapreduce.Job: Job job_1443100485659_0007 running in uber mode : false
15/09/24 13:38:12 INFO mapreduce.Job: map 0% reduce 0%
15/09/24 13:38:20 INFO mapreduce.Job: map 100% reduce 0%
15/09/24 13:38:28 INFO mapreduce.Job: map 100% reduce 100%
15/09/24 13:38:28 INFO mapreduce.Job: Job job_1443100485659_0007 completed successfully
15/09/24 13:38:28 INFO mapreduce.Job: Counters: 49
File System Counters
FILE: Number of bytes read=6506
FILE: Number of bytes written=256757
FILE: Number of read operations=0
FILE: Number of large read operations=0
FILE: Number of write operations=0
HDFS: Number of bytes read=336
HDFS: Number of bytes written=3600
HDFS: Number of read operations=5
HDFS: Number of large read operations=0
HDFS: Number of write operations=2
Job Counters
Launched map tasks=1
Launched reduce tasks=1
Rack-local map tasks=1
Total time spent by all maps in occupied slots (ms)=6144
Total time spent by all reduces in occupied slots (ms)=5032
Total time spent by all map tasks (ms)=6144
Total time spent by all reduce tasks (ms)=5032
Total vcore-seconds taken by all map tasks=6144
Total vcore-seconds taken by all reduce tasks=5032
Total megabyte-seconds taken by all map tasks=1536000
Total megabyte-seconds taken by all reduce tasks=1258000
Map-Reduce Framework
Map input records=100
Map output records=100
Map output bytes=6300
Map output materialized bytes=6506
Input split bytes=336
Combine input records=0
Combine output records=0
Reduce input groups=100
Reduce shuffle bytes=6506
Reduce input records=100
Reduce output records=100
Spilled Records=200
Shuffled Maps =1
Failed Shuffles=0
Merged Map outputs=1
GC time elapsed (ms)=177
CPU time spent (ms)=2220
Physical memory (bytes) snapshot=296923136
Virtual memory (bytes) snapshot=1996275712
Total committed heap usage (bytes)=262746112
Shuffle Errors
BAD_ID=0
CONNECTION=0
IO_ERROR=0
WRONG_LENGTH=0
WRONG_MAP=0
WRONG_REDUCE=0
File Input Format Counters
Bytes Read=0
File Output Format Counters
Bytes Written=3600
15/09/24 13:38:28 INFO streaming.StreamJob: Output directory: /tmp/videos_streaming
即使将输出的 bson 恢复到 mongodb 中也能正常工作。
最佳答案
这是一个错误，已在 1.4.1 版本中修复。 参见 https://github.com/mongodb/mongo-hadoop/commit/766922b656d11fd5e661eecb0cc370ba3f86b0d4
在这种情况下添加
"-D mapred.output.committer.class=com.mongodb.hadoop.mapred.output.MongoOutputCommitter"
导致预期的结果。
关于python - 使用带有 mongo-hadoop 和 python 的 hadoop 流式处理的空输出集合，我们在Stack Overflow上找到一个类似的问题： https://stackoverflow.com/questions/32763450/
我正在学习如何使用Nokogiri，根据这段代码我遇到了一些问题:require'rubygems'require'mechanize'post_agent=WWW::Mechanize.newpost_page=post_agent.get('http://www.vbulletin.org/forum/showthread.php?t=230708')puts"\nabsolutepathwithtbodygivesnil"putspost_page.parser.xpath('/html/body/div/div/div/div/div/table/tbody/tr/td/div
我有一个Ruby程序，它使用rubyzip压缩XML文件的目录树。gem。我的问题是文件开始变得很重，我想提高压缩级别，因为压缩时间不是问题。我在rubyzipdocumentation中找不到一种为创建的ZIP文件指定压缩级别的方法。有人知道如何更改此设置吗？是否有另一个允许指定压缩级别的Ruby库？ 最佳答案 这是我通过查看rubyzip内部创建的代码。level=Zlib::BEST_COMPRESSIONZip::ZipOutputStream.open(zip_file)do|zip|Dir.glob("**/*")d
类classAprivatedeffooputs:fooendpublicdefbarputs:barendprivatedefzimputs:zimendprotecteddefdibputs:dibendendA的实例a=A.new测试a.foorescueputs:faila.barrescueputs:faila.zimrescueputs:faila.dibrescueputs:faila.gazrescueputs:fail测试输出failbarfailfailfail.发送测试[:foo,:bar,:zim,:dib,:gaz].each{|m|a.send(m)resc
很好奇，就使用rubyonrails自动化单元测试而言，你们正在做什么？您是否创建了一个脚本来在cron中运行rake作业并将结果邮寄给您？git中的预提交Hook？只是手动调用？我完全理解测试，但想知道在错误发生之前捕获错误的最佳实践是什么。让我们理所当然地认为测试本身是完美无缺的，并且可以正常工作。下一步是什么以确保他们在正确的时间将可能有害的结果传达给您？ 最佳答案 不确定您到底想听什么，但是有几个级别的自动代码库控制:在处理某项功能时，您可以使用类似autotest的内容获得关于哪些有效，哪些无效的即时反馈。要确保您的提
假设我做了一个模块如下:m=Module.newdoclassCendend三个问题:除了对m的引用之外，还有什么方法可以访问C和m中的其他内容？我可以在创建匿名模块后为其命名吗(就像我输入“module...”一样)？如何在使用完匿名模块后将其删除，使其定义的常量不再存在？ 最佳答案 三个答案:是的，使用ObjectSpace.此代码使c引用你的类(class)C不引用m:c=nilObjectSpace.each_object{|obj|c=objif(Class===objandobj.name=~/::C$/)}当然这取决于
我正在尝试使用ruby和Savon来使用网络服务。测试服务为http://www.webservicex.net/WS/WSDetails.aspx?WSID=9&CATID=2require'rubygems'require'savon'client=Savon::Client.new"http://www.webservicex.net/stockquote.asmx?WSDL"client.get_quotedo|soap|soap.body={:symbol=>"AAPL"}end返回SOAP异常。检查soap信封，在我看来soap请求没有正确的命名空间。任何人都可以建议我
关闭。这个问题是opinion-based.它目前不接受答案。想要改进这个问题？更新问题，以便editingthispost可以用事实和引用来回答它.关闭4年前。Improvethisquestion我想在固定时间创建一系列低音和高音调的哔哔声。例如:在150毫秒时发出高音调的蜂鸣声在151毫秒时发出低音调的蜂鸣声200毫秒时发出低音调的蜂鸣声250毫秒的高音调蜂鸣声有没有办法在Ruby或Python中做到这一点？我真的不在乎输出编码是什么(.wav、.mp3、.ogg等等)，但我确实想创建一个输出文件。
我在我的项目目录中完成了compasscreate.和compassinitrails。几个问题:我已将我的.sass文件放在public/stylesheets中。这是放置它们的正确位置吗？当我运行compasswatch时，它不会自动编译这些.sass文件。我必须手动指定文件:compasswatchpublic/stylesheets/myfile.sass等。如何让它自动运行？文件ie.css、print.css和screen.css已放在stylesheets/compiled。如何在编译后不让它们重新出现的情况下删除它们？我自己编译的.sass文件编译成compiled/t
我想将html转换为纯文本。不过，我不想只删除标签，我想智能地保留尽可能多的格式。为插入换行符标签，检测段落并格式化它们等。输入非常简单，通常是格式良好的html(不是整个文档，只是一堆内容，通常没有anchor或图像)。我可以将几个正则表达式放在一起，让我达到80%，但我认为可能有一些现有的解决方案更智能。 最佳答案 首先，不要尝试为此使用正则表达式。很有可能你会想出一个脆弱/脆弱的解决方案，它会随着HTML的变化而崩溃，或者很难管理和维护。您可以使用Nokogiri快速解析HTML并提取文本:require'nokogiri'h
我想为Heroku构建一个Rails3应用程序。他们使用Postgres作为他们的数据库，所以我通过MacPorts安装了postgres9.0。现在我需要一个postgresgem并且共识是出于性能原因你想要pggem。但是我对我得到的错误感到非常困惑当我尝试在rvm下通过geminstall安装pg时。我已经非常明确地指定了所有postgres目录的位置可以找到但仍然无法完成安装:$envARCHFLAGS='-archx86_64'geminstallpg--\--with-pg-config=/opt/local/var/db/postgresql90/defaultdb/po