nutch1.9 + solr4.72
阅读原文时间:2023年07月12日阅读:1
solr.server.url : URL of the SOLR instance (mandatory)  
solr.commit.size : buffer size when sending to SOLR (default 1000)  
solr.mapping.file : name of the mapping file for fields (default solrindex-mapping.xml)  
solr.auth : use authentication (default false)  
solr.auth.username : use authentication (default false)  
solr.auth : username for authentication  
solr.auth.password : password for authentication

Indexer: java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357)
at org.apache.nutch.indexer.IndexingJob.index(IndexingJob.java:114)
at org.apache.nutch.indexer.IndexingJob.run(IndexingJob.java:176)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.indexer.IndexingJob.main(IndexingJob.java:186)

解决办法:

找到 $NUTCH_HOME/conf/nutch-default.xml 里面的

/home/hadoop/nutch-1.9/plugins 是我的nutch1.9 插件路径根据自己目录修改。

plugin.folders /home/hadoop/nutch-1.9/plugins Directories where nutch plugins are located. Each element may be a relative or absolute path. If absolute, it is used as is. If relative, it is searched for on the classpath.

solr日志提示:

INFO - 2014-11-07 17:01:39.848; org.apache.solr.core.SolrCore; [collection1] Opening new SolrCore at /data2/solr-4.7.2/example/solr/collection1/,
dataDir=/data2/solr-4.7.2/example/solr/collection1/data/
INFO - 2014-11-07 17:01:39.850; org.apache.solr.core.JmxMonitoredMap; No JMX servers found, not exposing Solr information with JMX.
INFO - 2014-11-07 17:01:39.855; org.apache.solr.core.SolrCore; [collection1] Added SolrEventListener
for newSearcher: org.apache.solr.core.QuerySenderListener{queries=[]}
INFO - 2014-11-07 17:01:39.856; org.apache.solr.core.SolrCore; [collection1] Added SolrEventListener
for firstSearcher: org.apache.solr.core.QuerySenderListener{queries=[{q=static firstSearcher warming in solrconfig.xml}]}

又遇到另一个错误

Active IndexWriters :
SOLRIndexWriter
solr.server.url : URL of the SOLR instance (mandatory)
solr.commit.size : buffer size when sending to SOLR (default 1000)
solr.mapping.file : name of the mapping file for fields (default solrindex-mapping.xml)
solr.auth : use authentication (default false)
solr.auth.username : use authentication (default false)
solr.auth : username for authentication
solr.auth.password : password for authentication

Indexer: java.io.IOException: Job failed!
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:1357)
at org.apache.nutch.indexer.IndexingJob.index(IndexingJob.java:114)
at org.apache.nutch.indexer.IndexingJob.run(IndexingJob.java:176)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
at org.apache.nutch.indexer.IndexingJob.main(IndexingJob.java:186

手机扫一扫

移动阅读更方便

阿里云服务器
腾讯云服务器
七牛云服务器

你可能感兴趣的文章