全球主机交流论坛

标题: 使用关关采集遇到的一个问题，这应该是那一块的问题？ [打印本页]
作者: biubiu    时间: 2018-4-2 11:37
标题: 使用关关采集遇到的一个问题，这应该是那一块的问题？
本帖最后由 biubiu 于 2018-4-2 17:52 编辑

用的是关关采集，然后远程采到另一个服务器数据库，网站的目录是用Samba共享过来的

之前采了一天没问题，在昨天晚上开始出现这个错误

  1. 无法从传输连接中读取数据: 远程主机强迫关闭了一个现有的连接
复制代码


不知道这个是网站数据库的问题，还是采集源站把我IPban？

使用关关的测试没问题，今天早上从8点采集到11点时候，又发现进度不动，日志出现这个错误

日志出现这个错误后，只有强制关闭关关后，才能正常采集



使用的是mysql5.5，php5.2，apache2.2，杰奇1.7，关关5.6


具体错误提示和代码如下，在中午11点的时候，出现过一次问题，但是数据库日志那个时间好像是空的





  1. 180402  8:13:50 [Note] Plugin 'InnoDB' is disabled.
  2. 180402  8:13:50 [Note] Plugin 'FEDERATED' is disabled.
  3. 180402  8:13:50 [Note] Server hostname (bind-address): '0.0.0.0'; port: 3306
  4. 180402  8:13:50 [Note]   - '0.0.0.0' resolves to '0.0.0.0';
  5. 180402  8:13:50 [Note] Server socket created on IP: '0.0.0.0'.
  6. 180402  8:13:51 [Note] Event Scheduler: Loaded 0 events
  7. 180402  8:13:51 [Note] /usr/local/mysql/bin/mysqld: ready for connections.
  8. Version: '5.5.56-log'  socket: '/tmp/mysql.sock'  port: 3306  Source distribution
  9. 180402  8:20:31 [Warning] IP address '138.68.62.190' could not be resolved: Name or service not known
  10. 180402  8:24:30 [Warning] IP address '119.1.109.84' could not be resolved: Name or service not known
  11. 180402  8:51:07 [Warning] IP address '111.73.45.103' could not be resolved: Name or service not known
  12. 180402  8:51:22 [Warning] IP address '111.73.46.80' could not be resolved: Name or service not known
  13. 180402 10:29:38 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  14. 180402 10:29:39 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  15. 180402 10:29:41 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  16. 180402 10:29:42 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  17. 180402 10:29:46 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  18. 180402 10:29:47 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  19. 180402 10:29:56 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  20. 180402 10:29:50 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  21. 180402 10:29:51 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  22. 180402 10:29:54 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  23. 180402 10:29:56 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  24. 180402 10:29:58 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  25. 180402 10:29:59 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  26. 180402 10:30:00 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  27. 180402 10:30:01 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  28. 180402 10:30:02 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  29. 180402 10:30:03 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  30. 180402 10:30:04 [Warning] IP address '122.156.156.56' could not be resolved: Temporary failure in name resolution
  31. 180402 13:43:47 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  32. 180402 13:43:57 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  33. 180402 13:44:10 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  34. 180402 13:44:18 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  35. 180402 13:44:31 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  36. 180402 13:44:41 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  37. 180402 13:44:54 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  38. 180402 13:45:05 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  39. 180402 13:45:15 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  40. 180402 13:45:25 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  41. 180402 13:45:35 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  42. 180402 13:45:50 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  43. 180402 13:45:58 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  44. 180402 13:46:04 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  45. 180402 13:46:09 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  46. 180402 13:46:25 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  47. 180402 13:46:28 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  48. 180402 13:46:29 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  49. 180402 13:46:46 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  50. 180402 13:46:48 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  51. 180402 13:46:59 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  52. 180402 13:47:18 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  53. 180402 13:47:30 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  54. 180402 13:47:40 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  55. 180402 13:47:54 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  56. 180402 13:48:02 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  57. 180402 13:48:03 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
  58. 180402 13:48:04 [Warning] IP address '180.255.137.102' could not be resolved: Temporary failure in name resolution
复制代码

作者: 二暖的萌萌君    时间: 2018-4-2 11:37
这个错误日志表示mysql对ip地址进行dns解析，解决的办法就是修改my.cnf配置文件取消dns解析
作者: Johnny12w    时间: 2018-4-2 11:46
这就是触及我知识的盲区了，不过 帮顶一下  楼下解答
作者: biubiu    时间: 2018-4-2 11:48
Johnny12w 发表于 2018-4-2 11:46
这就是触及我知识的盲区了，不过 帮顶一下  楼下解答

其实我搜了下

但是这个关键词+关关，好像没有符合的

大多数结果都在说我看不懂的东西
作者: ★百晓通★    时间: 2018-4-2 11:48
提示: 作者被禁止或删除 内容自动屏蔽
作者: biubiu    时间: 2018-4-2 11:52
★百晓通★ 发表于 2018-4-2 11:48
目测是把你的ip给屏蔽了

但是可以开五个线程，采集三小时都没问题啊
作者: ★百晓通★    时间: 2018-4-2 11:54
提示: 作者被禁止或删除 内容自动屏蔽
作者: 这小指    时间: 2018-4-2 12:04
提示: 作者被禁止或删除 内容自动屏蔽
作者: biubiu    时间: 2018-4-2 12:30
这小指 发表于 2018-4-2 12:04
采得急。。会卦你IP啊。。正常吧。。

一天下来，只有三百不到

这速度应该挺慢了
作者: biubiu    时间: 2018-4-2 17:07
有没有大佬把分领走
作者: 欧阳逍遥    时间: 2018-4-2 17:24
看看 mysql 日志吧。 应该是你本机的问题， 如果封采集 你章节也获取不到。
作者: gakki    时间: 2018-4-2 17:27
木有详细日志。。



欢迎光临 全球主机交流论坛 (https://loc.mjj8.eu.org/) Powered by Discuz! X3.4