weibo

Baiduspider应该吃点脑白金补补,整天没头没脑瞎转悠

  •  
  •   weibo · Jun 18, 2012 · 1634 views
    This topic created in 5253 days ago, the information mentioned may be changed or developed.
    该看的不看,不给看的非要看,同一个死胡同天天进去溜达一圈。
    2 replies  •  1970-01-01 08:00:00 +08:00
    sivacohan
    sivacohan
    Jun 18, 2012
    1
    你没写robots文件吗?
    weibo
    weibo
    OP
    Jun 22, 2012
    2
    就是因为写了不管用才吐槽哇。丫根本就无视robots。
    About   ·   Help   ·   Advertise   ·   Blog   ·   API   ·   FAQ   ·   Privacy   ·   Solana   ·   2596 Online   Highest 6679   ·     Select Language
    创意工作者们的社区
    World is powered by solitude
    VERSION: 3.9.8.5 · 26ms · UTC 14:08 · PVG 22:08 · LAX 06:08 · JFK 09:08
    ♥ Do have faith in what you're doing.