chrome 发表于 2020-12-15 21:35:11

谷歌浏览器爬虫插件Webscraper抓取腾讯体育社区发帖回复的模板


1、 数据字段
作者
发布日期
点赞数
原评论作者
原评论内容
回复内容/评论内容
楼层数
2、结果示例截图



3、sitemap json

{"_id":"sportsqq","startUrl":["https://fans.sports.qq.com/post.htm?id=1652219265287192668&mid=69#1_allWithElite"],"selectors":[{"id":"element","type":"SelectorElementClick","parentSelectors":["_root"],"selector":".mod-rpost li.main","multiple":true,"delay":"2000","clickElementSelector":"#J_pageTop span.page-down","clickType":"clickMore","discardInitialElements":"do-not-discard","clickElementUniquenessType":"uniqueText"},{"id":"author","type":"SelectorText","parentSelectors":["element"],"selector":"a.name","multiple":false,"regex":"","delay":0},{"id":"date","type":"SelectorText","parentSelectors":["element"],"selector":"span.txt","multiple":false,"regex":"","delay":0},{"id":"like","type":"SelectorText","parentSelectors":["element"],"selector":"span.zan","multiple":false,"regex":"\\d+","delay":0},{"id":"originalauthor","type":"SelectorText","parentSelectors":["element"],"selector":"span.name","multiple":false,"regex":"","delay":0},{"id":"originalreply","type":"SelectorText","parentSelectors":["element"],"selector":"div.quote","multiple":false,"regex":"","delay":0},{"id":"comment","type":"SelectorText","parentSelectors":["element"],"selector":".content div:not(.reply):not(.quote)","multiple":false,"regex":"","delay":0},{"id":"floor","type":"SelectorText","parentSelectors":["element"],"selector":".floor span","multiple":false,"regex":"","delay":0}]}

作者:iWebscraper
页: [1]
查看完整版本: 谷歌浏览器爬虫插件Webscraper抓取腾讯体育社区发帖回复的模板