I use RWKV2 as the environment set PIP_INDEX_URL=https://pypi.douban.com/simple export PIP_INDEX_URL=https://pypi.douban.com/simple pip install playwright playwright install
cd /mntnfs/med_data5/chenghao/uncheatable_eval/ python /mntnfs/med_data5/chenghao/uncheatable_eval/cmd_crawl.py
conda export > playright.env conda create -f playright.env
udo yum update
playwright codegen https://www.bbc.com/news
playwright codegen https://www.quora.com/ https://www.bloomberg.com
| 数据类型 | 代表性网站 | 网址 |
|---|---|---|
| 金融新闻 | Yahoo | Yahoo.com |
| 政治新闻 | BBC News | bbc.com/news |
| 讨论 | reddit_new.com(更多的主题确定一下) | |
| 网文 | Wattpad | wattpad.com |
| 百科 | Wikipedia 最新更改 | en.wikipedia.org/wiki/Special:NewPages |
| 论文 | arXiv | arxiv.org(多个主题)(目前还在做 但是适配应该是挺快的) |
| 代码 | GitHub Trending | github.com/trending |
| 论坛 | Quora | quora_week.com(多个主题) |
现在的任务:通arxiv,github,然后等人来了通那几个程序 事件线 9.45 arxiv读明白 github 15min读明白获取 的逻辑(上传代码,复制模块) 然后立刻就是一些设计性的东西,quora的按照 问题去写(设计问题领域)(问问gpt,)
| 博客 | Medium | medium.com | | 代码题目 | LeetCode | leetcode.com |
''' cd the fresh_eval folder cd C:\Users\jijivski\Desktop\local_VS\fresh_eval python C:\Users\jijivski\Desktop\local_VS\fresh_eval\cmd_crawl.py '''
Please use the following citation if you intend to use our repo:
@misc{FreshBench,
title={Evaluating LLMs at Evaluating Temporal Generalization},
author={Chenghao Zhu, Nuo Chen, Yufei Gao, Benyou Wang},
year = {2024},
publisher = {GitHub},
journal = {GitHub repository},
howpublished = {\url{https://github.com/FreedomIntelligence/FreshBench}},
}