refactor: React 前端重构,新旧平台合并为莞易学

This commit is contained in:
study-tool
2026-10-29 23:50:46 +08:00
parent 35853891c9
commit e8634a6317
62 changed files with 8923 additions and 4623 deletions
+18
View File
@@ -20,6 +20,24 @@
- 补充时写成明确、可执行的规则,避免只写模糊描述。
- 新规则应放到最相关的章节;找不到合适章节时放到“项目注意事项”。
## 日志规范
- 所有日志只走 `runtime.log(key, msg, level="info")`:它统一写控制台、内存(`/api/log`)和 SQLite(`/api/log/history`),三处内容必须一致。
- 禁止在新代码里自己 `print()` 写业务日志,也不要直接调 `store.run_log_add()`;模块只负责组织 `msg`。
- key 约定:账号相关用账号 id(页面卡片「课程日志」直接显示);全局 / 系统事件用 `"system"`(右上角「系统日志」弹窗显示)。
- 时间戳、级别、格式都由 `runtime.log` 统一拼(`时间 [级别] 内容`),模块里不要自己加时间前缀。
- 前端读日志统一用 `/api/log?key=&since=`(实时)+ `/api/log/history?key=&tail=`(历史兜底),不要另起一套日志接口。
## 代码结构 / 平台插件
- 业务代码都在 `src/study_tool/` 包里;根目录只放启动壳 `app.py`、`pyproject.toml`、`static/`、`data/`、`des*.js` 这类运行时资源。
- 平台代码只能放在 `src/study_tool/platforms/` 下;一个平台只注册一次(`Platform` + `registry.register`),并在 `Platform.entries` 里声明登录 / 学习入口。同一平台的不同页面代际可以拆成实现模块(如莞易学的 `jspx.py` / `study.py`),由平台模块按 `course["generation"]` 分发。
- 新增平台的标准步骤:写 `platforms/<名字>.py`(实现 `study(key, s, d, **opts)`、声明 `entries`)→ 在 `platforms/__init__.py` 的 `load_builtin()` 里 import → 结束。不要改 `engine.py`、`routes/`、前端。
- 引擎、路由、前端都不允许直接 import 某个具体平台模块;需要平台能力时用 `registry.get(course["platform"])`;识别平台用 `registry.detect(url, html)`。
- 前端源码在 `web/`(React + TypeScript + Vite + Tailwind CSS),构建产物输出到 `static/` 并提交进仓库;改完前端必须执行 `cd web && pnpm build`,不要直接改 `static/` 里的产物。
- 新代码的 import 一律显式(如 `from study_tool.config import JSPX`),不要再新增 `from xxx import *`;历史遗留的 star import 只保留在拆分前就存在的模块里。
- `docs/architecture.md` 维护分层与插件契约,改动结构时同步更新。
## 文档规范
- README 保持简洁,只放项目介绍、核心功能、快速开始和文档入口。
+24
View File
@@ -2,6 +2,30 @@
## Unreleased
### 重构
- 前端从单文件 `static/index.html`(原生 JS)改为 `web/` 工程:React 19 + TypeScript + Vite + Tailwind CSS v4;Vite 直接输出到 `static/`,FastAPI 托管 `/` 与 `/assets`,运行 Python 不再需要 Node
- 新旧学习平台合并为「莞易学」:`jspx.dgjy.net`(登录入口)与 `study.dgjy.net`(学习入口)统一注册为 `Platform(id="guanyixue", label="莞易学")`,课程页代际(`legacy` / `spa`)由 `platforms/detect.py` 判断,平台内部按代际分发到 `jspx.py` / `study.py`
- `Platform` 新增 `entries`(登录 / 学习入口 URL 片段)与 `registry.detect()`;课程发现按入口识别平台,新增平台不再需要改引擎。新增 `GET /api/platforms` 供前端展示平台名
- 测验交卷从 `platform`(jspx / study)改为 `generation`(legacy / spa),接口返回 `platform="guanyixue"` + `generation`
- 代码改为标准 `src/` 包布局:业务代码全部在 `src/study_tool/`,根目录 `app.py` 只做启动壳(`python app.py`、`start.bat`、Dockerfile 都不用改);新增 `pyproject.toml`,`pip install -e .` 后可用 `study-tool` 命令
- 平台拆成插件包 `src/study_tool/platforms/`:`base.py` 定义 `Platform` 契约、`registry.py` 注册表;引擎按 `course["platform"]` 从注册表分发
- HTTP 接口收进 `routes/`(accounts / misc / logs),`docs/architecture.md` 说明分层、平台识别与新增平台的步骤
### 新增
- 统一日志源 `runtime.log()`:控制台、内存(`/api/log`)、SQLite(`/api/log/history`)同一份内容;新增右上角「系统日志」弹窗查看 `key=system` 的启动/设置类日志
- 设置保存、服务启动都写入统一日志;卡片「课程日志」和「系统日志」的「清空」会同时清内存和 SQLite
- 前端:卡片状态徽标、学习进度、课程勾选、卡片内实时日志、测验 / 设置 / 系统日志弹窗全部保留;新增平台名徽标与空态引导
### 修复
- `discover()` 引用未定义的 `detect_platform` / `has_study_marker` 导致课程发现 `NameError`:代际识别集中到 `platforms/detect.py`,两代页面共用同一套判断
- 系统设置里的大模型配置保存后重新打开会回到默认值:`save_settings` 写的是嵌套结构 `{llm, study}`,`load_settings` 却按顶层字段读,现在改成从 `llm` 子对象读取
- AI 答题整段同步等待导致浏览器 / 反代超时:`/api/quiz/answer` 改为流式(text/event-stream)分批返回,每批失败自动重试一次
- AI 答题解析不出 JSON 时直接判空:补 `max_tokens`、空内容 / 非 JSON 抛错重试,并支持从自由文本、截断 JSON 里抠答案,多选连写(`AC`)也能识别
- 控制台是 GBK 时日志里含 `⚠` 之类字符会让工作线程抛 `UnicodeEncodeError`:`runtime.log` 现在编码失败会自动降级
## v0.0.1
首个版本。
+104
View File
@@ -2,6 +2,60 @@
已实现、但还需要你实测确认的事项。确认没问题后把对应条目删掉。
## 新旧平台合并为「莞易学」
**状态**:已实现,待实测确认。
### 做了什么
- `jspx.dgjy.net`(登录入口)和 `study.dgjy.net`(学习入口)在注册表里合并成一个平台:
`id=guanyixue`、`label=莞易学`。卡片右上角只显示「莞易学」。
- 课程发现时按 URL 和页面标记判断代际:旧版 `legacy`(`tier-tree-one` / `tier3`)、
新版 `spa`(Vue SPA / `/training/*`),写进 `course["generation"]`。
- 学习实现按代际分发:`legacy` 走 `engine._study_builtin`,`spa` 走 `engine.run_study_course`。
- 课程日志里的「平台:」一行会显示 `莞易学 · 旧版页面` 或 `莞易学 · 新版页面`。
- `GET /api/platforms` 返回 `[{id:"guanyixue",label:"莞易学"}]`,前端用 label 展示。
### 怎么测
1. 分别用一个旧版课程页账号和一个新版课程页账号(或同一账号的两门课)各跑一次自动学习。
2. 看卡片「课程日志」:应出现 `平台:莞易学 · 旧版页面` / `平台:莞易学 · 新版页面`,不再出现 `jspx` / `study` 平台名。
3. 卡片头部徽标应为「莞易学」;打开测验,交卷后后台日志正常,说明 `generation` 分支没走错。
### 如果没生效
- 日志报「无法识别课程页结构」:把页面快照发出来,可能站点又改版了,
需要补 `platforms/detect.py` 的代际标记。
- 日志报 `平台 xxx 没有可用的学习实现`:`course["platform"]` 不是 `guanyixue`,
检查 `platforms/jspx.py` 的 `_discover_once()` 是否被其他分支覆盖了。
## 前端 React 重构
**状态**:已实现,待实测确认。
### 做了什么
- 删除单文件 `static/index.html`,前端源码迁到 `web/`:React 19 + TypeScript + Vite +
Tailwind CSS v4,构建产物输出到 `static/`(`index.html` + `assets/*` + `favicon.svg`)。
- 页面功能保持不变:账号轮询(5s)、卡片内日志(1.5s)、课程勾选、登录 / 刷新 / 开始 / 停止 /
抓包 / 删除、自动交测验 / 反馈表开关、测验弹窗(手动作答 / AI 流式答题 / 再考一次)、
系统设置、系统日志、离线提示、Toast。
- FastAPI 新增 `/assets` 静态挂载和 `/favicon.svg`,`/` 仍返回 `static/index.html` 且禁止缓存。
### 怎么测
1. 直接 `python app.py`,打开页面:账号卡片、状态、课程列表、进度条、日志折叠都正常。
2. 走一遍登录 → 刷新课程 → 勾选 → 开始学习 → 停止,观察按钮 loading 和日志面板。
3. 打开测验(含单选 / 多选 / 判断 / 填空),提交后看标准答案和「再考一次」。
4. 设置里改大模型 / 学习模式并保存,刷新后值仍在;测试连接正常。
5. 右上角系统日志可查看、清空;断网后出现「后端未连接」提示。
### 如果没生效
- 页面空白 / 404 `/assets/...`:确认 `static/` 里有构建产物,且 `python app.py` 是在仓库根启动。
- 改了 `web/` 但页面没变:执行 `cd web && pnpm build`,构建产物才会进 `static/`。
- 端口不是 8848 时 `pnpm dev` 的 `/api` 代理会打错:改 `web/vite.config.ts` 的 `server.proxy`。
## 首次进入课程自动加入(syncSelf)
**状态**:已实现,待实测确认。
@@ -39,3 +93,53 @@ GET /mod/school/wanpeng/syncSelf?courseCode=<courseCode>
(抓包时重点看 `syncSelf?courseCode=` 参数是从哪个响应/本地状态来的)。
- 日志显示 syncSelf 成功但 `getById` 一直 `isJoin=0`
→ 同步在服务端没落库,先看 `syncSelf` 响应的 `result.code`,再考虑补 `/mod/gjt/roleList` 之外的接口。
## AI 答题(流式 + 重试 + 日志)
**状态**:已实现,待实测确认。
### 做了什么
- `/api/quiz/answer` 从「等全部批次算完再返回」改成流式(`text/event-stream`):每批 5 题算完就推一行,连接一直有数据,反代不会空闲断连。
- 每批失败按错误类型决定是否重试一次:超时 / 5xx / 429 / 空内容 / 非 JSON 会重试(第二次关掉 `response_format`、口头要求 JSON),鉴权类错误直接放弃这一批。
- 一批里只答出部分题时,第二轮只补问没答出来的题。
- 解析加了兜底:标准 JSON、markdown 包裹、截断 JSON、`1.A / 第3题:B / 3. 错误` 这类自由文本都能识别;多选连写 `AC` 会拆成 `A#C`。
- 日志:开始(题数/批数/模型/超时)、每批耗时与题数、失败原因、模型原文摘要、结束统计;同时打到控制台、SQLite(`/api/log/history?key=<账号>`)和该账号卡片的「课程日志」。
### 怎么测
1. 打开一个测验,点「AI 答题」,看状态栏是否逐批更新「Ns · 已填 x/y 题」。
2. 结束后展开该账号卡片的「课程日志」,应能看到 `AI答题 开始/第 1/2 批…/结束` 若干行;控制台同样能看到。
3. 故意把 base_url 改错或断开网络再点一次,日志里应出现 `失败 x.xs:LLM 404/超时…`,界面提示「详见该账号课程日志」。
### 如果没生效
- 状态栏一直停在 0/0、日志里没有任何 `AI答题` 行 → 说明请求没到后端(看浏览器 Network 里 `/api/quiz/answer` 的状态码)。
- 日志里每批都 `失败 … LLM 401` → api_key 不对;`LLM 404` → base_url 少了 `/v1`。
- 每批都是 `本批只答出 0 题` 且模型原文很长 → 模型没按要求给题号,可把批次调小(`quiz.py` 里 `QUIZ_BATCH`)或换个指令遵循更好的模型。
## 模块拆分 + 统一日志源 + 平台插件
**状态**:已实现,待实测确认。
### 做了什么
- 代码改成 `src/` 包布局:`src/study_tool/` 下按层分 `config`(常量)、`runtime`(状态 + 日志)、`store`(SQLite)、`engine`(学习引擎)、`capture`、`models`、`settings_store`、`llm`、`quiz`、`platforms/`(平台插件)、`routes/`(HTTP 接口)。根目录 `app.py` 只做启动壳,`python app.py` / `start.bat` / Dockerfile 的启动方式不变;新增 `pyproject.toml`(`pip install -e .` 后可用 `study-tool` 命令)。
- 平台插件化:`platforms/base.py` 定义 `Platform(id, label, study)`,`platforms/registry.py` 提供 `register/get/all`,`platforms/jspx.py` 与 `platforms/study.py` 各自注册;`engine.run_one_course` 发现课程后改成 `registry.get(course["platform"]).study(...)`,不再写死 `if platform == "study"`。新增平台 = 加一个模块 + 一行 import,`docs/architecture.md` 有完整步骤。
- 日志统一走 `runtime.log(key, msg, level)`:控制台、内存(`/api/log`)、SQLite(`/api/log/history`)同一份;设置保存、服务启动都会写。
- 新增右上角「系统日志」弹窗,看 `key=system` 的全局日志;卡片「课程日志」看该账号的日志。
- GBK 控制台编不了的字符(⚠ 等)自动降级,不再让 worker 线程抛异常。
### 怎么测
1. 启动服务,控制台应出现 `[system] SQLite: …` 和 `[system] 控制台启动 -> …`。
2. 页面右上角「系统日志」→ 看到上面两行;保存一次设置 → 多一行「设置已更新:模型 …」。
3. 点账号卡片的「课程日志」→ 学习日志和以前一致;点「清空」后不再出现旧行。
4. 跑一门课(旧平台 / 新平台各一次),日志里应出现该课程的流程,说明插件分发走到了对应平台。
5. `python -c "import sys; sys.path.insert(0,'src'); from study_tool.platforms import load_builtin, registry; load_builtin(); print(registry.all())"` → 应看到 jspx / study 两个平台。
4. 跑一次 AI 答题 → 该账号「课程日志」里是 `AI答题 …`,控制台同步同一份内容。
### 如果没生效
- 控制台没有 `[system]` 行 → 跑的是旧进程(端口被占用时新代码会提示后直接退出),先结束旧 PID 再启动。
- 「系统日志」弹窗空白 → `GET /api/log?key=system` 有 lines 就是前端缓存问题,刷新即可;没有 lines 说明还没产生 system 日志,保存一次设置就能看到。
+55 -6
View File
@@ -1,6 +1,6 @@
# 多账号学习控制台
# 莞易学多账号学习控制台
东莞市教师培训平台(jspx.dgjy.net / study.dgjy.net)的多账号挂机控制台。账号、会话、课程缓存、运行日志、系统设置全部存在服务端 SQLite,浏览器只是界面,换电脑、远程打开都在。
莞易学(`jspx.dgjy.net` / `study.dgjy.net`,新旧版课程页自动识别)的多账号挂机控制台。账号、会话、课程缓存、运行日志、系统设置全部存在服务端 SQLite,浏览器只是界面,换电脑、远程打开都在。
## 启动
@@ -63,6 +63,21 @@ docker compose logs -f # 看启动日志
镜像默认装 Chromium(直链视频要真播到结尾)。不需要就用
`docker compose build --build-arg WITH_PLAYWRIGHT=0`,镜像能小一大截。
## 前端开发
页面在 `web/`,技术栈 React 19 + TypeScript + Vite + Tailwind CSS v4。构建产物已提交到
`static/`,只跑 Python 时不需要装 Node:
```bash
cd web
pnpm install
pnpm dev # http://127.0.0.1:5173,/api 代理到 8848
pnpm build # 输出到 ../static/,Python 端直接托管
pnpm typecheck
```
改完前端执行一次 `pnpm build`,刷新页面即可;`static/index.html` 禁止缓存。
## 数据存储(SQLite3)
单文件 `data/study.db`(WAL 模式,读写不互斥)。表:
@@ -127,9 +142,33 @@ docker compose logs -f # 看启动日志
## 目录
```
app.py 服务端:登录链路 / 课程抓取 / 课时上报 / 测验 / 反馈表 / HTTP 接口
store.py SQLite3 存储层:账号 / 设置 / 登录记录 / 运行日志 / 状态 / 缓存 / 快照
static/index.html 前端:账号卡片 + 卡片内「课程日志」折叠面板(无框架,原生 JS)
app.py 启动壳:把 src 加进 sys.path,调 study_tool.app.main()
pyproject.toml 打包(src 布局;pip install -e . 后可用 study-tool 命令)
src/study_tool/
app.py 组装:FastAPI、鉴权中间件、页面 / health、启动 main()
webapp.py FastAPI 实例(路由模块从这里注册,避免循环导入)
runtime.py 运行状态 + 统一日志源(控制台 / 内存 / SQLite)
config.py 常量、环境变量、根目录定位(data / static / desenc.js)
store.py SQLite3:账号 / 设置 / 登录记录 / 运行日志 / 状态 / 缓存 / 快照
models.py HTTP 请求模型
settings_store.py 系统设置读写
llm.py 大模型调用
quiz.py 测验解析 / 交卷 / AI 答题
engine.py 学习引擎:发现 → 按平台分发 → worker / 视频 / 提交
capture.py 抓包
platforms/ 平台插件
base.py Platform 契约(id / label / study / entries)
registry.py 注册表:register / get / detect / all
detect.py 页面代际识别(旧版 / 新版 SPA)
guanyixue.py 莞易学:合并 jspx 登录入口与 study 学习入口
jspx.py 莞易学旧版页面实现
study.py 莞易学新版 SPA 实现
routes/ HTTP 接口
accounts.py 账号 / 登录 / 登录记录
misc.py 课程 / 发现 / 学习 / 停止 / 抓包 / 快照 / 平台列表
logs.py /api/log、/api/runs
web/ 前端源码(React 19 + TypeScript + Vite + Tailwind CSS v4)
static/ 前端构建产物(index.html + assets/ + favicon.svg)
des.js desenc.js DES 加密(登录表单 rsa 字段,站点原版算法)
start.bat 一键启动(Windows)
Dockerfile Docker 镜像(python:3.12-slim + nodejs + chromium)
@@ -137,10 +176,17 @@ docker-compose.yml Docker 编排:端口、数据卷、AUTH_TOKEN、健康检
.env.example 远程管理用的环境变量样例(复制成 .env)
requirements.txt 依赖
data/study.db SQLite 库(账号/设置/日志/快照)
docs/architecture.md 分层说明 + 平台插件怎么加
study_video.py 独立命令行工具:按 trainCourseId 直接刷视频课时(会话也存 study.db)
dgjy-toolkit.user.js 浏览器油猴脚本(独立使用,与网页端无关)
```
分层与插件契约见 [docs/architecture.md](docs/architecture.md):引擎只按 `course["platform"]`
从注册表取平台实现;平台用 `entries` 声明登录 / 学习入口,新增平台不用改 engine / 路由 / 前端。
日志统一从 `runtime.log()` 出:控制台、页面卡片「课程日志」(按账号 id)、右上角「系统日志」(key=system)
看到的是同一份;新增日志不要再自己 `print()`。
## 登录链路
```
@@ -156,7 +202,9 @@ GET jspx.dgjy.net/admin/main.action table-results 课程表
`requests` 不执行 JS,中间两跳是手工解析 `scriptLogin.src` 和 `verifyURL` 走完的。
新版平台(慕课)另走一条 OAuth 码换 token 的链,拿到 `study.dgjy.net` 的 `Middle-Token`,见 `ensure_study_session()`。
新版页面(慕课)另走一条 OAuth 码换 token 的链,拿到 `study.dgjy.net` 的 `Middle-Token`,见 `ensure_study_session()`。
`jspx.dgjy.net` 与 `study.dgjy.net` 在注册表里是同一个平台(`guanyixue` / 莞易学),
课程发现时自动判断页面代际(旧版 / 新版),分别走 `jspx.py` / `study.py` 的学习实现。
## 接口
@@ -164,6 +212,7 @@ GET jspx.dgjy.net/admin/main.action table-results 课程表
| --- | --- | --- |
| GET | `/` | 控制台页面 |
| GET | `/api/health` | 存活探测:pid / port / runs / SQLite 路径与行数(不需要 token) |
| GET | `/api/platforms` | 已注册平台(id / label),用于界面展示平台名 |
| GET | `/api/accounts` | 账号列表(会话、课程缓存、勾选,**不含密码**) |
| POST | `/api/accounts` | 新增/更新账号;`password` 不传 = 保留库里原密码 |
| GET | `/api/accounts/{id}` | 单个账号 |
+6 -3405
View File
File diff suppressed because it is too large Load Diff
+130
View File
@@ -0,0 +1,130 @@
# 架构说明
## 目录
```
app.py 启动壳:把 src 加进 sys.path,调用 study_tool.app.main()
pyproject.toml 打包配置(src 布局,console script: study-tool)
src/study_tool/
__init__.py 包信息(版本)
__main__.py python -m study_tool 入口
app.py 组装:FastAPI、鉴权中间件、页面 / health、启动 main()
webapp.py FastAPI 实例(路由模块从这里注册,避免循环导入)
config.py 常量 / 环境变量 / 根目录定位(data、static、desenc.js)
runtime.py 运行状态 RUNS + 统一日志 log()
store.py SQLite:账号 / 设置 / 日志 / 状态 / 缓存 / 快照
models.py HTTP 请求模型(Pydantic)
settings_store.py 系统设置读写
llm.py 大模型调用(OpenAI 兼容)
quiz.py 测验解析 / 交卷 / AI 答题(含 /api/quiz/*)
engine.py 学习引擎:登录→发现→按平台分发→worker / 视频 / 提交
capture.py 抓包
platforms/ 平台插件(见下)
base.py Platform 契约(id / label / study / entries)
registry.py 注册表:register / get / detect / all
detect.py 页面代际识别(legacy 旧版 / spa 新版)
guanyixue.py 莞易学平台:合并 jspx 登录入口与 study 学习入口
jspx.py 莞易学旧版页面实现(会话 / 登录 / 课程抓取 / 旧版学习)
study.py 莞易学新版 SPA 实现(StudyClient / 接口学习)
routes/ HTTP 接口
accounts.py 账号 / 登录 / 登录记录
misc.py 课程 / 发现 / 学习 / 停止 / 抓包 / 快照 / 平台列表
logs.py /api/log、/api/runs
web/ 前端源码(React 19 + TypeScript + Vite + Tailwind CSS v4)
static/ 前端构建产物(index.html + assets/ + favicon.svg,提交进仓库)
des*.js 服务端 DES 加密脚本(Node 调用)
```
## 分层
- **入口层**:`app.py`(根)+ `study_tool/app.py`。前者只负责 `sys.path` 与启动,后者组装应用。
- **接口层**:`routes/*` 与 `quiz.py` 里的 `/api/quiz/*`,只做参数校验、调用引擎、返回结果。
- **领域层**:`engine.py`(学习流程编排)、`platforms/*`(平台实现)、`llm.py` / `quiz.py` 的解析逻辑。
- **基础设施**:`store.py`(SQLite)、`runtime.py`(状态 + 日志)、`config.py`。
依赖方向单向:接口 → 领域 → 基础设施。基础设施不反向 import 接口。
## 平台插件与识别
平台实现在 `platforms/`,通过注册表注入,`engine` 只按 `course["platform"]` 分发:
```python
# engine.run_one_course 末尾
pf = registry.get(d.get("platform"))
pf.study(key, s, d, workers=..., cap=..., enable_quiz=..., ...)
```
`Platform` 契约(见 `platforms/base.py`):
```python
@dataclass
class Platform:
id: str # course["platform"] 的取值
label: str # 日志 / 界面展示名,如「莞易学」
study: Callable # (key, s, d, **opts) -> None
entries: tuple[str, ...] # 登录入口 / 学习入口的 URL 片段
```
`registry.detect(url, html)` 按 `entries` 命中平台;课程发现时把平台 id 写进
`course["platform"]`,把页面代际写进 `course["generation"]`(`legacy` / `spa`)。
引擎按平台分发,平台内部再按代际选择学习实现。
`opts` 固定包含:`workers / cap / enable_quiz / enable_feedback / mode / parallel /
quiz_key / cookies / plan / project / name`。插件可以只取自己需要的。
### 内置:莞易学
`jspx.dgjy.net`(登录入口)和 `study.dgjy.net`(学习入口)是同一个平台,统一注册为
`id=guanyixue`、`label=莞易学`。两代课程页:
- `platforms/jspx.py`:旧版页面(`tier-tree-one` / `tier3`),负责会话、登录、课程抓取,
学习流程在 `engine._study_builtin`。
- `platforms/study.py`:新版 Vue SPA,`StudyClient` + `/train/course/front/*` 接口,
学习流程在 `engine.run_study_course`。
- `platforms/guanyixue.py`:注册平台并按 `course["generation"]` 分发;
`platforms/detect.py` 只判断页面代际,不判断平台归属。
### 新增一个平台
1. 新建 `src/study_tool/platforms/<名字>.py`:
```python
from study_tool.platforms import registry
from study_tool.platforms.base import Platform
def _study(key, s, d, **opts):
# 用 s(requests.Session,带该账号 cookie)把课程活动跑完
# 日志一律 runtime.log(key, ...)
...
PLATFORM = registry.register(Platform(
id="<平台 id>", label="展示名", study=_study,
entries=("<登录入口域名>", "<学习入口域名>"),
))
```
2. 在 `platforms/__init__.py` 的 `load_builtin()` 里加一行 `from study_tool.platforms import <名字>`。
3. 平台自己的登录 / 发现流程把 `course["platform"]` 写成该 id 后,引擎自动分发;
`registry.detect()` 用登录 / 学习入口识别平台,不需要改前端。
现阶段登录与课程发现仍由莞易学模块承担(SSO 只有一套);接入第二个平台时,
在账号登录 / 发现入口按 `Platform.entries` 命中结果选择对应实现即可。
## 前端
`web/` 是独立的前端工程:React 19 + TypeScript + Vite + Tailwind CSS v4。
- `web/src/App.tsx`:账号轮询、操作编排、弹窗状态;`components/` 放卡片 / 弹窗 / 基础 UI。
- `web/src/lib/api.ts`:统一 fetch 封装(401 / 离线判定)与 SSE 读取。
- `web/src/types.ts`:账号、课程、运行状态、测验等接口类型。
- 构建产物输出到仓库根的 `static/`(`index.html` + `assets/*` + `favicon.svg`),
FastAPI 直接托管:`/` 返回 `static/index.html`(禁止缓存),`/assets` 挂 `StaticFiles`。
- 开发:`cd web && pnpm install && pnpm dev`(5173,`/api` 代理到 `127.0.0.1:8848`)。
- 构建 / 类型检查:`pnpm build` / `pnpm typecheck`。
## 日志
统一入口 `runtime.log(key, msg, level="info")`,一次写三处:控制台、内存
(`/api/log` 给前端轮询)、SQLite(`/api/log/history`)。key 用账号 id 或 `system`。
规范见 `AGENTS.md` 的「日志规范」,不要自己 `print()`。
+7
View File
@@ -0,0 +1,7 @@
# 后续待办
- 接入第二个学习平台时,把该平台的登录、课程发现实现放进 `platforms/<平台>.py`,
登录 / 发现入口用 `Platform.entries` + `registry.detect()` 选择;目前登录与发现仍由莞易学模块承担。
- 前端补一条自动化回归(Playwright):空态、账号卡片、测验弹窗、设置保存。
- 构建检查进 CI:`cd web && pnpm install --frozen-lockfile && pnpm typecheck && pnpm build`,
并校验 `static/` 与源码同步。
+26
View File
@@ -0,0 +1,26 @@
[build-system]
requires = ["setuptools>=68"]
build-backend = "setuptools.build_meta"
[project]
name = "study-tool"
version = "0.0.1"
description = "东莞市教师培训平台多账号学习控制台"
requires-python = ">=3.10"
dependencies = [
"fastapi>=0.110",
"uvicorn>=0.27",
"requests>=2.31",
"beautifulsoup4>=4.12",
"lxml>=5.0",
"playwright>=1.40",
]
[project.scripts]
study-tool = "study_tool.app:main"
[tool.setuptools]
package-dir = { "" = "src" }
[tool.setuptools.packages.find]
where = ["src"]
+3
View File
@@ -0,0 +1,3 @@
"""多账号学习控制台(东莞市教师培训平台)。"""
__version__ = "0.0.1"
+5
View File
@@ -0,0 +1,5 @@
"""`python -m study_tool` 入口(与根目录 app.py 等价)。"""
from study_tool.app import main
if __name__ == "__main__":
main()
+208
View File
@@ -0,0 +1,208 @@
"""多账号学习控制台 —— 入口。
代码结构
config 常量 / 环境变量
runtime 运行状态 + 统一日志(控制台 / 内存 / SQLite)
platform_jspx 旧版平台登录与课程抓取
platform_study 新版平台 API
engine 学习引擎(worker / 播放 / 提交)
capture 抓包
models HTTP 请求模型
settings_store 系统设置
llm 大模型调用
quiz 测验解析 / 交卷 / AI 答题
accounts 账号与登录接口
routes_misc 课程 / 学习 / 抓包 / 快照接口
log_routes 日志与运行状态接口
日志只走 runtime.log(),不要自己 print。
"""
import json
import os
import threading
import uvicorn
from fastapi import Request
from fastapi.responses import FileResponse, HTMLResponse, JSONResponse
from fastapi.staticfiles import StaticFiles
from study_tool import store
from study_tool.config import *
from study_tool.platforms import load_builtin
from study_tool.runtime import RUNS, RUNS_LOCK, log
from study_tool.webapp import app
# 导入即把各路由模块的接口注册到 app 上(必须在 main() 之前)
from study_tool import llm, quiz, settings_store # noqa: E402,F401
from study_tool.routes import accounts, logs, misc # noqa: E402,F401
load_builtin() # 注册内置平台插件(jspx / study)
APP_ID = "dgjy-study-console"
# 前端构建产物(web/ 由 Vite 输出到 static/):静态资源挂在 /assets
_ASSETS_DIR = os.path.join(STATIC_DIR, "assets")
if os.path.isdir(_ASSETS_DIR):
app.mount("/assets", StaticFiles(directory=_ASSETS_DIR), name="assets")
# 远程访问令牌:设置了 AUTH_TOKEN 后,页面/接口都要带 ?token=<值>(浏览器会记住 cookie)。
# 不设置 = 不校验(本机使用,或前面已经有反代做鉴权)。/api/health 永远放行,供健康检查用。
AUTH_TOKEN = (os.environ.get("AUTH_TOKEN") or "").strip()
AUTH_COOKIE = "dgjy_auth"
_AUTH_PAGE = """<!doctype html><meta charset="utf-8"><title>需要访问令牌</title>
<style>body{font:14px/1.7 system-ui,"Microsoft YaHei",sans-serif;background:#f5f6f8;color:#1f2430;
display:flex;min-height:100vh;align-items:center;justify-content:center;margin:0}
div{background:#fff;border:1px solid #e3e6ec;border-radius:12px;padding:26px 30px;max-width:520px}
h3{margin:0 0 10px}input{width:100%;padding:8px 10px;border:1px solid #d6dae2;border-radius:8px;
font-size:14px;margin-top:8px}button{margin-top:14px;padding:8px 18px;border:0;border-radius:8px;
background:#2b6cf6;color:#fff;font-size:14px;cursor:pointer}code{background:#f1f3f7;padding:1px 5px;border-radius:4px}</style>
<div><h3>需要访问令牌</h3>
<p>用 <code>/?token=&lt;AUTH_TOKEN&gt;</code> 打开本页,或把令牌填到下面。</p>
<form method="get" action="/"><input name="token" placeholder="访问令牌" autofocus><button>进入</button></form></div>
"""
@app.middleware("http")
async def auth_gate(request: Request, call_next):
if not AUTH_TOKEN:
return await call_next(request)
tok = (request.query_params.get("token")
or request.cookies.get(AUTH_COOKIE)
or request.headers.get("x-auth-token") or "")
if tok == AUTH_TOKEN:
resp = await call_next(request)
if request.query_params.get("token"):
# 带上 ?token= 访问后下发 cookie,页面里所有同源 fetch 会自动带上
resp.set_cookie(AUTH_COOKIE, AUTH_TOKEN, max_age=30 * 24 * 3600,
httponly=True, samesite="lax")
return resp
if request.url.path == "/api/health":
return await call_next(request)
if request.url.path.startswith("/api/"):
return JSONResponse({"ok": False, "code": "unauthorized",
"error": "缺少访问令牌(AUTH_TOKEN)"}, status_code=401)
return HTMLResponse(_AUTH_PAGE, status_code=401)
def hydrate_runs():
"""进程重启后把上次的运行状态读回来;上次没跑完的标记成「已中断」。"""
try:
saved = store.run_state_all()
except Exception:
return
with RUNS_LOCK:
for k, st in saved.items():
if k in RUNS:
continue
st = dict(st)
st.pop("log", None)
if st.get("status") in ("discovering", "studying"):
st["status"] = "interrupted"
st["error"] = "服务重启,上次运行已中断"
RUNS[k] = st
@app.get("/", response_class=HTMLResponse)
def index():
# 页面必须禁止缓存:后端重启或换端口后,旧标签页会拿着缓存里的 HTML 继续跑,
# 页面照常显示、所有接口全 ERR_CONNECTION_REFUSED,看起来就像"登录失败"。
html = open(os.path.join(STATIC_DIR, "index.html"), encoding="utf-8").read()
return HTMLResponse(html, headers={
"Cache-Control": "no-store, no-cache, must-revalidate, max-age=0",
"Pragma": "no-cache",
"Expires": "0",
})
@app.get("/favicon.svg")
def favicon():
path = os.path.join(STATIC_DIR, "favicon.svg")
if not os.path.exists(path):
return JSONResponse({}, status_code=404)
return FileResponse(path, headers={"Cache-Control": "public, max-age=86400"})
@app.get("/api/health")
def api_health():
return {"ok": True, "app": APP_ID, "pid": os.getpid(),
"port": int(os.environ.get("PORT", "8848")), "runs": len(RUNS),
"db": store.db_info(), "auth": bool(AUTH_TOKEN)}
def _port_open(port, host="127.0.0.1", timeout=0.6):
import socket
with socket.socket(socket.AF_INET, socket.SOCK_STREAM) as s:
s.settimeout(timeout)
return s.connect_ex((host, port)) == 0
def _lan_ip():
"""本机对外的网卡地址,用于启动提示;容器里拿到的是容器 IP,不能当访问地址,返回空。"""
if os.path.exists("/.dockerenv"):
return ""
import socket
try:
with socket.socket(socket.AF_INET, socket.SOCK_DGRAM) as s:
s.connect(("223.5.5.5", 80))
return s.getsockname()[0]
except Exception:
return ""
def _probe_self(port):
"""端口已被占用时判断是不是本程序自己在跑,避免重复启动直接报错。"""
import urllib.request
try:
with urllib.request.urlopen("http://127.0.0.1:%d/api/health" % port, timeout=1.5) as r:
return json.loads(r.read().decode("utf-8"))
except Exception:
return None
def main():
port = int(os.environ.get("PORT", "8848"))
# 默认只监听本机;Docker / 远程管理用 HOST=0.0.0.0
host = os.environ.get("HOST", "127.0.0.1")
url = "http://127.0.0.1:%d" % port
# 设了访问令牌时,打印出来的地址一律带上 ?token=:本机访问同样要校验令牌
suffix = ("/?token=%s" % AUTH_TOKEN) if AUTH_TOKEN else ""
store.init() # 建库建表 + 导入旧的 settings.json / logs/*.log
hydrate_runs() # 上次的运行状态读回来(没跑完的标成已中断)
log("system", "SQLite: %s" % store.DB_PATH)
if _port_open(port):
info = _probe_self(port)
if info and info.get("app") == APP_ID:
log("system", "服务已在运行 -> %s%s(PID %s)" % (url, suffix, info.get("pid")))
return
log("system", "端口 %d 被其它程序占用(不是本程序):netstat -ano | findstr :%d,"
"换端口用 PORT=8849 python app.py" % (port, port), level="error")
return
log("system", "控制台启动 -> %s%s" % (url, suffix))
if AUTH_TOKEN:
log("system", "IPv6 同步监听 http://[::1]:%d;远程访问 http://%s:%d" % (
port, _lan_ip() or "<服务器IP>", port))
elif host == "0.0.0.0":
log("system", "已监听 0.0.0.0 但没设 AUTH_TOKEN:同网段谁都能打开,远程部署请设置", level="warn")
srv4 = uvicorn.Server(uvicorn.Config(app, host=host, port=port,
log_level="warning", access_log=False))
def _serve_v6():
# Windows 上 localhost 优先解析到 ::1。只绑 127.0.0.1 时,
# 浏览器打开 http://localhost:8848 就是 ERR_CONNECTION_REFUSED。
try:
uvicorn.Server(uvicorn.Config(app, host="::1", port=port,
log_level="warning", access_log=False)).run()
except Exception:
pass
threading.Thread(target=_serve_v6, daemon=True, name="uvicorn-ipv6").start()
srv4.run()
if __name__ == "__main__":
main()
+93
View File
@@ -0,0 +1,93 @@
"""抓包:把页面 XHR/fetch 落成 data/capture-*.json。"""
import json
import os
import time
from study_tool import store
from study_tool.config import *
from study_tool.runtime import RUNS, log
# ------------------------------------------------------- 抓包(排查平台行为)
CAPTURES = {}
def capture_worker(key, cookies, minutes=10):
"""开一个有头浏览器,把这期间所有 /train/** 请求和响应记下来。
用于搞不清「某个状态到底由哪一发请求写成」:手动走一遍(点课程 → 播几秒 → 交评价),
再看抓到的接口和响应,就能定位该自动补哪一步。
"""
try:
from playwright.sync_api import sync_playwright
except Exception as e:
log(key, "抓包需要 playwright:%s" % e)
return
recs = CAPTURES.setdefault(key, [])
log(key, "抓包开始:浏览器里手动走一遍(点课程 → 播几秒 → 交评价),"
"完事点「停止抓包」,最多 %d 分钟" % minutes)
def on_resp(r):
try:
if r.request.resource_type not in ("xhr", "fetch"):
return
ct = (r.headers or {}).get("content-type", "")
body = ""
if "json" in ct:
try:
body = r.text()[:4000]
except Exception:
body = ""
recs.append({"t": time.strftime("%H:%M:%S"), "method": r.request.method,
"url": r.url, "req": (r.request.post_data or "")[:1000],
"status": r.status, "resp": body})
u = urlsplit(r.url)
log(key, " · %s %s%s → %s" % (r.request.method, u.netloc, u.path, r.status))
except Exception:
pass
try:
with sync_playwright() as p:
b = p.chromium.launch(headless=False)
ctx = b.new_context()
for c in cookies:
if "dgjy" in (c.get("domain") or ""):
try:
ctx.add_cookies([{"name": c["name"], "value": c.get("value") or "",
"domain": (c.get("domain") or "").lstrip("."),
"path": c.get("path") or "/"}])
except Exception:
pass
# 平台点课程/视频是 window.open 新开标签,必须把新页面也挂上监听,否则只抓到第一页
hooked = set()
def hook(page):
if id(page) in hooked:
return
hooked.add(id(page))
page.on("response", on_resp)
ctx.on("page", hook)
pg = ctx.new_page()
hook(pg)
# /training/ 根路径没有路由,会落到 404;直接开「我的培训」列表页
pg.goto(STUDY + "/training/myTrain", wait_until="domcontentloaded", timeout=60000)
t0 = time.time()
while time.time() - t0 < minutes * 60:
if (RUNS.get(key) or {}).get("capture_stop"):
break
pg.wait_for_timeout(1000)
except Exception as e:
log(key, "抓包异常:%s" % str(e)[:150])
finally:
path = ""
if recs:
try:
path = os.path.join(store.DATA_DIR,
"capture-%s-%s.json" % (key, time.strftime("%Y%m%d-%H%M%S")))
with open(path, "w", encoding="utf-8") as f:
json.dump(recs, f, ensure_ascii=False, indent=1)
except Exception as e:
log(key, "抓包结果保存失败:%s" % e)
set_state(key, capturing=False, capture_stop=False, capture_file=path)
log(key, "抓包结束:%d 条请求%s" % (len(recs), (",已存 " + path) if path else ""))
+73
View File
@@ -0,0 +1,73 @@
"""全局常量 / 环境变量。
平台地址、默认值只在这里写一份,其它模块 `from study_tool.config import *`。
"""
import os
import re
import shutil
# 包内路径 -> 项目根目录:data / static / des*.js 这些运行时资源都留在仓库根
HERE = os.path.dirname(os.path.abspath(__file__))
ROOT = os.path.dirname(os.path.dirname(HERE))
DATA = os.path.join(ROOT, "data")
LOGDIR = os.path.join(DATA, "logs") # 旧版日志目录;只有首次迁移会读它
STATIC_DIR = os.path.join(ROOT, "static")
os.makedirs(LOGDIR, exist_ok=True)
def _find_node():
"""Locate a node.exe: $NODE_BIN > PATH > common install dirs."""
for c in [os.environ.get("NODE_BIN"), shutil.which("node"), shutil.which("node.exe"),
r"D:\Software\devlopSoftware\Node\24.16.0\node.exe",
r"C:\Program Files\nodejs\node.exe",
r"C:\Program Files (x86)\nodejs\node.exe"]:
if c and os.path.exists(c):
return c
return "node"
NODE = _find_node()
DESENC = os.path.join(ROOT, "desenc.js")
UA = ("Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 "
"(KHTML, like Gecko) Chrome/154.0.0.0 Safari/537.36 Edg/154.0.0.0")
JSPX = "https://jspx.dgjy.net"
TPASS = "https://tyyh.dgjy.net/tpass"
# 表单提交带上来源头,和浏览器一致(该站有 WAF,字段异常会直接 403)
LOGIN_HEADERS = {"Referer": TPASS + "/login", "Origin": "https://tyyh.dgjy.net"}
AUTHORIZE = ("https://tyyh.dgjy.net/tpass/oauth2.0/authorize?client_id=wpxtgl&scope=all"
"&response_type=code&state=random&redirect_uri=https%3A%2F%2Fdj.dgjy.net%2Fhomepage"
"%2Fremote%2Fopenapi%2Fdgwjt%2Flogin%3Furl%3Dhttps%3A%2F%2Fjspx.dgjy.net%2Ftstudy"
"%2Fpassport%2Flogin.action")
EP_STUDY = JSPX + "/train/trainee/courseware-studyTimeUpdate.action"
# 新版培训平台(莞易学/study.dgjy.net)的课程接口。2026 年起的「慕课」课程不再
# 用 jspx 的 tier-tree 页面,而是 Vue SPA + /train/course/front/* 这组 JSON 接口。
TRAIN_AUTHORIZE_PATH = ("/oauth2.0/authorize?client_id=gyx&scope=all&response_type=code"
"&state=random&redirect_uri=https%3A%2F%2Fstudy.dgjy.net%2F%23%2Flogin%2Fback")
STUDY = os.environ.get("STUDY_BASE", "https://study.dgjy.net").rstrip("/")
DEBUG_DIR = os.path.join(DATA, "debug") # 页面快照的兜底目录(正常存 SQLite 的 snapshots 表)
os.makedirs(DEBUG_DIR, exist_ok=True)
HEX32 = re.compile(r"^[0-9A-Fa-f]{32}$")
# OAuth 授权码:tpass 发的是 ST-369516-xxxx-tpass,带连字符,不能只认 [0-9A-Za-z]
CODE_RE = re.compile(r"(?:[?#&]|\b)code=([0-9A-Za-z._\-]{6,128})")
# 「我的课程」的三个板块 -> 各自的 AJAX 列表接口与 courseType
COURSE_SECTIONS = [
("在学课程", "/train/trainee/studyingCourse.action", "studying"),
("助学课程", "/train/assist/assistanceCourse.action", "assistance"),
("督学课程", "/train/inspect/inspectingCourse.action", "inspecting"),
]
# 每个板块的三种状态(页面上是「进行中 / 未开始 / 已结束」三个页签)
PLAN_STATUS = [
("进行中", "TAKING_PLAN"),
("未开始", "NO_BEGAIN_PLAN"),
("已结束", "FINISHED_PLAN"),
]
# 只有这两种状态还能进去学;已结束的只能查看
STUDYABLE_STATUS = {"TAKING_PLAN", "NO_BEGAIN_PLAN"}
class SessionExpired(RuntimeError):
"""站点要求重新登录(cookie 已失效)。"""
+718
View File
@@ -0,0 +1,718 @@
"""学习引擎:运行状态、课程 worker、视频播放、反馈 / 测验提交。
日志统一走 runtime.log()。
"""
import json
import re
import time
from concurrent.futures import ThreadPoolExecutor, as_completed
from study_tool.config import *
from study_tool.platforms import registry
from study_tool.platforms.jspx import *
from study_tool.platforms.study import *
from study_tool.runtime import RUNS, RUNS_LOCK, log, set_state
# ------------------------------------------------------------------ study engine
class CwItem:
def __init__(self, d, cookies):
self.title = d["title"]
href = d["href"]
self.url = href if href.startswith("http") else JSPX + href
self.s = new_session(cookies)
self.rec = None
self.status = "done" if d.get("done") else "pending"
self.last = None
def resolve(self):
try:
r = self.s.get(self.url, timeout=40)
except Exception as e:
return "exc:%s" % e
m = re.search(r"'id':'([0-9A-F]{32})'", r.text)
if not m:
return "no-id"
self.rec = m.group(1)
return "ok"
def start(self):
try:
r = self.s.post(EP_STUDY, data={"id": self.rec, "order": "server_start",
"updatePassPerc": "true"}, timeout=40)
return r.text.strip()[:40]
except Exception as e:
return "EXC:%s" % e
def beat(self):
try:
r = self.s.post(EP_STUDY, data={"id": self.rec, "order": "server_time",
"updatePassPerc": "true",
"videoSchedule": 30}, timeout=40)
return r.text.strip()[:60]
except Exception as e:
return "EXC:%s" % e
def submit_feedback(s, href, key):
url = href if href.startswith("http") else JSPX + href
r = s.get(url, timeout=40)
soup = BeautifulSoup(r.text, "lxml")
fields = {i.get("name"): i.get("value") for i in soup.select("form input[type=hidden]") if i.get("name")}
if fields.get("allowStudy") == "false":
log(key, "反馈表:allowStudy=false,跳过")
return
r2 = s.post(JSPX + "/train/trainee/doFeedbackList.action", data=fields, timeout=40)
qs = BeautifulSoup(r2.text, "lxml")
answers = []
for it in qs.select("div.job-item"):
qtype = it.get("questype")
opts = [sp.get("data-name") for sp in it.select(".job-item-a span")]
ans = ("课程内容充实,讲师讲解清晰,对我的教学实践很有帮助,希望今后能增加更多一线教学案例。"
if qtype == "04" else (opts[0] if opts else "A"))
answers.append({"id": it.get("traineeid"), "quesId": it.get("qumid"),
"quesType": qtype, "quesNo": it.get("quesno"), "answer": ans})
payload = {"planId": fields.get("planId"), "objectId": fields.get("objectId"),
"answers": json.dumps(answers, ensure_ascii=False, separators=(",", ":")),
"submitStatus": "finish"}
rr = s.post(JSPX + "/train/trainee/saveFeedback.action", data=payload, timeout=40)
log(key, "反馈表:%d 题,%s" % (len(answers), "提交成功" if "MSG" not in rr.text else "返回 " + rr.text[:80]))
def submit_quiz(s, href, key, answer_key=None):
url = href if href.startswith("http") else JSPX + href
plan, _ = parse_ids(url)
m = re.search(r"objectId=([0-9A-Fa-f]+)", url)
obj = m.group(1) if m else ""
rr = s.get("%s/train/trainee/showTestQums.action?planId=%s&objectId=%s" % (JSPX, plan, obj), timeout=40)
qs = BeautifulSoup(rr.text, "lxml")
singles = (answer_key or {}).get("singles", {})
multis = (answer_key or {}).get("multis", {})
answers = []
for it in qs.select("div.job-item"):
t, qno = it.get("questype"), it.get("quesno")
opts = [sp.get("data-name") for sp in it.select(".job-item-a span")]
if t == "02":
ans = (multis.get(qno) or ("#".join(opts) if opts else "A"))
else:
ans = singles.get(qno) or (opts[0] if opts else "A")
answers.append({"id": it.get("traineeid"), "quesId": it.get("qumid"),
"quesType": t, "quesNo": qno, "answer": ans})
if not answers:
log(key, "测验:未取到题目,跳过")
return
payload = {"planId": plan, "objectId": obj,
"answers": json.dumps(answers, ensure_ascii=False, separators=(",", ":"))}
r3 = s.post(JSPX + "/train/trainee/endTest.action", data=payload, timeout=40)
r4 = s.get("%s/train/trainee/doTest.action?planId=%s&objectId=%s" % (JSPX, plan, obj), timeout=40)
sc = re.search(r"得分:\s*(\d+)\s*分",
re.sub(r"\s+", " ", BeautifulSoup(r4.text, "lxml").get_text(" ", strip=True)))
log(key, "测验:%d 题,%s,得分 %s" %
(len(answers), "提交成功" if "MSG" not in r3.text else r3.text[:60],
sc.group(1) if sc else "?"))
def study_worker(key, username, cookies, courses, workers, cap, quiz_key,
enable_quiz=False, enable_feedback=True, password="",
mode="fast", parallel=2):
"""Run each selected course in sequence for one account.
enable_quiz 默认 False —— 测验答题正确率无法保证,可能因不及格卡住「完成」,故默认跳过。
enable_feedback 默认 True —— 反馈表是主观问卷,没有对错,提交即完成。
mode fast=只调 study/log 接口;normal=开浏览器真播(parallel 路并发)。
"""
try:
set_state(key, status="discovering", log=[], done=0, total=0, started=time.time())
failed = []
log(key, "=== 开始:%s(共 %d 门课程)" % (username, len(courses)))
log(key, "设置:自动交测验=%s,自动交反馈表=%s,学习方式=%s" %
("开" if enable_quiz else "关", "开" if enable_feedback else "关",
"快速(只调接口)" if mode != "normal" else "常规(真播,%d 路并发)" % parallel))
for ci, c in enumerate(courses, 1):
with RUNS_LOCK:
if (RUNS.get(key) or {}).get("status") == "stopped":
log(key, "已按要求停止")
return
log(key, "--- [%d/%d] %s" % (ci, len(courses), c.get("name") or c["plan_id"]))
set_state(key, course=c.get("name", ""))
try:
run_one_course(key, username, cookies, c["plan_id"], c["project_id"], workers, cap,
quiz_key, enable_quiz, enable_feedback, c.get("name") or "", password,
mode, parallel)
except Exception as e:
failed.append(c.get("name") or c["plan_id"])
log(key, "课程处理异常:%s" % e)
set_state(key, status="finished", finished_at=time.time())
if failed:
log(key, "=== 结束:%d/%d 门课程异常(%s)" % (len(failed), len(courses), "、".join(failed)[:120]))
else:
log(key, "=== 全部完成")
except Exception as e:
log(key, "!! 运行异常:%s" % e)
set_state(key, status="error", error=str(e)[:300])
def run_one_course(key, username, cookies, plan, project, workers, cap, quiz_key,
enable_quiz=False, enable_feedback=True, name="", password="",
mode="fast", parallel=2):
s = new_session(cookies)
try:
d = discover(s, plan, project, name)
except SessionExpired:
# 先试无密码续期(CASTGC 通常还有效),不行再用浏览器里存的账号密码重登
log(key, "会话失效,尝试用 SSO 票据续期…")
renewed = ensure_jspx_session(s)
d = None
if renewed:
try:
d = discover(s, plan, project, name)
except SessionExpired:
d = None
if d is None:
if not password:
raise
log(key, "SSO 票据已过期,用账号密码重新登录…")
s, _ = login(username, password)
d = discover(s, plan, project, name)
# 新平台可能刚在 discover 里换到 study.dgjy.net 的会话(Middle-Token),存回去给后续课程用
set_state(key, course=d["course"], progress=d["progress"], user=d["user"],
cookies=dump_cookies(s))
log(key, "课程:%s | 进度 %s | %s" % (d["course"], d["progress"], d["info"]))
pf = registry.get(d.get("platform"))
gen = d.get("generation")
gen_label = {"legacy": "旧版页面", "spa": "新版页面"}.get(gen, "")
log(key, "平台:%s%s | 活动:课件 %d、反馈表 %d、测验 %d" %
((pf.label if pf else d.get("platform", "?")),
(" · " + gen_label) if gen_label else "",
len(d["courseware"]), len(d["feedback"]), len(d["test"])))
if gen == "spa":
log(key, "新版课程 ID:%s%s" %
(d.get("train_id") or "?",
(" | 页面:" + (d.get("page_url") or "")[:110]) if d.get("page_url") else ""))
if not d["courseware"] and not d["feedback"] and not d["test"]:
raise RuntimeError("课程里没有任何可识别的活动(课件/反馈表/测验都是 0)")
# 平台插件:按 course["platform"] 取实现;新增平台不用改这里
if pf is None or pf.study is None:
raise RuntimeError("平台 %s 没有可用的学习实现" % d.get("platform"))
pf.study(key, s, d, workers=workers, cap=cap, enable_quiz=enable_quiz,
enable_feedback=enable_feedback, mode=mode, parallel=parallel,
quiz_key=quiz_key, cookies=cookies, plan=plan, project=project, name=name)
def _study_builtin(key, s, d, workers=1, cap=30, enable_quiz=False, enable_feedback=False,
mode="fast", parallel=1, quiz_key="", cookies=None, plan="", project="",
name=""):
"""旧版 jspx 的内置流程:反馈表 + 测验 + 刷课件。"""
if enable_feedback:
for fb in d["feedback"]:
if fb["done"]:
log(key, "反馈表已完成,跳过")
continue
try:
submit_feedback(s, fb["href"], key)
except Exception as e:
log(key, "反馈表异常:%s" % e)
else:
for fb in d["feedback"]:
log(key, "反馈表:已按设置跳过(%s)" % ("已完成" if fb["done"] else "未完成"))
if enable_quiz:
for t in d["test"]:
if t["done"]:
log(key, "测验已完成,跳过")
continue
try:
submit_quiz(s, t["href"], key, quiz_key)
except Exception as e:
log(key, "测验异常:%s" % e)
else:
for t in d["test"]:
if t["done"]:
log(key, "测验:已完成,跳过")
else:
log(key, "测验:⚠ 已按设置跳过答题(避免因正确率不足卡住「完成」),"
"需要时请在页面上手动作答,或打开「自动交测验」开关")
objs = [CwItem(c, cookies) for c in d["courseware"]]
todo = [o for o in objs if o.status != "done"]
done0 = len(objs) - len(todo)
set_state(key, status="studying", total=len(objs), done=done0)
if todo:
log(key, "解析 %d 个学习记录…" % len(todo))
with ThreadPoolExecutor(max_workers=min(workers, len(todo))) as ex:
list(ex.map(lambda x: x.resolve(), todo))
live = [o for o in todo if o.rec]
log(key, "已解析 %d/%d,并发启动会话" % (len(live), len(todo)))
with ThreadPoolExecutor(max_workers=min(workers, len(live))) as ex:
list(ex.map(lambda x: x.start(), live))
t0 = time.time()
while time.time() - t0 < cap * 60:
with RUNS_LOCK:
if (RUNS.get(key) or {}).get("status") == "stopped":
log(key, "已按要求停止")
return
pending = [o for o in live if o.status != "done"]
if not pending:
break
with ThreadPoolExecutor(max_workers=min(workers, len(pending))) as ex:
resps = list(ex.map(lambda x: x.beat(), pending))
newly = []
for o, resp in zip(pending, resps):
o.last = resp
if resp == "study_over":
o.status = "done"
newly.append(o)
el = int(time.time() - t0)
dc = len([o for o in live if o.status == "done"]) + done0
set_state(key, done=dc, elapsed=el)
log(key, "第 %d 轮 %dm%02ds 完成 %d/%d" % (el // 60 + 1, el // 60, el % 60, dc, len(objs)))
for o in newly:
log(key, " ✓ %s" % o.title[:40])
time.sleep(60)
else:
log(key, "所有课件均已完成")
try:
d2 = discover(s, plan, project, name)
set_state(key, progress=d2["progress"], info=d2["info"], cookies=dump_cookies(s))
log(key, "课程结束:%s | %s" % (d2["progress"], d2["info"]))
except Exception as e:
log(key, "复查失败:%s" % e)
def run_study_course(key, s, d, workers, cap, enable_quiz, enable_feedback,
mode="fast", parallel=2):
"""新版平台(study.dgjy.net / Vue SPA)课程:视频走 study/log 接口,
反馈表走 evaluation/result,测验保持手动作答。
mode=fast 只调接口上报(直链 mp4 仍退回真播),速度最快
mode=normal 开无头浏览器真播视频,parallel 控制同时播几个
"""
cookies = dump_cookies(s)
page_url = d.get("page_url") or ""
train_id = d.get("train_id") or ""
client = StudyClient(s, page_url)
# ---- 先确认已加入培训 ----
# 没加入时 study/log 仍然回 200,但服务端不记账:逐个课时重试只会刷一屏「上报未生效」。
if d.get("need_join"):
joined, why = ensure_study_join(s, client, d)
if joined:
log(key, "加入培训:%s" % why)
d["is_join"] = True
else:
log(key, "加入培训被拒:%s" % (why or "未知原因"))
probe = next((c for c in d["courseware"] if not c["done"]), None)
if probe:
good, last = study_complete_period(cookies, page_url, probe)
log(key, "试报 1 个课时:%s" % ("生效" if good else "未生效(%s)" % last))
if not good:
log(key, "该账号对这门课没有写入权限,本次跳过。"
"需要课程管理员把这门课分配到账号下(jspx 在学 ≠ 新版平台已加入)")
return
else:
return
# ---- 反馈表 ----
if enable_feedback:
for fb in d["feedback"]:
if fb["done"]:
log(key, "反馈表已完成,跳过")
continue
try:
study_submit_feedback(client, fb, key, train_id)
except Exception as e:
log(key, "反馈表异常:%s" % e)
else:
for fb in d["feedback"]:
log(key, "反馈表:已按设置跳过(%s)" % ("已完成" if fb["done"] else "未完成"))
# ---- 测验 ----
for t in d["test"]:
score, passed = t.get("score"), t.get("passed_score")
if t["done"]:
if score is not None and passed is not None:
try:
if float(score) < float(passed):
log(key, "测验:已作答但不及格(%s/%s),需要在页面上重考" % (score, passed))
continue
except Exception:
pass
log(key, "测验:已完成,跳过")
elif enable_quiz:
log(key, "测验:新版平台不代答(%s 需在页面上手动作答)" % t["title"][:30])
else:
log(key, "测验:⚠ 已按设置跳过(%s),需要时请在页面上手动作答" % t["title"][:30])
# ---- 视频课时 ----
objs = d["courseware"]
todo = [c for c in objs if not c["done"]]
done0 = len(objs) - len(todo)
set_state(key, status="studying", total=len(objs), done=done0)
if not objs:
log(key, "没有视频课时")
return
kinds = {}
for c in objs:
kinds[c.get("kind") or "?"] = kinds.get(c.get("kind") or "?", 0) + 1
if kinds:
log(key, "视频类型:%s" % "、".join("%s %d 个" % (k, v) for k, v in kinds.items()))
if not todo:
log(key, "所有课件均已完成")
all_done = True
elif mode == "normal":
got = study_videos_normal(key, cookies, page_url, train_id, todo, parallel, cap, done0)
all_done = got >= len(objs)
set_state(key, done=got)
log(key, "视频课时:%d/%d 已完成" % (got, len(objs)))
else:
got = study_videos_fast(key, cookies, page_url, train_id, todo, workers, cap, done0)
all_done = got >= len(objs)
set_state(key, done=got)
log(key, "视频课时:%d/%d 已完成" % (got, len(objs)))
# ---- 课程容器(periodType 10/13):子课时学完不会自动完成 ----
if all_done and d.get("containers"):
for ct in d["containers"]:
if ct.get("done"):
continue
try: # 先重算子课程计数:并发上报会丢增量,计数不到容器就不完成
study_cal_final_score(client, ct["kcdm"])
log(key, " 已重算子课程完成计数(kcdm=%s)" % ct["kcdm"][:8])
except Exception as e:
log(key, " 重算子课程完成计数失败:%s" % str(e)[:80])
ok, msg = study_complete_container(client, ct)
log(key, " %s 课程节点「%s」:%s" % ("✓" if ok else "×", ct["name"][:24], msg))
try:
study_cal_final_score(client, train_id)
except Exception:
pass
try:
_reread_study(key, s, d)
except Exception as e:
log(key, "复查失败:%s" % e)
# 平台靠 document.hidden / visibilitychange 判断「用户切走了」,一 hidden 就暂停并记异常。
# 多路真播时把可见性钉死成 visible,不然后台标签页会被判成离开。
VIS_KEEP_JS = """
(() => {
const d = document;
try { Object.defineProperty(d, 'hidden', {get: () => false, configurable: true}); } catch (e) {}
try { Object.defineProperty(d, 'webkitHidden', {get: () => false, configurable: true}); } catch (e) {}
try { Object.defineProperty(d, 'visibilityState', {get: () => 'visible', configurable: true}); } catch (e) {}
d.addEventListener('visibilitychange', e => e.stopImmediatePropagation(), true);
})();
"""
def _classhour_of(url):
m = re.search(r"[?&]classhour=([0-9]+)", url or "")
return m.group(1) if m else ""
def _wait_video(pg, want_id, secs=60):
"""等播放页就绪:("ok", (frame, duration)) / ("redirect", 被切到的课时) / ("timeout", "")。"""
end = time.time() + secs
while time.time() < end:
cur = _classhour_of(pg.url)
if cur and want_id and cur != str(want_id):
return "redirect", cur
for fr in pg.frames:
try:
st = fr.evaluate("""() => {
const v = Array.from(document.querySelectorAll('video')).filter(x => x.duration > 30)[0];
return v ? {d: v.duration} : null; }""")
except Exception:
continue
if st and st.get("d"):
return "ok", (fr, float(st["d"]))
pg.wait_for_timeout(1000)
return "timeout", ""
def _kick_play(frame, seek):
"""保活:静音、1 倍速、必要时 seek 到结尾前 3 秒(seek=False 就是老老实实从头播)。"""
try:
frame.evaluate("""(seek) => {
const v = Array.from(document.querySelectorAll('video')).filter(x => x.duration > 30)[0];
if (!v) return;
v.muted = true;
try { v.playbackRate = 1; } catch (e) {}
if (seek && v.currentTime < v.duration - 5) {
try { v.currentTime = Math.max(0, v.duration - 3); } catch (e) {}
}
if (v.paused) v.play().catch(() => {});
}""", seek)
except Exception:
pass
def _dialog_text(pg):
try:
el = pg.query_selector(".el-message-box__message")
return (el.inner_text() or "").strip() if el else ""
except Exception:
return ""
def play_one_period(key, p, cookies, train_id, item, timeout=900, seek=False, attach_cdp=False):
"""真播一个课时到结尾。返回 (ok, 说明, 平台要求先学的课时 id)。
平台在进入播放页时会先查「是不是轮到这一节」,不按顺序会被弹回并跳到它指定的课时,
这时返回的第三个值就是那一节,调用方据此重排队列。
"""
pid = str(item["period_id"])
url = ("%s/training/courseVideo?classhour=%s&isJoin=1&needJoin=1&courseId=%s"
"&isFront=1&trainCourseId=%s" % (STUDY, pid, train_id, train_id))
posted = {"done": False}
browser, own = None, False
try:
if attach_cdp:
try:
browser = p.chromium.connect_over_cdp("http://127.0.0.1:9222")
except Exception:
browser = None
if browser is None:
browser = p.chromium.launch(headless=True, args=[
"--autoplay-policy=no-user-gesture-required", "--mute-audio",
"--disable-background-timer-throttling", "--disable-renderer-backgrounding"])
own = True
ctx = browser.new_context()
else:
ctx = browser.contexts[0] if browser.contexts else browser.new_context()
for c in cookies:
if "dgjy" in (c.get("domain") or ""):
try:
ctx.add_cookies([{"name": c["name"], "value": c.get("value") or "",
"domain": (c.get("domain") or "").lstrip("."),
"path": c.get("path") or "/"}])
except Exception:
pass
pg = ctx.new_page()
pg.add_init_script(VIS_KEEP_JS)
def on_req(r):
try:
if "period/study/log" in r.url and '"isComplete":1' in (r.post_data or "").replace(" ", ""):
posted["done"] = True
except Exception:
pass
pg.on("request", on_req)
pg.goto(url, wait_until="domcontentloaded", timeout=60000)
status, val = _wait_video(pg, pid, 60)
if status == "redirect":
return False, "平台按顺序放行,页面被切到课时 %s" % val, str(val)
if status != "ok":
return False, "没等到 <video>(可能需要专用播放器的课时)", ""
frame = val[0]
t0 = time.time()
while time.time() - t0 < timeout:
if posted["done"]:
return True, "", ""
msg = _dialog_text(pg)
if "顺序" in msg or "未完成课时" in msg:
return False, "平台按顺序放行:%s" % msg[:30], _classhour_of(pg.url)
_kick_play(frame, seek)
pg.wait_for_timeout(2000)
return False, "超时未等到播放结束上报", ""
except Exception as e:
return False, str(e)[:120], ""
finally:
if own and browser is not None:
try:
browser.close()
except Exception:
pass
def study_videos_fast(key, cookies, page_url, train_id, todo, workers, cap, done0=0):
"""快速学习:直接调 study/log 上报;直链 mp4 接口不认,退回真播。返回完成总数。"""
deadline = time.time() + cap * 60
hard = [c for c in todo if c.get("kind") != "direct"]
soft = [c for c in todo if c.get("kind") == "direct"]
ok = done0
if hard:
log(key, "并发提交 %d 个视频课时(workers=%d)…" % (len(hard), min(workers, len(hard))))
ex = ThreadPoolExecutor(max_workers=min(workers, len(hard)))
futs = {ex.submit(study_complete_period, cookies, page_url, it): it for it in hard}
try:
for fut in as_completed(futs, timeout=max(1, deadline - time.time())):
it = futs[fut]
try:
good, msg = fut.result()
except Exception as e:
good, msg = False, str(e)[:80]
if good:
ok += 1
log(key, " ✓ %s(%ss)" % (it["title"][:40], it.get("duration") or 0))
else:
log(key, " × %s 上报未生效:%s" % (it["title"][:40], msg))
set_state(key, done=ok)
except TimeoutError:
log(key, "已到时间上限(%d 分钟),剩余课时留待下次" % cap)
except Exception as e:
log(key, "批量提交中断:%s" % e)
finally:
ex.shutdown(wait=False, cancel_futures=True)
if soft:
log(key, "另有 %d 个直链视频课时需要真播放到结尾(%s)"
% (len(soft), "、".join(c["title"][:16] for c in soft[:4])))
for it in soft:
if (RUNS.get(key) or {}).get("status") == "stopped":
break
try:
good = play_period_to_end(key, cookies, page_url,
train_id, it["period_id"], it["title"])
except Exception as e:
log(key, " × %s 播放失败:%s" % (it["title"][:30], str(e)[:100]))
continue
if good:
ok += 1
log(key, " ✓ %s(播放到结尾)" % it["title"][:40])
else:
log(key, " × %s 未确认完成" % it["title"][:40])
set_state(key, done=ok)
return ok
def _play_wave(key, cookies, train_id, wave, deadline, seek):
"""一波并发:每路一个独立 playwright + 独立浏览器,互不遮挡。"""
def run(it):
try:
from playwright.sync_api import sync_playwright
with sync_playwright() as p:
return play_one_period(key, p, cookies, train_id, it,
timeout=max(60, deadline - time.time()), seek=seek)
except Exception as e:
return False, str(e)[:100], ""
out = []
ex = ThreadPoolExecutor(max_workers=len(wave))
try:
futs = {ex.submit(run, it): it for it in wave}
for fut in as_completed(futs):
try:
ok, why, wanted = fut.result()
except Exception as e:
ok, why, wanted = False, str(e)[:100], ""
out.append((futs[fut], ok, why, wanted))
finally:
ex.shutdown(wait=False)
return out
def study_videos_normal(key, cookies, page_url, train_id, todo, parallel, cap, done0=0):
"""常规学习:开无头浏览器真播视频,parallel 路并发。
平台可能按课节顺序放行(不在顺序上会被弹回),所以先按并发跑一波;
一旦被弹回就把并发降到 1,并把平台指定的那一节挪到队首,按顺序补回去。
"""
try:
from playwright.sync_api import sync_playwright # noqa: F401
except Exception as e:
log(key, "缺少 playwright,常规学习不可用:%s" % e)
return done0
parallel = max(1, min(int(parallel or 1), 5, len(todo)))
log(key, "常规学习:%d 个课时真播,%d 路并发" % (len(todo), parallel))
deadline = time.time() + cap * 60
ok, pending, order_only, bounced = done0, list(todo), False, {}
while pending and time.time() < deadline:
if (RUNS.get(key) or {}).get("status") == "stopped":
log(key, "已按要求停止")
break
wave, pending = pending[:parallel], pending[parallel:]
log(key, "本轮 %d 路:%s" % (len(wave), "、".join(x["title"][:14] for x in wave)))
for it, good, why, wanted in _play_wave(key, cookies, train_id, wave, deadline, seek=False):
if good:
ok += 1
log(key, " ✓ %s(真播到结尾)" % it["title"][:40])
else:
log(key, " × %s:%s" % (it["title"][:30], why))
if wanted:
order_only = True
n = bounced[it["period_id"]] = bounced.get(it["period_id"], 0) + 1
if n >= 3: # 一直被顺序校验弹回,别再空转
log(key, " × %s:连续被顺序校验弹回,跳过" % it["title"][:30])
else:
i = next((i for i, x in enumerate(pending)
if str(x["period_id"]) == str(wanted)), None)
if i is None: # 平台要的那一节正在播或不在这门课里,先排到队尾
pending.append(it)
else: # 先播平台要的那一节,再回来播这一个
pending.insert(0, pending.pop(i))
set_state(key, done=ok)
if order_only and parallel > 1:
parallel = 1
log(key, "检测到平台按顺序放行,并发降为 1(剩下的逐个播)")
return ok
def play_period_to_end(key, cookies, page_url, train_id, period_id, title, timeout=900):
"""直链视频(fileType=other):平台只认 onPlayEnd 上报的 isComplete=1。
做法:Playwright 打开课程播放页(带登录 cookie)→ 秒跳到 duration-3 秒 → 播放 →
等接口出现 isComplete=1 → 回读 completeTime 复核。
"""
try:
from playwright.sync_api import sync_playwright
except Exception as e:
log(key, " 缺少 playwright,直链视频无法自动播完:%s" % e)
return False
item = {"period_id": period_id, "title": title}
try:
with sync_playwright() as p:
ok, why, _ = play_one_period(key, p, cookies, train_id, item,
timeout=timeout, seek=True, attach_cdp=True)
except Exception as e:
log(key, " 播放异常:%s" % str(e)[:120])
return False
if not ok:
log(key, " 未播完:%s" % why)
return False
time.sleep(2)
try:
c = StudyClient(new_session(cookies), page_url)
return study_is_done(c, period_id)
except Exception:
return True
def study_sync_gyx(client, train_id):
"""培训里的「课程」是 periodType 10/13 的容器节点,不跟着里面的课时自动完成。
这条同步接口要课程管理员权限:学生账号会回「无权操作该课程」,调一次没坏处,
管理员账号跑的时候能直接把容器刷成完成。
"""
j = client.call("GET", "/course/front/study/sync/gyxCourseData/%s" % train_id)
if j.get("code") == 200:
return "已同步"
return "跳过(%s)" % str(j.get("msg") or ("code=%s" % j.get("code")))[:40]
def _reread_study(key, s, d):
"""课程跑完后按 trainCourseId 直接复查(不重新解析 jspx 页面)。"""
client = StudyClient(s, d.get("page_url") or "")
try:
log(key, "同步莞易学课程完成状态:%s" % study_sync_gyx(client, d["train_id"]))
except Exception as e:
log(key, "同步莞易学课程完成状态失败:%s" % str(e)[:100])
try:
d2 = discover_study(client, d["train_id"], d["course"])
except SessionExpired:
client.bootstrap()
d2 = discover_study(client, d["train_id"], d["course"])
set_state(key, progress=d2["progress"], info=d2["info"], cookies=dump_cookies(s))
log(key, "课程结束:%s | %s" % (d2["progress"], d2["info"]))
+63
View File
@@ -0,0 +1,63 @@
"""大模型调用(OpenAI 兼容 /chat/completions)。"""
import time
import requests
from study_tool.webapp import app
from study_tool.config import *
from study_tool.settings_store import *
def llm_chat(messages, cfg, max_tokens=None, json_mode=True):
"""OpenAI 兼容的 /chat/completions。不支持 response_format 的服务端会自动去掉重试一次。"""
base = (cfg.get("base_url") or "").rstrip("/")
if not base:
raise RuntimeError("base_url 为空")
url = base + "/chat/completions"
body = {"model": cfg.get("model") or "gpt-4o-mini", "messages": messages,
"temperature": float(cfg.get("temperature") or 0.2)}
if max_tokens:
body["max_tokens"] = int(max_tokens)
if json_mode:
body["response_format"] = {"type": "json_object"}
headers = {"Authorization": "Bearer " + (cfg.get("api_key") or ""),
"Content-Type": "application/json"}
timeout = int(cfg.get("timeout") or 120)
r = requests.post(url, json=body, headers=headers, timeout=timeout)
# 有的网关不认 response_format 但回的是 400/422,而不是 400,去掉再发一次
if json_mode and r.status_code in (400, 422):
body.pop("response_format", None)
r = requests.post(url, json=body, headers=headers, timeout=timeout)
if r.status_code >= 400:
msg = (r.text or "").strip()
if msg.startswith("<"):
msg = "网关返回 HTML 错误页(HTTP %s)" % r.status_code
raise RuntimeError("LLM %s: %s" % (r.status_code, msg[:200]))
try:
j = r.json()
except ValueError:
raise RuntimeError("LLM 返回的不是 JSON(HTTP 200):%s" % (r.text or "")[:120])
content = (((j.get("choices") or [{}])[0].get("message") or {}).get("content") or "").strip()
if not content:
raise RuntimeError("LLM 返回空内容(可能被 max_tokens 截断,或被网关过滤)")
return content
@app.post("/api/llm/test")
def api_llm_test(b: LlmTestIn):
cfg = dict(load_settings()["llm"])
if b.base_url.strip():
cfg["base_url"] = b.base_url.strip()
if b.model.strip():
cfg["model"] = b.model.strip()
if b.api_key.strip():
cfg["api_key"] = b.api_key.strip()
cfg["timeout"] = max(10, min(120, int(b.timeout or 60)))
if not cfg.get("api_key"):
return {"ok": False, "error": "没有 api_key"}
t0 = time.time()
try:
reply = llm_chat([{"role": "user", "content": "只回复两个字符:ok"}], cfg,
max_tokens=8, json_mode=False)
return {"ok": True, "ms": int((time.time() - t0) * 1000), "reply": (reply or "")[:80]}
except Exception as e:
return {"ok": False, "error": str(e)[:300]}
+110
View File
@@ -0,0 +1,110 @@
"""HTTP 请求模型(Pydantic)。"""
from pydantic import BaseModel
# ------------------------------------------------------------------------ models
class LoginIn(BaseModel):
username: str = ""
password: str = ""
account_id: str = "" # 只给账号 id 时,用户名/密码从 SQLite 里取,密码不出库
class AccountsIn(BaseModel):
accounts: list = []
class AccountIn(BaseModel):
id: str = ""
username: str = ""
password: str | None = None # 不传 = 保留库里已有的密码
note: str = ""
user: str = ""
cookies: list = []
courses: list = []
selected: list = []
status: str = "idle"
lastError: str = ""
lastErrorAt: float = 0
optQuiz: bool = False
optFeedback: bool = True
loginAt: float = 0
created: float = 0
class CookiesIn(BaseModel):
cookies: list
class DiscoverIn(BaseModel):
cookies: list
plan_id: str
project_id: str
name: str = ""
class StudyIn(BaseModel):
key: str
username: str = ""
password: str = "" # 仅用于会话失效时自动重登,不落盘
cookies: list = []
courses: list = [] # [{name, plan_id, project_id}]
plan_id: str = ""
project_id: str = ""
workers: int = 40
cap_minutes: int = 90
quiz_key: dict | None = None
enable_quiz: bool = False # 默认关闭:答题正确率无法保证
enable_feedback: bool = True # 反馈表无对错,默认开启
class StopIn(BaseModel):
key: str
class CaptureIn(BaseModel):
key: str
cookies: list = []
minutes: int = 10 # 抓包最长分钟数(1~30)
class QuizIn(BaseModel):
cookies: list = []
plan_id: str = ""
project_id: str = ""
name: str = ""
# retake=True:交卷后点「再考一次」,让平台生成新答卷(消耗一次机会)
retake: bool = False
period_id: str = "" # 指定要重考/查看的课时(不传就按原逻辑挑第一个)
class QuizSubmitIn(BaseModel):
cookies: list = []
plan_id: str = ""
object_id: str = ""
generation: str = "legacy" # legacy / spa,决定走旧版还是新版交卷接口
result_id: str = ""
answers: dict = {} # {"1": "A", "2": "A#C"}
class QuizAnswerIn(BaseModel):
questions: list = [] # [{no,type,title,options:[{key,text}]}]
prompt: str = ""
account_id: str = "" # 有账号就把日志写进它的「课程日志」,没有就写 key=ai
class LlmCfgIn(BaseModel):
base_url: str = ""
api_key: str = ""
model: str = ""
temperature: float = 0.2
timeout: int = 120
prompt: str = ""
study_mode: str = "" # "" = 不改;fast / normal
study_parallel: int = 0 # 0 = 不改;1~5
class LlmTestIn(BaseModel):
base_url: str = ""
api_key: str = ""
model: str = ""
timeout: int = 60
+15
View File
@@ -0,0 +1,15 @@
"""平台插件包。
内置平台在 `load_builtin()` 里导入(导入即注册)。新增平台:
1. 新建 `platforms/<名字>.py`,实现 `Platform.study`、声明 `entries` 登录 / 学习入口,
并 `registry.register(...)`;
2. 在下面的 `load_builtin()` 里加一行 import;
3. 路由 / 引擎不用改 —— 它们只认 `course["platform"]`。
"""
from study_tool.platforms import registry # noqa: F401 供 engine、路由使用
from study_tool.platforms.base import Platform # noqa: F401
def load_builtin():
"""导入内置平台,触发注册。幂等,app 启动时调用一次。"""
from study_tool.platforms import guanyixue # noqa: F401
+33
View File
@@ -0,0 +1,33 @@
"""平台插件契约。
新增一个平台 = 在 `platforms/` 下加一个模块,构造 `Platform` 并 `registry.register()`,
然后把它加进 `platforms/__init__.py` 的 `load_builtin()`。引擎只按
`course["platform"]` 去注册表取实现,不再 import 具体平台。
`entries` 声明登录入口 / 学习入口的 URL 片段,`registry.detect(url, html)` 用它识别
页面属于哪个平台;同一平台的不同代页面(如莞易学的旧版 / 新版)用 `course["generation"]`
区分,由平台内部自行分发。
Platform.study 的签名约定:
study(key, s, d, **opts)
key 运行 key(账号 id,日志也用它)
s requests.Session(带该账号 cookie)
d discover() 返回的课程描述(course/courseware/feedback/test/platform/generation/...)
opts workers / cap / enable_quiz / enable_feedback / mode / parallel /
quiz_key / cookies / plan / project / name
"""
from dataclasses import dataclass
from typing import Callable, Optional
@dataclass
class Platform:
id: str # course["platform"] 的取值
label: str # 日志 / 界面里的展示名
study: Optional[Callable] = None # 学一门课;None = 这个平台还没实现
entries: tuple = () # 登录 / 学习入口 URL 片段,用于识别平台
def matches(self, url="", html=""):
"""登录入口或学习入口命中任意片段,就认为页面属于本平台。"""
text = "%s\n%s" % (url or "", html or "")
return any(e and e in text for e in self.entries)
+33
View File
@@ -0,0 +1,33 @@
"""页面代际识别。
莞易学的登录入口(jspx.dgjy.net)和学习入口(study.dgjy.net)指向同一套课程,
但课程页有两代前端:旧版 jspx 页面和新版 Vue SPA。这里只根据页面 / URL 判断代际,
平台归属由 `Platform.entries`(登录、学习入口)负责。
"""
# 旧版页面骨架
LEGACY_MARKERS = ("tier-tree-one", "tier3")
# 新版 SPA 标记:Vue 入口、培训课程接口路由、study 域名
SPA_MARKERS = ("/training/curriculum", "/training/courseVideo", "/training/comment",
"static/js/app.", "study.dgjy.net/training", "study.dgjy.net/#/")
SPA_HOST = "study.dgjy.net"
def has_study_marker(html, page_url=""):
"""页面是不是新版莞易学(study.dgjy.net / Vue SPA)。"""
if page_url and SPA_HOST in page_url:
return True
if any(k in html for k in SPA_MARKERS):
return True
flat = html.replace('"', "").replace("'", "")
return "<div id=app>" in flat
def detect_generation(html, page_url=""):
"""返回课程页代际:legacy(旧版)/ spa(新版)/ ""(无法识别)。"""
if any(k in html for k in LEGACY_MARKERS):
return "legacy"
if has_study_marker(html, page_url):
return "spa"
return ""
+22
View File
@@ -0,0 +1,22 @@
"""莞易学平台:jspx.dgjy.net(登录入口)与 study.dgjy.net(学习入口)是同一个平台。
课程页有两代前端,`discover` 会把代际写进 `course["generation"]`(legacy / spa),
这里按代际分发到对应的学习实现。新增其他平台时,照本文件写一个模块:
在 `Platform.entries` 声明登录 / 学习入口,注册表就能按入口识别平台。
"""
from study_tool.platforms import jspx, registry, study
from study_tool.platforms.base import Platform
ID = "guanyixue"
LABEL = "莞易学"
# 登录入口 / 学习入口;命中任意一个就归到莞易学
ENTRIES = ("jspx.dgjy.net", "study.dgjy.net", "dgjy.net")
def _study(key, s, d, **opts):
if d.get("generation") == "spa":
return study._study(key, s, d, **opts)
return jspx._study(key, s, d, **opts)
PLATFORM = registry.register(Platform(id=ID, label=LABEL, study=_study, entries=ENTRIES))
+635
View File
@@ -0,0 +1,635 @@
"""旧版平台(jspx.dgjy.net):会话 / cookie / 登录 / 课程抓取。
对外:new_session / login / scrape_courses / discover。
"""
import json
import re
import subprocess
from html import unescape as html_unescape
from urllib.parse import unquote, urljoin, urlsplit
import requests
from bs4 import BeautifulSoup
from study_tool.config import *
from study_tool.platforms import registry
from study_tool.platforms.detect import detect_generation, has_study_marker
# ------------------------------------------------------------------------ crypto
def str_enc(data: str) -> str:
r = subprocess.run([NODE, DESENC, data, "1", "2", "3"],
capture_output=True, text=True, timeout=30)
if r.returncode != 0:
raise RuntimeError("strEnc failed: %s" % (r.stderr or "")[:200])
return r.stdout.strip()
# ------------------------------------------------------------------- http client
def new_session(cookies=None):
s = requests.Session()
s.headers.update({"User-Agent": UA, "Accept-Language": "zh-CN,zh;q=0.9"})
for c in (cookies or []):
if "dgjy" not in (c.get("domain") or ""):
continue
s.cookies.set(c["name"], c.get("value") or "",
domain=(c.get("domain") or "").lstrip("."),
path=c.get("path") or "/")
return s
def dump_cookies(s):
return [{"name": c.name, "value": c.value, "domain": c.domain, "path": c.path}
for c in s.cookies]
def whoami(html):
soup = BeautifulSoup(html, "lxml")
hdr = soup.select_one("#header")
if hdr:
m = re.search(r"你好[,,]?\s*(\S+)\s*老师", re.sub(r"\s+", " ", hdr.get_text(" ", strip=True)))
if m:
return m.group(1)
return ""
def parse_ids(text):
plan = project = ""
m = re.search(r"planId=([0-9A-Fa-f]{16,})", text or "")
if m:
plan = m.group(1)
m = re.search(r"projectId=([0-9A-Fa-f]{16,})", text or "")
if m:
project = m.group(1)
return plan, project
def _follow_js_login(s, page):
"""补上浏览器才会执行的两跳,否则只拿得到 CASTGC、拿不到 jspx 的会话。 `oauth2.0/authorize` 链的最后一跳**不是 302**,而是 dj.dgjy.net 上一个
1486 字节的 JS 中转页,里面动态插 <script>:
scriptLogin.src = 'https://passport.dgjy.net/scriptLogin?action=simpleLogin&d1=...&d2=...';
scriptLogin 返回的是 JS,不是跳转:
var loginError=null;
var verifyURL="https://dj.dgjy.net/fpf/login/verify.action?ticket=...&auth=...&sid=...";
location.href=verifyURL;
verify.action 之后才会 302 → loginCall → jspx/tstudy/passport/login.action,
到这一步 jspx.dgjy.net 的 JSESSIONID 才真正下发。
requests 不执行 JS,所以这两跳必须手工走一遍。
"""
m = re.search(r"scriptLogin\.src\s*=\s*'([^']+)'", page or "")
if not m:
return False
r = s.get(html_unescape(m.group(1)), timeout=40)
body = r.text or ""
if re.search(r"loginError\s*=\s*(?!null)", body):
raise RuntimeError("SSO 校验未通过:%s" % body.strip()[:200])
m2 = re.search(r'verifyURL\s*=\s*"([^"]+)"', body)
if not m2:
return False
s.get(html_unescape(m2.group(1)).replace("\\/", "/"), timeout=40, allow_redirects=True)
return True
def _js_redirect_candidates(page):
"""从一个不执行 JS 的响应体里,按出现顺序抽出下一跳 URL。"""
out = []
for pat in (r"scriptLogin\.src\s*=\s*'([^']+)'",
r'scriptLogin\.src\s*=\s*"([^"]+)"',
r'verifyURL\s*=\s*"([^"]+)"',
r"verifyURL\s*=\s*'([^']+)'",
r"location\.href\s*=\s*['\"]([^'\"]+)['\"]",
r"window\.location\.href\s*=\s*['\"]([^'\"]+)['\"]"):
out.extend(re.findall(pat, page or ""))
return [html_unescape(u).replace("\\/", "/") for u in out if u]
def follow_js_hops(s, start_url, stop=None, max_hops=6):
"""通用 SSO 补跳:页面给的不是 302 而是 JS/scriptLogin 时,手工走完。
study.dgjy.net 的授权链和 jspx 不是同一套页面模板,所以这里按「下一跳 URL」
逐个 GET,直到 stop() 为真(例如 Middle-Token 已经下发)或没有下一跳。
"""
cur, seen = start_url, set()
for _ in range(max_hops):
if cur in seen:
break
seen.add(cur)
try:
r = s.get(cur, timeout=40, allow_redirects=True)
except Exception:
break
if stop and stop():
return True
nxt = _js_redirect_candidates(r.text or "")
if not nxt:
break
cur = urljoin(r.url, nxt[0])
return bool(stop and stop())
def _login_error(html, status=200):
"""从 /tpass/login 的响应里取出服务端提示。
提示藏在 <script type="text/html" id="login_template"> 里的
<span id="errormsghide" style="display:none">,BeautifulSoup 的 get_text()
看不见 script 内容,所以只能按原文正则取;锁号是另一张 403 提示页。
"""
text = html or ""
m = re.search(r"验证失败次数过多[^<]*", text)
if m:
return m.group(0).strip()
m = re.search(r'<span[^>]*id="errormsghide"[^>]*>(.*?)</span>', text, re.S)
if m:
msg = re.sub(r"<[^>]+>", " ", m.group(1))
msg = re.sub(r"\s+", " ", html_unescape(msg).replace("\xa0", " ")).strip()
if msg:
return msg
m = re.search(r"(用户名|密码|账号|账户)[^<>]{0,40}(错误|不存在|不正确|锁定)", text)
if m:
return m.group(0).strip()
if status == 403:
return "账号已被锁定(403),约 10 分钟后解锁"
return ""
def parse_accountlist(html):
"""多身份账号:登录响应里内联 `var accountlist = '<json>';`。
每个元素带 USERNAME(身份证)、CODENAME(教师/家长/学生)、UNIT_NAME,
以及该身份自己的 LOGINUSERNAME / LOGINPASSWORD —— 选身份那一步是服务端
把可登录的账号密码回给前端,再带 choosenumber 提交一次。
"""
m = re.search(r"var\s+accountlist\s*=\s*'(.*?)';", html or "", re.S)
if not m:
return []
try:
data = json.loads(html_unescape(m.group(1)))
except Exception:
return []
return data if isinstance(data, list) else []
def _login_as_identity(s, un, lt, ex, it):
"""按 login_dgjy.js 的选身份分支提交:rsa 用该身份的 LOGINUSERNAME+LOGINPASSWORD。"""
name = it.get("LOGINUSERNAME") or ""
pwd = it.get("LOGINPASSWORD") or ""
payload = {"un": un, "ul": str(len(name)), "pl": str(len(pwd)),
"rsa": str_enc(name + pwd + lt), "lt": lt,
"choosenumber": it.get("USERNAME") or "", "_eventId": "submit"}
if ex:
payload["execution"] = ex
return s.post(TPASS + "/login", data=payload, timeout=30, allow_redirects=True,
headers=LOGIN_HEADERS)
def ensure_jspx_session(s):
"""用 CASTGC 走老平台(jspx)的授权链,建立 jspx.dgjy.net 的会话;成功返回 True。
必须先把 jspx 的 JSESSIONID / route 清掉:这两个是粘性会话 cookie,
浏览器里带过来的那份常常指向已经下线的后端节点(route 对不上号),
留着就永远跳 /admin/login.action,看起来像「登录失效」。
"""
try:
r = s.get(JSPX + "/admin/main.action", timeout=30)
if "table-results" in (r.text or ""):
return True
except Exception:
pass
for c in list(s.cookies):
if "jspx" in (c.domain or ""):
s.cookies.clear(c.domain, c.path, c.name)
try:
r = s.get(AUTHORIZE, timeout=40, allow_redirects=True)
_follow_js_login(s, r.text or "")
r2 = s.get(JSPX + "/admin/main.action", timeout=30)
return "table-results" in (r2.text or "")
except Exception:
return False
def _jspx_call(s, fn):
"""跑一个 jspx 请求;会话失效且手上还有 CASTGC 时,清掉粘性 cookie 重新授权后重试一次。
浏览器 / IndexedDB 里存着的 jspx JSESSIONID+route 经常指向已经下线的后端节点,
fetch_admin 看到的就是「跳回 /admin/login.action」,看着像登录过期,
实际 CASTGC 还有效 —— 这种不该让用户重新输密码。
"""
try:
return fn()
except SessionExpired:
if not ensure_jspx_session(s):
raise
return fn()
def login(username: str, password: str):
"""SSO login -> (session, user)。"""
s = new_session()
r = s.get(TPASS + "/login", timeout=30)
lt = re.search(r'id="lt"[^>]*value="([^"]*)"', r.text)
lt = lt.group(1) if lt else ""
ex = re.search(r'name="execution"[^>]*value="([^"]*)"', r.text)
payload = {
"un": username, "pd": password,
"ul": str(len(username)), "pl": str(len(password)),
"rsa": str_enc(username + password + lt),
"lt": lt, "choosenumber": "", "_eventId": "submit",
}
if ex:
payload["execution"] = ex.group(1)
r2 = s.post(TPASS + "/login", data=payload, timeout=30, allow_redirects=True,
headers=LOGIN_HEADERS)
if not any(c.name == "CASTGC" for c in s.cookies):
accts = parse_accountlist(r2.text)
if accts:
# 一个身份证下挂多个身份时,第一次提交只回账号选择页,不会给票据。
# 这里取教师身份(本平台主要场景),没有就取第一个,然后用该身份重提。
pick = next((x for x in accts if "教师" in (x.get("CODENAME") or "")), accts[0])
m = re.search(r'id="lt"[^>]*value="([^"]*)"', r2.text)
ex2 = re.search(r'name="execution"[^>]*value="([^"]*)"', r2.text)
r2 = _login_as_identity(s, username, (m.group(1) if m else lt),
(ex2.group(1) if ex2 else (ex.group(1) if ex else "")), pick)
if not any(c.name == "CASTGC" for c in s.cookies):
msg = _login_error(r2.text, r2.status_code)
raise RuntimeError((msg or "登录失败:未获得登录票据(账号或密码错误?)")[:200])
# 老平台:authorize 链的终点是 JS 中转页,必须手工补两跳才建得起 jspx 会话
if not ensure_jspx_session(s):
raise RuntimeError("SSO 登录未完成:jspx.dgjy.net 没有建立会话(登录链路可能已改版)")
html = fetch_admin(s)
# 同一张 CASTGC 再授权一次给新版平台(client_id=gyx),拿 Middle-Token
ensure_study_session(s)
return s, whoami(html)
def _next_hop_urls(page):
"""不执行 JS 时,从响应体里找出所有可能的下一跳(SSO 中转页/脚本/表单)。"""
out = _js_redirect_candidates(page)
for m in re.finditer(r'(?:src|href)\s*=\s*["\']([^"\']*(?:login|callback|authorize|verify|code)[^"\']*)["\']',
page or "", re.I):
out.append(html_unescape(m.group(1)))
for m in re.finditer(r'<form[^>]+action=["\']([^"\']+)["\']', page or "", re.I):
out.append(html_unescape(m.group(1)))
seen, uniq = set(), []
for u in out:
u = u.replace("\\/", "/")
if u.startswith("http") or u.startswith("/") or "?" in u:
if u not in seen:
seen.add(u)
uniq.append(u)
return uniq
def ensure_study_session(s, force=False):
"""用现有 SSO 票把 study.dgjy.net 的会话补上。
新版平台的登录是 OAuth 授权码换 token(前端 SPA 源码里写死了这几个地址):
GET tyyh.dgjy.net/tpass/oauth2.0/authorize?client_id=gyx
&redirect_uri=https://study.dgjy.net/#/login/back&response_type=code
... -> study.dgjy.net/#/login/back?code=ST-xxxx-tpass
POST study.dgjy.net/mod/gjt/login/<CODE> # 换出前端会话(JSESSIONID)
GET study.dgjy.net/mod/education/gyx/train/front/login
-> {"result":{"url":".../training","token":"<jwt>"}} # 这才是 Middle-Token
成功标准只有一个:cookie 里出现 study.dgjy.net 的 Middle-Token。
"""
if force:
for c in list(s.cookies):
if c.name == "Middle-Token":
try:
s.cookies.clear(c.domain, c.path, c.name)
except Exception:
pass
if _study_token(s):
return True
try:
r = s.get(TPASS + TRAIN_AUTHORIZE_PATH, timeout=40, allow_redirects=True)
except Exception:
return False
cur_url, body = r.url or "", r.text or ""
tried = set()
for _ in range(6):
m = CODE_RE.search(body) or CODE_RE.search(cur_url)
if m and m.group(1) not in tried:
tried.add(m.group(1))
if _exchange_code(s, m.group(1)):
return True
hops = _next_hop_urls(body)
if not hops:
break
nxt = urljoin(cur_url or STUDY, hops[0])
if "code=" in nxt:
code = (CODE_RE.search(nxt) or [None, ""])[1]
if code and code not in tried and _exchange_code(s, code):
return True
try:
r = s.get(nxt, timeout=40, allow_redirects=True)
except Exception:
break
cur_url, body = r.url or "", r.text or ""
return bool(_study_token(s))
def _fetch_train_token(s):
"""SSO 登录后,再用 gyx 会话换培训系统的 token(前端 `_51` 那个接口)。
返回体形如:
{"result":{"url":"https://study.dgjy.net/training","token":"<jwt>"},"resultCode":200}
这个 token 就是培训系统的 `Middle-Token`(前端把它写进 cookie 再发 Bearer)。
"""
try:
r = s.get(STUDY + "/mod/education/gyx/train/front/login", timeout=40,
headers={"Accept": "application/json, text/plain, */*"})
j = r.json()
except Exception:
return False
data = j.get("result") if isinstance(j, dict) else None
if not isinstance(data, dict):
data = j.get("data") if isinstance(j, dict) else None
tok = ""
if isinstance(data, dict):
for k in ("token", "accessToken", "middleToken"):
if data.get(k):
tok = str(data[k])
break
if not tok:
return False
s.cookies.set("Middle-Token", tok, domain=urlsplit(STUDY).hostname, path="/")
return True
def _exchange_code(s, code):
"""code -> Middle-Token。前端是 POST /mod/gjt/login/<code>,再取 gyx 培训 token。"""
paths = ("/mod/gjt/login/%s", "/train/mod/gjt/login/%s")
for path in paths:
try:
rr = s.post(STUDY + (path % code), timeout=40,
headers={"Accept": "application/json, text/plain, */*"})
except Exception:
continue
if _study_token(s):
return True
try:
j = rr.json()
except Exception:
j = {}
ok = isinstance(j, dict) and str(j.get("resultCode")) == "200"
if ok:
# SSO 换票成功后,再换培训系统的 Bearer token(Middle-Token)
if _fetch_train_token(s):
return True
data = j.get("result") or {}
if isinstance(data, dict):
for k in ("token", "accessToken", "middleToken"):
if data.get(k):
s.cookies.set("Middle-Token", str(data[k]),
domain=urlsplit(STUDY).hostname, path="/")
return True
return False
def fetch_admin(s):
"""GET /admin/main.action。
站点会话失效时**不返回 302**,而是 200 + 55 字节的 JS 跳转存根:
<script>location.href="/admin/login.action";</script>
旧代码直接把它当正常页面解析 -> 一个表格都没有 -> 静默返回空列表,
于是「会话失效」「站点改版」「账号确实没有课」被压成同一条提示。
"""
r = s.get(JSPX + "/admin/main.action", timeout=40)
html = r.text or ""
if "/admin/login.action" in html and "table-results" not in html:
# CASTGC 还有效的话,这里能无密码把 jspx 会话补回来
if ensure_jspx_session(s):
r = s.get(JSPX + "/admin/main.action", timeout=40)
html = r.text or ""
if "/admin/login.action" in html and "table-results" not in html:
raise SessionExpired("登录已失效:站点把请求跳回了 /admin/login.action(请重新登录)")
if "table-results" not in html:
raise RuntimeError("课程页结构异常:未找到 table-results 表格(站点可能已改版,页面长度 %d)"
% len(html))
return html
def _parse_course_rows(html, section=""):
"""从「我的课程」列表片段里抽出课程行。
行结构(各板块一致):
<table class="table-results"><tr><th>在学课程</th></tr>
<tr><td><p class="course-tt"><a href="courseStudyMain.action?planId=..&projectId=..">名字</a></p>
<p class="course-dd"><span>班期:..</span><span>分数:82</span><span>成绩:合格</span></p>
</td><td><a class="abtn-orange-big">查看</a></td></tr>
</table>
注意 href 是**不带前导斜杠的相对路径**(`courseStudyMain.action?...`),
相对 `/train/trainee/` 解析,不能直接 `JSPX + href`。
"""
soup = BeautifulSoup(html, "lxml")
out = []
for table in soup.select("table.table-results"):
th = table.select_one("th")
sec = section or (re.sub(r"\s+", " ", th.get_text(" ", strip=True)) if th else "")
# 只按「有没有课程行」判断,不能用 "暂无" in table.get_text():
# 表格里任何一个单元格出现「暂无」都会把整张表(含全部课程)丢掉。
rows = [tr for tr in table.select("tr") if tr.select_one("p.course-tt a")]
for tr in rows:
a = tr.select_one("p.course-tt a")
href = unquote(a.get("href") or "")
plan, project = parse_ids(href)
if not plan or not project:
continue
dd = tr.select_one("p.course-dd")
out.append({
"section": sec,
"name": a.get_text(" ", strip=True),
"info": re.sub(r"\s+", " ", dd.get_text(" ", strip=True)) if dd else "",
"plan_id": plan,
"project_id": project,
"url": urljoin(JSPX + "/train/trainee/", href),
"progress": "",
})
return out
def scrape_courses(s, with_progress=True):
"""把「我的课程」下三个板块 × 三种状态**全部**拉出来,含已学完的。
站点把列表拆成了 AJAX 接口,每个组合一次请求:
/train/trainee/studyingCourse.action?courseType=studying&planStatus=TAKING_PLAN
/train/assist/assistanceCourse.action?courseType=assistance&planStatus=FINISHED_PLAN
/train/inspect/inspectingCourse.action?courseType=inspecting&planStatus=NO_BEGAIN_PLAN
...
只看 /admin/main.action 是看不到「已结束」课程的——那个首页只渲染在学/助学/督学
三张「进行中」的概览表,课一学完就从首页消失了。
返回空列表只代表「三个板块九种状态都没课」;
会话失效或页面改版一律抛异常,让调用方能给出准确提示。
"""
# 先用首页校验会话,避免九个接口各自失败还看不出来
_jspx_call(s, lambda: fetch_admin(s))
out, seen = [], set()
for section, path, ctype in COURSE_SECTIONS:
for label, status in PLAN_STATUS:
url = "%s%s?courseType=%s&planStatus=%s" % (JSPX, path, ctype, status)
try:
html = s.get(url, timeout=40).text
except Exception:
continue
for c in _parse_course_rows(html, section):
key = (c["plan_id"], c["project_id"])
if key in seen:
continue
seen.add(key)
c["course_type"] = ctype
c["status"] = status
c["status_label"] = label
c["in_study"] = status in STUDYABLE_STATUS
out.append(c)
# 进度只在「进行中/未开始」的课上查,已结束的动辄几十门,逐个请求太慢
if with_progress:
for c in out:
if not c["in_study"]:
continue
try:
rr = s.get(c["url"], timeout=30)
p = BeautifulSoup(rr.text, "lxml").select_one("p.loading font")
c["progress"] = p.get_text(strip=True) if p else ""
except Exception:
pass
return out
def parse_jspx_course(html):
"""老版 jspx 课程页(tier-tree)解析。"""
soup = BeautifulSoup(html, "lxml")
course = soup.select_one("h1")
prog = soup.select_one("p.loading font")
info = soup.select_one("div.results-info p.info")
cw, fb, ts = [], [], []
for one in soup.select("div.tier-tree-one"):
ns = one.select_one("p.tier1.has-children span.name")
chapter = re.sub(r"\s+", " ", ns.get_text(" ", strip=True)) if ns else "?"
for p in one.select("p.tier3"):
a = p.select_one("a")
if not a:
continue
href = a.get("href") or ""
txt = re.sub(r"\s+", " ", p.get_text(" ", strip=True))
name = p.select_one("span.name")
title = re.sub(r"\s+", " ", name.get_text(" ", strip=True)) if name else txt[:40]
m = re.search(r"(\d+)分钟", txt)
done = "已完成" in txt
if "courseware.action" in href:
cw.append({"chapter": chapter, "title": title, "href": href, "done": done,
"duration": int(m.group(1)) if m else None})
elif "doFeedback.action" in href:
fb.append({"title": title, "href": href, "done": done})
elif "doTest.action" in href:
ts.append({"title": title, "href": href, "done": done})
return {
"user": whoami(html),
"course": course.get_text(" ", strip=True) if course else "?",
"progress": prog.get_text(strip=True) if prog else "?",
"info": re.sub(r"\s+", " ", info.get_text(" ", strip=True)) if info else "?",
"courseware": cw, "feedback": fb, "test": ts,
}
def discover(s, plan, project, name=""):
"""打开课程页并解析;会话失效时先用 CASTGC 补一次 jspx 授权再重试。"""
return _jspx_call(s, lambda: _discover_once(s, plan, project, name))
def _discover_once(s, plan, project, name=""):
url = "%s/train/trainee/courseStudyMain.action?planId=%s&projectId=%s&trainRole=0" % (JSPX, plan, project)
r = s.get(url, timeout=40)
html = r.text or ""
if "/admin/login.action" in html and len(html) < 2000:
# 课程页也走同一个判断:CASTGC 有效就无密码续期
if ensure_jspx_session(s):
r = s.get(url, timeout=40)
html = r.text or ""
if "没有权限" in html:
raise RuntimeError("该账号对此课程没有权限")
if "/admin/login.action" in html and len(html) < 2000:
raise SessionExpired("登录已失效:课程页把请求跳回了 /admin/login.action(请重新登录)")
# 课程页 302 到 study 时,token 在跳转 URL 里;哪怕 SPA 外壳返回空也要当成学过的新平台
study_url = "study.dgjy.net" in (r.url or "")
tok = extract_study_token(r.url, r.history)
if tok:
host = urlsplit(r.url).hostname or urlsplit(STUDY).hostname
try:
s.cookies.set("Middle-Token", tok, domain=host, path="/")
except Exception:
pass
if len(html) < 3000 and not (study_url or tok or has_study_marker(html, r.url)):
raise RuntimeError("课程页返回异常(页面长度仅 %d,登录可能已失效)" % len(html))
generation = detect_generation(html, r.url)
# 按登录 / 学习入口识别平台;以后新增平台时这里不用改,靠 Platform.entries 命中
pf = registry.detect(r.url, html)
platform_id = pf.id if pf else "guanyixue"
if generation == "legacy":
d = parse_jspx_course(html)
if d["courseware"] or d["feedback"] or d["test"]:
d["platform"] = platform_id
d["generation"] = "legacy"
return d
# 老结构但一个活动都没有:多半是「慕课」外链页(页面还在 jspx,课时在 study 平台)
if not has_study_marker(html, r.url):
snap = save_snapshot(plan, project, r.url, html)
raise RuntimeError("课程页能打开,但没有任何课件/反馈表/测验(页面已存 %s)。"
"若是慕课课程,请确认新平台登录态是否有效" % snap)
elif generation != "spa":
snap = save_snapshot(plan, project, r.url, html)
raise RuntimeError("无法识别课程页结构(站点可能又改版):页面里既没有 jspx 的 "
"tier-tree,也没有新版 SPA 标记。页面已存 %s,请把它发我" % snap)
# ---- 新版平台(Vue SPA + /train/course/front/* JSON 接口)----
tid = extract_train_id(r.url, html)
user = whoami(html)
client = StudyClient(s, r.url)
def _load():
nonlocal tid
if not tid:
tid = study_resolve_train_id(client, name)
if not tid:
snap = save_snapshot(plan, project, r.url, html)
raise RuntimeError("新版课程页未带 trainCourseId,且按课程名也匹配不到(课程名:%s)。"
"页面已存 %s" % (name or "?", snap))
return discover_study(client, tid, name, user)
try:
d = _load()
except SessionExpired:
client.bootstrap()
tid = extract_train_id(r.url, html)
d = _load()
d["platform"] = platform_id
d["generation"] = "spa"
# URL 里可能带 token(凭据),日志/状态里一律打码;鉴权已经写进 cookie
d["page_url"] = re.sub(r"([?&])(token|access_token|securityKey|sign)=[^&]*", r"\1\2=***", r.url or "")
d["plan_id"] = plan
d["project_id"] = project
return d
# ---------------------------------------------------------------- 平台注册
def _study(key, s, d, **opts):
"""旧版页面的学习流程仍在 engine._study_builtin(反馈表 / 测验 / 刷课件)。"""
from study_tool.engine import _study_builtin
return _study_builtin(key, s, d, **opts)
+26
View File
@@ -0,0 +1,26 @@
"""平台注册表:引擎、路由都只通过这里拿平台实现。"""
from study_tool.platforms.base import Platform
_PLATFORMS = {}
def register(platform: Platform) -> Platform:
_PLATFORMS[platform.id] = platform
return platform
def get(pid):
"""按 course["platform"] 取平台实现。"""
return _PLATFORMS.get(pid or "")
def detect(url="", html=""):
"""按登录入口 / 学习入口识别平台;识别不到返回 None。"""
for p in all():
if p.matches(url, html):
return p
return None
def all():
return sorted(_PLATFORMS.values(), key=lambda p: p.id)
+688
View File
@@ -0,0 +1,688 @@
"""新版莞易学课程页(study.dgjy.net):StudyClient、课程结构、学习动作。"""
import os
import re
import time
from bs4 import BeautifulSoup
from study_tool import store
from study_tool.config import *
from study_tool.platforms.jspx import *
from study_tool.runtime import log
# ------------------------------------------------------- 新版平台:页面识别/提取
def extract_train_id(page_url, html):
"""从跳转后的 URL / 页面内链接 / 隐藏域里找新版培训课程 ID(32 位 hex)。"""
q = parse_qs(urlsplit(page_url or "").query)
for k in ("trainCourseId", "courseId", "id"):
for v in q.get(k, []):
if HEX32.match(v or ""):
return v
# 页面里指向 study 的链接 / iframe / JS 跳转
for m in re.finditer(r"(?:https?:)?//[^\s\"'<>]*study\.dgjy\.net/[^\s\"'<>]+", html or ""):
u = m.group(0)
tail = u.split("#", 1)[1] if "#" in u else u
qq = parse_qs(tail.split("?", 1)[1]) if "?" in tail else {}
for k in ("trainCourseId", "courseId", "id"):
for v in qq.get(k, []):
if HEX32.match(v or ""):
return v
# 相对路径 /training/curriculum?id=...
for m in re.finditer(r"/training/(?:curriculum|courseVideo|comment)\?([^\s\"'<>]+)", html or ""):
qq = parse_qs(m.group(1).replace("&amp;", "&"))
for k in ("trainCourseId", "courseId", "id"):
for v in qq.get(k, []):
if HEX32.match(v or ""):
return v
# 隐藏域
try:
soup = BeautifulSoup(html or "", "lxml")
for i in soup.select("input[type=hidden]"):
nm = (i.get("name") or "").lower()
val = (i.get("value") or "").strip()
if HEX32.match(val) and ("course" in nm or nm in ("id", "trainid")):
return val
except Exception:
pass
return ""
def extract_study_token(page_url, history=None):
"""课程页跳转到 study 时,token 直接挂在 URL 上(前端读它写 Middle-Token cookie)。
courseStudyMain.action -> 302 study/openapi/train/front/getById?...
-> 302 study/training/trainDetails?id=..&token=<jwt>
"""
urls = [page_url or ""]
for h in history or []:
try:
urls.append(h.headers.get("Location") or "")
except Exception:
pass
for u in urls:
if not u:
continue
tail = u.split("#", 1)[1] if "#" in u else u
qq = parse_qs(tail.split("?", 1)[1]) if "?" in tail else {}
for k in ("token", "access_token", "Middle-Token"):
v = qq.get(k)
if v and v[0]:
return v[0]
return ""
def save_snapshot(plan, project, url, html):
"""存下原始页面(进 SQLite),方便站点再次改版时定位选择器。
返回给用户的是取回地址 /api/snapshot/<id>;写库失败才退回文件。
"""
safe_url = re.sub(r"([?&])(token|access_token|securityKey|sign)=[^&]*", r"\1\2=***", url or "")
try:
sid = store.snapshot_add(plan, project, safe_url, html or "")
return "/api/snapshot/%d" % sid
except Exception:
pass
name = "course_%s_%s_%s.html" % (re.sub(r"[^\w.-]", "_", str(plan))[:20],
re.sub(r"[^\w.-]", "_", str(project))[:20],
time.strftime("%H%M%S"))
path = os.path.join(DEBUG_DIR, name)
try:
with open(path, "w", encoding="utf-8") as f:
f.write("<!-- final url: %s -->\n" % safe_url)
f.write(html or "")
return path
except Exception:
return "(保存失败)"
# ------------------------------------------------------- 新版平台:HTTP 客户端
def _study_token(s):
for c in s.cookies:
if c.name == "Middle-Token" and "dgjy" in (c.domain or ""):
return c.value
return ""
class StudyClient:
"""新版平台接口客户端。
API 前缀不写死:课程页可能由 jspx 代理、也可能跳到 study.dgjy.net,
所以按「页面 origin/train」→「study.dgjy.net/train」→「gjt/tp_edu_biz/train」
依次试,哪个能返回 200 就用哪个(结果缓存)。
"""
def __init__(self, session, page_url=""):
self.s = session
self.token = _study_token(session)
self.bases = []
origin = ""
if page_url:
u = urlsplit(page_url)
if u.scheme and u.netloc:
origin = "%s://%s" % (u.scheme, u.netloc)
for b in ([origin + "/train"] if origin else []) + [STUDY + "/train"]:
if b not in self.bases:
self.bases.append(b)
if origin and "gjt.dgjy.net" in origin:
for b in (origin + "/tp_edu_biz/train",):
if b not in self.bases:
self.bases.append(b)
self.base = None
self.last_errors = []
def _raw(self, method, base, path, params=None, json_body=None):
h = {"Accept": "application/json, text/plain, */*",
"Referer": STUDY + "/training/curriculum"}
if self.token:
h["Authorization"] = "Bearer " + self.token
r = self.s.request(method, base + path, params=params, json=json_body,
headers=h, timeout=40)
try:
return r.json()
except Exception:
# 不是 JSON:多半是打到了错误前缀(返回登录页/HTML),标 -1 让 call() 换下一个 base
return {"code": -1 if r.status_code < 400 else r.status_code,
"msg": "非 JSON 响应:%s" % (r.text or "")[:120]}
def call(self, method, path, params=None, json_body=None):
bases = ([self.base] if self.base else []) + [b for b in self.bases if b != self.base]
self.last_errors = []
saw_auth = False
for b in bases:
try:
j = self._raw(method, b, path, params, json_body)
except Exception as e:
self.last_errors.append("%s -> %s" % (b, e))
continue
code = j.get("code")
if code in (401, 403) or code == 404 or code == -1:
saw_auth = saw_auth or code in (401, 403)
self.last_errors.append("%s -> %s" % (b, j.get("msg") or ("业务码 %s" % code)))
if self.base == b:
self.base = None
continue
self.base = b
return j
if saw_auth and not self.base:
raise SessionExpired("新版平台没有登录态(Middle-Token 缺失或已过期):请点「重新登录」。%s"
% "; ".join(self.last_errors)[:180])
raise RuntimeError("新版平台接口不可用:%s" % ("; ".join(self.last_errors)[:300] or "无可用地址"))
def bootstrap(self):
"""用现有 SSO 票据强制换一张新的 study.dgjy.net token(旧的可能已过期)。"""
try:
ensure_study_session(self.s, force=True)
except Exception:
pass
self.token = _study_token(self.s)
# ------------------------------------------------------- 新版平台:课程结构
def _flatten_periods(nodes, chapter="", out=None):
out = [] if out is None else out
for n in nodes or []:
if not isinstance(n, dict):
continue
nm = re.sub(r"\s+", " ", n.get("name") or "").strip()
row = dict(n)
row["_chapter"] = chapter
out.append(row)
if isinstance(n.get("children"), list) and n["children"]:
_flatten_periods(n["children"], nm or chapter, out)
return out
def _video_duration(n):
f = n.get("file") or {}
for v in (f.get("videoDuration"), f.get("duration"), f.get("fileDuration"),
n.get("duration"), n.get("videoDuration")):
try:
iv = int(float(v))
if iv > 0:
return iv
except Exception:
continue
return 0
def _period_done(n):
sl = n.get("studyLog") or {}
if sl.get("completeTime"):
return True
try:
return float(sl.get("progress") or 0) >= 1
except Exception:
return False
def _int_or_none(v):
"""平台把次数偶尔给成字符串;取不到就返回 None(页面按「未知」处理)。"""
try:
return int(v)
except (TypeError, ValueError):
return None
# 视频文件类型 -> 播放器通道(来自课程播放页 chunk-3d0ebfea 的 judgeVideoType)
CLOUD_TYPES = {"cloud_video", "middle"} # polyv 云视频:/period/middle/play
MOOC_TYPES = {"mooc_video"} # 网易云课堂:走签名/moc 播放
OTHER_TYPES = {"other"} # 普通 mp4:原生 <video>,ended 即完成
def _norm_name(s):
return re.sub(r"[\s()()【】\[\]·、,,::\-—_/]+", "", s or "").lower()
def _walk_json(o):
if isinstance(o, dict):
yield o
for v in o.values():
yield from _walk_json(v)
elif isinstance(o, list):
for v in o:
yield from _walk_json(v)
def study_resolve_train_id(client, name):
"""课程页没带 ID 时,用「我的课程」/课程列表按名字匹配。"""
target = _norm_name(name)
if not target:
return ""
cands = []
sources = [
("GET", "/course/front/study/studyCenter/myCourse/list/0",
{"pageNum": 1, "pageSize": 200}),
("GET", "/course/front/study/studyCenter/myCourse/list/1",
{"pageNum": 1, "pageSize": 200}),
("GET", "/course/front/trainCourse/list",
{"pageNum": 1, "pageSize": 100, "courseName": name}),
]
for method, path, params in sources:
try:
j = client.call(method, path, params=params)
except SessionExpired:
raise
except Exception:
continue
for rec in _walk_json(j.get("data")):
nm = ""
for k in ("courseName", "trainCourseName", "name", "title"):
if isinstance(rec.get(k), str) and rec.get(k).strip():
nm = rec[k]
break
if not nm:
for k, v in rec.items():
if k.lower().endswith("name") and isinstance(v, str) and v.strip():
nm = v
break
cid = ""
for k in ("trainCourseId", "courseId", "id"):
v = rec.get(k)
if isinstance(v, str) and HEX32.match(v):
cid = v
break
if not cid:
for k, v in rec.items():
if k.lower().endswith("id") and isinstance(v, str) and HEX32.match(v):
cid = v
break
if not nm or not cid:
continue
a = _norm_name(nm)
if a == target:
return cid
if target in a or a in target:
cands.append((cid, nm))
if cands:
return cands[0][0]
return ""
def discover_study(client, train_id, name="", user=""):
info = client.call("GET", "/course/front/trainCourse/getById",
params={"id": train_id}).get("data") or {}
tree = client.call("GET", "/course/front/period/list/tree/studyLog",
params={"courseId": train_id, "isFront": 1}).get("data") or []
if not info and not tree:
raise RuntimeError("新版平台读不到课程结构(trainCourseId=%s)" % train_id)
courseware, feedback, test, containers = [], [], [], []
mooc_nodes, seen = [], set()
def add_video(n, chapter):
pid = str(n.get("id") or "")
if not pid or pid in seen:
return
seen.add(pid)
f = n.get("file") or {}
ftype = str(f.get("fileType") or "")
if ftype in CLOUD_TYPES:
kind = "polyv"
elif ftype in MOOC_TYPES:
kind = "mooc"
else:
kind = "direct"
courseware.append({
"chapter": chapter or "课程",
"title": re.sub(r"\s+", " ", n.get("name") or "") or ("课时 %s" % pid),
"href": "",
"done": _period_done(n),
"duration": _video_duration(n),
"period_id": pid,
"source": "study",
"file_type": ftype,
"kind": kind,
"from_type": str(f.get("fromType") or ""),
"allow_drag": str(n.get("allowVideoDrag") or ""),
})
for n in _flatten_periods(tree):
pt = str(n.get("periodType") or "")
nm = re.sub(r"\s+", " ", n.get("name") or "").strip()
chapter = n.get("_chapter") or ""
if pt == "2":
add_video(n, chapter)
elif pt == "17":
feedback.append({
"title": nm or "培训反馈",
"href": "",
"done": _period_done(n),
"period_id": str(n.get("id") or ""),
"evaluation_id": n.get("evaluationId"),
})
elif pt in ("5", "6"):
tp = n.get("testpaper") or {}
status = str(tp.get("resultStatus") or "")
done = status in ("FINISHED", "REVIEWING", "REVIEWED", "PASS", "UNPASS") \
or _period_done(n)
test.append({
"title": nm or "测验",
"href": "",
"done": done,
"period_id": str(n.get("id") or ""),
"testpaper_id": tp.get("testpaperId"),
"testpaper_result_id": tp.get("testpaperResultId"),
"score": (n.get("studyLog") or {}).get("logPeriodScore"),
"passed_score": tp.get("passedScore"),
"result_status": status,
# 平台的考试次数:allow=总次数,surplus=还剩几次;重考要先看它
"allow_exam_count": _int_or_none(n.get("allowExamCount")),
"surplus_exam_count": _int_or_none(n.get("surplusExamCount")),
# 交卷后是否允许看正确答案/解析(每个测验单独配置)
"exam_after_watch_answer": str(n.get("examAfterWatchAnswer") or ""),
"exam_after_watch_question": str(n.get("examAfterWatchQuestion") or ""),
"complete_limit": str(n.get("completeLimit") or ""),
})
elif pt in ("10", "13") and n.get("kcdm"):
# 10/13 都是「莞易学课程」容器节点,真正的视频课时挂在 kcdm 指向的 MOOC 课程下
mooc_nodes.append((nm or chapter, str(n["kcdm"])))
containers.append({"period_id": str(n.get("id") or ""), "name": nm or chapter,
"kcdm": str(n["kcdm"]), "done": _period_done(n)})
# 莞易学课程节点(periodType=10):真正的视频课时挂在 kcdm 指向的 MOOC 课程下
for mooc_name, mooc_id in mooc_nodes:
try:
sub = client.call("GET", "/course/front/period/list/tree/studyLog",
params={"courseId": mooc_id, "isFront": 1}).get("data") or []
except Exception:
continue
for v in _flatten_periods(sub, mooc_name):
if str(v.get("periodType") or "") == "2":
add_video(v, mooc_name)
st = info.get("study") or {}
if st.get("periodTotal"):
progress = "%s/%s 课时" % (st.get("periodStudy") or 0, st.get("periodTotal"))
else:
progress = "%d/%d 课时" % (len([c for c in courseware if c["done"]]), len(courseware))
bits = []
if info.get("id"):
bits.append("trainCourseId=%s" % info["id"])
if info.get("isJoin") is not None:
bits.append("已加入=%s" % ("是" if str(info.get("isJoin")) == "1" else "否"))
if info.get("needJoin") is not None:
bits.append("需加入=%s" % ("是" if str(info.get("needJoin")) == "1" else "否"))
if info.get("completeRule") is not None:
bits.append("完成规则=%s" % info.get("completeRule"))
return {
"user": user,
"course": info.get("courseName") or name or "?",
"progress": progress,
"info": " | ".join(bits) or "?",
"courseware": courseware,
"feedback": feedback,
"test": test,
"containers": containers,
"train_id": train_id,
# 未加入培训时 study/log 会被静默丢弃,调用方要先补 join
"is_join": str(info.get("isJoin")) == "1",
"need_join": str(info.get("needJoin")) == "1",
# 浏览器「刷新课程页就能加入」靠的就是它:/mod/school/wanpeng/syncSelf?courseCode=<courseCode>
"course_code": str(info.get("courseCode") or ""),
}
# ------------------------------------------------------- 新版平台:动作
def study_period_log(client, period_id, done, seconds=0):
"""播放器两个包:播放中 {isComplete:0, lastProgressTime},播完 {isComplete:1}(不带时长)。"""
body = {"periodId": int(period_id), "isComplete": 1 if done else 0}
if not done:
body["lastProgressTime"] = str(int(seconds or 0))
return client.call("POST", "/course/front/period/study/log", json_body=body)
def study_log_detail(client, period_id, stime, etime):
"""学时台账(播放器暂停/离开时发):stime/etime 是这次学习的起止时间。"""
fmt = "%Y-%m-%d %H:%M:%S"
return client.call("POST", "/course/front/study/log/detail/save",
json_body={"stime": time.strftime(fmt, time.localtime(stime)),
"etime": time.strftime(fmt, time.localtime(etime)),
"periodId": int(period_id)})
def study_is_done(client, period_id):
j = client.call("GET", "/course/front/period/getById", params={"periodId": int(period_id)})
sl = (j.get("data") or {}).get("studyLog") or {}
if sl.get("completeTime"):
return True
try:
return float(sl.get("progress") or 0) >= 1
except Exception:
return False
def study_cal_final_score(client, course_id):
"""按学习日志重算课程的完成计数(PUT)。
并发上报 period/study/log 会丢增量:实测 14 个课时 completeTime 全有,但课程上的
periodStudy 只记到 11,培训那边的「课程」节点就永远不完成。这个接口能把计数补齐。
"""
return client.call("PUT", "/course/front/calFinalScore?courseId=%s" % course_id)
def study_complete_container(client, ct):
"""培训里的「课程」是 periodType 10/13 的容器节点:子课时学完它不会自动完成。
前端从不给这种节点发 study/log(播视频只动子课时),但接口本身没按节点类型拦,
所以这里补一发 isComplete=1,写完回读 completeTime 确认真生效。
"""
pid = ct["period_id"]
try:
client.call("POST", "/course/front/period/study/log",
json_body={"periodId": int(pid), "isComplete": 1})
except Exception as e:
return False, str(e)[:100]
time.sleep(0.5)
try:
j = client.call("GET", "/course/front/period/getById", params={"periodId": int(pid)})
sl = (j.get("data") or {}).get("studyLog") or {}
if sl.get("completeTime"):
return True, "已标记完成(%s)" % sl["completeTime"]
return False, "接口回 200 但 completeTime 仍为空"
except Exception as e:
return False, "回读失败:%s" % str(e)[:80]
def study_refresh_page(s, d):
"""照浏览器的做法把课程页重新走一遍(jspx 课程页 → 带新 token 的 trainDetails)。
新版平台的 isJoin 有时候要等页面真正被打开一次才落库:直接调 student/join 被拒
(「该课程无法直接加入,请联系管理员」),但刷新一次页面它就变 1 了。
所以加入失败后补一次页面访问,再复查。
"""
plan, project = d.get("plan_id") or "", d.get("project_id") or ""
if not (plan and project):
return ""
url = "%s/train/trainee/courseStudyMain.action?planId=%s&projectId=%s&trainRole=0" % (
JSPX, plan, project)
try:
r = s.get(url, timeout=40, allow_redirects=True)
return r.url or ""
except Exception:
return ""
def study_mod_get(client, path, params=None):
"""调 /mod/ 这组接口(不在 /train 下,也不带 Bearer,只认 cookie 会话)。
浏览器课程页刷新时发的就是这组:/mod/student/currentInfo、/mod/school/wanpeng/syncSelf、
/mod/gjt/roleList。用 StudyClient 的会话(cookie)直接 GET 就能通,
而 /train/* 必须额外带 Authorization: Bearer <Middle-Token>。
"""
h = {"Accept": "application/json, text/plain, */*",
"Referer": STUDY + "/training/trainDetails"}
r = client.s.get(STUDY + path, params=params, headers=h, timeout=40)
try:
return r.json()
except Exception:
return {"resultCode": r.status_code, "resultMsg": (r.text or "")[:200]}
def study_sync_self(client, course_code):
"""把当前账号同步进课程 —— 浏览器刷新课程页时真正「加入培训」的那一步。
抓包实录(常用公文写作):
getById -> isJoin=0 needJoin=1
GET /mod/school/wanpeng/syncSelf?courseCode=<code> (耗时约 2s)
getById -> isJoin=1
前端在 isJoin != 1 时就是发这一发把学员同步进课程;
isFreeJoin=0 的慕课课不走 student/join,只能靠它落库。
返回 (ok, msg)。
"""
j = study_mod_get(client, "/mod/school/wanpeng/syncSelf", {"courseCode": course_code})
res = j.get("result") or {}
code = str(j.get("resultCode") or res.get("code") or "")
return code == "200", str(res.get("msg") or j.get("resultMsg") or code or "?")
def study_sync_identity(client):
"""页面上紧随 syncSelf 的身份拉取(/mod/gjt/roleList),个别课程同步后要靠它才认人。
返回 True/False,失败无所谓,只当补一刀。
"""
try:
j = study_mod_get(client, "/mod/gjt/roleList")
return bool(j.get("result")) or str(j.get("resultCode") or "") == "200"
except Exception:
return False
def ensure_study_join(s, client, d):
"""确保这门培训已加入;返回 (ok, 说明)。
顺序(照浏览器课程页的真实行为):
当前状态 → student/join → 被拒就 syncSelf(courseCode) 轮询复查
→ 再不行就刷新一次 jspx 课程页复查。
"""
tid = d.get("train_id") or ""
code = d.get("course_code") or ""
def joined():
j = client.call("GET", "/course/front/trainCourse/getById", params={"id": tid})
return str((j.get("data") or {}).get("isJoin")) == "1"
if d.get("is_join") or joined():
return True, "已加入"
ok, msg = study_join_course(client, tid)
if ok:
return True, "加入成功"
# 浏览器刷新课程页走的就是这条:syncSelf 落库,再重新拉 getById
if code:
sync_ok, sync_msg = study_sync_self(client, code)
for i in range(8):
time.sleep(0.6 if i == 0 else 1.5)
try:
if joined():
return True, "同步课程页后已加入(student/join 被拒:%s;syncSelf=%s)" % (
msg or "-", sync_msg or "-")
except SessionExpired:
raise
except Exception:
pass
if i == 2:
# 页面在 syncSelf 之后还会拉一次身份,个别课程靠它才认人
study_sync_identity(client)
note = "syncSelf:%s" % ("成功" if sync_ok else "失败(%s)" % (sync_msg or "-"))
else:
note = "课程没有 courseCode,无法走同步接口"
study_refresh_page(s, d)
try:
if joined():
return True, "刷新课程页后已加入(student/join 被拒:%s;%s)" % (msg or "-", note)
except SessionExpired:
raise
except Exception:
pass
return False, "%s;%s" % (msg or "未加入", note)
def study_join_course(client, train_id):
"""加入培训(POST /course/front/student/join?courseId=...)。
课程 needJoin=1 且 isJoin=0 时必须先加入,否则 study/log 照样回 200,
但学习记录不会计数 —— 现象就是「每个课时都报成功、复查全是未完成」。
isFreeJoin=0 的课程服务端会直接拒:「该课程无法直接加入,请联系管理员」。
慕课课(isFreeJoin=0)别指望这个接口,要改用 study_sync_self —— 见 ensure_study_join。
返回 (ok, msg)。
"""
j = client.call("POST", "/course/front/student/join", params={"courseId": train_id})
return str(j.get("code")) == "200", str(j.get("msg") or j.get("message") or "")
def study_complete_period(cookies, page_url, item):
"""把一个视频课时报到 complete=1,并以服务端 completeTime 为准。"""
s = new_session(cookies)
c = StudyClient(s, page_url)
pid, dur = item["period_id"], int(item.get("duration") or 0)
last = ""
for attempt in range(1, 4):
try:
study_period_log(c, pid, False, 0)
time.sleep(0.35)
now = time.time()
try: # 学时台账:播放器暂停/离开时都会发,缺它学时可能不记
study_log_detail(c, pid, now - max(60, dur), now)
except Exception:
pass
j = study_period_log(c, pid, True, dur)
last = "code=%s %s" % (j.get("code"), str(j.get("msg") or "")[:60])
except SessionExpired:
raise
except Exception as e:
last = str(e)[:100]
time.sleep(1.2)
try:
if study_is_done(c, pid):
return True, "ok"
except Exception as e:
last = str(e)[:100]
time.sleep(1.0)
return False, last
def study_submit_feedback(client, fb, key, train_id):
eid = fb.get("evaluation_id")
if not eid:
log(key, "反馈表:该节点没有 evaluationId,跳过")
return
j = client.call("GET", "/course/front/evaluation/result/getDetail",
params={"evaluationId": eid})
data = j.get("data") or {}
if data.get("resultId"):
log(key, "反馈表:已提交过(resultId=%s),跳过" % data["resultId"])
return
items = data.get("items") or []
if not items:
log(key, "反馈表:没有题目(evaluationId=%s),跳过" % eid)
return
score_flag = str(data.get("scoreFlag")) != "0"
stars = data.get("starCount") or 10
answers = [{"itemId": it.get("itemId"),
"answer": stars if score_flag else ""} for it in items]
payload = {"periodId": int(fb["period_id"]), "evaluationId": int(eid),
"items": answers, "trainCourseId": train_id}
r = client.call("POST", "/course/front/evaluation/result", json_body=payload)
if r.get("code") == 200:
log(key, "反馈表:%d 题,提交成功(%s分)" % (len(answers), stars))
else:
log(key, "反馈表:提交失败 code=%s %s" % (r.get("code"), str(r.get("msg") or "")[:80]))
# ---------------------------------------------------------------- 学习实现
def _study(key, s, d, **opts):
from study_tool.engine import run_study_course
return run_study_course(key, s, d, opts.get("workers", 1), opts.get("cap", 30),
opts.get("enable_quiz", False), opts.get("enable_feedback", False),
opts.get("mode", "fast"), opts.get("parallel", 2))
+666
View File
@@ -0,0 +1,666 @@
"""测验:题目解析、交卷、AI 答题(流式)。"""
import json
import re
import time
from fastapi.responses import StreamingResponse
from study_tool.webapp import app
from study_tool.config import *
from study_tool.engine import *
from study_tool.llm import *
from study_tool.models import *
from study_tool.runtime import log
# ------------------------------------------------------------------ quiz
STUDY_QMAP = {"SINGLECHOICE": "01", "MULTIPLECHOICE": "02", "JUDGMENT": "03",
"TRUEFALSE": "03", "FILLIN": "04", "SHORTANSWER": "04", "ESSAY": "04"}
# 判断题在新版平台里没有 metasData 选项(只有一条 sort/content/option 全 null 的占位),
# 真正可选项是前端写死的「正确 / 错误」,交卷时 replay 用 0/1 下标表示。
# 这里补出 A/B 两个伪选项,页面才有得选,交卷也能把字母换成正确下标。
JUDGE_OPTIONS = [{"key": "A", "text": "正确"}, {"key": "B", "text": "错误"}]
_ANSWER_YES = {"A", "正确", "对", "是", "√", "T", "TRUE", "Y", "YES"}
_ANSWER_NO = {"B", "错误", "错", "否", "×", "X", "F", "FALSE", "N", "NO"}
def answer_tokens(raw, options=None, qtype="01"):
"""把答案文本拆成选项字母列表。
判断题允许模型/用户写「正确 / 错误 / 对 / 错 / √ / × / T / F」,
统一收敛到 A(正确)/ B(错误);有选项时只保留合法字母;
问答题没有选项,原样保留文本。
"""
keys = [o.get("key") for o in (options or []) if o.get("key")]
parts = [p for p in re.split(r"[#,\s、/]+", str(raw or "").strip().upper()) if p]
# 多选常被模型写成 AC / ABC 这种连写,按选项字母拆开
if keys:
parts = [c for p in parts for c in (list(p) if len(p) > 1 and all(ch in keys for ch in p)
else [p])]
out, seen = [], set()
for p in parts:
if p in keys:
tok = p
elif qtype == "03":
tok = "A" if p in _ANSWER_YES else ("B" if p in _ANSWER_NO else "")
elif not keys:
tok = p
else:
tok = ""
if tok and tok not in seen:
seen.add(tok)
out.append(tok)
return out
def _plain(s):
return re.sub(r"\s+", " ", BeautifulSoup(s or "", "lxml").get_text(" ", strip=True)).strip()
def study_parse_paper(data):
"""把 /questions/front/testpaper/getById 的 data.questions 拍平成题目列表。
结构:questions = [{type, data: [{seq, questionType, stem, metasData:[{option,content}],
itemResultId, replay}]}]
replay 是已保存答案的**0 基选项下标**数组,例如 ["2"] = 第 3 个选项。
"""
out = []
for grp in data.get("questions") or []:
for it in grp.get("data") or []:
qtype = STUDY_QMAP.get(str(it.get("questionType") or ""), "01")
opts = []
for m in it.get("metasData") or []:
key = str(m.get("option") or "").strip().upper()
if key:
opts.append({"key": key, "text": _plain(m.get("content"))})
opts.sort(key=lambda o: o["key"])
# 判断题:平台不给选项,补上 正确/错误,页面才看得见、交卷才好映射 0/1
if not opts and qtype == "03":
opts = [dict(o) for o in JUDGE_OPTIONS]
picked = ""
rp = it.get("replay")
if rp:
try:
idx = json.loads(rp) if isinstance(rp, str) else rp
picked = "#".join(opts[int(i)]["key"] for i in idx
if 0 <= int(i) < len(opts))
except Exception:
picked = ""
out.append({"no": str(int(it.get("seq") or 0) + 1),
"type": qtype,
"title": _plain(it.get("stem"))[:600],
"options": opts,
"item_id": it.get("itemResultId"),
"picked": picked})
return out
def _idx_letters(raw, opts):
"""review 接口里的 replay/answer 是 JSON 字符串形式的 0 基下标数组。"""
if raw in (None, "", "null"):
return ""
try:
idx = json.loads(raw) if isinstance(raw, str) else raw
except Exception:
return ""
if idx is None:
return ""
if not isinstance(idx, (list, tuple)):
idx = [idx]
out = []
for i in idx:
try:
n = int(i)
except (TypeError, ValueError):
continue
if 0 <= n < len(opts):
out.append(opts[n]["key"])
return "#".join(out)
def _answer_text(raw):
"""填空/问答题的标准答案:可能是 JSON 数组 [{content:…}],也可能就是文本。"""
if raw in (None, ""):
return ""
v = raw
if isinstance(v, str):
try:
v = json.loads(v)
except Exception:
return _plain(v)
if isinstance(v, list):
parts = []
for x in v:
parts.append(_plain(x.get("content") or "") if isinstance(x, dict) else _plain(str(x)))
return " / ".join(p for p in parts if p)
if isinstance(v, dict):
return _plain(v.get("content") or "")
return _plain(str(v))
def study_parse_review(data, show_answers=True):
"""把 /questions/front/testpaper/teacher/review 的题目拍平,带标准答案/得分/解析。
review 的 item 与取题接口不同:
replay = 学生作答的 0 基下标数组(JSON 字符串)
answer = 标准答案:选择题是 0 基下标数组,填空/问答是 [{content:…}] 或文本
answerScore / status / analysis = 得分、对错、解析
show_answers=False 对应测验配置 examAfterWatchAnswer=0:平台不给看答案,
这里也不返回 correct/analysis,避免把不该展示的答案泄露到页面。
"""
out, seq = [], 0
for grp in data.get("questions") or []:
for it in grp.get("data") or []:
seq += 1
qtype = STUDY_QMAP.get(str(it.get("questionType") or ""), "01")
opts = []
for m in it.get("metasData") or []:
key = str(m.get("option") or "").strip().upper()
if key:
opts.append({"key": key, "text": _plain(m.get("content"))})
opts.sort(key=lambda o: o["key"])
if not opts and qtype == "03":
opts = [dict(o) for o in JUDGE_OPTIONS]
picked = (_idx_letters(it.get("replay"), opts)
if qtype in ("01", "02", "03") else _answer_text(it.get("replay")))
correct, is_correct = "", None
if show_answers:
if qtype in ("01", "02", "03"):
correct = _idx_letters(it.get("answer"), opts)
if correct:
is_correct = (set(picked.split("#")) - {""}) == \
(set(correct.split("#")) - {""})
else:
correct = _answer_text(it.get("answer"))
try:
is_correct = float(it.get("answerScore") or 0) > 0
except Exception:
is_correct = None
try:
ascore = float(it.get("answerScore") or 0)
except Exception:
ascore = None
out.append({"no": str(seq),
"type": qtype,
"title": _plain(it.get("stem"))[:600],
"options": opts,
"item_id": it.get("itemResultId"),
"picked": picked,
"correct": correct,
"is_correct": is_correct,
"answer_score": ascore,
"analysis": (_plain(it.get("analysis"))[:600] if show_answers else "")})
return out
def parse_quiz_html(html):
"""解析 jspx 的 showTestQums 页面:div.job-item[questype][quesno][traineeid][qumid]。"""
soup = BeautifulSoup(html or "", "lxml")
out = []
for it in soup.select("div.job-item"):
opts = []
for sp in it.select(".job-item-a span"):
key = (sp.get("data-name") or "").strip()
txt = re.sub(r"\s+", " ", sp.get_text(" ", strip=True))
if key:
opts.append({"key": key.upper(), "text": txt})
stem = ""
node = (it.select_one(".job-item-t") or it.select_one(".job-item-title")
or it.select_one("p.title") or it.select_one("div.title"))
if node:
stem = re.sub(r"\s+", " ", node.get_text(" ", strip=True))
else:
full = re.sub(r"\s+", " ", it.get_text(" ", strip=True))
for o in opts:
if o["text"]:
full = full.replace(o["text"], "")
stem = re.sub(r"\s+", " ", full).strip(" .、0123456789")
# 判断题在页面上通常只有 A/B 两个 radio、没有选项文字,
# 照样补出「正确/错误」,免得只看到一个字母不知道对错
qtype = (it.get("questype") or "01").strip()
if not opts and qtype == "03":
opts = [dict(o) for o in JUDGE_OPTIONS]
out.append({"no": (it.get("quesno") or "").strip(),
"type": qtype,
"title": stem[:600],
"options": opts,
"traineeid": it.get("traineeid"),
"ques_id": it.get("qumid")})
return out
def fetch_quiz_page(s, plan, obj):
url = "%s/train/trainee/showTestQums.action?planId=%s&objectId=%s" % (JSPX, plan, obj)
r = s.get(url, timeout=40)
html = r.text or ""
if "/admin/login.action" in html and len(html) < 2000:
raise SessionExpired("登录已失效,请重新登录后再取题")
return html
@app.post("/api/quiz")
def api_quiz(b: QuizIn):
"""取一次测验的题目(含选项),供页面表格展示。"""
if not b.cookies:
return {"ok": False, "code": "no_cookie", "error": "尚未登录"}
s = new_session(b.cookies)
try:
d = discover(s, b.plan_id, b.project_id, b.name)
except SessionExpired as e:
return {"ok": False, "code": "session_expired", "error": str(e)[:300]}
except Exception as e:
return {"ok": False, "error": str(e)[:300]}
tests = d.get("test") or []
if not tests:
return {"ok": False, "error": "这门课没有测验"}
if d.get("generation") == "spa":
return _quiz_study(s, d, tests, retake=b.retake, period_id=b.period_id)
t = next((x for x in tests if not x.get("done")), tests[0])
url = t["href"] if t["href"].startswith("http") else JSPX + t["href"]
plan, _ = parse_ids(url)
m = re.search(r"objectId=([0-9A-Fa-f]+)", url)
obj = m.group(1) if m else (b.project_id or "")
try:
html = fetch_quiz_page(s, plan, obj)
except SessionExpired as e:
return {"ok": False, "code": "session_expired", "error": str(e)[:300]}
except Exception as e:
return {"ok": False, "error": "取题失败:%s" % str(e)[:200]}
qs = parse_quiz_html(html)
if not qs:
return {"ok": False, "error": "没解析到题目(页面 %d 字节),站点可能改版" % len(html)}
return {"ok": True, "platform": "guanyixue", "generation": "legacy",
"plan_id": plan, "object_id": obj,
"title": t.get("title") or "测验", "done": bool(t.get("done")),
"questions": qs}
def _quiz_study(s, d, tests, retake=False, period_id=""):
"""新版平台取题 / 重考 / 交卷后看答案。
取题:GET /train/questions/front/testpaper/getById?testpaperResultId=…
重考:PUT /train/questions/front/testpaper/start/do
{"periodId": <课时 id>, "trainCourseId": <trainCourseId>}
-> 新答卷 testpaperResultId(平台有 allowExamCount/surplusExamCount 次数限制)
看答案:GET /train/questions/front/testpaper/teacher/review?testpaperResultId=…
返回 answer(标准答案下标/文本)、replay(学生答案)、answerScore、analysis。
是否展示由测验的 examAfterWatchAnswer 决定,不是所有测验都给看。
这些和页面上「开始考试 / 查看试卷」发的是同一条请求,所以纯 API 也能完成。
"""
def pick_test():
if period_id:
for x in tests:
if str(x.get("period_id") or "") == str(period_id):
return x
return (next((x for x in tests if not x.get("done") and x.get("testpaper_result_id")), None)
or next((x for x in tests if not x.get("done")), None)
or next((x for x in tests if x.get("testpaper_result_id")), None)
or (tests[0] if tests else None))
t = pick_test()
if not t:
return {"ok": False, "code": "no_test", "error": "这门课没有测验"}
client = StudyClient(s, d.get("page_url") or (STUDY + "/training/curriculum"))
allow = t.get("allow_exam_count")
left = t.get("surplus_exam_count")
show_answers = str(t.get("exam_after_watch_answer") or "") == "1"
started = False
def start_paper(pid, err_prefix):
try:
j0 = client.call("PUT", "/questions/front/testpaper/start/do",
json_body={"periodId": int(pid),
"trainCourseId": d.get("train_id") or ""})
except Exception as e:
return None, "%s:%s" % (err_prefix, str(e)[:200])
if str(j0.get("code")) != "200":
return None, "%s:%s" % (err_prefix,
str(j0.get("msg") or j0.get("message") or j0)[:200])
data0 = j0.get("data") or {}
new_rid = str(data0.get("testpaperResultId") or data0.get("resultId") or "")
if not new_rid:
return None, "%s:平台没有返回 testpaperResultId" % err_prefix
return new_rid, ""
# ---- 重考:已交卷且还有剩余次数,start/do 会生成一份新答卷 ----
if retake:
if not t.get("done") and t.get("testpaper_result_id"):
return {"ok": False, "code": "doing",
"error": "还有一份未交卷的答卷,先交卷再重考"}
if not (isinstance(left, int) and left > 0):
used = (allow - left) if isinstance(allow, int) and isinstance(left, int) else "?"
return {"ok": False, "code": "no_attempts",
"error": "考试次数已用完(已用 %s/%s 次),不能再考" % (used, allow)}
pid = str(t.get("period_id") or "").strip()
if not pid:
return {"ok": False, "code": "no_period", "error": "这个测验没有课时 ID,无法重考"}
new_rid, err = start_paper(pid, "重考失败")
if err:
return {"ok": False, "error": err}
old_rid = str(t.get("testpaper_result_id") or "")
if new_rid == old_rid:
return {"ok": False, "code": "no_attempts",
"error": "平台没有生成新答卷(可能次数已用完或需要老师重置)"}
started = True
t = dict(t)
t.update({"testpaper_result_id": new_rid, "done": False, "result_status": "DOING"})
if isinstance(left, int):
left = max(0, left - 1) # 先本地减 1;交卷后重新 discover 会校准
rid = new_rid
else:
rid = str(t.get("testpaper_result_id") or "")
# ---- 第一次取题:还没有答卷就自动创建 ----
if not rid:
if t.get("done"):
return {"ok": False, "code": "no_result",
"error": "这个测验已完成,但平台没有返回答卷 ID,无法再看题目"}
pid = str(t.get("period_id") or "").strip()
if not pid:
return {"ok": False, "code": "no_period",
"error": "这个测验没有课时 ID,无法自动开始答卷"}
rid, err = start_paper(pid, "自动开始答卷失败")
if err:
return {"ok": False, "error": err}
started = True
# ---- 取当前答卷;已交卷的再调 review 拿标准答案 ----
paper = None
try:
j = client.call("GET", "/questions/front/testpaper/getById",
params={"testpaperResultId": rid})
if str(j.get("code")) == "200":
paper = j.get("data") or {}
except Exception:
paper = None
res = (paper or {}).get("result") or {}
status = str(res.get("status") or t.get("result_status") or "").upper()
done = status in ("FINISHED", "REVIEWED", "REVIEWING") or bool(t.get("done"))
qs, review = [], False
if done:
try:
jr = client.call("GET", "/questions/front/testpaper/teacher/review",
params={"testpaperResultId": rid})
if str(jr.get("code")) == "200":
rdata = jr.get("data") or {}
qs = study_parse_review(rdata, show_answers=show_answers)
review = bool(qs)
res = rdata.get("result") or res
paper = rdata
status = str(res.get("status") or status).upper()
except Exception:
pass
if not qs and paper:
qs = study_parse_paper(paper)
if not qs:
return {"ok": False, "error": "接口返回成功,但没有解析到题目"}
score = res.get("answerSumScore")
if score is None:
score = (paper or {}).get("score") if (paper or {}).get("score") is not None else t.get("score")
passed_score = (paper or {}).get("passedScore")
if passed_score is None:
passed_score = t.get("passed_score")
return {"ok": True, "platform": "guanyixue", "generation": "spa", "result_id": rid,
"period_id": t.get("period_id"),
"train_id": d.get("train_id") or "",
"started": started, # True = 本次请求创建了新答卷
"title": t.get("title") or (paper or {}).get("name") or "测验",
"questions": qs,
"done": done,
"review": review, # True = 已交卷,题目里带标准答案/解析
"show_answers": show_answers,
"allow_exam_count": allow,
"surplus_exam_count": left,
"can_retake": bool(done and isinstance(left, int) and left > 0),
"exam_after_watch_answer": t.get("exam_after_watch_answer") or "",
"result_status": status,
"score": score,
"passed_score": passed_score,
"passed": str(res.get("passedStatus") or "") == "1",
"submit_time": res.get("submitTime")}
def _quiz_study_submit(b):
"""新版平台交卷:PUT /train/questions/front/result/submitExam
{"resultId": "<testpaperResultId>",
"resultItemList": [{"fileIds": [], "itemId": "<itemResultId>", "replay": [0,2] | null}]}
replay 是**0 基选项下标**数组,字母答案要先按选项顺序换成下标。
"""
if not b.result_id:
return {"ok": False, "error": "缺少 resultId,请重新点一次「测验」"}
s = new_session(b.cookies)
client = StudyClient(s, STUDY + "/training/curriculum")
try:
j = client.call("GET", "/questions/front/testpaper/getById",
params={"testpaperResultId": b.result_id})
except Exception as e:
return {"ok": False, "error": "交卷前取题失败:%s" % str(e)[:200]}
if str(j.get("code")) != "200":
return {"ok": False, "error": "交卷前取题失败:%s" % str(j.get("msg") or j)[:200]}
qs = study_parse_paper(j.get("data") or {})
if not qs:
return {"ok": False, "error": "交卷前取题失败:没有题目"}
res0 = (j.get("data") or {}).get("result") or {}
st0 = str(res0.get("status") or "").upper()
if st0 in ("FINISHED", "REVIEWED", "REVIEWING"):
sc = res0.get("answerSumScore")
return {"ok": False, "code": "already_finished",
"error": "这份答卷已经交过卷%s;点「再考一次」可以生成新答卷再提交"
% ("(得分 %s)" % sc if sc is not None else "")}
items, answered = [], 0
for q in qs:
keys = [o["key"] for o in q["options"]]
letters = answer_tokens((b.answers or {}).get(q["no"]), q["options"], q["type"])
idx = [keys.index(x) for x in letters if x in keys]
if idx:
answered += 1
items.append({"fileIds": [], "itemId": q["item_id"], "replay": idx or None})
body = {"resultId": b.result_id, "resultItemList": items}
try:
r = client.call("PUT", "/questions/front/result/submitExam", json_body=body)
except Exception as e:
return {"ok": False, "error": "交卷失败:%s" % str(e)[:200]}
if str(r.get("code")) != "200":
return {"ok": False, "error": "交卷失败:%s" % str(r.get("msg") or r)[:200]}
score = None
try:
j2 = client.call("GET", "/questions/front/testpaper/getById",
params={"testpaperResultId": b.result_id})
res = ((j2.get("data") or {}).get("result") or {})
score = res.get("answerSumScore")
except Exception:
pass
return {"ok": True, "answers": answered, "total": len(items), "score": score,
"msg": "交卷成功"}
@app.post("/api/quiz/submit")
def api_quiz_submit(b: QuizSubmitIn):
"""按 quesNo 合并用户/模型的答案后交卷。重新取一次题,保证 traineeid 是当前会话的。"""
if not b.cookies:
return {"ok": False, "error": "尚未登录"}
if b.generation == "spa":
return _quiz_study_submit(b)
s = new_session(b.cookies)
try:
html = fetch_quiz_page(s, b.plan_id, b.object_id)
except Exception as e:
return {"ok": False, "error": "重新取题失败:%s" % str(e)[:200]}
qs = parse_quiz_html(html)
if not qs:
return {"ok": False, "error": "重新取题失败,无法提交"}
answers = []
for it in qs:
ans = str((b.answers or {}).get(it["no"]) or "").strip().upper()
if not ans:
ans = it["options"][0]["key"] if it["options"] else "A"
answers.append({"id": it["traineeid"], "quesId": it["ques_id"],
"quesType": it["type"], "quesNo": it["no"], "answer": ans})
payload = {"planId": b.plan_id, "objectId": b.object_id,
"answers": json.dumps(answers, ensure_ascii=False, separators=(",", ":"))}
r3 = s.post(JSPX + "/train/trainee/endTest.action", data=payload, timeout=40)
try:
r4 = s.get("%s/train/trainee/doTest.action?planId=%s&objectId=%s"
% (JSPX, b.plan_id, b.object_id), timeout=40)
text = re.sub(r"\s+", " ", BeautifulSoup(r4.text, "lxml").get_text(" ", strip=True))
m = re.search(r"得分:\s*(\d+)\s*分", text)
score = m.group(1) if m else None
except Exception:
score = None
return {"ok": True, "answers": len(answers), "score": score,
"msg": "提交成功" if "MSG" not in (r3.text or "") else (r3.text or "")[:80]}
_ANS_PAIR = re.compile(
r"""(\d+)\s*(?:题)?\s*["']?\s*[::=、..]\s*["']?\s*([A-F](?:\s*[#、,/,\s]\s*[A-F])*|正确|错误|对|错|√|×)""",
re.I)
def parse_llm_answers(content, questions):
"""优先按 JSON 解析;模型没给 JSON(或被截断)时从「1.A / 第3题:B」里抠。"""
def _pick(raw):
out = {}
for q in questions:
no = str(q.get("no") or "")
v = raw.get(no, raw.get(no.strip()))
if isinstance(v, list):
v = "#".join(str(x) for x in v)
parts = answer_tokens(v, q.get("options"), str(q.get("type") or "01"))
if parts:
out[no] = "#".join(parts)
return out
txt = re.sub(r"```(?:json)?|```", "", (content or "").strip()).strip()
m = re.search(r"\{.*\}", txt, re.S)
if m:
try:
data = json.loads(m.group(0))
except Exception:
data = None
if isinstance(data, dict):
raw = data.get("answers") if isinstance(data.get("answers"), dict) else data
if isinstance(raw, dict):
out = _pick(raw)
if out:
return out
return _pick({no: v for no, v in _ANS_PAIR.findall(txt)})
QUIZ_BATCH = 5
# 这些错误重试也没用(鉴权/路径/参数问题),其它(超时、5xx、空内容)值得再问一次
_RETRY_HINT = re.compile(r"timed out|timeout|超时|429|5\d\d|空内容|不是 JSON", re.I)
def _quiz_lines(part):
lines = []
for q in part:
opts = ";".join("%s. %s" % (o.get("key"), o.get("text")) for o in (q.get("options") or []))
lines.append("第%s题(%s)%s\n选项:%s" % (
q.get("no"), TYPE_LABEL.get(str(q.get("type")), "单选"),
q.get("title") or "", opts or "无"))
return "\n\n".join(lines)
def _quiz_log(key, msg):
"""AI 答题日志:统一走 runtime.log(控制台 + 内存 + SQLite)。"""
log(key or "system", "AI答题 " + msg)
def _quiz_ask(system, part, cfg, strict=False):
"""问一批题,返回 (答案, 模型原文)。
strict:连 response_format 一起关掉,改成口头要求(有的网关不认这个字段)。
"""
if strict:
system += ('\n只输出一个 JSON 对象,形如 {"answers":{"1":"A"}};不要解释,不要 markdown。')
content = llm_chat([{"role": "system", "content": system},
{"role": "user", "content": _quiz_lines(part)}],
cfg, max_tokens=1600, json_mode=not strict)
return parse_llm_answers(content, part), content
def _sse(obj):
return "data: " + json.dumps(obj, ensure_ascii=False) + "\n\n"
def _quiz_stream(system, questions, cfg, key=""):
total = len(questions)
batches = (total + QUIZ_BATCH - 1) // QUIZ_BATCH
_quiz_log(key, "开始:%d 题 / %d 批,模型 %s(%s),超时 %ss" % (
total, batches, cfg.get("model") or "?",
urlsplit(cfg.get("base_url") or "").hostname or "?", cfg.get("timeout") or 120))
t0, filled, failed = time.time(), 0, 0
for bi, i in enumerate(range(0, total, QUIZ_BATCH), 1):
part = questions[i:i + QUIZ_BATCH]
answers, err = {}, ""
for strict in (False, True):
tag = "第 %d/%d 批[%s]%s" % (bi, batches, ",".join(str(q.get("no")) for q in part),
" 补问" if strict else "")
t1 = time.time()
try:
got, content = _quiz_ask(system, part, cfg, strict)
except Exception as e:
err = str(e)[:160]
_quiz_log(key, tag + " 失败 %.1fs:%s" % (time.time() - t1, err))
if not _RETRY_HINT.search(err):
break
continue
answers.update(got)
part = [q for q in part if str(q.get("no")) not in got] # 第二轮回只问没答出来的
if not part:
_quiz_log(key, tag + " 成功 %.1fs:%d 题" % (time.time() - t1, len(answers)))
err = ""
break
_quiz_log(key, tag + " 本批只答出 %d 题 %.1fs,模型原文:%s" % (
len(answers), time.time() - t1, content[:300].replace("\n", " ")))
err = "还有 %d 题没答出来" % len(part)
filled += len(answers)
if not answers:
failed += 1
yield _sse({"answers": answers, "error": "" if answers else err})
_quiz_log(key, "结束:已填 %d/%d,失败 %d 批,耗时 %.1fs" % (
filled, total, failed, time.time() - t0))
yield _sse({"done": True, "total": total, "failed": failed})
def _quiz_err(msg, total=0):
return StreamingResponse(iter([_sse({"done": True, "total": total, "failed": 0, "error": msg})]),
media_type="text/event-stream",
headers={"Cache-Control": "no-cache", "X-Accel-Buffering": "no"})
@app.post("/api/quiz/answer")
def api_quiz_answer(b: QuizAnswerIn):
"""分批问模型,边算边把结果推回去(text/event-stream,每批一行)。
整段同步返回时,20 题要串行等好几分钟,浏览器/反代先断,前面算好的答案也拿不到;
流式之后连接一直有数据,单批失败只影响这一批 5 题。
"""
cfg = load_settings()["llm"]
key = b.account_id or ""
if not cfg.get("api_key") or not cfg.get("base_url"):
msg = "还没配置大模型:右上角「设置」→ 填 base_url / api_key / model"
_quiz_log(key, msg)
return _quiz_err(msg, len(b.questions))
if not b.questions:
_quiz_log(key, "没有题目")
return _quiz_err("没有题目")
system = (b.prompt or cfg.get("prompt") or DEFAULT_ANSWER_PROMPT)
return StreamingResponse(_quiz_stream(system, b.questions, cfg, key),
media_type="text/event-stream",
headers={"Cache-Control": "no-cache", "X-Accel-Buffering": "no"})
+1
View File
@@ -0,0 +1 @@
"""HTTP 路由包:按业务域拆分,导入即注册到 study_tool.webapp.app。"""
+105
View File
@@ -0,0 +1,105 @@
"""账号 / 登录 / 登录记录接口。"""
import time
from study_tool.webapp import app
from study_tool import store
from study_tool.config import *
from study_tool.models import *
from study_tool.platforms.jspx import *
from study_tool.runtime import log
def _log_login(username, ok, code, error, elapsed, stage=""):
"""每次登录尝试:统一日志 + login_log 表(登录记录页用)。"""
log(username or "-", "登录%s code=%s%s %s %.1fs" % (
"成功" if ok else "失败", code, (" " + stage) if stage else "",
(error or "")[:120], elapsed or 0))
try:
store.login_log_add(username, ok, code, elapsed, stage, error)
except Exception:
pass
def _login_account(b: LoginIn):
"""解析出一组可登录的凭据:显式传入优先,否则按账号 id 从库里取。"""
acc = store.account_get(b.account_id) if b.account_id else None
username = (b.username or "").strip() or ((acc or {}).get("username") or "")
password = b.password or (store.account_password(b.account_id) if b.account_id else "")
return acc, username, password
@app.post("/api/login")
def api_login(b: LoginIn):
t0 = time.time()
acc, username, password = _login_account(b)
if not username or not password:
err = "没有可用的账号密码:新账号请在「添加账号」里填密码,服务端会把它存进 SQLite"
_log_login(username or b.account_id, False, "no_credential", err, time.time() - t0,
"LoginIn")
return JSONResponse({"ok": False, "code": "no_credential", "error": err}, status_code=200)
try:
s, user = login(username, password)
except Exception as e:
err = str(e)[:300]
_log_login(username, False, "login_failed", err, time.time() - t0, type(e).__name__)
if acc:
store.account_upsert({"id": acc["id"], "username": acc["username"],
"status": "login_failed", "lastError": err,
"lastErrorAt": time.time()})
return JSONResponse({"ok": False, "code": "login_failed", "error": err}, status_code=200)
warn = ""
try:
courses = scrape_courses(s)
except Exception as e:
courses, warn = [], str(e)[:200]
cookies = dump_cookies(s)
_log_login(username, True, "ok", warn, time.time() - t0, "user=%s" % user)
if acc:
store.account_save_login(acc["id"], user, cookies, courses)
return {"ok": True, "user": user, "cookies": cookies, "courses": courses, "warn": warn}
@app.get("/api/loginlog")
def api_loginlog(tail: int = 40):
"""登录尝试回放:前端点「登录」后,这里能看到平台到底回了什么。"""
return {"ok": True, "lines": store.login_log_tail(tail)}
# ------------------------------------------------------------------ accounts
@app.get("/api/accounts")
def api_accounts():
"""全部账号(含会话 cookie / 课程缓存 / 勾选),**不含密码**。"""
return {"ok": True, "accounts": store.account_list()}
@app.post("/api/accounts")
def api_account_save(b: AccountIn):
"""新增或更新一个账号。password 不传(或传空)表示保留库里已有的密码。"""
rec = b.model_dump()
if not (rec.get("password") or "").strip():
rec["password"] = None
if not rec.get("id") and not rec.get("username"):
return JSONResponse({"ok": False, "error": "缺少 username"}, status_code=200)
try:
aid = store.account_upsert(rec)
except Exception as e:
return JSONResponse({"ok": False, "error": "写入 SQLite 失败:%s" % str(e)[:200]},
status_code=200)
return {"ok": True, "id": aid, "account": store.account_get(aid)}
@app.get("/api/accounts/{account_id}")
def api_account_get(account_id: str):
acc = store.account_get(account_id)
if not acc:
return JSONResponse({"ok": False, "error": "账号不存在"}, status_code=200)
return {"ok": True, "account": acc}
@app.delete("/api/accounts/{account_id}")
def api_account_del(account_id: str):
store.account_delete(account_id)
with RUNS_LOCK:
RUNS.pop(account_id, None)
return {"ok": True}
+22
View File
@@ -0,0 +1,22 @@
"""/api/log、/api/runs:前端轮询日志与运行状态。"""
from study_tool.webapp import app
from study_tool.runtime import RUNS, RUNS_LOCK
@app.get("/api/log")
def api_log(key: str, since: int = 0):
st = RUNS.get(key) or {}
log = st.get("log", [])
out = {"lines": log[since:], "next": len(log), "status": st.get("status", ""),
"done": st.get("done", 0), "total": st.get("total", 0),
"course": st.get("course", ""), "progress": st.get("progress", "")}
# discover 可能给账号补上了 study.dgjy.net 的 Middle-Token,回传给前端写回 IndexedDB
if st.get("cookies"):
out["cookies"] = st["cookies"]
return out
@app.get("/api/runs")
def api_runs():
with RUNS_LOCK:
return {k: {kk: vv for kk, vv in v.items() if kk != "log"} for k, v in RUNS.items()}
+165
View File
@@ -0,0 +1,165 @@
"""课程 / 发现 / 学习 / 停止 / 抓包 / 快照 / 历史日志接口。"""
import time
from fastapi.responses import HTMLResponse, JSONResponse
from study_tool.webapp import app
from study_tool import store
from study_tool.capture import *
from study_tool.config import *
from study_tool.engine import *
from study_tool.models import *
from study_tool.platforms import registry
from study_tool.platforms.jspx import *
from study_tool.platforms.study import *
from study_tool.runtime import RUNS, RUNS_LOCK, log
# ------------------------------------------------------------------ 平台
@app.get("/api/platforms")
def api_platforms():
"""已注册平台;前端用 label 展示,例如「莞易学」。"""
return {"ok": True, "platforms": [{"id": p.id, "label": p.label} for p in registry.all()]}
# ------------------------------------------------------------------ 运行日志 / 快照
@app.get("/api/log/history")
def api_log_history(key: str = "", tail: int = 200):
"""从 SQLite 读历史日志;不带 key 时列出每个账号存了多少行。"""
if not key:
return {"ok": True, "keys": store.run_log_keys()}
return {"ok": True, "key": key, "lines": store.run_log_tail(key, tail)}
@app.delete("/api/log/history")
def api_log_history_clear(key: str = ""):
"""清历史日志;带 key 时连内存里的那一段也清掉,前端不用刷新页面。"""
store.run_log_clear(key)
with RUNS_LOCK:
st = RUNS.get(key)
if st is not None:
st["log"] = []
return {"ok": True}
@app.get("/api/snapshots")
def api_snapshots(limit: int = 50):
"""站点改版时存下的课程页原始 HTML 列表。"""
return {"ok": True, "snapshots": store.snapshot_list(limit)}
@app.get("/api/snapshot/{sid}", response_class=HTMLResponse)
def api_snapshot(sid: int):
row = store.snapshot_get(sid)
if not row:
return HTMLResponse("<h3>快照不存在</h3>", status_code=404)
head = ("<!-- id=%s planId=%s projectId=%s final url: %s created=%s -->\n"
% (row["id"], row["plan_id"], row["project_id"], row["url"],
time.strftime("%Y-%m-%d %H:%M:%S", time.localtime(row["created"] or 0))))
return HTMLResponse(head + (row["html"] or ""))
@app.post("/api/courses")
def api_courses(b: CookiesIn):
if not b.cookies:
return JSONResponse({"ok": False, "code": "no_cookie",
"error": "本机没有该账号的会话 cookie,请先点「登录」"}, status_code=200)
s = new_session(b.cookies)
if not s.cookies:
return JSONResponse({"ok": False, "code": "no_cookie",
"error": "保存的 cookie 全部被过滤(domain 不含 dgjy),请重新登录"},
status_code=200)
try:
courses = scrape_courses(s)
except SessionExpired as e:
return JSONResponse({"ok": False, "code": "session_expired", "error": str(e)[:300]}, status_code=200)
except Exception as e:
return JSONResponse({"ok": False, "code": "fetch_failed", "error": str(e)[:300]}, status_code=200)
if not courses:
return JSONResponse({"ok": False, "code": "no_course",
"error": "登录态有效,但该账号名下三个板块(在学/助学/督学)"
"的进行中、未开始、已结束里都没有课程"}, status_code=200)
try:
user = whoami(fetch_admin(s))
except Exception:
user = ""
return {"ok": True, "courses": courses, "user": user,
"in_study": len([c for c in courses if c["in_study"]]),
# 补 jspx 会话时 cookie 会换新(JSESSIONID/route),回传让前端写回 IndexedDB
"cookies": dump_cookies(s)}
@app.post("/api/discover")
def api_discover(b: DiscoverIn):
s = new_session(b.cookies)
try:
d = discover(s, b.plan_id, b.project_id, b.name)
return {"ok": True, **d, "cookies": dump_cookies(s)}
except Exception as e:
return JSONResponse({"ok": False, "error": str(e)[:300]}, status_code=200)
@app.post("/api/study")
def api_study(b: StudyIn):
st = RUNS.get(b.key) or {}
if st.get("status") in ("discovering", "studying"):
return JSONResponse({"ok": False, "error": "该账号正在学习中"}, status_code=200)
if not b.cookies:
return JSONResponse({"ok": False, "error": "尚未登录"}, status_code=200)
courses = b.courses or []
if not courses and b.plan_id and b.project_id:
courses = [{"name": "", "plan_id": b.plan_id, "project_id": b.project_id}]
if not courses:
return JSONResponse({"ok": False, "error": "没有选中任何课程"}, status_code=200)
set_state(b.key, status="discovering", log=[], done=0, total=0, started=time.time())
# 会话失效时后台要能自动重登:优先用请求里的密码,没有就按 key 从 SQLite 取
pw = b.password or store.account_password(b.key) or ""
st = load_settings()["study"]
threading.Thread(target=study_worker,
args=(b.key, b.username, b.cookies, courses,
max(1, min(b.workers, 95)), b.cap_minutes, b.quiz_key,
b.enable_quiz, b.enable_feedback, pw,
st.get("mode") or "fast", int(st.get("parallel") or 2)),
daemon=True).start()
return {"ok": True, "courses": len(courses),
"enable_quiz": b.enable_quiz, "enable_feedback": b.enable_feedback,
"study": st}
@app.post("/api/stop")
def api_stop(b: StopIn):
set_state(b.key, status="stopped")
log(b.key, "用户请求停止")
return {"ok": True}
@app.post("/api/capture")
def api_capture(b: CaptureIn):
"""开一个可见的浏览器让用户手动走一遍,记录所有 /train/** 请求与响应。"""
if (RUNS.get(b.key) or {}).get("capturing"):
return JSONResponse({"ok": False, "error": "正在抓包"}, status_code=200)
if not b.cookies:
return JSONResponse({"ok": False, "error": "尚未登录"}, status_code=200)
CAPTURES[b.key] = []
set_state(b.key, capturing=True, capture_stop=False, capture_file="")
log(b.key, "正在打开浏览器…")
threading.Thread(target=capture_worker,
args=(b.key, b.cookies, max(1, min(int(b.minutes or 10), 30))),
daemon=True).start()
return {"ok": True}
@app.post("/api/capture/stop")
def api_capture_stop(b: StopIn):
set_state(b.key, capture_stop=True)
log(b.key, "用户请求停止抓包")
return {"ok": True}
@app.get("/api/capture")
def api_capture_get(key: str = ""):
st = RUNS.get(key) or {}
return {"ok": True, "capturing": bool(st.get("capturing")),
"file": st.get("capture_file") or "",
"records": CAPTURES.get(key) or []}
+50
View File
@@ -0,0 +1,50 @@
"""运行状态 + 统一日志源。
日志只有一个出口 log():
* 控制台:带上时间/级别/key,docker compose logs 也能看
* 内存:RUNS[key]["log"],/api/log 供前端轮询
* SQLite:store.run_log_add,/api/log/history 重启后还能查
新代码不要再自己 print(),也不要直接写 run_log 表。
"""
import threading
import time
from study_tool import store
RUNS = {}
RUNS_LOCK = threading.Lock()
MAX_LINES = 1000 # 每个 key 内存里最多留 1000 行
TRIM_LINES = 300 # 超了先丢最旧的 300 行
def log(key, msg, level="info", persist=True):
"""写一条日志,返回拼好的整行。"""
key = key or "system"
line = "%s [%s] %s" % (time.strftime("%Y-%m-%d %H:%M:%S"), level, msg)
try:
print("%s [%s]" % (line, key), flush=True)
except UnicodeEncodeError: # Windows 控制台 GBK 编不了 ⚠ 之类
print(("%s [%s]" % (line, key)).encode("gbk", "replace").decode("gbk"), flush=True)
with RUNS_LOCK:
st = RUNS.setdefault(key, {})
logs = st.setdefault("log", [])
logs.append(line)
if len(logs) > MAX_LINES:
del logs[:TRIM_LINES]
st["updated"] = time.time()
if persist:
try:
store.run_log_add(key, line)
except Exception:
pass
return line
def set_state(key, **kw):
with RUNS_LOCK:
st = RUNS.setdefault(key, {})
st.update(kw)
st["updated"] = time.time()
store.run_state_set(key, RUNS.get(key) or {})
+90
View File
@@ -0,0 +1,90 @@
"""系统设置(大模型 + 学习方式)读写。"""
from study_tool import store
from study_tool.webapp import app
from study_tool.config import *
from study_tool.models import *
from study_tool.runtime import log
# ------------------------------------------------------------------ settings
SETTINGS_NAME = "llm"
DEFAULT_LLM = {
"base_url": "https://api.openai.com/v1",
"api_key": "",
"model": "gpt-4o-mini",
"temperature": 0.2,
"timeout": 120,
"prompt": "",
}
# 学习方式:fast = 只调 study/log 接口,不开浏览器;normal = 真播视频(可多路并发)
DEFAULT_STUDY = {
"mode": "fast",
"parallel": 2,
}
DEFAULT_ANSWER_PROMPT = (
"你是考试答题助手。根据题干和选项判断正确答案。\n"
"单选题返回一个选项字母;多选题返回多个字母,用 # 连接(如 A#C);判断题只返回 A 或 B(A=正确,B=错误)。\n"
"只输出 JSON:{\"answers\":{\"题号\":\"答案\"}},不要输出解释或多余文字。"
)
TYPE_LABEL = {"01": "单选", "02": "多选", "03": "判断", "04": "问答"}
def load_settings():
data = store.get_setting(SETTINGS_NAME) or {}
llm = dict(DEFAULT_LLM)
study = dict(DEFAULT_STUDY)
if isinstance(data, dict):
raw = data.get("llm")
if isinstance(raw, dict):
llm.update({k: v for k, v in raw.items() if k in DEFAULT_LLM and v is not None})
st = data.get("study")
if isinstance(st, dict):
study.update({k: v for k, v in st.items() if v is not None})
study["mode"] = study.get("mode") if study.get("mode") in ("fast", "normal") else "fast"
try:
study["parallel"] = max(1, min(int(study.get("parallel") or 2), 5))
except (TypeError, ValueError):
study["parallel"] = 2
return {"llm": llm, "study": study}
def save_settings(data):
store.set_setting(SETTINGS_NAME, {"llm": data.get("llm") or {},
"study": data.get("study") or {}})
@app.get("/api/settings")
def api_get_settings():
cfg = load_settings()
llm = cfg["llm"]
key = llm.get("api_key") or ""
out = dict(llm)
out["api_key"] = ""
out["has_key"] = bool(key)
out["key_hint"] = (key[:4] + "…" + key[-4:]) if len(key) > 10 else ("已设置" if key else "")
return {"ok": True, "llm": out, "study": cfg["study"]}
@app.post("/api/settings")
def api_set_settings(b: LlmCfgIn):
cur = load_settings()
llm = cur["llm"]
if b.base_url.strip():
llm["base_url"] = b.base_url.strip()
if b.api_key.strip(): # 留空 = 保留原 key,前端不回显明文
llm["api_key"] = b.api_key.strip()
if b.model.strip():
llm["model"] = b.model.strip()
llm["temperature"] = max(0.0, min(2.0, float(b.temperature or 0)))
llm["timeout"] = max(10, min(600, int(b.timeout or 120)))
llm["prompt"] = b.prompt or ""
if b.study_mode in ("fast", "normal"): # 空串 = 不改
cur["study"]["mode"] = b.study_mode
if b.study_parallel: # 0 = 不改
cur["study"]["parallel"] = max(1, min(int(b.study_parallel), 5))
save_settings(cur)
log("system", "设置已更新:模型 %s(%s),学习方式 %s/%s 路" % (
cur["llm"]["model"], cur["llm"]["base_url"],
cur["study"]["mode"], cur["study"]["parallel"]))
return {"ok": True, "study": cur["study"]}
+3 -1
View File
@@ -31,7 +31,9 @@ import threading
import time
HERE = os.path.dirname(os.path.abspath(__file__))
DATA_DIR = os.environ.get("DATA_DIR") or os.path.join(HERE, "data")
# 包在 src/study_tool 下,数据目录仍是仓库根目录的 data/
ROOT = os.path.dirname(os.path.dirname(HERE))
DATA_DIR = os.environ.get("DATA_DIR") or os.path.join(ROOT, "data")
DB_PATH = os.environ.get("DB_PATH") or os.path.join(DATA_DIR, "study.db")
# 旧的文件式存储位置(只在首次启动时导入一次)
+10
View File
@@ -0,0 +1,10 @@
"""FastAPI 实例。
单独一个模块,路由模块从这里 `from study_tool.webapp import app` 注册接口,
避免 app.py <-> 路由模块循环导入。
"""
from fastapi import FastAPI
app = FastAPI(title="多账号学习控制台")
File diff suppressed because one or more lines are too long
File diff suppressed because one or more lines are too long
+10
View File
@@ -0,0 +1,10 @@
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64">
<defs>
<linearGradient id="g" x1="0" y1="0" x2="1" y2="1">
<stop offset="0" stop-color="#2f6bff" />
<stop offset="1" stop-color="#4fa4ff" />
</linearGradient>
</defs>
<rect width="64" height="64" rx="16" fill="url(#g)" />
<text x="32" y="44" font-family="Microsoft YaHei, sans-serif" font-size="34" font-weight="700" fill="#fff" text-anchor="middle">学</text>
</svg>

After

Width:  |  Height:  |  Size: 457 B

+13 -1199
View File
File diff suppressed because it is too large Load Diff
+4 -1
View File
@@ -27,7 +27,10 @@ import time
import requests
import store
# 代码在 src/study_tool 包里,命令行脚本自己把 src 加进 sys.path
sys.path.insert(0, os.path.join(os.path.dirname(os.path.abspath(__file__)), "src"))
from study_tool import store # noqa: E402
HERE = os.path.dirname(os.path.abspath(__file__))
BASE = "https://study.dgjy.net"
+53 -2
View File
@@ -1,5 +1,56 @@
# TODO
暂无待办。
## 待评估:接入广东公需课平台(jsxx.gds.edu.cn)
(「首次进入课程弹『未加入课堂』」已修复,实测确认见 `OPTIMIZATION.md`。)
**状态**:只沉淀思路,不实现。手上没有公需课账号,接口抓不到,代码不动。
### 背景
参考脚本:`2026广东公需课·全自动完美版(后台保活+10分钟刷新).js`(油猴 v1.3,`@match https://jsxx.gds.edu.cn/*`)。
它做的事:悬浮面板 + 后台保活 + 10 分钟整页刷新 + 视频题目题库命中(约 200 条)+ 未命中时 12 轮
暴力试错 + 考核页按课程 id 硬编码两套 30 题答案自动勾选(不代交卷)。
注意:这是**广东专业技术人员继续教育公需课**,跟本项目的 dgjy(东莞教师培训)不是一套系统,
连登录入口都不同。
### 结论:不能直接融合
| 维度 | 该脚本 | 本项目 | 能不能用 |
| --- | --- | --- | --- |
| 站点 | jsxx.gds.edu.cn | jspx / study.dgjy.net | 无交集 |
| 实现层 | 页面 DOM 点击、layui/mylayer 弹层 | 服务端接口 + Playwright 真播 | 不同层 |
| 答案 | 硬编码题库 + 按课程 id 两套答案 | 大模型现算 | 数据不可复用 |
| 保活 | setInterval、伪造 mousemove、整页 reload | 服务端跑逻辑,浏览器只播视频 | reload 会打断播放 |
| 兜底 | 12 轮暴力试错 | LLM + 交卷前人工核对 | 平台限次,会烧光重考机会 |
### 真要接入时的顺序
1. **抓包取证**(阻塞项,必须有公需课账号)
- 登录链路:账号密码还是统一身份认证?落哪些 cookie / token
- 课程列表与课时树接口
- 课时上报接口:视频进度怎么记账,是否要心跳
- 考试接口:取卷、交卷、重考次数(对应 dgjy 的 `surplusExamCount` 那一套)
- 视频是不是直链,需不需要 Playwright 真播到结尾
2. **适配层分派**:`app.py` 现在 `login()` / `discover()` / `detect_platform()` / `StudyClient`
全是 dgjy 专用,得按平台分支;`accounts` 表加平台标识,控制台卡片显示平台
3. **答题**:本地题库命中优先、LLM 兜底(题库得自己攒 dgjy 的,脚本那 200 条是公需课内容,搬不过来)
4. **UI**:课程卡片区分平台;公需课的「考核」页结构跟 dgjy 完全不同,不能复用测验弹窗
### 明确不照抄的部分
- 暴力试错答题:dgjy 平台一般只给 3 次重考,试错直接废掉机会
- 10 分钟整页刷新:打断正在播放的视频,进度白费
- 按课程 id 硬编码答案:换课程批次即失效,脚本注释自己写了「已反转,解决反了问题」,说明是试错出来的
- `.layui-layer` / `.mylayer-wrap` / `#studySelectAct .next` / `#topicList .m-topic-item` 这些选择器
- 用 `innerText` 包含「正确」判断已答弹层:题干带「正确」二字就会被误点
- 把「下一节」按钮 `pointer-events:none` 锁死:平台一改版就失效
### 可以借鉴的
- 题库命中优先、LLM 兜底(省 token、命中时更准)
- 强制播完才放开「下一节」—— 项目已有等价实现(播到 `ended` + `completeTime` 校验)
## 已完成
- 「首次进入课程弹『未加入课堂』」已修复,实测确认见 `OPTIMIZATION.md`。
+14
View File
@@ -0,0 +1,14 @@
<!doctype html>
<html lang="zh-CN">
<head>
<meta charset="UTF-8" />
<meta name="viewport" content="width=device-width, initial-scale=1.0" />
<meta name="theme-color" content="#f6f8fc" />
<link rel="icon" type="image/svg+xml" href="/favicon.svg" />
<title>莞易学 · 多账号学习控制台</title>
</head>
<body>
<div id="root"></div>
<script type="module" src="/src/main.tsx"></script>
</body>
</html>
+27
View File
@@ -0,0 +1,27 @@
{
"name": "guanyixue-console-web",
"private": true,
"version": "0.1.0",
"type": "module",
"scripts": {
"dev": "vite",
"build": "vite build",
"typecheck": "tsc --noEmit",
"preview": "vite preview"
},
"dependencies": {
"clsx": "^2.1.1",
"lucide-react": "^0.468.0",
"react": "^19.0.0",
"react-dom": "^19.0.0"
},
"devDependencies": {
"@tailwindcss/vite": "^4.0.0",
"@types/react": "^19.0.0",
"@types/react-dom": "^19.0.0",
"@vitejs/plugin-react": "^4.3.0",
"tailwindcss": "^4.0.0",
"typescript": "^5.7.0",
"vite": "^6.0.0"
}
}
+1503
View File
File diff suppressed because it is too large Load Diff
+2
View File
@@ -0,0 +1,2 @@
allowBuilds:
esbuild: true
+10
View File
@@ -0,0 +1,10 @@
<svg xmlns="http://www.w3.org/2000/svg" viewBox="0 0 64 64">
<defs>
<linearGradient id="g" x1="0" y1="0" x2="1" y2="1">
<stop offset="0" stop-color="#2f6bff" />
<stop offset="1" stop-color="#4fa4ff" />
</linearGradient>
</defs>
<rect width="64" height="64" rx="16" fill="url(#g)" />
<text x="32" y="44" font-family="Microsoft YaHei, sans-serif" font-size="34" font-weight="700" fill="#fff" text-anchor="middle">学</text>
</svg>

After

Width:  |  Height:  |  Size: 457 B

+773
View File
@@ -0,0 +1,773 @@
import { useCallback, useEffect, useRef, useState } from 'react'
import { Plus, RefreshCw, Users, WifiOff } from 'lucide-react'
import { AccountCard } from './components/AccountCard'
import { AddAccountDialog, type NewAccount } from './components/AddAccountDialog'
import { QuizDialog } from './components/QuizDialog'
import { SettingsDialog } from './components/SettingsDialog'
import { StatBar } from './components/StatBar'
import { SystemLogDialog } from './components/SystemLogDialog'
import { Toast, type ToastState } from './components/Toast'
import { TopBar } from './components/TopBar'
import { Button } from './components/ui/Button'
import { ApiError, api } from './lib/api'
import { countCourses, toastMessage } from './lib/utils'
import type { Account, Cookie, Course, LogResponse, PlatformInfo, RunState } from './types'
interface AccountsResponse {
ok?: boolean
accounts: Account[]
}
interface LoginResponse {
ok?: boolean
error?: string
code?: string
warn?: string
user?: string
cookies?: Cookie[]
courses?: Course[]
}
interface CoursesResponse {
ok?: boolean
error?: string
code?: string
courses?: Course[]
user?: string
cookies?: Cookie[]
}
interface InlineLog {
lines: string[]
since: number
busy: boolean
historyTried: boolean
}
type DialogState =
| { type: 'add' }
| { type: 'settings' }
| { type: 'system' }
| { type: 'quiz'; accountId: string; course: Course }
| null
const LOG_STORAGE_KEY = 'guanyixue.inlineLogsOpen'
function readOpenLogs(): Set<string> {
try {
const ids = JSON.parse(localStorage.getItem(LOG_STORAGE_KEY) || '[]')
return new Set(Array.isArray(ids) ? ids.filter((id) => typeof id === 'string') : [])
} catch {
return new Set()
}
}
function persistOpenLogs(ids: Set<string>) {
try {
localStorage.setItem(LOG_STORAGE_KEY, JSON.stringify([...ids]))
} catch {
// 隐私模式禁用 localStorage 时忽略
}
}
function accountPayload(account: Account) {
return {
id: account.id,
username: account.username,
note: account.note || '',
user: account.user || '',
cookies: account.cookies || [],
courses: account.courses || [],
selected: account.selected || [],
status: account.status || 'idle',
lastError: account.lastError || '',
lastErrorAt: account.lastErrorAt || 0,
optQuiz: account.optQuiz === true,
optFeedback: account.optFeedback !== false,
loginAt: account.loginAt || 0,
}
}
export default function App() {
const [accounts, setAccounts] = useState<Account[]>([])
const accountsRef = useRef(accounts)
const [platforms, setPlatforms] = useState<Record<string, string>>({ guanyixue: '莞易学' })
const [offline, setOffline] = useState(false)
const [toast, setToast] = useState<ToastState | null>(null)
const [pending, setPending] = useState<Record<string, string>>({})
const [refreshing, setRefreshing] = useState(false)
const [dialog, setDialog] = useState<DialogState>(null)
const [openLogs, setOpenLogs] = useState<Set<string>>(() => readOpenLogs())
const openLogsRef = useRef(openLogs)
const [logs, setLogs] = useState<Record<string, InlineLog>>({})
const logsRef = useRef(logs)
const toastTimer = useRef<number | undefined>(undefined)
useEffect(() => {
accountsRef.current = accounts
}, [accounts])
useEffect(() => {
logsRef.current = logs
}, [logs])
useEffect(() => {
openLogsRef.current = openLogs
persistOpenLogs(openLogs)
}, [openLogs])
useEffect(() => () => window.clearTimeout(toastTimer.current), [])
const notify = useCallback((next: ToastState) => {
setToast(next)
window.clearTimeout(toastTimer.current)
toastTimer.current = window.setTimeout(() => setToast(null), 3800)
}, [])
const saveAccount = useCallback(async (account: Account) => {
const response = await api<{ ok?: boolean; error?: string }>('/api/accounts', {
method: 'POST',
body: JSON.stringify(accountPayload(account)),
})
if (response.ok === false) throw new Error(response.error || '保存失败')
return response
}, [])
const replaceAccount = useCallback((account: Account) => {
setAccounts((previous) => {
const exists = previous.some((item) => item.id === account.id)
const next = exists
? previous.map((item) => (item.id === account.id ? account : item))
: [...previous, account]
accountsRef.current = next
return next
})
}, [])
const load = useCallback(
async (silent = true) => {
try {
const [runs, list] = await Promise.all([
api<Record<string, RunState>>('/api/runs'),
api<AccountsResponse>('/api/accounts'),
])
const next = (list.accounts || [])
.map((account) => ({ ...account, run: runs[account.id] || null }))
.sort((a, b) => (a.created || 0) - (b.created || 0))
setAccounts(next)
accountsRef.current = next
setOffline(false)
for (const account of next) {
const cookies = account.run?.cookies
if (
cookies &&
cookies.length &&
JSON.stringify(cookies) !== JSON.stringify(account.cookies || [])
) {
const updated = { ...account, cookies }
account.cookies = cookies
saveAccount(updated).catch(() => {})
}
}
} catch (error) {
if (error instanceof ApiError && error.offline) {
setOffline(true)
} else if (!silent) {
notify({ message: `读取账号失败:${toastMessage(error)}`, tone: 'error' })
}
}
},
[notify, saveAccount],
)
useEffect(() => {
void load()
const timer = window.setInterval(() => {
if (!document.hidden) void load()
}, 5000)
return () => window.clearInterval(timer)
}, [load])
useEffect(() => {
api<{ platforms: PlatformInfo[] }>('/api/platforms')
.then((response) => {
const map: Record<string, string> = {}
for (const platform of response.platforms || []) map[platform.id] = platform.label
if (Object.keys(map).length) setPlatforms(map)
})
.catch(() => {})
}, [])
const pullLog = useCallback(
async (id: string) => {
const current = logsRef.current[id] || {
lines: [],
since: 0,
busy: false,
historyTried: false,
}
if (current.busy) return
const state: InlineLog = { ...current, busy: true }
const commit = (value: InlineLog) => {
logsRef.current = { ...logsRef.current, [id]: value }
setLogs((previous) => ({ ...previous, [id]: value }))
}
commit(state)
try {
let response = await api<LogResponse>(
`/api/log?key=${encodeURIComponent(id)}&since=${state.since}`,
)
// 服务端日志超过上限会裁掉最旧的行,游标比长度大时整体重拉
if (typeof response.next === 'number' && response.next < state.since) {
state.lines = []
state.since = 0
response = await api<LogResponse>(`/api/log?key=${encodeURIComponent(id)}&since=0`)
}
let lines = response.lines || []
// 服务重启后内存日志为空,退回读一次 SQLite 历史
if (!lines.length && !response.status && !state.historyTried) {
state.historyTried = true
try {
const history = await api<{ lines?: string[] }>(
`/api/log/history?key=${encodeURIComponent(id)}&tail=300`,
)
if (history.lines?.length) lines = history.lines
} catch {
// 历史日志读不到就只显示实时日志
}
}
if (lines.length) state.lines = [...state.lines, ...lines].slice(-600)
if (typeof response.next === 'number') state.since = Math.max(state.since, response.next)
const cookies = response.cookies
if (cookies?.length) {
const account = accountsRef.current.find((item) => item.id === id)
if (account && JSON.stringify(account.cookies || []) !== JSON.stringify(cookies)) {
const updated = { ...account, cookies }
replaceAccount(updated)
saveAccount(updated).catch(() => {})
}
}
} catch {
// 单个账号拉日志失败不打断整页轮询
} finally {
state.busy = false
commit(state)
}
},
[replaceAccount, saveAccount],
)
useEffect(() => {
const timer = window.setInterval(() => {
if (document.hidden) return
openLogsRef.current.forEach((id) => void pullLog(id))
}, 1500)
return () => window.clearInterval(timer)
}, [pullLog])
const setLogOpen = useCallback(
(id: string, open?: boolean) => {
const shouldOpen = open === undefined ? !openLogsRef.current.has(id) : open
const next = new Set(openLogsRef.current)
if (shouldOpen) next.add(id)
else next.delete(id)
openLogsRef.current = next
setOpenLogs(next)
if (shouldOpen) void pullLog(id)
},
[pullLog],
)
async function withPending<T>(id: string, tag: string, task: () => Promise<T>) {
setPending((previous) => ({ ...previous, [id]: tag }))
try {
return await task()
} finally {
setPending((previous) => {
const next = { ...previous }
delete next[id]
return next
})
}
}
async function login(account: Account, quiet = false) {
return withPending(account.id, 'login', async () => {
replaceAccount({ ...account, status: 'logging', lastError: '' })
try {
await saveAccount({ ...account, status: 'logging', lastError: '' })
const response = await api<LoginResponse>('/api/login', {
method: 'POST',
body: JSON.stringify({ account_id: account.id }),
})
if (!response.ok) {
const failed: Account = {
...account,
status: 'login_failed',
lastError: response.error || `HTTP ${response.code || '失败'}`,
lastErrorAt: Date.now(),
run: null,
}
replaceAccount(failed)
await saveAccount(failed).catch(() => {})
if (!quiet) notify({ message: `登录失败:${failed.lastError}`, tone: 'error' })
return false
}
const courses = response.courses || []
const updated: Account = {
...account,
status: 'logged_in',
cookies: response.cookies || [],
user: response.user || account.user || '',
courses,
selected: (account.selected || []).filter((plan) =>
courses.some((course) => course.plan_id === plan),
),
loginAt: Date.now(),
updated: Date.now(),
lastError: '',
lastErrorAt: 0,
run: null,
}
replaceAccount(updated)
await saveAccount(updated).catch(() => {})
if (!quiet) {
notify({
message: response.warn
? `登录成功,但课程读取异常:${response.warn}`
: `登录成功:${updated.user || updated.username},读到 ${countCourses(courses).total} 门`,
tone: response.warn ? 'info' : 'success',
})
}
void load()
return true
} catch (error) {
const failed: Account = {
...account,
status: 'login_failed',
lastError: toastMessage(error),
lastErrorAt: Date.now(),
}
replaceAccount(failed)
await saveAccount(failed).catch(() => {})
if (!quiet) notify({ message: `登录失败:${failed.lastError}`, tone: 'error' })
if (error instanceof ApiError && error.offline) setOffline(true)
return false
}
})
}
async function refreshCourses(account: Account) {
return withPending(account.id, 'refresh', async () => {
try {
let response = await api<CoursesResponse>('/api/courses', {
method: 'POST',
body: JSON.stringify({ cookies: account.cookies }),
})
if (!response.ok && response.code === 'session_expired') {
notify({ message: '会话已失效,正在自动重新登录…' })
if (!(await login(account, true))) return
const latest = accountsRef.current.find((item) => item.id === account.id)
if (!latest) return
response = await api<CoursesResponse>('/api/courses', {
method: 'POST',
body: JSON.stringify({ cookies: latest.cookies }),
})
}
if (!response.ok) {
notify({ message: `读取失败:${response.error || response.code || '未知错误'}`, tone: 'error' })
return
}
const latest = accountsRef.current.find((item) => item.id === account.id) || account
const updated: Account = {
...latest,
courses: response.courses || [],
user: response.user || latest.user,
cookies: response.cookies?.length ? response.cookies : latest.cookies,
status: 'logged_in',
updated: Date.now(),
lastError: '',
lastErrorAt: 0,
}
replaceAccount(updated)
await saveAccount(updated).catch(() => {})
notify({ message: `已刷新,读到 ${countCourses(updated.courses).total} 门`, tone: 'success' })
} catch (error) {
notify({ message: `读取失败:${toastMessage(error)}`, tone: 'error' })
}
})
}
async function startStudy(account: Account) {
const selected = account.selected || []
const courses = (account.courses || []).filter(
(course) => selected.includes(course.plan_id) && course.in_study !== false,
)
if (!courses.length) {
notify({ message: '请先勾选要学习的课程', tone: 'error' })
return
}
if (!account.cookies?.length) {
notify({ message: '请先登录', tone: 'error' })
return
}
return withPending(account.id, 'study', async () => {
try {
const response = await api<{
ok?: boolean
error?: string
study?: { mode?: string; parallel?: number }
}>('/api/study', {
method: 'POST',
body: JSON.stringify({
key: account.id,
username: account.user || account.username,
cookies: account.cookies,
courses,
workers: 40,
cap_minutes: 90,
enable_quiz: account.optQuiz === true,
enable_feedback: account.optFeedback !== false,
}),
})
if (!response.ok) {
notify({ message: `启动失败:${response.error || '未知错误'}`, tone: 'error' })
return
}
const mode =
response.study?.mode === 'normal'
? `常规真播 ${response.study?.parallel || 1} 路并发`
: '快速模式(只调接口)'
notify({
message: `已开始 ${courses.length} 门课程 · ${mode}${
account.optQuiz ? ' · 含自动答题' : ' · 测验需手动作答'
}`,
tone: 'success',
})
setLogOpen(account.id, true)
void load()
} catch (error) {
notify({ message: `启动失败:${toastMessage(error)}`, tone: 'error' })
}
})
}
async function stopStudy(account: Account) {
return withPending(account.id, 'stop', async () => {
try {
await api('/api/stop', {
method: 'POST',
body: JSON.stringify({ key: account.id }),
})
notify({ message: '已请求停止' })
void load()
} catch (error) {
notify({ message: `停止失败:${toastMessage(error)}`, tone: 'error' })
}
})
}
async function capture(account: Account) {
if (!account.cookies?.length) {
notify({ message: '请先登录', tone: 'error' })
return
}
return withPending(account.id, 'capture', async () => {
try {
const response = await api<{ ok?: boolean; error?: string }>('/api/capture', {
method: 'POST',
body: JSON.stringify({ key: account.id, cookies: account.cookies, minutes: 10 }),
})
if (!response.ok) {
notify({ message: `抓包失败:${response.error || '未知错误'}`, tone: 'error' })
return
}
notify({
message: '已打开浏览器,请手动走一遍课程页;最多记录 10 分钟',
tone: 'success',
})
} catch (error) {
notify({ message: `抓包失败:${toastMessage(error)}`, tone: 'error' })
}
})
}
async function stopCapture(account: Account) {
return withPending(account.id, 'capture', async () => {
try {
await api('/api/capture/stop', {
method: 'POST',
body: JSON.stringify({ key: account.id }),
})
notify({ message: '已请求停止抓包' })
void load()
} catch (error) {
notify({ message: `停止抓包失败:${toastMessage(error)}`, tone: 'error' })
}
})
}
async function removeAccount(account: Account) {
if (!window.confirm(`删除账号「${account.user || account.username}」?课程缓存和日志不会自动清理。`))
return
try {
await api(`/api/accounts/${encodeURIComponent(account.id)}`, { method: 'DELETE' })
setAccounts((previous) => {
const next = previous.filter((item) => item.id !== account.id)
accountsRef.current = next
return next
})
notify({ message: '账号已删除' })
} catch (error) {
notify({ message: `删除失败:${toastMessage(error)}`, tone: 'error' })
}
}
async function updateSelection(account: Account, selected: string[]) {
const updated = { ...account, selected }
replaceAccount(updated)
try {
await saveAccount(updated)
} catch (error) {
notify({ message: `保存勾选失败:${toastMessage(error)}`, tone: 'error' })
}
}
function toggleCourse(account: Account, planId: string, checked: boolean) {
const current = account.selected || []
void updateSelection(
account,
checked ? [...new Set([...current, planId])] : current.filter((plan) => plan !== planId),
)
}
function selectAll(account: Account) {
const studyable = (account.courses || [])
.filter((course) => course.in_study !== false)
.map((course) => course.plan_id)
void updateSelection(account, [...new Set([...(account.selected || []), ...studyable])])
}
async function toggleOption(account: Account, key: 'quiz' | 'feedback', checked: boolean) {
const updated =
key === 'quiz' ? { ...account, optQuiz: checked } : { ...account, optFeedback: checked }
replaceAccount(updated)
try {
await saveAccount(updated)
notify({
message:
key === 'quiz'
? checked
? '已开启自动交测验(注意正确率)'
: '已关闭自动交测验'
: checked
? '已开启自动交反馈表'
: '已关闭自动交反馈表',
})
} catch (error) {
notify({ message: `保存失败:${toastMessage(error)}`, tone: 'error' })
}
}
async function addAccount(data: NewAccount) {
const response = await api<{ ok?: boolean; error?: string; account?: Account }>('/api/accounts', {
method: 'POST',
body: JSON.stringify({
username: data.username,
password: data.password,
note: data.note,
cookies: [],
courses: [],
selected: [],
status: 'idle',
created: Date.now(),
}),
})
if (response.ok === false) throw new Error(response.error || '保存失败')
const list = await api<AccountsResponse>('/api/accounts')
const created =
response.account || (list.accounts || []).find((account) => account.username === data.username)
if (!created) {
notify({ message: '已保存,但列表里没有找到新账号,请刷新页面', tone: 'error' })
await load()
return
}
notify({ message: '已保存,正在尝试首次登录…' })
const ok = await login(created, true)
const latest = accountsRef.current.find((account) => account.id === created.id)
if (ok) {
notify({ message: `登录成功:${latest?.user || data.username}`, tone: 'success' })
} else {
notify({
message: `登录失败:${latest?.lastError || '未知原因'}(请手动点击「登录」重试)`,
tone: 'error',
})
}
await load()
}
async function refreshNow() {
setRefreshing(true)
try {
await load(false)
} finally {
setRefreshing(false)
}
}
function platformLabel(account: Account) {
const id = (account.courses || []).find((course) => course.platform)?.platform
return (id && platforms[id]) || '莞易学'
}
const quizAccount =
dialog?.type === 'quiz'
? accounts.find((account) => account.id === dialog.accountId) || null
: null
const quizCourse =
dialog?.type === 'quiz'
? quizAccount?.courses.find((course) => course.plan_id === dialog.course.plan_id) ||
dialog.course
: null
return (
<div className="min-h-screen">
<TopBar
refreshing={refreshing}
onRefresh={() => void refreshNow()}
onSettings={() => setDialog({ type: 'settings' })}
onSystemLog={() => setDialog({ type: 'system' })}
onAdd={() => setDialog({ type: 'add' })}
/>
<main className="mx-auto max-w-[1320px] px-4 pb-16 pt-5 sm:px-6">
{offline && (
<div className="mb-4 flex flex-wrap items-center gap-2.5 rounded-xl border border-red-200 bg-red-50 px-4 py-2.5 text-[12.5px] text-red-700">
<WifiOff className="size-4 shrink-0" />
<span className="font-medium">后端未连接</span>
<span className="text-red-500">
页面显示的是上一次数据,请确认服务已启动、端口没有变化。
</span>
<div className="flex-1" />
<Button size="sm" variant="secondary" loading={refreshing} onClick={() => void refreshNow()}>
重试
</Button>
</div>
)}
<StatBar accounts={accounts} />
<div className="mb-3 mt-6 flex items-end justify-between gap-3">
<div>
<h2 className="text-[14px] font-semibold text-slate-900">账号列表</h2>
<p className="mt-0.5 text-[11.5px] text-slate-400">
新旧版课程自动识别为「莞易学」,每 5 秒自动刷新状态
</p>
</div>
{accounts.length > 0 && (
<Button
size="sm"
variant="secondary"
icon={<RefreshCw className="size-3.5" />}
loading={refreshing}
onClick={() => void refreshNow()}
>
刷新
</Button>
)}
</div>
{accounts.length === 0 ? (
<div className="card-shadow grid place-items-center rounded-2xl border border-dashed border-slate-300 bg-white px-6 py-16 text-center">
<div className="grid size-12 place-items-center rounded-2xl bg-brand-50 text-brand-600">
<Users className="size-6" />
</div>
<h3 className="mt-4 text-[14px] font-semibold text-slate-800">还没有账号</h3>
<p className="mt-1.5 max-w-md text-[12.5px] leading-relaxed text-slate-500">
添加东莞市教师培训平台账号后,可自动读取课程、勾选学习、提交反馈表与测验。
新旧版课程页会统一识别为「莞易学」。
</p>
<Button
variant="primary"
className="mt-5"
icon={<Plus className="size-4" />}
onClick={() => setDialog({ type: 'add' })}
>
添加第一个账号
</Button>
</div>
) : (
<div className="grid items-start gap-4 md:grid-cols-2 xl:grid-cols-3">
{accounts.map((account) => (
<AccountCard
key={account.id}
account={account}
platformLabel={platformLabel(account)}
pending={pending[account.id]}
openLog={openLogs.has(account.id)}
logLines={logs[account.id]?.lines || []}
onToggleLog={() => setLogOpen(account.id)}
onLogin={() => void login(account)}
onRefresh={() => void refreshCourses(account)}
onStudy={() => void startStudy(account)}
onStop={() => void stopStudy(account)}
onCapture={() => void capture(account)}
onStopCapture={() => void stopCapture(account)}
onDelete={() => void removeAccount(account)}
onQuiz={() => {
const list = (account.courses || []).filter((course) => course.in_study !== false)
const course =
list.find((item) => account.selected?.includes(item.plan_id)) || list[0]
if (!course) {
notify({ message: '这门课还没有课程数据,先点「刷新课程」', tone: 'error' })
return
}
if (!account.cookies?.length) {
notify({ message: '请先登录', tone: 'error' })
return
}
setDialog({ type: 'quiz', accountId: account.id, course })
}}
onToggleCourse={(planId, checked) => toggleCourse(account, planId, checked)}
onSelectAll={() => selectAll(account)}
onClearSelection={() => void updateSelection(account, [])}
onToggleOption={(key, checked) => void toggleOption(account, key, checked)}
/>
))}
</div>
)}
</main>
<footer className="border-t border-line/70 py-5 text-center text-[11px] text-slate-400">
莞易学 · 多账号学习控制台 · 数据保存在本机
</footer>
<AddAccountDialog
open={dialog?.type === 'add'}
onClose={() => setDialog(null)}
onSubmit={addAccount}
/>
<SettingsDialog
open={dialog?.type === 'settings'}
onClose={() => setDialog(null)}
notify={notify}
/>
<SystemLogDialog open={dialog?.type === 'system'} onClose={() => setDialog(null)} />
<QuizDialog
open={dialog?.type === 'quiz' && !!quizAccount}
account={quizAccount}
course={quizCourse}
onClose={() => setDialog(null)}
notify={notify}
onSubmitted={() => void load()}
/>
<Toast toast={toast} />
</div>
)
}
+469
View File
@@ -0,0 +1,469 @@
import { useEffect, useRef, useState } from 'react'
import {
ChevronDown,
CircleStop,
ClipboardCheck,
Ellipsis,
ListVideo,
LogIn,
Play,
RefreshCw,
Square,
Trash2,
Video,
} from 'lucide-react'
import type { Account, Course } from '../types'
import { ageText, cn, countCourses } from '../lib/utils'
import { Badge } from './ui/Badge'
import { Button } from './ui/Button'
type Tone = 'neutral' | 'brand' | 'success' | 'warning' | 'danger' | 'running'
function statusMeta(account: Account, pending?: string): { label: string; tone: Tone; pulse: boolean } {
const status =
pending === 'login' || account.status === 'logging' || account.run?.status === 'logging'
? 'logging'
: account.run?.status || account.status || 'idle'
const map: Record<string, { label: string; tone: Tone; pulse?: boolean }> = {
discovering: { label: '发现课程中', tone: 'running', pulse: true },
studying: { label: '学习中', tone: 'running', pulse: true },
finished: { label: '已完成', tone: 'success' },
stopped: { label: '已停止', tone: 'warning' },
error: { label: '出错', tone: 'danger' },
interrupted: { label: '已中断', tone: 'warning' },
logging: { label: '登录中', tone: 'running', pulse: true },
logged_in: { label: '已登录', tone: 'success' },
login_failed: { label: '登录失败', tone: 'danger' },
idle: { label: '未登录', tone: 'neutral' },
}
const item = map[status] || { label: status, tone: 'neutral' as Tone }
return { label: item.label, tone: item.tone, pulse: !!item.pulse }
}
function CourseRow({
account,
course,
disabled,
onToggle,
}: {
account: Account
course: Course
disabled: boolean
onToggle: (planId: string, checked: boolean) => void
}) {
const selected = account.selected?.includes(course.plan_id)
return (
<label
className={cn(
'flex cursor-pointer items-start gap-2.5 rounded-lg border border-transparent px-2 py-1.5 transition',
'hover:border-line hover:bg-slate-50',
disabled && 'pointer-events-none opacity-60',
)}
>
<input
type="checkbox"
className="mt-0.5 size-3.5 shrink-0 accent-brand-500"
checked={!!selected}
disabled={disabled}
onChange={(event) => onToggle(course.plan_id, event.target.checked)}
/>
<span className="min-w-0 flex-1">
<span className="block truncate text-[12.5px] font-medium text-slate-700">
{course.name || course.plan_id}
</span>
<span className="mt-0.5 block truncate text-[11px] text-slate-400">
{[course.section, course.status_label, course.info].filter(Boolean).join(' · ') || '—'}
</span>
</span>
<span className="shrink-0 pt-0.5 text-[11px] tabular-nums text-slate-500">
{course.progress || ''}
</span>
</label>
)
}
export function AccountCard({
account,
platformLabel,
pending,
openLog,
logLines,
onToggleLog,
onLogin,
onRefresh,
onStudy,
onStop,
onCapture,
onStopCapture,
onQuiz,
onDelete,
onToggleCourse,
onSelectAll,
onClearSelection,
onToggleOption,
}: {
account: Account
platformLabel: string
pending?: string
openLog: boolean
logLines: string[]
onToggleLog: () => void
onLogin: () => void
onRefresh: () => void
onStudy: () => void
onStop: () => void
onCapture: () => void
onStopCapture: () => void
onQuiz: () => void
onDelete: () => void
onToggleCourse: (planId: string, checked: boolean) => void
onSelectAll: () => void
onClearSelection: () => void
onToggleOption: (key: 'quiz' | 'feedback', checked: boolean) => void
}) {
const [menuOpen, setMenuOpen] = useState(false)
const menuRef = useRef<HTMLDivElement>(null)
const logRef = useRef<HTMLPreElement>(null)
const stickRef = useRef(true)
useEffect(() => {
if (!menuOpen) return
const onDown = (event: PointerEvent) => {
if (!menuRef.current?.contains(event.target as Node)) setMenuOpen(false)
}
document.addEventListener('pointerdown', onDown)
return () => document.removeEventListener('pointerdown', onDown)
}, [menuOpen])
useEffect(() => {
const el = logRef.current
if (el && stickRef.current) el.scrollTop = el.scrollHeight
}, [logLines, openLog])
const meta = statusMeta(account, pending)
const busy = !!pending || account.status === 'logging' || account.run?.status === 'logging'
const all = account.courses || []
const studyable = all.filter((course) => course.in_study !== false)
const finished = all.filter((course) => course.in_study === false)
const counts = countCourses(all)
const done = account.run?.done || 0
const total = account.run?.total || 0
const pct = total ? Math.round((done / total) * 100) : 0
const running = ['discovering', 'studying'].includes(account.run?.status || '')
const selectedCount = account.selected?.length || 0
const canStudy = selectedCount > 0 && (account.cookies?.length || 0) > 0
return (
<article
data-id={account.id}
className="card-shadow flex min-w-0 flex-col rounded-2xl border border-line bg-white transition-colors hover:border-slate-300/80"
>
<header className="flex items-start gap-3 px-4 pt-4">
<div className="relative mt-0.5 grid size-10 shrink-0 place-items-center rounded-xl bg-gradient-to-br from-brand-50 to-sky-50 text-[13px] font-semibold text-brand-700 ring-1 ring-brand-100">
{(account.user || account.username || '?').slice(0, 1).toUpperCase()}
<span
className={cn(
'absolute -bottom-0.5 -right-0.5 size-3 rounded-full border-2 border-white',
meta.tone === 'success'
? 'bg-emerald-500'
: meta.tone === 'danger'
? 'bg-red-500'
: meta.tone === 'running'
? 'bg-sky-500'
: meta.tone === 'warning'
? 'bg-amber-500'
: 'bg-slate-300',
meta.pulse && 'animate-pulse',
)}
/>
</div>
<div className="min-w-0 flex-1">
<div className="flex items-center gap-2">
<h2 className="truncate text-[13.5px] font-semibold text-slate-900">
{account.user || account.username}
</h2>
<Badge tone={meta.tone} dot>
{meta.label}
</Badge>
</div>
<div className="mt-1 flex flex-wrap items-center gap-x-2 gap-y-0.5 text-[11px] text-slate-400">
<span className="truncate">{account.username}</span>
{account.note && <span className="truncate">· {account.note}</span>}
<span>· {ageText(account.updated || account.loginAt)}</span>
</div>
</div>
<Badge tone="brand" className="mt-0.5 shrink-0">
{platformLabel}
</Badge>
</header>
<div className="px-4 pt-3">
<div className="flex items-center justify-between gap-2">
<div className="text-[11.5px] text-slate-500">
共 <b className="font-semibold text-slate-700">{counts.total}</b> 门 · 可学{' '}
<b className="font-semibold text-slate-700">{counts.studyable}</b>
{finished.length > 0 && <span className="text-slate-400"> · 已完成 {finished.length}</span>}
</div>
{studyable.length > 0 && (
<div className="flex items-center gap-1">
<button
type="button"
disabled={busy}
className="rounded px-1.5 py-0.5 text-[11px] text-brand-600 transition hover:bg-brand-50 disabled:opacity-40"
onClick={onSelectAll}
>
全选
</button>
<button
type="button"
disabled={busy || selectedCount === 0}
className="rounded px-1.5 py-0.5 text-[11px] text-slate-500 transition hover:bg-slate-100 disabled:opacity-40"
onClick={onClearSelection}
>
清空
</button>
</div>
)}
</div>
<div className="scrollbar-thin mt-1.5 max-h-[196px] min-h-[70px] overflow-y-auto pr-0.5">
{all.length === 0 ? (
<div className="grid min-h-[70px] place-items-center rounded-lg border border-dashed border-line text-[12px] text-slate-400">
还没有课程,先登录或刷新课程
</div>
) : (
<>
{studyable.map((course) => (
<CourseRow
key={course.plan_id}
account={account}
course={course}
disabled={busy}
onToggle={onToggleCourse}
/>
))}
{finished.length > 0 && (
<div className="mt-1 border-t border-dashed border-line pt-1">
{finished.map((course) => (
<div
key={course.plan_id}
className="flex items-start gap-2.5 rounded-lg px-2 py-1.5 text-slate-400"
>
<span className="mt-0.5 grid size-3.5 shrink-0 place-items-center rounded-full bg-emerald-50 text-[9px] text-emerald-600">
✓
</span>
<span className="min-w-0 flex-1">
<span className="block truncate text-[12px]">{course.name || course.plan_id}</span>
<span className="mt-0.5 block truncate text-[10.5px] opacity-80">
{[course.section, course.info].filter(Boolean).join(' · ')}
</span>
</span>
<span className="shrink-0 text-[10.5px]">{course.status_label || '已结束'}</span>
</div>
))}
</div>
)}
</>
)}
</div>
</div>
<div className="mt-3 flex flex-wrap items-center gap-x-4 gap-y-1.5 border-t border-line/70 px-4 py-2.5">
<label className="flex cursor-pointer items-center gap-1.5 text-[11.5px] text-slate-600">
<input
type="checkbox"
className="size-3.5 accent-brand-500"
checked={account.optQuiz === true}
disabled={busy}
onChange={(event) => onToggleOption('quiz', event.target.checked)}
/>
自动交测验
</label>
<label className="flex cursor-pointer items-center gap-1.5 text-[11.5px] text-slate-600">
<input
type="checkbox"
className="size-3.5 accent-brand-500"
checked={account.optFeedback !== false}
disabled={busy}
onChange={(event) => onToggleOption('feedback', event.target.checked)}
/>
自动交反馈表
</label>
<div className="flex-1" />
<span className="text-[11px] tabular-nums text-slate-400">
{selectedCount > 0 ? `已选 ${selectedCount} 门` : '未选择课程'}
</span>
</div>
<div className="flex flex-wrap items-center gap-1.5 border-t border-line/70 px-4 py-2.5">
<Button
size="sm"
variant="soft"
loading={pending === 'login' || account.status === 'logging' || account.run?.status === 'logging'}
disabled={busy}
icon={<LogIn className="size-3.5" />}
onClick={onLogin}
>
{account.cookies?.length ? '重新登录' : '登录'}
</Button>
<Button
size="sm"
loading={pending === 'refresh'}
disabled={busy || !account.cookies?.length}
icon={<RefreshCw className="size-3.5" />}
onClick={onRefresh}
>
刷新课程
</Button>
<Button
size="sm"
variant="primary"
loading={pending === 'study'}
disabled={busy || !canStudy}
icon={<Play className="size-3.5" />}
onClick={onStudy}
>
开始学习
</Button>
<div className="flex-1" />
{running && (
<Button
size="icon"
variant="danger"
loading={pending === 'stop'}
onClick={onStop}
title="停止学习"
aria-label="停止学习"
>
<CircleStop className="size-4" />
</Button>
)}
<div className="relative" ref={menuRef}>
<Button
size="icon"
variant="ghost"
onClick={() => setMenuOpen((open) => !open)}
aria-label="更多操作"
title="更多操作"
>
<Ellipsis className="size-4" />
</Button>
{menuOpen && (
<div className="absolute bottom-10 right-0 z-20 w-40 overflow-hidden rounded-xl border border-line bg-white py-1 shadow-xl shadow-slate-900/10">
{[
{ label: '课程日志', icon: ListVideo, action: onToggleLog },
{ label: '打开测验', icon: ClipboardCheck, action: onQuiz },
account.run?.capturing
? { label: '停止抓包', icon: Square, action: onStopCapture }
: { label: '抓包 10 分钟', icon: Video, action: onCapture },
{ label: '删除账号', icon: Trash2, action: onDelete, danger: true },
].map((item) => (
<button
key={item.label}
type="button"
className={cn(
'flex w-full items-center gap-2 px-3 py-2 text-left text-[12px] transition hover:bg-slate-50',
item.danger ? 'text-red-600' : 'text-slate-700',
)}
onClick={() => {
setMenuOpen(false)
item.action()
}}
>
<item.icon className="size-3.5 opacity-70" />
{item.label}
</button>
))}
</div>
)}
</div>
</div>
{(total > 0 || account.run?.error) && (
<div className="border-t border-line/70 px-4 py-3">
<div className="mb-1.5 flex items-center justify-between gap-2 text-[11px] text-slate-500">
<span className="truncate">
{account.run?.course || account.run?.status || '学习进度'}
</span>
<span className="shrink-0 tabular-nums">
{done} / {total}
{total > 0 && <span className="ml-1 text-slate-400">({pct}%)</span>}
</span>
</div>
<div className="h-1.5 overflow-hidden rounded-full bg-slate-100">
<div
className={cn(
'h-full rounded-full transition-all duration-500',
account.run?.status === 'error'
? 'bg-red-500'
: account.run?.status === 'finished'
? 'bg-emerald-500'
: 'bg-gradient-to-r from-brand-500 to-sky-400',
)}
style={{ width: `${Math.min(100, pct)}%` }}
/>
</div>
{account.run?.error && (
<p className="mt-2 rounded-lg bg-red-50 px-2.5 py-1.5 text-[11px] leading-relaxed text-red-700">
{account.run.error}
</p>
)}
</div>
)}
{account.lastError && (
<div className="border-t border-line/70 px-4 py-2.5">
<p className="rounded-lg bg-red-50/80 px-2.5 py-1.5 text-[11px] leading-relaxed text-red-700">
{account.lastError}
{account.lastErrorAt ? (
<span className="ml-1 text-red-400">· {ageText(account.lastErrorAt)}</span>
) : null}
</p>
</div>
)}
<div className={cn('border-t border-line/70', openLog ? 'block' : 'hidden')}>
<div className="flex items-center gap-2 px-4 pt-2.5 text-[11px] text-slate-400">
<span className="font-medium text-slate-500">课程日志</span>
<span className="tabular-nums">({logLines.length})</span>
<div className="flex-1" />
<button
type="button"
onClick={onToggleLog}
className="rounded px-1.5 py-0.5 text-[11px] text-slate-500 transition hover:bg-slate-100"
>
收起
</button>
</div>
<pre
ref={logRef}
onScroll={(event) => {
const el = event.currentTarget
stickRef.current = el.scrollHeight - el.scrollTop - el.clientHeight < 24
}}
className={cn(
'scrollbar-thin mx-4 mb-3 mt-2 max-h-56 overflow-auto rounded-lg bg-slate-950/95 p-3',
'font-mono text-[11px] leading-relaxed text-slate-300',
logLines.length === 0 && 'text-slate-500',
)}
>
{logLines.length ? logLines.join('\n') : '暂无日志 · 开始学习后这里会实时显示'}
</pre>
</div>
<button
type="button"
onClick={onToggleLog}
className="flex items-center justify-center gap-1 border-t border-line/70 py-1.5 text-[10.5px] text-slate-400 transition hover:bg-slate-50 hover:text-slate-600"
aria-expanded={openLog}
>
<ChevronDown className={cn('size-3 transition-transform', openLog && 'rotate-180')} />
{openLog ? '收起课程日志' : '展开课程日志'}
</button>
</article>
)
}
+115
View File
@@ -0,0 +1,115 @@
import { useEffect, useState } from 'react'
import { Modal } from './ui/Modal'
import { Button } from './ui/Button'
import { inputCls } from '../lib/utils'
export interface NewAccount {
username: string
password: string
note: string
}
export function AddAccountDialog({
open,
onClose,
onSubmit,
}: {
open: boolean
onClose: () => void
onSubmit: (account: NewAccount) => Promise<void>
}) {
const [username, setUsername] = useState('')
const [password, setPassword] = useState('')
const [note, setNote] = useState('')
const [saving, setSaving] = useState(false)
const [error, setError] = useState('')
useEffect(() => {
if (!open) return
setUsername('')
setPassword('')
setNote('')
setError('')
setSaving(false)
}, [open])
async function submit() {
if (!username.trim() || !password) {
setError('请填写账号和密码')
return
}
setSaving(true)
setError('')
try {
await onSubmit({ username: username.trim(), password, note: note.trim() })
onClose()
} catch (err) {
setError(err instanceof Error ? err.message : String(err))
} finally {
setSaving(false)
}
}
return (
<Modal
open={open}
onClose={onClose}
title="添加账号"
subtitle="账号密码保存在本机 SQLite,用于会话失效时自动重新登录"
footer={
<>
<Button onClick={onClose} disabled={saving}>
取消
</Button>
<Button variant="primary" loading={saving} onClick={submit}>
保存并登录
</Button>
</>
}
>
<div className="space-y-4">
<div>
<label className="mb-1.5 block text-[12px] font-medium text-slate-600">登录账号</label>
<input
className={inputCls}
value={username}
autoFocus
placeholder="手机号 / 身份证号 / 教师账号"
onChange={(event) => setUsername(event.target.value)}
onKeyDown={(event) => event.key === 'Enter' && submit()}
/>
</div>
<div>
<label className="mb-1.5 block text-[12px] font-medium text-slate-600">密码</label>
<input
className={inputCls}
type="password"
value={password}
autoComplete="off"
placeholder="平台登录密码"
onChange={(event) => setPassword(event.target.value)}
onKeyDown={(event) => event.key === 'Enter' && submit()}
/>
</div>
<div>
<label className="mb-1.5 block text-[12px] font-medium text-slate-600">
备注 <span className="font-normal text-slate-400">(可选)</span>
</label>
<input
className={inputCls}
value={note}
placeholder="例如:张三 · 语文"
onChange={(event) => setNote(event.target.value)}
/>
</div>
<p className="rounded-lg border border-line bg-slate-50 px-3 py-2 text-[11.5px] leading-relaxed text-slate-500">
保存后会自动尝试登录一次。若密码错误或需要验证码,卡片上会保留「登录」按钮,可手动重试。
</p>
{error && (
<p className="rounded-lg bg-red-50 px-3 py-2 text-[12px] text-red-700">{error}</p>
)}
</div>
</Modal>
)
}
+436
View File
@@ -0,0 +1,436 @@
import { useEffect, useRef, useState } from 'react'
import { Bot, RotateCcw, Send } from 'lucide-react'
import { api, fetchSse } from '../lib/api'
import type { Account, Course, QuizData, QuizOption, QuizQuestion } from '../types'
import { cn, splitKeys, TYPE_LABEL } from '../lib/utils'
import { Badge } from './ui/Badge'
import { Button } from './ui/Button'
import { Modal } from './ui/Modal'
import type { ToastState } from './Toast'
function optionLabel(option: QuizOption): string {
const text = String(option?.text || '').replace(/\s+/g, ' ').trim()
return text.length > 24 ? `${text.slice(0, 24)}…` : text
}
export function QuizDialog({
open,
account,
course,
onClose,
notify,
onSubmitted,
}: {
open: boolean
account: Account | null
course: Course | null
onClose: () => void
notify: (toast: ToastState) => void
onSubmitted: () => void
}) {
const [data, setData] = useState<QuizData | null>(null)
const [answers, setAnswers] = useState<Record<string, string>>({})
const [loading, setLoading] = useState(false)
const [submitting, setSubmitting] = useState(false)
const [retaking, setRetaking] = useState(false)
const [aiRunning, setAiRunning] = useState(false)
const [status, setStatus] = useState('')
const [statusTone, setStatusTone] = useState<'info' | 'success' | 'error'>('info')
const gotRef = useRef(0)
async function load(retake = false) {
if (!account || !course) return false
setLoading(true)
setStatus(retake ? '正在生成新答卷…' : '取题中…')
setStatusTone('info')
try {
const body: Record<string, unknown> = {
cookies: account.cookies,
plan_id: course.plan_id,
project_id: course.project_id,
name: course.name || '',
}
if (retake) {
body.retake = true
body.period_id = data?.period_id || ''
}
const response = await api<QuizData>('/api/quiz', {
method: 'POST',
body: JSON.stringify(body),
})
if (!response.ok) {
setData(null)
setStatus(response.error || '取题失败')
setStatusTone('error')
return false
}
setData(response)
setAnswers(
Object.fromEntries((response.questions || []).map((question) => [question.no, question.picked || ''])),
)
const bits: string[] = []
if (response.done) {
const left = response.surplus_exam_count
if (left !== undefined && left !== null) bits.push(`剩 ${left} 次`)
else if (response.allow_exam_count) bits.push(`共 ${response.allow_exam_count} 次`)
if (response.show_answers) bits.push('已显示标准答案')
else if (response.exam_after_watch_answer === '0') bits.push('本测验不开放答案')
setStatus(`已交卷${bits.length ? ` · ${bits.join(' · ')}` : ''}`)
setStatusTone('success')
} else {
setStatus(response.started ? '已自动创建答卷(限时考试已开始计时)' : '')
setStatusTone('info')
}
return true
} catch (error) {
setStatus(error instanceof Error ? error.message : '取题失败')
setStatusTone('error')
return false
} finally {
setLoading(false)
}
}
useEffect(() => {
if (!open || !account || !course) return
setData(null)
setAnswers({})
setAiRunning(false)
void load(false)
// 只在打开或切换课程时取题;轮询更新 account 对象不重新取题
// eslint-disable-next-line react-hooks/exhaustive-deps
}, [open, account?.id, course?.plan_id])
if (!account || !course) return null
const questions = data?.questions || []
const done = !!data?.done
const show = !!data?.show_answers
const canRetake = !!data?.can_retake
const left = data?.surplus_exam_count
const disabled = done || loading || submitting || aiRunning
function setAnswer(no: string, value: string) {
setAnswers((previous) => ({ ...previous, [no]: value }))
}
function toggleMulti(no: string, key: string, checked: boolean) {
setAnswers((previous) => {
const keys = splitKeys(previous[no])
const next = checked ? [...keys, key] : keys.filter((item) => item !== key)
next.sort()
return { ...previous, [no]: next.join('#') }
})
}
async function submit() {
if (!data || !account) return
const missing = questions.filter((question) => !answers[question.no]).length
if (missing && !window.confirm(`还有 ${missing} 题没作答,确定提交?`)) return
setSubmitting(true)
setStatus('提交中…')
setStatusTone('info')
try {
const response = await api<{ ok: boolean; error?: string; code?: string; score?: number }>(
'/api/quiz/submit',
{
method: 'POST',
body: JSON.stringify({
cookies: account.cookies,
plan_id: data.plan_id,
object_id: data.object_id,
generation: data.generation || 'legacy',
result_id: data.result_id || '',
answers,
}),
},
)
if (!response.ok) {
if (response.code === 'already_finished') await load()
setStatus(response.error || '提交失败')
setStatusTone('error')
return
}
notify({ message: `测验已提交${response.score ? `,得分 ${response.score}` : ''}`, tone: 'success' })
await load()
onSubmitted()
} catch (error) {
setStatus(error instanceof Error ? error.message : '提交失败')
setStatusTone('error')
} finally {
setSubmitting(false)
}
}
async function retake() {
if (!data) return
if (!data.can_retake) {
notify({ message: '没有剩余考试机会', tone: 'error' })
return
}
const tip = left !== undefined && left !== null ? `(剩余 ${left} 次)` : ''
if (!window.confirm(`再考一次会消耗 1 次机会${tip};限时考试会立即开始计时,确定?`)) return
setRetaking(true)
try {
if (await load(true)) notify({ message: '已生成新答卷,可以重新答题了', tone: 'success' })
} finally {
setRetaking(false)
}
}
async function aiAnswer() {
if (!data || !account) return
if (data.done) {
notify({ message: '已交卷,点「再考一次」生成新答卷后再 AI 答题', tone: 'error' })
return
}
setAiRunning(true)
gotRef.current = 0
const started = Date.now()
let failed = 0
let lastError = ''
const timer = window.setInterval(() => {
setStatus(
`AI 答题中… ${Math.round((Date.now() - started) / 1000)}s · 已填 ${gotRef.current}/${questions.length} 题`,
)
setStatusTone('info')
}, 1000)
setStatus(`AI 答题中… 已填 0/${questions.length} 题`)
try {
await fetchSse(
'/api/quiz/answer',
{ questions: data.questions, account_id: account.id },
(event) => {
const batch = event.answers as Record<string, string> | undefined
if (batch && typeof batch === 'object') {
const count = Object.keys(batch).length
if (count) {
gotRef.current += count
setAnswers((previous) => ({ ...previous, ...batch }))
}
}
if (event.error) lastError = String(event.error)
if (event.done && typeof event.failed === 'number') failed = event.failed
},
)
if (!gotRef.current) {
setStatus(lastError ? `AI 答题失败:${lastError}` : 'AI 没有返回答案')
setStatusTone('error')
} else if (failed) {
setStatus(`AI 已填 ${gotRef.current} 题,${failed} 题失败${lastError ? `:${lastError}` : ''}`)
setStatusTone('error')
} else {
setStatus(`AI 已填 ${gotRef.current} 题`)
setStatusTone('success')
}
} catch (error) {
setStatus(error instanceof Error ? error.message : 'AI 答题失败')
setStatusTone('error')
} finally {
window.clearInterval(timer)
setAiRunning(false)
}
}
const retakeLabel = canRetake
? `再考一次${left !== undefined && left !== null ? `(剩 ${left} 次)` : ''}`
: left === 0
? '考试机会已用完'
: '再考一次'
return (
<Modal
open={open}
onClose={onClose}
title={`测验 · ${course.name || course.plan_id}`}
subtitle={status || '取题后可手动作答,或让大模型逐批填写'}
size="xl"
footer={
<>
<span
className={cn(
'mr-auto max-w-[50%] truncate text-[11.5px]',
statusTone === 'error'
? 'text-red-600'
: statusTone === 'success'
? 'text-emerald-600'
: 'text-slate-500',
)}
>
{status}
</span>
{done && (
<Button
size="sm"
loading={retaking}
disabled={loading || !canRetake}
icon={<RotateCcw className="size-3.5" />}
onClick={retake}
>
{retakeLabel}
</Button>
)}
<Button size="sm" onClick={onClose}>
关闭
</Button>
<Button
size="sm"
variant="soft"
loading={aiRunning}
disabled={disabled || !questions.length}
icon={<Bot className="size-3.5" />}
onClick={aiAnswer}
>
AI 答题
</Button>
<Button
size="sm"
variant="primary"
loading={submitting}
disabled={disabled || !questions.length}
icon={<Send className="size-3.5" />}
onClick={submit}
>
提交
</Button>
</>
}
>
{loading && !questions.length ? (
<div className="py-16 text-center text-[13px] text-slate-400">正在打开课程页取题…</div>
) : !questions.length ? (
<div className="py-16 text-center text-[13px] text-red-600">{status || '没有题目'}</div>
) : (
<div className="space-y-2.5">
{questions.map((question) => {
const options = question.options || []
const picked = answers[question.no] || ''
const isMulti = question.type === '02'
const hasOptions = options.length > 0
return (
<div key={question.no} className="rounded-xl border border-line px-3.5 py-3">
<div className="flex items-start gap-2">
<span className="mt-0.5 grid size-5 shrink-0 place-items-center rounded-md bg-slate-100 text-[10.5px] font-semibold tabular-nums text-slate-500">
{question.no}
</span>
<Badge tone="neutral" className="mt-0.5 shrink-0">
{TYPE_LABEL[question.type || ''] || '题目'}
</Badge>
<p className="min-w-0 flex-1 text-[13px] leading-relaxed text-slate-800">
{question.title || `第 ${question.no} 题`}
</p>
{show && question.is_correct !== undefined && (
<span
className={cn(
'shrink-0 text-[12px] font-semibold',
question.is_correct ? 'text-emerald-600' : 'text-red-500',
)}
>
{question.is_correct ? '✓' : '✗'}
</span>
)}
</div>
{hasOptions && (
<div className="mt-2 flex flex-wrap gap-1.5 pl-7">
{options.map((option) => {
const correct = show && splitKeys(question.correct).includes(option.key)
const wrong =
show &&
splitKeys(question.picked).includes(option.key) &&
!splitKeys(question.correct).includes(option.key)
return (
<span
key={option.key}
className={cn(
'max-w-full rounded-lg border px-2 py-1 text-[11.5px] leading-snug',
correct
? 'border-emerald-200 bg-emerald-50 text-emerald-800'
: wrong
? 'border-red-200 bg-red-50 text-red-700'
: 'border-line bg-slate-50/70 text-slate-600',
)}
>
<b className="mr-1 font-semibold">{option.key}</b>
{optionLabel(option)}
</span>
)
})}
</div>
)}
<div className="mt-2.5 flex flex-wrap items-center gap-2 pl-7">
{isMulti ? (
<div className="flex flex-wrap gap-1.5">
{options.map((option) => {
const keys = splitKeys(picked)
return (
<label
key={option.key}
title={`${option.key}. ${option.text || ''}`}
className={cn(
'flex cursor-pointer items-center gap-1 rounded-lg border px-2 py-1 text-[11.5px] transition',
keys.includes(option.key)
? 'border-brand-300 bg-brand-50 text-brand-700'
: 'border-line text-slate-600 hover:border-slate-300',
disabled && 'pointer-events-none opacity-60',
)}
>
<input
type="checkbox"
className="size-3 accent-brand-500"
checked={keys.includes(option.key)}
disabled={disabled}
onChange={(event) =>
toggleMulti(question.no, option.key, event.target.checked)
}
/>
{option.key}
</label>
)
})}
</div>
) : hasOptions ? (
<select
className="h-8 w-full max-w-[320px] rounded-lg border border-line bg-white px-2 text-[12px] text-slate-700 focus:border-brand-500 focus:outline-none disabled:bg-slate-50 disabled:text-slate-400"
value={picked}
disabled={disabled}
onChange={(event) => setAnswer(question.no, event.target.value)}
>
<option value="">未选</option>
{options.map((option) => (
<option key={option.key} value={option.key}>
{option.key}. {option.text || ''}
</option>
))}
</select>
) : (
<input
className="h-8 w-full max-w-[320px] rounded-lg border border-line bg-white px-2 text-[12px] text-slate-700 focus:border-brand-500 focus:outline-none disabled:bg-slate-50 disabled:text-slate-400"
value={picked}
placeholder="填写答案"
disabled={disabled}
onChange={(event) => setAnswer(question.no, event.target.value)}
/>
)}
{show && question.correct && (
<span className="text-[11.5px] text-slate-500">
标准答案:<b className="font-semibold text-slate-700">{question.correct}</b>
</span>
)}
</div>
{show && question.analysis && (
<p className="mt-2 rounded-lg bg-slate-50 px-2.5 py-1.5 text-[11.5px] leading-relaxed text-slate-500">
解析:{question.analysis}
</p>
)}
</div>
)
})}
</div>
)}
</Modal>
)
}
+270
View File
@@ -0,0 +1,270 @@
import { useEffect, useState } from 'react'
import { Cpu, Gauge, KeyRound, ServerCog } from 'lucide-react'
import { api } from '../lib/api'
import { inputCls } from '../lib/utils'
import { Button } from './ui/Button'
import { Modal } from './ui/Modal'
import type { ToastState } from './Toast'
interface SettingsResponse {
llm?: {
base_url?: string
model?: string
temperature?: number
timeout?: number
prompt?: string
has_key?: boolean
key_hint?: string
}
study?: { mode?: string; parallel?: number }
}
export function SettingsDialog({
open,
onClose,
notify,
}: {
open: boolean
onClose: () => void
notify: (toast: ToastState) => void
}) {
const [loading, setLoading] = useState(false)
const [saving, setSaving] = useState(false)
const [testing, setTesting] = useState(false)
const [form, setForm] = useState({
base_url: '',
api_key: '',
model: '',
temperature: '0.2',
timeout: '120',
prompt: '',
study_mode: 'fast',
study_parallel: '2',
})
const [keyHint, setKeyHint] = useState('sk-...')
useEffect(() => {
if (!open) return
setLoading(true)
api<SettingsResponse>('/api/settings')
.then((response) => {
const llm = response.llm || {}
const study = response.study || {}
setForm({
base_url: llm.base_url || '',
api_key: '',
model: llm.model || '',
temperature: String(llm.temperature ?? 0.2),
timeout: String(llm.timeout ?? 120),
prompt: llm.prompt || '',
study_mode: study.mode || 'fast',
study_parallel: String(study.parallel || 2),
})
setKeyHint(llm.has_key ? `已保存 ${llm.key_hint || ''},留空不修改` : 'sk-...')
})
.catch((error) => notify({ message: `读取设置失败:${error.message}`, tone: 'error' }))
.finally(() => setLoading(false))
}, [open, notify])
function update<K extends keyof typeof form>(key: K, value: string) {
setForm((previous) => ({ ...previous, [key]: value }))
}
async function save() {
setSaving(true)
try {
await api('/api/settings', {
method: 'POST',
body: JSON.stringify({
base_url: form.base_url.trim(),
api_key: form.api_key.trim(),
model: form.model.trim(),
temperature: Number.parseFloat(form.temperature) || 0.2,
timeout: Number.parseInt(form.timeout, 10) || 120,
prompt: form.prompt,
study_mode: form.study_mode,
study_parallel: Number.parseInt(form.study_parallel, 10) || 0,
}),
})
notify({ message: '设置已保存', tone: 'success' })
onClose()
} catch (error) {
notify({ message: `保存失败:${error instanceof Error ? error.message : error}`, tone: 'error' })
} finally {
setSaving(false)
}
}
async function test() {
setTesting(true)
try {
const response = await api<{ ok?: boolean; ms?: number; reply?: string; error?: string }>(
'/api/llm/test',
{
method: 'POST',
body: JSON.stringify({
base_url: form.base_url.trim(),
api_key: form.api_key.trim(),
model: form.model.trim(),
}),
},
)
notify({
message: response.ok
? `连接正常(${response.ms} ms):${response.reply || ''}`
: `连接失败:${response.error || '未知错误'}`,
tone: response.ok ? 'success' : 'error',
})
} catch (error) {
notify({ message: `连接失败:${error instanceof Error ? error.message : error}`, tone: 'error' })
} finally {
setTesting(false)
}
}
return (
<Modal
open={open}
onClose={onClose}
title="系统设置"
subtitle="大模型接口、答题提示词与学习模式"
size="lg"
footer={
<>
<Button loading={testing} onClick={test} icon={<Cpu className="size-3.5" />}>
测试连接
</Button>
<Button onClick={onClose} disabled={saving}>
取消
</Button>
<Button variant="primary" loading={saving} onClick={save} disabled={loading}>
保存
</Button>
</>
}
>
{loading ? (
<div className="py-10 text-center text-[12.5px] text-slate-400">读取设置…</div>
) : (
<div className="space-y-6">
<section>
<div className="mb-3 flex items-center gap-2 text-[12.5px] font-semibold text-slate-700">
<ServerCog className="size-4 text-brand-500" />
大模型(OpenAI 兼容)
</div>
<div className="space-y-3">
<div>
<label className="mb-1.5 block text-[12px] text-slate-600">
接口地址 <span className="text-slate-400">(写到 /v1 为止)</span>
</label>
<input
className={inputCls}
value={form.base_url}
placeholder="https://api.openai.com/v1"
onChange={(event) => update('base_url', event.target.value)}
/>
</div>
<div className="grid gap-3 sm:grid-cols-2">
<div>
<label className="mb-1.5 block text-[12px] text-slate-600">API Key</label>
<div className="relative">
<KeyRound className="pointer-events-none absolute left-2.5 top-1/2 size-3.5 -translate-y-1/2 text-slate-400" />
<input
className={`${inputCls} pl-8`}
type="password"
autoComplete="off"
value={form.api_key}
placeholder={keyHint}
onChange={(event) => update('api_key', event.target.value)}
/>
</div>
</div>
<div>
<label className="mb-1.5 block text-[12px] text-slate-600">模型</label>
<input
className={inputCls}
value={form.model}
placeholder="gpt-4o-mini / deepseek-chat / qwen-plus"
onChange={(event) => update('model', event.target.value)}
/>
</div>
</div>
<div className="grid gap-3 sm:grid-cols-2">
<div>
<label className="mb-1.5 block text-[12px] text-slate-600">温度</label>
<input
className={inputCls}
type="number"
min={0}
max={2}
step={0.1}
value={form.temperature}
onChange={(event) => update('temperature', event.target.value)}
/>
</div>
<div>
<label className="mb-1.5 block text-[12px] text-slate-600">超时(秒)</label>
<input
className={inputCls}
type="number"
min={10}
max={600}
value={form.timeout}
onChange={(event) => update('timeout', event.target.value)}
/>
</div>
</div>
<div>
<label className="mb-1.5 block text-[12px] text-slate-600">
答题提示词 <span className="text-slate-400">(留空使用内置)</span>
</label>
<textarea
className={`${inputCls} min-h-24 resize-y`}
value={form.prompt}
placeholder='只输出 JSON {"answers":{"题号":"答案"}}'
onChange={(event) => update('prompt', event.target.value)}
/>
</div>
</div>
</section>
<section className="border-t border-line pt-5">
<div className="mb-3 flex items-center gap-2 text-[12.5px] font-semibold text-slate-700">
<Gauge className="size-4 text-brand-500" />
学习模式
</div>
<div className="grid gap-3 sm:grid-cols-2">
<div>
<label className="mb-1.5 block text-[12px] text-slate-600">模式</label>
<select
className={inputCls}
value={form.study_mode}
onChange={(event) => update('study_mode', event.target.value)}
>
<option value="fast">快速学习(只调接口上报)</option>
<option value="normal">常规学习(真实播放视频)</option>
</select>
</div>
<div>
<label className="mb-1.5 block text-[12px] text-slate-600">常规模式并发数</label>
<input
className={inputCls}
type="number"
min={1}
max={5}
value={form.study_parallel}
onChange={(event) => update('study_parallel', event.target.value)}
/>
</div>
</div>
<p className="mt-3 rounded-lg bg-slate-50 px-3 py-2 text-[11.5px] leading-relaxed text-slate-500">
常规学习会开多个无头浏览器同时播视频;平台若按课节顺序放行,会被弹回并自动降为 1
路。快速学习只调用 <code className="rounded bg-white px-1 ring-1 ring-line">period/study/log</code>,不启动浏览器。
</p>
</section>
</div>
)}
</Modal>
)
}
+63
View File
@@ -0,0 +1,63 @@
import { Activity, GraduationCap, ShieldCheck, Users } from 'lucide-react'
import type { Account } from '../types'
export function StatBar({ accounts }: { accounts: Account[] }) {
const loggedIn = accounts.filter(
(account) => account.cookies?.length > 0 || ['logged_in', 'studying'].includes(account.status || ''),
).length
const running = accounts.filter((account) =>
['discovering', 'studying'].includes(account.run?.status || ''),
).length
const done = accounts.reduce((sum, account) => sum + (account.run?.done || 0), 0)
const total = accounts.reduce((sum, account) => sum + (account.run?.total || 0), 0)
const stats = [
{ label: '账号', value: accounts.length, hint: '已添加', icon: Users, tone: 'text-brand-600 bg-brand-50' },
{
label: '已登录',
value: loggedIn,
hint: accounts.length ? `共 ${accounts.length} 个` : '等待添加',
icon: ShieldCheck,
tone: 'text-emerald-600 bg-emerald-50',
},
{
label: '学习中',
value: running,
hint: running ? '正在跑课' : '空闲',
icon: Activity,
tone: 'text-sky-600 bg-sky-50',
},
{
label: '课程进度',
value: total ? `${done}/${total}` : '—',
hint: total ? `${Math.round((done / total) * 100)}%` : '暂无任务',
icon: GraduationCap,
tone: 'text-amber-600 bg-amber-50',
},
]
return (
<section className="grid grid-cols-2 gap-3 lg:grid-cols-4">
{stats.map((stat) => (
<div
key={stat.label}
className="flex items-center gap-3 rounded-xl border border-line bg-white px-4 py-3"
>
<span className={`grid size-9 shrink-0 place-items-center rounded-lg ${stat.tone}`}>
<stat.icon className="size-4" />
</span>
<div className="min-w-0">
<div className="text-[11px] text-slate-400">{stat.label}</div>
<div className="flex items-baseline gap-1.5">
<span className="text-[17px] font-semibold tabular-nums leading-tight text-slate-900">
{stat.value}
</span>
<span className="truncate text-[10.5px] text-slate-400">{stat.hint}</span>
</div>
</div>
</div>
))}
</section>
)
}
+84
View File
@@ -0,0 +1,84 @@
import { useEffect, useRef, useState } from 'react'
import { api } from '../lib/api'
import { Button } from './ui/Button'
import { Modal } from './ui/Modal'
export function SystemLogDialog({ open, onClose }: { open: boolean; onClose: () => void }) {
const [lines, setLines] = useState<string[]>([])
const [clearing, setClearing] = useState(false)
const preRef = useRef<HTMLPreElement>(null)
const stickRef = useRef(true)
useEffect(() => {
if (!open) return
let alive = true
const pull = async () => {
try {
const response = await api<{ lines?: string[] }>('/api/log/history?key=system&tail=500')
if (alive) setLines(response.lines || [])
} catch {
// 面板轮询失败不打断页面
}
}
setLines([])
pull()
const timer = window.setInterval(() => {
if (!document.hidden) pull()
}, 2500)
return () => {
alive = false
window.clearInterval(timer)
}
}, [open])
useEffect(() => {
const el = preRef.current
if (el && stickRef.current) el.scrollTop = el.scrollHeight
}, [lines, open])
async function clear() {
setClearing(true)
try {
await api('/api/log/history?key=system', { method: 'DELETE' })
setLines([])
} finally {
setClearing(false)
}
}
return (
<Modal
open={open}
onClose={onClose}
title="系统日志"
subtitle="全局事件与系统级错误,实时刷新"
size="xl"
footer={
<>
<span className="mr-auto text-[11px] text-slate-400">共 {lines.length} 行 · 保留最近 500 行</span>
<Button variant="danger" size="sm" loading={clearing} onClick={clear}>
清空
</Button>
<Button size="sm" onClick={onClose}>
关闭
</Button>
</>
}
bodyClassName="bg-slate-950 p-0"
>
<pre
ref={preRef}
onScroll={(event) => {
const el = event.currentTarget
stickRef.current = el.scrollHeight - el.scrollTop - el.clientHeight < 24
}}
className="scrollbar-thin h-[60vh] overflow-auto whitespace-pre-wrap break-words p-4 font-mono text-[11.5px] leading-relaxed text-slate-300"
>
{lines.length ? lines.join('\n') : '暂无系统日志'}
</pre>
</Modal>
)
}
+32
View File
@@ -0,0 +1,32 @@
import { AlertCircle, CheckCircle2, Info } from 'lucide-react'
import { cn } from '../lib/utils'
export interface ToastState {
message: string
tone?: 'info' | 'success' | 'error'
}
export function Toast({ toast }: { toast: ToastState | null }) {
if (!toast) return null
const tone = toast.tone || 'info'
const Icon = tone === 'error' ? AlertCircle : tone === 'success' ? CheckCircle2 : Info
return (
<div
role="status"
className={cn(
'animate-toast-in fixed bottom-7 left-1/2 z-[60] flex max-w-[85vw] -translate-x-1/2 items-center gap-2',
'rounded-xl px-4 py-2.5 text-[12.5px] font-medium shadow-xl shadow-slate-900/20',
tone === 'error'
? 'bg-red-600 text-white'
: tone === 'success'
? 'bg-emerald-600 text-white'
: 'bg-slate-900 text-white',
)}
>
<Icon className="size-4 shrink-0 opacity-90" />
<span className="break-words">{toast.message}</span>
</div>
)
}
+78
View File
@@ -0,0 +1,78 @@
import { Plus, RefreshCw, ScrollText, Settings2 } from 'lucide-react'
import { Button } from './ui/Button'
export function TopBar({
refreshing,
onRefresh,
onSettings,
onSystemLog,
onAdd,
}: {
refreshing: boolean
onRefresh: () => void
onSettings: () => void
onSystemLog: () => void
onAdd: () => void
}) {
return (
<header className="sticky top-0 z-30 border-b border-line/80 bg-white/85 backdrop-blur-xl">
<div className="mx-auto flex h-16 max-w-[1320px] items-center gap-3 px-4 sm:px-6">
<div className="flex min-w-0 items-center gap-3">
<div className="grid size-9 shrink-0 place-items-center rounded-xl bg-gradient-to-br from-brand-500 to-sky-400 text-[15px] font-bold text-white shadow-md shadow-brand-500/30">
学
</div>
<div className="min-w-0">
<div className="flex items-center gap-2">
<h1 className="truncate text-[15px] font-semibold tracking-tight text-slate-900">
莞易学
</h1>
<span className="hidden rounded-md bg-slate-100 px-1.5 py-0.5 text-[10px] font-medium text-slate-500 sm:inline">
多账号学习控制台
</span>
</div>
<p className="truncate text-[11.5px] text-slate-500">
东莞市教师培训平台 · 新旧版课程自动识别
</p>
</div>
</div>
<div className="flex-1" />
<div className="flex items-center gap-1.5">
<Button
variant="ghost"
size="icon"
onClick={onRefresh}
loading={refreshing}
title="刷新列表"
aria-label="刷新列表"
>
<RefreshCw className="size-4" />
</Button>
<Button
variant="ghost"
size="icon"
onClick={onSystemLog}
title="系统日志"
aria-label="系统日志"
>
<ScrollText className="size-4" />
</Button>
<Button
variant="ghost"
size="icon"
onClick={onSettings}
title="系统设置"
aria-label="系统设置"
>
<Settings2 className="size-4" />
</Button>
<Button variant="primary" className="ml-1" icon={<Plus className="size-4" />} onClick={onAdd}>
<span className="hidden sm:inline">添加账号</span>
</Button>
</div>
</div>
</header>
)
}
+39
View File
@@ -0,0 +1,39 @@
import type { ReactNode } from 'react'
import { cn } from '../../lib/utils'
type Tone = 'neutral' | 'brand' | 'success' | 'warning' | 'danger' | 'running'
const TONES: Record<Tone, string> = {
neutral: 'bg-slate-100 text-slate-600 ring-slate-200',
brand: 'bg-brand-50 text-brand-700 ring-brand-100',
success: 'bg-emerald-50 text-emerald-700 ring-emerald-100',
warning: 'bg-amber-50 text-amber-700 ring-amber-100',
danger: 'bg-red-50 text-red-700 ring-red-100',
running: 'bg-sky-50 text-sky-700 ring-sky-100',
}
export function Badge({
tone = 'neutral',
children,
dot = false,
className,
}: {
tone?: Tone
children: ReactNode
dot?: boolean
className?: string
}) {
return (
<span
className={cn(
'inline-flex items-center gap-1.5 rounded-full px-2 py-0.5 text-[11px] font-medium ring-1 ring-inset',
TONES[tone],
className,
)}
>
{dot && <span className="size-1.5 rounded-full bg-current opacity-70" />}
{children}
</span>
)
}
+60
View File
@@ -0,0 +1,60 @@
import type { ButtonHTMLAttributes, ReactNode } from 'react'
import { Loader2 } from 'lucide-react'
import { cn } from '../../lib/utils'
type Variant = 'primary' | 'secondary' | 'ghost' | 'danger' | 'soft'
type Size = 'sm' | 'md' | 'icon'
const VARIANTS: Record<Variant, string> = {
primary:
'border-brand-500 bg-brand-500 text-white shadow-sm shadow-brand-500/25 hover:border-brand-600 hover:bg-brand-600',
secondary: 'border-line bg-white text-slate-700 hover:border-slate-300 hover:bg-slate-50',
ghost: 'border-transparent bg-transparent text-slate-600 hover:bg-slate-100',
danger: 'border-transparent bg-transparent text-red-600 hover:bg-red-50',
soft: 'border-brand-100 bg-brand-50 text-brand-700 hover:border-brand-200 hover:bg-brand-100',
}
const SIZES: Record<Size, string> = {
sm: 'h-8 gap-1.5 rounded-lg px-2.5 text-xs',
md: 'h-9 gap-1.5 rounded-lg px-3.5 text-[13px]',
icon: 'h-9 w-9 rounded-lg',
}
interface ButtonProps extends ButtonHTMLAttributes<HTMLButtonElement> {
variant?: Variant
size?: Size
loading?: boolean
icon?: ReactNode
}
export function Button({
variant = 'secondary',
size = 'md',
loading = false,
icon,
className,
children,
disabled,
type = 'button',
...rest
}: ButtonProps) {
return (
<button
type={type}
disabled={disabled || loading}
className={cn(
'inline-flex shrink-0 items-center justify-center border font-medium transition',
'focus-visible:outline-none focus-visible:ring-3 focus-visible:ring-brand-500/20',
'disabled:cursor-not-allowed disabled:opacity-50',
VARIANTS[variant],
SIZES[size],
className,
)}
{...rest}
>
{loading ? <Loader2 className="size-3.5 animate-spin" /> : icon}
{children}
</button>
)
}
+82
View File
@@ -0,0 +1,82 @@
import { useEffect, type ReactNode } from 'react'
import { X } from 'lucide-react'
import { cn } from '../../lib/utils'
const SIZES = {
md: 'max-w-xl',
lg: 'max-w-3xl',
xl: 'max-w-6xl',
}
export function Modal({
open,
onClose,
title,
subtitle,
size = 'md',
footer,
children,
bodyClassName,
}: {
open: boolean
onClose: () => void
title: ReactNode
subtitle?: ReactNode
size?: keyof typeof SIZES
footer?: ReactNode
children: ReactNode
bodyClassName?: string
}) {
useEffect(() => {
if (!open) return
const onKey = (event: KeyboardEvent) => {
if (event.key === 'Escape') onClose()
}
window.addEventListener('keydown', onKey)
const previous = document.body.style.overflow
document.body.style.overflow = 'hidden'
return () => {
window.removeEventListener('keydown', onKey)
document.body.style.overflow = previous
}
}, [open, onClose])
if (!open) return null
return (
<div className="fixed inset-0 z-50 flex items-center justify-center p-4">
<div className="absolute inset-0 bg-slate-900/40 backdrop-blur-[2px]" onClick={onClose} />
<div
role="dialog"
aria-modal="true"
className={cn(
'relative flex max-h-[calc(100vh-2rem)] w-full flex-col overflow-hidden rounded-2xl',
'border border-line bg-white shadow-2xl shadow-slate-900/20',
SIZES[size],
)}
>
<header className="flex items-start gap-3 border-b border-line px-5 py-4">
<div className="min-w-0 flex-1">
<h2 className="truncate text-[15px] font-semibold text-slate-900">{title}</h2>
{subtitle && <p className="mt-0.5 truncate text-xs text-slate-500">{subtitle}</p>}
</div>
<button
type="button"
onClick={onClose}
className="-mr-1 rounded-lg p-1.5 text-slate-400 transition hover:bg-slate-100 hover:text-slate-600"
aria-label="关闭"
>
<X className="size-4" />
</button>
</header>
<div className={cn('min-h-0 flex-1 overflow-auto px-5 py-4', bodyClassName)}>{children}</div>
{footer && (
<footer className="flex flex-wrap items-center justify-end gap-2 border-t border-line bg-slate-50/70 px-5 py-3">
{footer}
</footer>
)}
</div>
</div>
)
}
+68
View File
@@ -0,0 +1,68 @@
@import "tailwindcss";
@theme {
--font-sans: "Inter", "Segoe UI", -apple-system, BlinkMacSystemFont, "Microsoft YaHei", sans-serif;
--color-brand-50: #eef4ff;
--color-brand-100: #dbe7ff;
--color-brand-200: #bfd4ff;
--color-brand-500: #2f6bff;
--color-brand-600: #1f55e0;
--color-brand-700: #1a46bd;
--color-line: #e6eaf2;
}
@layer base {
html {
color-scheme: light;
scroll-behavior: smooth;
}
body {
@apply min-h-screen bg-[#f5f7fb] text-slate-900 antialiased;
font-family: var(--font-sans);
}
::selection {
background: rgb(47 107 255 / 0.18);
}
}
@layer utilities {
.scrollbar-thin {
scrollbar-width: thin;
scrollbar-color: #c9d2e3 transparent;
}
.scrollbar-thin::-webkit-scrollbar {
width: 6px;
height: 6px;
}
.scrollbar-thin::-webkit-scrollbar-thumb {
border-radius: 999px;
background: #c9d2e3;
}
.card-shadow {
box-shadow:
0 1px 2px rgb(16 24 40 / 0.04),
0 18px 36px -24px rgb(16 24 40 / 0.22);
}
.animate-toast-in {
animation: toast-in 0.24s cubic-bezier(0.2, 0.8, 0.2, 1);
}
}
@keyframes toast-in {
from {
opacity: 0;
transform: translate(-50%, 10px);
}
to {
opacity: 1;
transform: translate(-50%, 0);
}
}
+68
View File
@@ -0,0 +1,68 @@
export class ApiError extends Error {
offline = false
status?: number
code?: string
constructor(message: string, init: { offline?: boolean; status?: number; code?: string } = {}) {
super(message)
this.name = 'ApiError'
Object.assign(this, init)
}
}
export async function api<T = unknown>(path: string, init: RequestInit = {}): Promise<T> {
let res: Response
try {
res = await fetch(path, {
...init,
headers: { 'Content-Type': 'application/json', ...(init.headers || {}) },
})
} catch {
throw new ApiError('后端未连接', { offline: true })
}
if (res.status === 401) {
throw new ApiError('需要访问令牌:请用 /?token=<AUTH_TOKEN> 打开一次', { status: 401 })
}
if (!res.ok) throw new ApiError(`HTTP ${res.status}`, { status: res.status })
return (await res.json()) as T
}
export async function fetchSse(
path: string,
body: unknown,
onEvent: (event: Record<string, unknown>) => void,
): Promise<void> {
let res: Response
try {
res = await fetch(path, {
method: 'POST',
headers: { 'Content-Type': 'application/json' },
body: JSON.stringify(body),
})
} catch {
throw new ApiError('后端未连接', { offline: true })
}
if (res.status === 401) throw new ApiError('需要访问令牌:请用 /?token=<AUTH_TOKEN> 打开一次')
if (!res.ok) throw new ApiError(`HTTP ${res.status}`)
if (!res.body) throw new ApiError('浏览器不支持流式响应')
const reader = res.body.getReader()
const decoder = new TextDecoder()
let buffer = ''
for (;;) {
const { value, done } = await reader.read()
if (done) break
buffer += decoder.decode(value, { stream: true })
const chunks = buffer.split('\n\n')
buffer = chunks.pop() || ''
for (const chunk of chunks) {
const line = chunk.trim()
if (!line.startsWith('data:')) continue
try {
onEvent(JSON.parse(line.slice(5).trim()) as Record<string, unknown>)
} catch {
// 忽略坏行,下一批继续
}
}
}
}
+43
View File
@@ -0,0 +1,43 @@
import clsx, { type ClassValue } from 'clsx'
import type { Course } from '../types'
export const cn = (...values: ClassValue[]) => clsx(values)
export const inputCls =
'w-full rounded-lg border border-line bg-white px-3 py-2 text-[13px] text-slate-900 ' +
'placeholder:text-slate-400 transition focus:border-brand-500 focus:outline-none ' +
'focus:ring-3 focus:ring-brand-500/15 disabled:cursor-not-allowed disabled:bg-slate-50'
export function ageText(ts?: number): string {
if (!ts) return '—'
const minutes = Math.floor((Date.now() - ts) / 60000)
if (minutes < 1) return '刚刚'
if (minutes < 60) return `${minutes} 分钟前`
return `${Math.floor(minutes / 60)} 小时前`
}
export function countCourses(courses: Course[] = []): { total: number; studyable: number } {
return {
total: courses.length,
studyable: courses.filter((c) => c.in_study !== false).length,
}
}
export function splitKeys(value?: string): string[] {
return String(value || '')
.split('#')
.filter(Boolean)
}
export const TYPE_LABEL: Record<string, string> = {
'01': '单选',
'02': '多选',
'03': '判断',
'04': '问答',
}
export function toastMessage(error: unknown): string {
if (error instanceof Error) return error.message
return String(error)
}
+11
View File
@@ -0,0 +1,11 @@
import { StrictMode } from 'react'
import { createRoot } from 'react-dom/client'
import App from './App'
import './index.css'
createRoot(document.getElementById('root')!).render(
<StrictMode>
<App />
</StrictMode>,
)
+112
View File
@@ -0,0 +1,112 @@
export interface Cookie {
name: string
value: string
domain?: string
path?: string
}
export interface Course {
plan_id: string
project_id: string
name?: string
section?: string
status_label?: string
info?: string
progress?: string
in_study?: boolean
platform?: string
generation?: string
[key: string]: unknown
}
export interface RunState {
status?: string
total?: number
done?: number
course?: string
progress?: string
error?: string
mode?: string
parallel?: number
capturing?: boolean
capture_file?: string
cookies?: Cookie[]
[key: string]: unknown
}
export interface Account {
id: string
username: string
note?: string
user?: string
cookies: Cookie[]
courses: Course[]
selected: string[]
status?: string
lastError?: string
lastErrorAt?: number
optQuiz?: boolean
optFeedback?: boolean
loginAt?: number
created?: number
updated?: number
hasPassword?: boolean
run?: RunState | null
}
export interface PlatformInfo {
id: string
label: string
}
export interface LogResponse {
lines?: string[]
next?: number
status?: string
done?: number
total?: number
course?: string
progress?: string
cookies?: Cookie[]
}
export interface QuizOption {
key: string
text?: string
}
export interface QuizQuestion {
no: string
type?: string
title?: string
options?: QuizOption[]
picked?: string
correct?: string
is_correct?: boolean
analysis?: string
[key: string]: unknown
}
export interface QuizData {
ok: boolean
error?: string
code?: string
platform?: string
generation?: string
plan_id?: string
object_id?: string
result_id?: string
period_id?: string
title?: string
questions: QuizQuestion[]
done?: boolean
review?: boolean
show_answers?: boolean
can_retake?: boolean
surplus_exam_count?: number | null
allow_exam_count?: number | null
score?: number | string
started?: boolean
exam_after_watch_answer?: string
[key: string]: unknown
}
+20
View File
@@ -0,0 +1,20 @@
{
"compilerOptions": {
"target": "ES2022",
"useDefineForClassFields": true,
"lib": ["ES2022", "DOM", "DOM.Iterable"],
"module": "ESNext",
"skipLibCheck": true,
"moduleResolution": "bundler",
"allowImportingTsExtensions": true,
"resolveJsonModule": true,
"isolatedModules": true,
"noEmit": true,
"jsx": "react-jsx",
"strict": true,
"noUnusedLocals": false,
"noUnusedParameters": false,
"types": ["vite/client"]
},
"include": ["src"]
}
+19
View File
@@ -0,0 +1,19 @@
import { fileURLToPath } from 'node:url'
import { defineConfig } from 'vite'
import react from '@vitejs/plugin-react'
import tailwindcss from '@tailwindcss/vite'
// 构建产物直接写进仓库根的 static/,FastAPI 原样托管;开发时用 vite 代理 /api。
export default defineConfig({
plugins: [react(), tailwindcss()],
build: {
outDir: fileURLToPath(new URL('../static', import.meta.url)),
emptyOutDir: true,
},
server: {
port: 5173,
proxy: {
'/api': 'http://127.0.0.1:8848',
},
},
})