清理迁移残留与历史方案文档
This commit is contained in:
parent
f3b4641010
commit
995be07b83
@ -1,391 +0,0 @@
|
||||
# TUS 协议迁移方案文档
|
||||
|
||||
> **状态**:已规划,暂不实施
|
||||
> **原因**:优先采用方案A(优化当前方案),TUS作为长期备选方案
|
||||
|
||||
---
|
||||
|
||||
## 📋 文档概述
|
||||
|
||||
本文档记录了 TUS 协议迁移的完整技术方案,作为未来系统升级的参考。
|
||||
|
||||
**核心原则**:
|
||||
- ✅ 零新增环境变量(复用现有配置)
|
||||
- ✅ 零新增 Docker 依赖
|
||||
- ✅ 渐进式迁移(保留回滚方案)
|
||||
- ✅ 一次性成功,避免返工
|
||||
|
||||
---
|
||||
|
||||
## 🎯 TUS 协议简介
|
||||
|
||||
### 什么是 TUS
|
||||
|
||||
**TUS(Tus Upload System)** 是一个基于 HTTP 的**可断点续传上传协议**,专门设计用于解决大文件上传的可靠性问题。
|
||||
|
||||
### 核心特性
|
||||
|
||||
| 特性 | 说明 |
|
||||
|------|------|
|
||||
| **断点续传** | 上传中断后可从断点继续,无需重新上传 |
|
||||
| **开放标准** | RFC 协议规范,跨平台互操作性 |
|
||||
| **可扩展性** | 支持多种扩展(校验、过期、终止等) |
|
||||
| **标准化实现** | 官方提供多语言客户端和服务端库 |
|
||||
|
||||
### 工作流程
|
||||
|
||||
```
|
||||
1. POST /files
|
||||
→ 创建上传会话
|
||||
→ 返回: 201 Created
|
||||
→ Header: Location: /files/abc123
|
||||
|
||||
2. PATCH /files/abc123
|
||||
→ Header: Upload-Offset: 0
|
||||
→ Header: Content-Type: application/offset+octet-stream
|
||||
→ Body: [前50MB数据]
|
||||
→ 返回: 204 No Content
|
||||
→ Header: Upload-Offset: 52428800 (50MB)
|
||||
|
||||
3. 重复步骤2直到上传完成
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 📊 方案对比分析
|
||||
|
||||
### 方案A(已实施)vs 方案B(TUS)
|
||||
|
||||
| 维度 | 方案A(优化当前方案) | 方案B(TUS协议) |
|
||||
|------|---------------------|----------------|
|
||||
| **开发周期** | ✅ 1天完成 | ⚠️ 5-7天 |
|
||||
| **测试周期** | ✅ 已验证 | ⚠️ 3-5天 |
|
||||
| **配置风险** | ✅ 零新增变量 | ⚠️ 需要5+个新变量 |
|
||||
| **兼容性** | ✅ 100%向后兼容 | ⚠️ 需客户端升级 |
|
||||
| **代码量** | ✅ 100行 | ⚠️ 需重写2000+行 |
|
||||
| **维护成本** | ✅ 低(熟悉代码) | ⚠️ 中(新协议) |
|
||||
| **标准化** | ❌ 自定义 | ✅ RFC标准 |
|
||||
| **跨平台** | ❌ 需自己实现客户端 | ✅ 官方库支持 |
|
||||
|
||||
### 性能对比
|
||||
|
||||
| 指标 | 方案A | 方案B |
|
||||
|------|-------|-------|
|
||||
| **分片大小** | 50MB | 可配置(推荐50MB) |
|
||||
| **并发上传** | 2-3并发 | 原生支持 |
|
||||
| **断点续传** | ✅ 自定义实现 | ✅ 协议级支持 |
|
||||
| **请求数(1GB)** | 20个 | 20个 |
|
||||
| **网络开销** | 低 | 低 |
|
||||
|
||||
### 结论
|
||||
|
||||
**短期(当前)**:采用方案A
|
||||
- ✅ 立即见效
|
||||
- ✅ 零风险
|
||||
- ✅ 已完成部署
|
||||
|
||||
**长期(未来)**:评估是否迁移到TUS
|
||||
- 需要跨平台客户端支持时
|
||||
- 需要标准化协议时
|
||||
- 有充足开发和测试时间时
|
||||
|
||||
---
|
||||
|
||||
## 🚀 TUS 迁移方案(预留)
|
||||
|
||||
### 技术选型
|
||||
|
||||
#### 服务端:@tus/server
|
||||
|
||||
```json
|
||||
{
|
||||
"dependencies": {
|
||||
"@tus/server": "^2.3.0",
|
||||
"@tus/file-store": "^1.0.0"
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
#### 客户端:tus-js-client
|
||||
|
||||
```json
|
||||
{
|
||||
"dependencies": {
|
||||
"tus-js-client": "^3.0.0"
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
### 零配置迁移策略
|
||||
|
||||
#### 原则:复用现有配置
|
||||
|
||||
**❌ 不推荐**:新增大量环境变量
|
||||
|
||||
```env
|
||||
# 不推荐这样做!
|
||||
TUS_MAX_FILE_SIZE=107374182400
|
||||
TUS_UPLOAD_DIR=/app/uploads/tus
|
||||
TUS_LOCK_STORAGE=redis
|
||||
TUS_REDIS_PREFIX=tus:lock:
|
||||
TUS_LOCK_TIMEOUT=3600
|
||||
```
|
||||
|
||||
**✅ 推荐**:复用现有配置
|
||||
|
||||
```typescript
|
||||
// lib/tus-config.ts
|
||||
export const TUS_CONFIG = {
|
||||
// 复用现有UPLOAD_DIR
|
||||
uploadDir: process.env.UPLOAD_DIR || './uploads',
|
||||
|
||||
// 复用现有REDIS_URL
|
||||
redisUrl: process.env.REDIS_URL,
|
||||
|
||||
// 固定配置(无需环境变量)
|
||||
maxSize: 100 * 1024 * 1024 * 1024, // 100GB
|
||||
chunkSize: 50 * 1024 * 1024, // 50MB
|
||||
}
|
||||
```
|
||||
|
||||
### API 设计
|
||||
|
||||
#### 路由结构
|
||||
|
||||
```
|
||||
app/api/files/
|
||||
├── route.ts # TUS主端点
|
||||
└── [fileId]/
|
||||
└── route.ts # TUS文件操作
|
||||
```
|
||||
|
||||
#### 端点实现
|
||||
|
||||
```typescript
|
||||
// app/api/files/route.ts
|
||||
import { Server } from '@tus/server'
|
||||
import { FileStore } from '@tus/file-store'
|
||||
|
||||
// 创建TUS服务器实例(复用现有配置)
|
||||
const tusServer = new Server({
|
||||
path: '/api/files',
|
||||
datastore: new FileStore({
|
||||
directory: process.env.UPLOAD_DIR || './uploads',
|
||||
}),
|
||||
})
|
||||
|
||||
// 导出处理器
|
||||
export const runtime = 'nodejs'
|
||||
export const dynamic = 'force-dynamic'
|
||||
|
||||
export async function POST(req: Request) {
|
||||
return tusServer.handle(req)
|
||||
}
|
||||
|
||||
export async function OPTIONS(req: Request) {
|
||||
return tusServer.handle(req)
|
||||
}
|
||||
```
|
||||
|
||||
### 渐进式迁移方案
|
||||
|
||||
#### 阶段1:双模式运行(1-2周)
|
||||
|
||||
```typescript
|
||||
// components/UploadModal.tsx
|
||||
const USE_TUS = process.env.NEXT_PUBLIC_ENABLE_TUS === 'true'
|
||||
|
||||
export function UploadModal() {
|
||||
if (USE_TUS) {
|
||||
return <TusUpload />
|
||||
}
|
||||
return <ChunkUpload />
|
||||
}
|
||||
```
|
||||
|
||||
#### 阶段2:灰度发布(2-4周)
|
||||
|
||||
```typescript
|
||||
// 10% 用户使用TUS
|
||||
const USE_TUS = Math.random() < 0.1
|
||||
|
||||
// 监控错误率和性能
|
||||
// 逐步提升到50%、100%
|
||||
```
|
||||
|
||||
#### 阶段3:全量切换(1-2月)
|
||||
|
||||
- 所有用户使用TUS
|
||||
- 保留旧代码1个月作为回滚
|
||||
- 确认稳定后删除旧代码
|
||||
|
||||
---
|
||||
|
||||
## ⚠️ 风险预防
|
||||
|
||||
### 避免Redis配置问题
|
||||
|
||||
#### 历史教训
|
||||
|
||||
```typescript
|
||||
// ❌ 错误:独立配置Redis连接
|
||||
const tusRedis = new Redis(process.env.TUS_REDIS_URL, {
|
||||
// 新的配置,可能出错
|
||||
})
|
||||
|
||||
// ✅ 正确:复用现有Redis实例
|
||||
import { redis } from '@/lib/upload-sessions-redis'
|
||||
|
||||
export class TusDataStore {
|
||||
constructor() {
|
||||
this.redis = redis // 复用现有连接
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
### 避免Docker配置问题
|
||||
|
||||
#### ❌ 不推荐:修改Docker配置
|
||||
|
||||
```yaml
|
||||
# docker-compose.yml
|
||||
services:
|
||||
app:
|
||||
environment:
|
||||
# 新增5+个环境变量
|
||||
- TUS_MAX_FILE_SIZE=107374182400
|
||||
- TUS_UPLOAD_DIR=/app/uploads/tus
|
||||
- TUS_LOCK_STORAGE=redis
|
||||
# ...
|
||||
```
|
||||
|
||||
#### ✅ 推荐:使用默认值
|
||||
|
||||
```typescript
|
||||
// lib/tus-config.ts
|
||||
export const TUS_CONFIG = {
|
||||
// 使用现有环境变量或默认值
|
||||
uploadDir: process.env.UPLOAD_DIR || './uploads',
|
||||
|
||||
// 硬编码配置(无需环境变量)
|
||||
maxSize: 100 * 1024 * 1024 * 1024, // 100GB
|
||||
chunkSize: 50 * 1024 * 1024, // 50MB
|
||||
expirationPeriodInMs: 24 * 60 * 60 * 1000, // 24小时
|
||||
}
|
||||
```
|
||||
|
||||
### 错误处理与降级
|
||||
|
||||
```typescript
|
||||
// lib/tus-server.ts
|
||||
export async function initTusServer() {
|
||||
try {
|
||||
const tusServer = new Server({
|
||||
datastore: new FileStore({
|
||||
directory: TUS_CONFIG.uploadDir,
|
||||
}),
|
||||
})
|
||||
|
||||
// 验证配置
|
||||
await validateTusConfig()
|
||||
|
||||
return tusServer
|
||||
} catch (error) {
|
||||
console.error('[TUS] 初始化失败,降级到传统上传:', error)
|
||||
return null // 降级到传统上传
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 📋 实施清单
|
||||
|
||||
### 前置条件
|
||||
|
||||
- [ ] 充足的开发时间(1-2周)
|
||||
- [ ] 充足的测试时间(1-2周)
|
||||
- [ ] 跨平台客户端需求明确
|
||||
- [ ] 团队完成TUS协议培训
|
||||
|
||||
### 开发阶段
|
||||
|
||||
- [ ] 安装依赖包(@tus/server, tus-js-client)
|
||||
- [ ] 实现TUS服务端(/api/files)
|
||||
- [ ] 实现TUS客户端组件
|
||||
- [ ] 实现降级机制
|
||||
|
||||
### 测试阶段
|
||||
|
||||
- [ ] 单元测试(TUS协议)
|
||||
- [ ] 集成测试(与现有系统)
|
||||
- [ ] 性能测试(对比方案A)
|
||||
- [ ] 压力测试(并发上传)
|
||||
- [ ] 兼容性测试(各浏览器)
|
||||
|
||||
### 部署阶段
|
||||
|
||||
- [ ] 影子环境部署
|
||||
- [ ] 10% 灰度发布
|
||||
- [ ] 50% 灰度发布
|
||||
- [ ] 100% 全量发布
|
||||
- [ ] 监控关键指标
|
||||
|
||||
---
|
||||
|
||||
## 🎯 触发条件
|
||||
|
||||
**建议在以下情况下考虑迁移**:
|
||||
|
||||
1. **需要跨平台客户端**
|
||||
- iOS、Android、桌面应用等
|
||||
- TUS有官方库支持
|
||||
|
||||
2. **需要标准化协议**
|
||||
- 与第三方系统集成
|
||||
- 需要遵循RFC标准
|
||||
|
||||
3. **有充足的开发时间**
|
||||
- 当前系统稳定运行
|
||||
- 有1-2个月的迁移窗口
|
||||
|
||||
4. **方案A遇到瓶颈**
|
||||
- 当前方案无法满足需求
|
||||
- 需要TUS的特定特性
|
||||
|
||||
---
|
||||
|
||||
## 📚 参考资料
|
||||
|
||||
### 官方资源
|
||||
|
||||
- [TUS 协议官网](https://tus.io/)
|
||||
- [TUS 协议规范](https://tus.io/protocols/resumable-upload.html)
|
||||
- [TUS Node.js Server](https://github.com/tus/tus-node-server)
|
||||
- [TUS JavaScript Client](https://github.com/tus/tus-js-client)
|
||||
|
||||
### NPM 包
|
||||
|
||||
- `@tus/server`: 服务端实现
|
||||
- `@tus/file-store`: 文件系统存储
|
||||
- `@tus/s3-store`: AWS S3 存储
|
||||
- `tus-js-client`: 客户端库
|
||||
|
||||
### 社区实践
|
||||
|
||||
- [NextJS-TUS 示例项目](https://github.com/zacheryvaughn/NextJS-TUS)
|
||||
- [Designing a High-Load File Upload System with TUS](https://ductruong.com/en/blog/2024/05/designing-a-high-load-file-upload-system-with-the-tus-protocol/)
|
||||
|
||||
---
|
||||
|
||||
## 📝 版本历史
|
||||
|
||||
| 版本 | 日期 | 说明 |
|
||||
|------|------|------|
|
||||
| v1.0 | 2026-01-27 | 初始版本,基于方案A的研究分析 |
|
||||
|
||||
---
|
||||
|
||||
**最后更新**:2026-01-27
|
||||
**状态**:已规划,暂不实施
|
||||
**优先级**:低(方案A已满足需求)
|
||||
@ -1,519 +0,0 @@
|
||||
# 由壹点3D素材 - 公网部署方案(frp 内网穿透)
|
||||
|
||||
## 方案概述
|
||||
|
||||
通过 frp 内网穿透实现公网环境下的远程构建和部署,无需 VPN,随时随地都能部署。
|
||||
|
||||
### 架构图
|
||||
|
||||
```
|
||||
你的电脑(公网任意位置)
|
||||
↓
|
||||
↓ SSH over frp (端口 2222)
|
||||
↓
|
||||
公网服务器(frp 服务端)
|
||||
↓
|
||||
↓ frp tunnel
|
||||
↓
|
||||
构建机 192.168.42.134(frp 客户端)
|
||||
├─ Docker Registry (端口 5000)
|
||||
├─ Registry UI (端口 5001)
|
||||
└─ 构建镜像
|
||||
↓
|
||||
↓ 内网直连
|
||||
↓
|
||||
生产服务器 192.168.58.20
|
||||
└─ 部署容器
|
||||
```
|
||||
|
||||
### 核心优势
|
||||
|
||||
1. **公网随时部署**:在家、咖啡厅、出差都能部署
|
||||
2. **带宽友好**:
|
||||
- 代码传输:1-5MB(增量)
|
||||
- SSH 操作:<1Mbps
|
||||
- 镜像构建:在构建机本地,不占公网带宽
|
||||
- 镜像传输:走内网,不占公网带宽
|
||||
3. **可视化管理**:Web UI 查看镜像列表
|
||||
4. **自动清理**:保持构建机干净整洁
|
||||
|
||||
---
|
||||
|
||||
## 一、环境准备
|
||||
|
||||
### 1.1 公网服务器(frp 服务端)
|
||||
|
||||
**要求**:
|
||||
- 有公网 IP 或域名
|
||||
- 开放端口:7000(frp)、2222(SSH)、5000(Registry)、5001(Registry UI)
|
||||
- 系统:Linux(Ubuntu/CentOS 均可)
|
||||
- 带宽:家庭宽带 100M 即可
|
||||
|
||||
**示例配置**(请替换为你的实际信息):
|
||||
```
|
||||
IP/域名:your-server.com
|
||||
SSH端口:22
|
||||
用户名:root
|
||||
```
|
||||
|
||||
### 1.2 构建机(frp 客户端)
|
||||
|
||||
**已知信息**:
|
||||
```
|
||||
IP:192.168.42.134
|
||||
用户:root
|
||||
密码:Jsjj@8888
|
||||
系统:Ubuntu
|
||||
```
|
||||
|
||||
### 1.3 生产服务器
|
||||
|
||||
**已知信息**:
|
||||
```
|
||||
IP:192.168.58.20
|
||||
用户:root
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 二、frp 服务端配置(公网服务器)
|
||||
|
||||
### 2.1 安装 frp
|
||||
|
||||
```bash
|
||||
# SSH 登录公网服务器
|
||||
ssh root@your-server.com
|
||||
|
||||
# 下载 frp(选择最新版本)
|
||||
cd /opt
|
||||
wget https://github.com/fatedier/frp/releases/download/v0.52.3/frp_0.52.3_linux_amd64.tar.gz
|
||||
tar -xzf frp_0.52.3_linux_amd64.tar.gz
|
||||
mv frp_0.52.3_linux_amd64 frp
|
||||
cd frp
|
||||
```
|
||||
|
||||
### 2.2 配置 frps.toml
|
||||
|
||||
```bash
|
||||
cat > frps.toml << 'EOF'
|
||||
# frp 服务端配置
|
||||
bindPort = 7000
|
||||
# 认证令牌(请修改为复杂密码)
|
||||
auth.token = "your-secure-token-change-this"
|
||||
|
||||
# Web 管理界面(可选)
|
||||
webServer.addr = "0.0.0.0"
|
||||
webServer.port = 7500
|
||||
webServer.user = "admin"
|
||||
webServer.password = "admin123"
|
||||
|
||||
# 日志配置
|
||||
log.to = "/var/log/frps.log"
|
||||
log.level = "info"
|
||||
log.maxDays = 3
|
||||
EOF
|
||||
```
|
||||
|
||||
### 2.3 创建 systemd 服务
|
||||
|
||||
```bash
|
||||
cat > /etc/systemd/system/frps.service << 'EOF'
|
||||
[Unit]
|
||||
Description=frp server
|
||||
After=network.target
|
||||
|
||||
[Service]
|
||||
Type=simple
|
||||
User=root
|
||||
Restart=on-failure
|
||||
RestartSec=5s
|
||||
ExecStart=/opt/frp/frps -c /opt/frp/frps.toml
|
||||
|
||||
[Install]
|
||||
WantedBy=multi-user.target
|
||||
EOF
|
||||
|
||||
# 启动服务
|
||||
systemctl daemon-reload
|
||||
systemctl enable frps
|
||||
systemctl start frps
|
||||
systemctl status frps
|
||||
```
|
||||
|
||||
### 2.4 开放防火墙端口
|
||||
|
||||
```bash
|
||||
# Ubuntu/Debian
|
||||
ufw allow 7000/tcp
|
||||
ufw allow 2222/tcp
|
||||
ufw allow 5000/tcp
|
||||
ufw allow 5001/tcp
|
||||
ufw allow 7500/tcp
|
||||
|
||||
# CentOS/RHEL
|
||||
firewall-cmd --permanent --add-port=7000/tcp
|
||||
firewall-cmd --permanent --add-port=2222/tcp
|
||||
firewall-cmd --permanent --add-port=5000/tcp
|
||||
firewall-cmd --permanent --add-port=5001/tcp
|
||||
firewall-cmd --permanent --add-port=7500/tcp
|
||||
firewall-cmd --reload
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 三、构建机配置(frp 客户端 + Registry)
|
||||
|
||||
### 3.1 安装 frp 客户端
|
||||
|
||||
```bash
|
||||
# SSH 登录构建机(内网)
|
||||
ssh root@192.168.42.134
|
||||
|
||||
# 下载 frp
|
||||
cd /opt
|
||||
wget https://github.com/fatedier/frp/releases/download/v0.52.3/frp_0.52.3_linux_amd64.tar.gz
|
||||
tar -xzf frp_0.52.3_linux_amd64.tar.gz
|
||||
mv frp_0.52.3_linux_amd64 frp
|
||||
cd frp
|
||||
```
|
||||
|
||||
### 3.2 配置 frpc.toml
|
||||
|
||||
```bash
|
||||
cat > frpc.toml << 'EOF'
|
||||
# frp 客户端配置
|
||||
serverAddr = "your-server.com" # 替换为你的公网服务器地址
|
||||
serverPort = 7000
|
||||
auth.token = "your-secure-token-change-this" # 与服务端保持一致
|
||||
|
||||
# SSH 穿透
|
||||
[[proxies]]
|
||||
name = "ssh"
|
||||
type = "tcp"
|
||||
localIP = "127.0.0.1"
|
||||
localPort = 22
|
||||
remotePort = 2222
|
||||
|
||||
# Docker Registry 穿透
|
||||
[[proxies]]
|
||||
name = "registry"
|
||||
type = "tcp"
|
||||
localIP = "127.0.0.1"
|
||||
localPort = 5000
|
||||
remotePort = 5000
|
||||
|
||||
# Registry UI 穿透
|
||||
[[proxies]]
|
||||
name = "registry-ui"
|
||||
type = "tcp"
|
||||
localIP = "127.0.0.1"
|
||||
localPort = 5001
|
||||
remotePort = 5001
|
||||
|
||||
# 日志配置
|
||||
log.to = "/var/log/frpc.log"
|
||||
log.level = "info"
|
||||
log.maxDays = 3
|
||||
EOF
|
||||
```
|
||||
|
||||
### 3.3 创建 systemd 服务
|
||||
|
||||
```bash
|
||||
cat > /etc/systemd/system/frpc.service << 'EOF'
|
||||
[Unit]
|
||||
Description=frp client
|
||||
After=network.target
|
||||
|
||||
[Service]
|
||||
Type=simple
|
||||
User=root
|
||||
Restart=on-failure
|
||||
RestartSec=5s
|
||||
ExecStart=/opt/frp/frpc -c /opt/frp/frpc.toml
|
||||
|
||||
[Install]
|
||||
WantedBy=multi-user.target
|
||||
EOF
|
||||
|
||||
# 启动服务
|
||||
systemctl daemon-reload
|
||||
systemctl enable frpc
|
||||
systemctl start frpc
|
||||
systemctl status frpc
|
||||
```
|
||||
|
||||
### 3.4 安装 Docker Registry + UI
|
||||
|
||||
```bash
|
||||
# 创建目录
|
||||
mkdir -p /opt/docker-registry/{data,config}
|
||||
|
||||
# 创建 docker-compose.yml
|
||||
cat > /opt/docker-registry/docker-compose.yml << 'EOF'
|
||||
version: '3.8'
|
||||
|
||||
services:
|
||||
registry:
|
||||
image: registry:2
|
||||
container_name: docker-registry
|
||||
restart: always
|
||||
ports:
|
||||
- "5000:5000"
|
||||
environment:
|
||||
REGISTRY_STORAGE_DELETE_ENABLED: "true"
|
||||
volumes:
|
||||
- ./data:/var/lib/registry
|
||||
networks:
|
||||
- registry-net
|
||||
|
||||
ui:
|
||||
image: joxit/docker-registry-ui:latest
|
||||
container_name: docker-registry-ui
|
||||
restart: always
|
||||
ports:
|
||||
- "5001:80"
|
||||
environment:
|
||||
- SINGLE_REGISTRY=true
|
||||
- REGISTRY_TITLE=由壹点3D素材 - 镜像仓库
|
||||
- DELETE_IMAGES=true
|
||||
- SHOW_CONTENT_DIGEST=true
|
||||
- NGINX_PROXY_PASS_URL=http://registry:5000
|
||||
- SHOW_CATALOG_NB_TAGS=true
|
||||
- CATALOG_MIN_BRANCHES=1
|
||||
- CATALOG_MAX_BRANCHES=1
|
||||
- TAGLIST_PAGE_SIZE=100
|
||||
- REGISTRY_SECURED=false
|
||||
- CATALOG_ELEMENTS_LIMIT=1000
|
||||
depends_on:
|
||||
- registry
|
||||
networks:
|
||||
- registry-net
|
||||
|
||||
networks:
|
||||
registry-net:
|
||||
driver: bridge
|
||||
EOF
|
||||
|
||||
# 启动 Registry
|
||||
cd /opt/docker-registry
|
||||
docker-compose up -d
|
||||
|
||||
# 检查状态
|
||||
docker-compose ps
|
||||
```
|
||||
|
||||
### 3.5 验证 Registry
|
||||
|
||||
```bash
|
||||
# 测试 Registry API
|
||||
curl http://localhost:5000/v2/_catalog
|
||||
|
||||
# 测试 UI(在浏览器中访问)
|
||||
# http://localhost:5001
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 四、本地电脑配置(PowerShell 脚本)
|
||||
|
||||
### 4.1 测试 frp 连接
|
||||
|
||||
```powershell
|
||||
# 测试 SSH 穿透(通过公网服务器连接构建机)
|
||||
ssh -p 2222 root@your-server.com
|
||||
|
||||
# 如果连接成功,说明 frp 配置正确
|
||||
```
|
||||
|
||||
### 4.2 配置 SSH 密钥(可选,避免每次输入密码)
|
||||
|
||||
```powershell
|
||||
# 生成 SSH 密钥(如果没有)
|
||||
ssh-keygen -t rsa -b 4096 -C "your-email@example.com"
|
||||
|
||||
# 复制公钥到构建机
|
||||
ssh-copy-id -p 2222 root@your-server.com
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 五、部署脚本(deploy-public-build.ps1)
|
||||
|
||||
这个脚本会在下一步创建,功能包括:
|
||||
|
||||
1. 通过 frp 连接构建机
|
||||
2. 同步代码到构建机
|
||||
3. 在构建机上构建镜像
|
||||
4. 推送镜像到本地 Registry
|
||||
5. 从 Registry 拉取镜像到生产服务器
|
||||
6. 启动容器
|
||||
7. 自动清理旧镜像
|
||||
|
||||
---
|
||||
|
||||
## 六、使用流程
|
||||
|
||||
### 6.1 日常部署
|
||||
|
||||
```powershell
|
||||
# 在你的电脑上(任意公网位置)
|
||||
.\deploy-public-build.ps1 -Target production
|
||||
|
||||
# 部署到影子系统
|
||||
.\deploy-public-build.ps1 -Target shadow
|
||||
```
|
||||
|
||||
### 6.2 查看镜像(Web UI)
|
||||
|
||||
浏览器访问:`http://your-server.com:5001`
|
||||
|
||||
可以看到:
|
||||
- 所有镜像列表
|
||||
- 镜像标签(版本)
|
||||
- 镜像大小
|
||||
- 创建时间
|
||||
- 删除镜像(点击删除按钮)
|
||||
|
||||
### 6.3 手动清理镜像
|
||||
|
||||
```powershell
|
||||
# SSH 到构建机
|
||||
ssh -p 2222 root@your-server.com
|
||||
|
||||
# 清理 Docker 缓存
|
||||
docker system prune -af --volumes
|
||||
|
||||
# 清理 Registry 旧镜像(保留最近 5 个版本)
|
||||
cd /opt/docker-registry
|
||||
docker exec docker-registry registry garbage-collect /etc/docker/registry/config.yml
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 七、故障排查
|
||||
|
||||
### 7.1 frp 连接失败
|
||||
|
||||
```bash
|
||||
# 检查服务端状态
|
||||
systemctl status frps
|
||||
journalctl -u frps -f
|
||||
|
||||
# 检查客户端状态
|
||||
ssh root@192.168.42.134
|
||||
systemctl status frpc
|
||||
journalctl -u frpc -f
|
||||
|
||||
# 检查端口是否开放
|
||||
telnet your-server.com 7000
|
||||
```
|
||||
|
||||
### 7.2 Registry 无法访问
|
||||
|
||||
```bash
|
||||
# 检查 Registry 状态
|
||||
ssh -p 2222 root@your-server.com
|
||||
cd /opt/docker-registry
|
||||
docker-compose ps
|
||||
docker-compose logs -f
|
||||
|
||||
# 检查端口
|
||||
curl http://localhost:5000/v2/_catalog
|
||||
```
|
||||
|
||||
### 7.3 镜像推送失败
|
||||
|
||||
```bash
|
||||
# 检查 Registry 配置
|
||||
docker info | grep Registry
|
||||
|
||||
# 手动推送测试
|
||||
docker tag youyidian-3d-material:latest localhost:5000/youyidian-3d-material:latest
|
||||
docker push localhost:5000/youyidian-3d-material:latest
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 八、安全建议
|
||||
|
||||
1. **修改默认密码**:
|
||||
- frp token
|
||||
- Registry UI 密码(如果启用认证)
|
||||
|
||||
2. **使用 HTTPS**(生产环境推荐):
|
||||
- 为 Registry 配置 SSL 证书
|
||||
- 使用 Nginx 反向代理
|
||||
|
||||
3. **限制访问**:
|
||||
- 使用防火墙限制 Registry 端口只允许内网访问
|
||||
- frp 只开放必要的端口
|
||||
|
||||
4. **定期备份**:
|
||||
- Registry 数据目录:`/opt/docker-registry/data`
|
||||
- 构建缓存:`/opt/youyidian-3d-build`
|
||||
|
||||
---
|
||||
|
||||
## 九、性能优化
|
||||
|
||||
### 9.1 构建缓存
|
||||
|
||||
```bash
|
||||
# 在构建机上配置 Docker BuildKit 缓存
|
||||
export DOCKER_BUILDKIT=1
|
||||
export BUILDKIT_PROGRESS=plain
|
||||
|
||||
# 使用缓存挂载加速构建
|
||||
docker build --cache-from localhost:5000/youyidian-3d-material:latest .
|
||||
```
|
||||
|
||||
### 9.2 Registry 存储优化
|
||||
|
||||
```bash
|
||||
# 定期清理未使用的镜像层
|
||||
docker exec docker-registry registry garbage-collect /etc/docker/registry/config.yml
|
||||
|
||||
# 压缩 Registry 数据
|
||||
cd /opt/docker-registry/data
|
||||
tar -czf registry-backup-$(date +%Y%m%d).tar.gz docker/
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 十、成本分析
|
||||
|
||||
### 10.1 带宽消耗(每次部署)
|
||||
|
||||
- 代码同步:1-5MB(增量)
|
||||
- SSH 操作:<1MB
|
||||
- Registry UI 访问:<1MB
|
||||
- **总计**:<10MB/次
|
||||
|
||||
### 10.2 时间消耗(每次部署)
|
||||
|
||||
- 代码同步:10-30秒
|
||||
- 镜像构建:1-3分钟(首次更长)
|
||||
- 镜像传输:30-60秒(内网)
|
||||
- 容器启动:10-20秒
|
||||
- **总计**:2-5分钟/次
|
||||
|
||||
---
|
||||
|
||||
## 十一、下一步
|
||||
|
||||
1. 根据你的实际情况修改配置文件中的:
|
||||
- `your-server.com` → 你的公网服务器地址
|
||||
- `your-secure-token-change-this` → 你的 frp 认证令牌
|
||||
|
||||
2. 按照步骤二、三配置 frp 服务端和客户端
|
||||
|
||||
3. 运行 `deploy-public-build.ps1` 脚本进行部署
|
||||
|
||||
4. 访问 Registry UI 查看镜像
|
||||
|
||||
---
|
||||
|
||||
**文档版本**:v1.0
|
||||
**更新时间**:2025-01-17
|
||||
**维护人员**:开发团队
|
||||
@ -1,389 +0,0 @@
|
||||
# 内外网统一访问和钉钉登录方案
|
||||
|
||||
**目标**: 实现内网用户和外网用户统一访问 `https://3d.yydd.ai`,内网走内网,外网走外网,钉钉登录正常工作
|
||||
|
||||
**更新时间**: 2026-01-05
|
||||
|
||||
---
|
||||
|
||||
## 📊 方案概述
|
||||
|
||||
### 核心原理
|
||||
|
||||
使用统一域名 `https://3d.yydd.ai`,通过DNS解析区分内网和外网:
|
||||
|
||||
- **内网用户**: DNS解析到内网IP (`192.168.58.20`) → 直接内网访问(速度快)
|
||||
- **外网用户**: DNS解析到公网IP (`180.97.221.140`) → 通过FRP转发(正常访问)
|
||||
- **钉钉回调**: 公网DNS解析到公网IP → 通过FRP转发 → 正常工作
|
||||
|
||||
### 网络架构
|
||||
|
||||
```
|
||||
【内网用户访问流程】
|
||||
内网用户 → 内网DNS解析 → 3d.yydd.ai → 192.168.58.20 → 内网服务器Nginx → 应用(4320端口)
|
||||
✅ 直接内网访问,速度快
|
||||
|
||||
【外网用户访问流程】
|
||||
外网用户 → 公网DNS解析 → 3d.yydd.ai → 180.97.221.140 → FRP服务器Nginx → FRP隧道(2320端口) → 内网应用(4320端口)
|
||||
✅ 通过FRP转发,正常访问
|
||||
|
||||
【钉钉回调流程】
|
||||
钉钉服务器 → 公网DNS解析 → 3d.yydd.ai → 180.97.221.140 → FRP转发 → 内网服务器
|
||||
✅ 钉钉回调正常工作
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## ✅ 已完成的配置
|
||||
|
||||
### 1. 服务器配置
|
||||
|
||||
- ✅ **内网服务器Nginx**: 已配置 `3d.yydd.ai` 域名,支持HTTPS(443端口)
|
||||
- ✅ **FRP服务器Nginx**: 已配置 `3d.yydd.ai` 域名,支持HTTPS(443端口)
|
||||
- ✅ **FRP隧道**: 已配置,公网2320端口转发到内网4320端口
|
||||
- ✅ **应用代码**: 已实现统一域名方案和智能URL重写
|
||||
|
||||
### 2. 代码实现
|
||||
|
||||
- ✅ **钉钉回调地址**: 统一使用 `https://3d.yydd.ai/dingtalk-callback`
|
||||
- ✅ **智能URL重写**: 根据用户网络位置自动选择资源地址
|
||||
- ✅ **网络检测**: 自动检测用户是否在内网
|
||||
|
||||
---
|
||||
|
||||
## 🔧 DNS配置方案
|
||||
|
||||
### 方案1: hosts文件配置(最安全,推荐)⭐⭐⭐⭐⭐
|
||||
|
||||
**适用场景**: 只有少数几台电脑需要访问,或网管不允许修改路由器/DNS服务器
|
||||
|
||||
**优点**:
|
||||
- ✅ 不需要修改路由器或DNS服务器
|
||||
- ✅ 完全可控,不影响其他设备
|
||||
- ✅ 没有网络层风险
|
||||
- ✅ 网管可以接受
|
||||
|
||||
**配置步骤**:
|
||||
|
||||
#### Windows电脑
|
||||
|
||||
1. **以管理员身份打开记事本**
|
||||
- 右键 "记事本" → 以管理员身份运行
|
||||
|
||||
2. **打开hosts文件**
|
||||
- 文件 → 打开
|
||||
- 路径: `C:\Windows\System32\drivers\etc\hosts`
|
||||
- 文件类型: 选择 "所有文件"
|
||||
|
||||
3. **添加记录**
|
||||
```
|
||||
192.168.58.20 3d.yydd.ai
|
||||
```
|
||||
|
||||
4. **保存文件**
|
||||
|
||||
5. **清除DNS缓存**
|
||||
```cmd
|
||||
ipconfig /flushdns
|
||||
```
|
||||
|
||||
#### Linux/Mac电脑
|
||||
|
||||
1. **编辑hosts文件**
|
||||
```bash
|
||||
sudo nano /etc/hosts
|
||||
```
|
||||
|
||||
2. **添加记录**
|
||||
```
|
||||
192.168.58.20 3d.yydd.ai
|
||||
```
|
||||
|
||||
3. **保存文件**(Ctrl+O, Enter, Ctrl+X)
|
||||
|
||||
4. **清除DNS缓存**(如果需要)
|
||||
```bash
|
||||
# Linux (systemd-resolved)
|
||||
sudo systemd-resolve --flush-caches
|
||||
|
||||
# Mac
|
||||
sudo dscacheutil -flushcache
|
||||
```
|
||||
|
||||
**验证**:
|
||||
```bash
|
||||
nslookup 3d.yydd.ai
|
||||
# 应该返回: 192.168.58.20
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
### 方案2: 内网DNS服务器配置(如果网管同意)⭐⭐⭐⭐
|
||||
|
||||
**适用场景**: 有内网DNS服务器(`221.228.255.1`),网管愿意配合配置
|
||||
|
||||
**优点**:
|
||||
- ✅ 一次配置,所有内网用户生效
|
||||
- ✅ 由网管统一管理,更安全
|
||||
- ✅ 可以配置访问控制
|
||||
|
||||
**配置需求**:
|
||||
|
||||
联系网管,在DNS服务器(`221.228.255.1`)上添加A记录:
|
||||
|
||||
```
|
||||
主机名: 3d
|
||||
域名: yydd.ai
|
||||
记录类型: A
|
||||
IP地址: 192.168.58.20
|
||||
TTL: 3600
|
||||
```
|
||||
|
||||
**详细配置方法**:
|
||||
- Windows Server DNS: DNS管理器 → 正向查找区域 → 新建主机(A)
|
||||
- Linux BIND: 编辑区域文件,添加A记录
|
||||
- dnsmasq: 编辑配置文件,添加hosts记录
|
||||
|
||||
---
|
||||
|
||||
### 方案3: 智能DNS服务(阿里云/腾讯云)⭐⭐⭐
|
||||
|
||||
**适用场景**: 域名DNS可以迁移到阿里云或腾讯云
|
||||
|
||||
**优点**:
|
||||
- ✅ 用户完全无感,无需任何配置
|
||||
- ✅ 自动根据用户IP选择解析结果
|
||||
- ✅ 配置简单,一次配置长期有效
|
||||
|
||||
**缺点**:
|
||||
- ⚠️ 需要付费(阿里云个人版19.9元/年)
|
||||
- ⚠️ 需要迁移DNS服务商
|
||||
|
||||
#### 阿里云DNS配置步骤
|
||||
|
||||
1. **迁移DNS到阿里云**
|
||||
- 登录: https://dns.console.aliyun.com/
|
||||
- 添加域名 `yydd.ai`
|
||||
- 修改域名DNS服务器为阿里云提供的DNS服务器
|
||||
|
||||
2. **配置分线路解析**
|
||||
- 添加默认线路记录: `3d` → `180.97.221.140`(公网IP)
|
||||
- 添加自定义线路记录: `3d` → `192.168.58.20`(内网IP)
|
||||
- 配置内网IP段: `192.168.0.0/16` 或 `192.168.58.0/24`
|
||||
|
||||
#### 腾讯云DNS配置步骤
|
||||
|
||||
1. **迁移DNS到腾讯云**
|
||||
- 登录: https://console.cloud.tencent.com/cns
|
||||
- 添加域名 `yydd.ai`
|
||||
- 修改域名DNS服务器为腾讯云提供的DNS服务器
|
||||
|
||||
2. **配置智能解析**
|
||||
- 添加默认线路记录: `3d` → `180.97.221.140`
|
||||
- 添加自定义线路记录: `3d` → `192.168.58.20`
|
||||
- 配置内网IP段: `192.168.0.0/16`
|
||||
|
||||
---
|
||||
|
||||
## 🔐 钉钉登录实现
|
||||
|
||||
### 工作原理
|
||||
|
||||
**钉钉登录流程**:
|
||||
|
||||
1. **用户点击钉钉登录**
|
||||
- 浏览器跳转到钉钉授权页面
|
||||
- 回调地址: `https://3d.yydd.ai/dingtalk-callback`
|
||||
|
||||
2. **用户授权后,钉钉回调**
|
||||
- 钉钉服务器访问: `https://3d.yydd.ai/dingtalk-callback?code=...`
|
||||
- 钉钉服务器通过公网DNS解析到公网IP
|
||||
- 通过FRP转发到内网服务器
|
||||
- 回调正常工作 ✅
|
||||
|
||||
3. **内网用户访问**
|
||||
- 内网用户通过内网DNS解析到内网IP
|
||||
- 直接访问内网服务器
|
||||
- 访问速度快 ✅
|
||||
|
||||
### 关键配置
|
||||
|
||||
**钉钉回调地址**: `https://3d.yydd.ai/dingtalk-callback`
|
||||
|
||||
**代码实现**:
|
||||
```typescript
|
||||
const redirectUrl = `https://3d.yydd.ai/dingtalk-callback`
|
||||
```
|
||||
|
||||
**为什么不能使用内网IP**:
|
||||
- ❌ 钉钉服务器无法访问内网IP(`192.168.58.20`)
|
||||
- ❌ 钉钉开放平台不接受内网IP作为回调地址
|
||||
- ✅ 必须使用公网可访问的域名
|
||||
|
||||
### 验证方法
|
||||
|
||||
1. **测试DNS解析**
|
||||
```bash
|
||||
# 内网环境
|
||||
nslookup 3d.yydd.ai
|
||||
# 应该返回: 192.168.58.20
|
||||
|
||||
# 公网环境
|
||||
nslookup 3d.yydd.ai 8.8.8.8
|
||||
# 应该返回: 180.97.221.140
|
||||
```
|
||||
|
||||
2. **测试钉钉登录**
|
||||
- 访问: `https://3d.yydd.ai/login`
|
||||
- 点击钉钉登录
|
||||
- 完成授权
|
||||
- 验证登录成功
|
||||
|
||||
---
|
||||
|
||||
## 🔒 安全性说明
|
||||
|
||||
### 内网IP不会暴露到公网
|
||||
|
||||
**技术事实**:
|
||||
- 路由器DNS或内网DNS服务器只在局域网内生效
|
||||
- 公网DNS不受影响,仍然返回外网IP
|
||||
- 内网IP(`192.168.58.20`)是私有IP,公网无法路由
|
||||
- 公网用户无法直接访问内网IP
|
||||
|
||||
**DNS解析分离**:
|
||||
```
|
||||
内网用户查询 → 内网DNS → 192.168.58.20(只在局域网内)
|
||||
公网用户查询 → 公网DNS → 180.97.221.140(公网IP)
|
||||
钉钉服务器查询 → 公网DNS → 180.97.221.140(公网IP)
|
||||
```
|
||||
|
||||
### 安全建议
|
||||
|
||||
即使使用hosts文件或DNS配置,也建议:
|
||||
|
||||
1. **服务器安全配置**
|
||||
- 配置防火墙规则(如果支持)
|
||||
- 只允许内网IP段访问
|
||||
- 使用强密码
|
||||
- 定期更新系统
|
||||
|
||||
2. **Nginx访问控制**(可选)
|
||||
```nginx
|
||||
location / {
|
||||
# 只允许内网IP访问
|
||||
allow 192.168.58.0/24;
|
||||
deny all;
|
||||
|
||||
proxy_pass http://127.0.0.1:4320;
|
||||
}
|
||||
```
|
||||
|
||||
3. **监控和日志**
|
||||
- 配置访问日志
|
||||
- 监控异常访问
|
||||
- 定期检查日志
|
||||
|
||||
---
|
||||
|
||||
## 📋 配置检查清单
|
||||
|
||||
### 服务器配置
|
||||
|
||||
- [ ] 内网服务器Nginx已配置 `3d.yydd.ai` 域名
|
||||
- [ ] 内网服务器HTTPS证书已配置
|
||||
- [ ] FRP服务器Nginx已配置 `3d.yydd.ai` 域名
|
||||
- [ ] FRP隧道已配置并运行
|
||||
- [ ] 应用代码已使用统一域名
|
||||
|
||||
### DNS配置(选择一种方案)
|
||||
|
||||
- [ ] hosts文件配置(每台电脑)
|
||||
- [ ] 内网DNS服务器配置(联系网管)
|
||||
- [ ] 智能DNS服务配置(阿里云/腾讯云)
|
||||
|
||||
### 钉钉配置
|
||||
|
||||
- [ ] 钉钉回调地址已配置: `https://3d.yydd.ai/dingtalk-callback`
|
||||
- [ ] 钉钉开放平台白名单已添加
|
||||
- [ ] 钉钉登录功能已测试
|
||||
|
||||
### 验证测试
|
||||
|
||||
- [ ] 内网DNS解析测试(应返回 `192.168.58.20`)
|
||||
- [ ] 公网DNS解析测试(应返回 `180.97.221.140`)
|
||||
- [ ] 内网访问测试(应能正常访问)
|
||||
- [ ] 钉钉登录测试(应能正常登录)
|
||||
|
||||
---
|
||||
|
||||
## 🎯 推荐方案
|
||||
|
||||
### 根据实际情况选择
|
||||
|
||||
1. **如果只有少数几台电脑**: 使用 **hosts文件配置**(最安全,推荐)
|
||||
2. **如果有多台电脑,网管同意**: 使用 **内网DNS服务器配置**
|
||||
3. **如果可以迁移DNS服务商**: 使用 **智能DNS服务**(阿里云/腾讯云)
|
||||
|
||||
### 当前状态
|
||||
|
||||
- ✅ 服务器配置已完成
|
||||
- ✅ 代码实现已完成
|
||||
- ⚠️ DNS配置待完成(根据实际情况选择方案)
|
||||
|
||||
---
|
||||
|
||||
## 📚 技术细节
|
||||
|
||||
### 网络架构
|
||||
|
||||
**内网服务器**: `192.168.58.20:4320`
|
||||
- Nginx监听: 80/443端口
|
||||
- 域名: `3d.yydd.ai`
|
||||
- SSL证书: TrueNAS证书
|
||||
|
||||
**FRP服务器**: `180.97.221.140`
|
||||
- Nginx监听: 80/443端口
|
||||
- 域名: `3d.yydd.ai`
|
||||
- SSL证书: Let's Encrypt证书
|
||||
- FRP隧道: 2320端口 → 内网4320端口
|
||||
|
||||
### 代码实现位置
|
||||
|
||||
- **钉钉登录**: `app/login/page.tsx`
|
||||
- **钉钉回调**: `app/dingtalk-callback/page.tsx`
|
||||
- **网络检测**: `lib/network-detection.ts`
|
||||
- **URL重写**: `lib/url-rewrite.ts`
|
||||
|
||||
---
|
||||
|
||||
## ⚠️ 常见问题
|
||||
|
||||
### Q1: 配置DNS后,内网IP会暴露到公网吗?
|
||||
|
||||
**A**: 不会。内网DNS只在局域网内生效,公网DNS不受影响,内网IP无法在公网路由。
|
||||
|
||||
### Q2: 能否直接使用内网IP实现钉钉登录?
|
||||
|
||||
**A**: 不能。钉钉服务器无法访问内网IP,必须使用公网可访问的域名。
|
||||
|
||||
### Q3: 配置路由器DNS和内网DNS服务器有区别吗?
|
||||
|
||||
**A**: 功能上类似,都是让内网用户解析到内网IP。路由器DNS只服务该路由器下的设备,内网DNS服务器可能服务整个内网。
|
||||
|
||||
### Q4: 如果网管不允许配置DNS怎么办?
|
||||
|
||||
**A**: 使用hosts文件配置,不需要修改路由器或DNS服务器,完全可控。
|
||||
|
||||
---
|
||||
|
||||
## 💡 总结
|
||||
|
||||
**方案核心**: 使用统一域名 `https://3d.yydd.ai`,通过DNS解析区分内网和外网
|
||||
|
||||
**关键点**:
|
||||
- ✅ 内网用户通过内网DNS解析到内网IP,访问速度快
|
||||
- ✅ 外网用户和钉钉回调通过公网DNS解析到公网IP,正常工作
|
||||
- ✅ 内网IP不会暴露到公网,安全性有保障
|
||||
|
||||
**推荐配置**: 根据实际情况选择hosts文件、内网DNS服务器或智能DNS服务
|
||||
@ -1,589 +0,0 @@
|
||||
# 由壹点3D素材 - 内网部署方案(专用构建机)
|
||||
|
||||
## 方案概述
|
||||
|
||||
使用专用的 Ubuntu 构建机进行镜像构建,保护本地 SSD,提高构建效率。
|
||||
|
||||
### 架构图
|
||||
|
||||
```
|
||||
你的电脑(内网)
|
||||
↓ SSH (192.168.42.134)
|
||||
↓ 传输代码(1-5MB)
|
||||
↓
|
||||
构建机 192.168.42.134
|
||||
├─ Docker Registry (端口 5000)
|
||||
├─ Registry UI (端口 5001)
|
||||
└─ 构建镜像(180MB)
|
||||
↓
|
||||
↓ 内网传输镜像
|
||||
↓
|
||||
生产服务器 192.168.58.20
|
||||
└─ 部署容器
|
||||
```
|
||||
|
||||
### 核心优势
|
||||
|
||||
1. **保护本地 SSD**:构建过程在远程服务器,不占用本地磁盘
|
||||
2. **构建速度快**:Ubuntu 服务器性能强,构建速度比 Windows Docker Desktop 快
|
||||
3. **可视化管理**:Web UI 查看所有镜像版本
|
||||
4. **自动清理**:保持构建机干净整洁
|
||||
5. **内网高速**:镜像传输走内网,速度快(1Gbps)
|
||||
|
||||
---
|
||||
|
||||
## 一、环境准备
|
||||
|
||||
### 1.1 构建机(192.168.42.134)
|
||||
|
||||
**已知信息**:
|
||||
```
|
||||
IP:192.168.42.134
|
||||
用户:root
|
||||
密码:Jsjj@8888
|
||||
系统:Ubuntu
|
||||
```
|
||||
|
||||
**需要安装**:
|
||||
- Docker
|
||||
- Docker Compose
|
||||
- Docker Registry + UI
|
||||
|
||||
### 1.2 生产服务器(192.168.58.20)
|
||||
|
||||
**已知信息**:
|
||||
```
|
||||
IP:192.168.58.20
|
||||
用户:root
|
||||
系统:Linux
|
||||
```
|
||||
|
||||
**需要配置**:
|
||||
- 允许从构建机拉取镜像(配置 insecure-registry)
|
||||
|
||||
### 1.3 你的电脑
|
||||
|
||||
**需要工具**:
|
||||
- PuTTY(plink、pscp)
|
||||
- Git Bash(用于打包代码)
|
||||
- PowerShell 7+
|
||||
|
||||
---
|
||||
|
||||
## 二、构建机配置
|
||||
|
||||
### 2.1 安装 Docker(如果未安装)
|
||||
|
||||
```bash
|
||||
# SSH 登录构建机
|
||||
ssh root@192.168.42.134
|
||||
|
||||
# 安装 Docker
|
||||
curl -fsSL https://get.docker.com | sh
|
||||
|
||||
# 启动 Docker
|
||||
systemctl start docker
|
||||
systemctl enable docker
|
||||
|
||||
# 验证安装
|
||||
docker --version
|
||||
```
|
||||
|
||||
### 2.2 安装 Docker Compose
|
||||
|
||||
```bash
|
||||
# 下载 Docker Compose
|
||||
curl -L "https://github.com/docker/compose/releases/download/v2.24.0/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
|
||||
|
||||
# 添加执行权限
|
||||
chmod +x /usr/local/bin/docker-compose
|
||||
|
||||
# 验证安装
|
||||
docker-compose --version
|
||||
```
|
||||
|
||||
### 2.3 配置 Docker Registry + UI
|
||||
|
||||
```bash
|
||||
# 创建目录
|
||||
mkdir -p /opt/docker-registry/{data,config}
|
||||
|
||||
# 创建 docker-compose.yml
|
||||
cat > /opt/docker-registry/docker-compose.yml << 'EOF'
|
||||
version: '3.8'
|
||||
|
||||
services:
|
||||
registry:
|
||||
image: registry:2
|
||||
container_name: docker-registry
|
||||
restart: always
|
||||
ports:
|
||||
- "5000:5000"
|
||||
environment:
|
||||
REGISTRY_STORAGE_DELETE_ENABLED: "true"
|
||||
volumes:
|
||||
- ./data:/var/lib/registry
|
||||
networks:
|
||||
- registry-net
|
||||
|
||||
ui:
|
||||
image: joxit/docker-registry-ui:latest
|
||||
container_name: docker-registry-ui
|
||||
restart: always
|
||||
ports:
|
||||
- "5001:80"
|
||||
environment:
|
||||
- SINGLE_REGISTRY=true
|
||||
- REGISTRY_TITLE=由壹点3D素材 - 镜像仓库
|
||||
- DELETE_IMAGES=true
|
||||
- SHOW_CONTENT_DIGEST=true
|
||||
- NGINX_PROXY_PASS_URL=http://registry:5000
|
||||
- SHOW_CATALOG_NB_TAGS=true
|
||||
- CATALOG_MIN_BRANCHES=1
|
||||
- CATALOG_MAX_BRANCHES=1
|
||||
- TAGLIST_PAGE_SIZE=100
|
||||
- REGISTRY_SECURED=false
|
||||
- CATALOG_ELEMENTS_LIMIT=1000
|
||||
depends_on:
|
||||
- registry
|
||||
networks:
|
||||
- registry-net
|
||||
|
||||
networks:
|
||||
registry-net:
|
||||
driver: bridge
|
||||
EOF
|
||||
|
||||
# 启动 Registry
|
||||
cd /opt/docker-registry
|
||||
docker-compose up -d
|
||||
|
||||
# 检查状态
|
||||
docker-compose ps
|
||||
docker-compose logs -f
|
||||
```
|
||||
|
||||
### 2.4 验证 Registry
|
||||
|
||||
```bash
|
||||
# 测试 Registry API
|
||||
curl http://localhost:5000/v2/_catalog
|
||||
|
||||
# 应该返回:{"repositories":[]}
|
||||
```
|
||||
|
||||
### 2.5 创建构建目录
|
||||
|
||||
```bash
|
||||
# 创建构建目录
|
||||
mkdir -p /opt/youyidian-3d-build
|
||||
|
||||
# 设置权限
|
||||
chmod 755 /opt/youyidian-3d-build
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 三、生产服务器配置
|
||||
|
||||
### 3.1 配置 insecure-registry
|
||||
|
||||
生产服务器需要配置允许从构建机拉取镜像(HTTP,非 HTTPS)。
|
||||
|
||||
```bash
|
||||
# SSH 登录生产服务器
|
||||
ssh root@192.168.58.20
|
||||
|
||||
# 编辑 Docker 配置
|
||||
cat > /etc/docker/daemon.json << 'EOF'
|
||||
{
|
||||
"insecure-registries": ["192.168.42.134:5000"],
|
||||
"registry-mirrors": [
|
||||
"https://registry.cn-hangzhou.aliyuncs.com",
|
||||
"https://docker.mirrors.ustc.edu.cn"
|
||||
]
|
||||
}
|
||||
EOF
|
||||
|
||||
# 重启 Docker
|
||||
systemctl restart docker
|
||||
|
||||
# 验证配置
|
||||
docker info | grep -A 5 "Insecure Registries"
|
||||
```
|
||||
|
||||
### 3.2 测试拉取镜像
|
||||
|
||||
```bash
|
||||
# 测试从构建机拉取镜像
|
||||
curl http://192.168.42.134:5000/v2/_catalog
|
||||
|
||||
# 应该返回:{"repositories":[]}
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 四、本地电脑配置
|
||||
|
||||
### 4.1 配置 SSH 免密登录(可选)
|
||||
|
||||
```powershell
|
||||
# 生成 SSH 密钥(如果没有)
|
||||
ssh-keygen -t rsa -b 4096
|
||||
|
||||
# 复制公钥到构建机
|
||||
type $env:USERPROFILE\.ssh\id_rsa.pub | ssh root@192.168.42.134 "mkdir -p ~/.ssh && cat >> ~/.ssh/authorized_keys"
|
||||
|
||||
# 测试免密登录
|
||||
ssh root@192.168.42.134 "echo '连接成功'"
|
||||
```
|
||||
|
||||
### 4.2 测试 PuTTY 工具
|
||||
|
||||
```powershell
|
||||
# 测试 plink
|
||||
& "C:\Program Files\PuTTY\plink.exe" -batch -pw Jsjj@8888 root@192.168.42.134 "echo '连接成功'"
|
||||
|
||||
# 测试 pscp
|
||||
echo "test" > test.txt
|
||||
& "C:\Program Files\PuTTY\pscp.exe" -batch -pw Jsjj@8888 test.txt root@192.168.42.134:/tmp/
|
||||
Remove-Item test.txt
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 五、部署脚本使用
|
||||
|
||||
### 5.1 脚本功能
|
||||
|
||||
`deploy-build-server.ps1` 脚本会自动完成以下步骤:
|
||||
|
||||
1. 打包代码(排除 node_modules、.next 等大文件)
|
||||
2. 上传代码到构建机
|
||||
3. 在构建机上构建 Docker 镜像
|
||||
4. 推送镜像到本地 Registry
|
||||
5. 从 Registry 拉取镜像到生产服务器
|
||||
6. 在生产服务器上启动容器
|
||||
7. 自动清理旧镜像和缓存
|
||||
|
||||
### 5.2 基本用法
|
||||
|
||||
```powershell
|
||||
# 部署到正式系统(默认)
|
||||
.\deploy-build-server.ps1
|
||||
|
||||
# 部署到影子系统
|
||||
.\deploy-build-server.ps1 -Target shadow
|
||||
|
||||
# 跳过代码同步(代码已在构建机上)
|
||||
.\deploy-build-server.ps1 -SkipSync
|
||||
|
||||
# 跳过镜像构建(镜像已存在)
|
||||
.\deploy-build-server.ps1 -SkipBuild
|
||||
|
||||
# 不使用构建缓存(彻底重新构建)
|
||||
.\deploy-build-server.ps1 -NoCache
|
||||
|
||||
# 保留旧镜像(不自动清理)
|
||||
.\deploy-build-server.ps1 -KeepOldImages
|
||||
```
|
||||
|
||||
### 5.3 完整参数
|
||||
|
||||
```powershell
|
||||
.\deploy-build-server.ps1 `
|
||||
-Target production ` # 部署目标:shadow 或 production
|
||||
-BuildServerIP 192.168.42.134 ` # 构建机 IP
|
||||
-ProdServerIP 192.168.58.20 ` # 生产服务器 IP
|
||||
-ImageName youyidian-3d-material ` # 镜像名称
|
||||
-ImageTag latest ` # 镜像标签
|
||||
-SkipSync ` # 跳过代码同步
|
||||
-SkipBuild ` # 跳过镜像构建
|
||||
-NoCache ` # 不使用构建缓存
|
||||
-KeepOldImages # 保留旧镜像
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 六、Registry UI 使用
|
||||
|
||||
### 6.1 访问 UI
|
||||
|
||||
浏览器访问:`http://192.168.42.134:5001`
|
||||
|
||||
### 6.2 功能说明
|
||||
|
||||
- **查看镜像列表**:所有推送到 Registry 的镜像
|
||||
- **查看镜像标签**:每个镜像的所有版本(标签)
|
||||
- **查看镜像详情**:镜像大小、创建时间、层信息
|
||||
- **删除镜像**:点击删除按钮删除不需要的镜像
|
||||
|
||||
### 6.3 镜像命名规范
|
||||
|
||||
```
|
||||
youyidian-3d-material:latest # 最新版本
|
||||
youyidian-3d-material:20250117-1430 # 带时间戳的版本
|
||||
youyidian-3d-material:v1.0.0 # 带版本号的版本
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 七、清理策略
|
||||
|
||||
### 7.1 自动清理(脚本默认行为)
|
||||
|
||||
脚本会在部署完成后自动清理:
|
||||
|
||||
1. **构建机**:
|
||||
- 清理 6 小时前的构建缓存
|
||||
- 清理悬空镜像(dangling images)
|
||||
- 保留最近使用的基础镜像
|
||||
|
||||
2. **生产服务器**:
|
||||
- 清理 6 小时前的旧镜像
|
||||
- 清理未使用的容器
|
||||
- 保留当前运行的容器和镜像
|
||||
|
||||
### 7.2 手动清理
|
||||
|
||||
```bash
|
||||
# SSH 登录构建机
|
||||
ssh root@192.168.42.134
|
||||
|
||||
# 清理所有未使用的资源(谨慎使用)
|
||||
docker system prune -af --volumes
|
||||
|
||||
# 清理构建缓存(保留 5GB)
|
||||
docker builder prune -af --filter "until=24h"
|
||||
|
||||
# 清理 Registry 存储(垃圾回收)
|
||||
cd /opt/docker-registry
|
||||
docker exec docker-registry registry garbage-collect /etc/docker/registry/config.yml
|
||||
|
||||
# 查看磁盘使用情况
|
||||
docker system df
|
||||
df -h
|
||||
```
|
||||
|
||||
### 7.3 定期清理脚本(可选)
|
||||
|
||||
```bash
|
||||
# 创建定期清理脚本
|
||||
cat > /opt/cleanup-docker.sh << 'EOF'
|
||||
#!/bin/bash
|
||||
echo "开始清理 Docker 资源..."
|
||||
|
||||
# 清理构建缓存(保留 5GB)
|
||||
docker builder prune -af --filter "until=24h"
|
||||
|
||||
# 清理悬空镜像
|
||||
docker image prune -f
|
||||
|
||||
# 清理未使用的容器
|
||||
docker container prune -f --filter "until=24h"
|
||||
|
||||
# 清理未使用的网络
|
||||
docker network prune -f
|
||||
|
||||
# 清理 Registry 存储
|
||||
cd /opt/docker-registry
|
||||
docker exec docker-registry registry garbage-collect /etc/docker/registry/config.yml
|
||||
|
||||
echo "清理完成"
|
||||
docker system df
|
||||
EOF
|
||||
|
||||
chmod +x /opt/cleanup-docker.sh
|
||||
|
||||
# 添加到 crontab(每天凌晨 3 点执行)
|
||||
(crontab -l 2>/dev/null; echo "0 3 * * * /opt/cleanup-docker.sh >> /var/log/docker-cleanup.log 2>&1") | crontab -
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 八、故障排查
|
||||
|
||||
### 8.1 构建机连接失败
|
||||
|
||||
```powershell
|
||||
# 测试网络连接
|
||||
ping 192.168.42.134
|
||||
|
||||
# 测试 SSH 连接
|
||||
ssh root@192.168.42.134
|
||||
|
||||
# 测试 plink 连接
|
||||
& "C:\Program Files\PuTTY\plink.exe" -batch -pw Jsjj@8888 root@192.168.42.134 "echo 'OK'"
|
||||
```
|
||||
|
||||
### 8.2 Registry 无法访问
|
||||
|
||||
```bash
|
||||
# 检查 Registry 状态
|
||||
ssh root@192.168.42.134
|
||||
cd /opt/docker-registry
|
||||
docker-compose ps
|
||||
|
||||
# 查看日志
|
||||
docker-compose logs -f registry
|
||||
docker-compose logs -f ui
|
||||
|
||||
# 重启 Registry
|
||||
docker-compose restart
|
||||
|
||||
# 测试 API
|
||||
curl http://localhost:5000/v2/_catalog
|
||||
```
|
||||
|
||||
### 8.3 镜像推送失败
|
||||
|
||||
```bash
|
||||
# 检查 Registry 配置
|
||||
docker info | grep Registry
|
||||
|
||||
# 手动推送测试
|
||||
docker tag youyidian-3d-material:latest localhost:5000/youyidian-3d-material:latest
|
||||
docker push localhost:5000/youyidian-3d-material:latest
|
||||
|
||||
# 查看 Registry 日志
|
||||
docker logs docker-registry -f
|
||||
```
|
||||
|
||||
### 8.4 生产服务器拉取失败
|
||||
|
||||
```bash
|
||||
# 检查 insecure-registry 配置
|
||||
ssh root@192.168.58.20
|
||||
docker info | grep -A 5 "Insecure Registries"
|
||||
|
||||
# 测试连接
|
||||
curl http://192.168.42.134:5000/v2/_catalog
|
||||
|
||||
# 手动拉取测试
|
||||
docker pull 192.168.42.134:5000/youyidian-3d-material:latest
|
||||
```
|
||||
|
||||
### 8.5 构建失败
|
||||
|
||||
```bash
|
||||
# 查看构建日志
|
||||
ssh root@192.168.42.134
|
||||
cd /opt/youyidian-3d-build
|
||||
docker build -t youyidian-3d-material:latest .
|
||||
|
||||
# 检查磁盘空间
|
||||
df -h
|
||||
|
||||
# 清理磁盘空间
|
||||
docker system prune -af
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 九、性能优化
|
||||
|
||||
### 9.1 构建缓存优化
|
||||
|
||||
```bash
|
||||
# 在构建机上配置 BuildKit 缓存
|
||||
cat >> ~/.bashrc << 'EOF'
|
||||
export DOCKER_BUILDKIT=1
|
||||
export BUILDKIT_PROGRESS=plain
|
||||
EOF
|
||||
|
||||
source ~/.bashrc
|
||||
```
|
||||
|
||||
### 9.2 网络优化
|
||||
|
||||
```bash
|
||||
# 配置 Docker 镜像加速
|
||||
cat > /etc/docker/daemon.json << 'EOF'
|
||||
{
|
||||
"registry-mirrors": [
|
||||
"https://registry.cn-hangzhou.aliyuncs.com",
|
||||
"https://docker.mirrors.ustc.edu.cn",
|
||||
"https://dockerproxy.com"
|
||||
]
|
||||
}
|
||||
EOF
|
||||
|
||||
systemctl restart docker
|
||||
```
|
||||
|
||||
### 9.3 磁盘优化
|
||||
|
||||
```bash
|
||||
# 定期清理日志
|
||||
find /var/lib/docker/containers/ -name "*.log" -mtime +7 -delete
|
||||
|
||||
# 限制日志大小
|
||||
cat > /etc/docker/daemon.json << 'EOF'
|
||||
{
|
||||
"log-driver": "json-file",
|
||||
"log-opts": {
|
||||
"max-size": "10m",
|
||||
"max-file": "3"
|
||||
}
|
||||
}
|
||||
EOF
|
||||
|
||||
systemctl restart docker
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 十、成本分析
|
||||
|
||||
### 10.1 时间消耗(每次部署)
|
||||
|
||||
- 代码打包:5-10秒
|
||||
- 代码上传:10-30秒(1-5MB)
|
||||
- 镜像构建:1-3分钟(首次更长)
|
||||
- 镜像推送到 Registry:10-20秒
|
||||
- 镜像拉取到生产服务器:30-60秒(180MB,内网 1Gbps)
|
||||
- 容器启动:10-20秒
|
||||
- **总计**:2-5分钟/次
|
||||
|
||||
### 10.2 磁盘占用
|
||||
|
||||
- 构建机:
|
||||
- 代码:~100MB
|
||||
- 镜像:~500MB(包括基础镜像)
|
||||
- Registry 数据:~200MB/版本
|
||||
- 构建缓存:~1GB
|
||||
- **总计**:~2-3GB
|
||||
|
||||
- 生产服务器:
|
||||
- 镜像:~500MB
|
||||
- 容器:~100MB
|
||||
- **总计**:~600MB
|
||||
|
||||
---
|
||||
|
||||
## 十一、与现有方案对比
|
||||
|
||||
| 项目 | 本地构建 | 专用构建机 |
|
||||
|------|---------|-----------|
|
||||
| 构建速度 | 慢(Windows Docker Desktop) | 快(Linux 原生) |
|
||||
| 本地 SSD 磨损 | 高(频繁写入) | 无(远程构建) |
|
||||
| 磁盘占用 | 大(本地缓存) | 小(只有代码) |
|
||||
| 可视化管理 | 无 | 有(Registry UI) |
|
||||
| 版本管理 | 无 | 有(Registry 标签) |
|
||||
| 部署频率 | 10-30次/天 | 10-30次/天 |
|
||||
| 网络消耗 | 180MB/次(上传镜像) | 5MB/次(上传代码) |
|
||||
|
||||
---
|
||||
|
||||
## 十二、下一步
|
||||
|
||||
1. 按照步骤二配置构建机(安装 Docker、Registry)
|
||||
2. 按照步骤三配置生产服务器(insecure-registry)
|
||||
3. 运行 `deploy-build-server.ps1` 脚本进行部署
|
||||
4. 访问 Registry UI 查看镜像:`http://192.168.42.134:5001`
|
||||
|
||||
---
|
||||
|
||||
**文档版本**:v1.0
|
||||
**更新时间**:2025-01-17
|
||||
**维护人员**:开发团队
|
||||
@ -1,438 +0,0 @@
|
||||
# 分片上传优化 - 内外网自适应方案
|
||||
|
||||
**实施时间**: 2026-01-24
|
||||
**优化目标**: 根据用户网络环境自动选择最优分片大小,提升上传性能和用户体验
|
||||
|
||||
---
|
||||
|
||||
## 优化方案
|
||||
|
||||
### 核心策略
|
||||
|
||||
**内网用户**: 20MB分片(千兆网络,速度快)
|
||||
**公网用户**: 10MB分片(平衡性能和稳定性)
|
||||
|
||||
### 预期效果
|
||||
|
||||
#### 公网用户(10MB分片)
|
||||
|
||||
```
|
||||
452MB文件上传:
|
||||
- 优化前(5MB):91个请求,~30分钟
|
||||
- 优化后(10MB):46个请求,~27分钟
|
||||
- 提升:请求数减少50%,节省3分钟(10%)
|
||||
|
||||
主要改进:
|
||||
✅ HTTP请求数减半
|
||||
✅ 服务器固定开销减半(认证、会话等)
|
||||
✅ 超时风险可控(19.6秒 < 60秒)
|
||||
✅ 断点续传损失可接受(10MB)
|
||||
```
|
||||
|
||||
#### 内网用户(20MB分片)
|
||||
|
||||
```
|
||||
452MB文件上传:
|
||||
- 优化前(5MB):91个请求,~10秒
|
||||
- 优化后(20MB):23个请求,~6秒
|
||||
- 提升:请求数减少75%,节省4秒(40%)
|
||||
|
||||
10GB文件上传:
|
||||
- 优化前(5MB):2048个请求,~3.5分钟
|
||||
- 优化后(20MB):512个请求,~1.5分钟
|
||||
- 提升:请求数减少75%,节省2分钟(57%)
|
||||
|
||||
主要改进:
|
||||
✅ HTTP请求数减少75%
|
||||
✅ 充分利用千兆网络带宽
|
||||
✅ 大文件上传时间大幅缩短
|
||||
✅ 服务器负载显著降低
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 实施内容
|
||||
|
||||
### 1. 新增文件
|
||||
|
||||
#### `lib/chunk-upload-config.ts`
|
||||
分片上传配置管理模块,提供以下功能:
|
||||
|
||||
- `getOptimalChunkSize()`: 异步获取最优分片大小(根据网络检测结果)
|
||||
- `getChunkSizeSync()`: 同步获取分片大小(如果已检测)
|
||||
- `getChunkTimeout()`: 根据分片大小动态计算超时时间
|
||||
- `formatChunkSize()`: 格式化分片大小为可读字符串
|
||||
|
||||
**核心逻辑**:
|
||||
```typescript
|
||||
export async function getOptimalChunkSize(): Promise<number> {
|
||||
let network = getNetworkStatus()
|
||||
|
||||
if (!network.lastChecked) {
|
||||
network = await initializeNetwork()
|
||||
}
|
||||
|
||||
return network.isInternal
|
||||
? 20 * 1024 * 1024 // 内网:20MB
|
||||
: 10 * 1024 * 1024 // 公网:10MB
|
||||
}
|
||||
```
|
||||
|
||||
### 2. 修改的核心文件
|
||||
|
||||
#### `lib/chunk-upload.ts`
|
||||
- 导入 `getOptimalChunkSize` 和 `getChunkTimeout`
|
||||
- 修改默认 `chunkSize` 为动态获取(内网20MB,公网10MB)
|
||||
- 修改超时时间为根据分片大小动态计算
|
||||
|
||||
**关键改动**:
|
||||
```typescript
|
||||
// 优化前
|
||||
const { chunkSize = 5 * 1024 * 1024, ... } = options
|
||||
xhr.timeout = 60000
|
||||
|
||||
// 优化后
|
||||
let defaultChunkSize = 10 * 1024 * 1024
|
||||
if (!options.chunkSize) {
|
||||
defaultChunkSize = await getOptimalChunkSize()
|
||||
}
|
||||
const { chunkSize = defaultChunkSize, ... } = options
|
||||
xhr.timeout = getChunkTimeout(chunk.size)
|
||||
```
|
||||
|
||||
#### `lib/network.ts`
|
||||
- 缩短缓存时间:5分钟 → 1分钟
|
||||
- 增强缓存失效机制:添加 `invalidateAndRefresh()` 方法
|
||||
- 改进日志输出
|
||||
|
||||
**关键改动**:
|
||||
```typescript
|
||||
// 优化前
|
||||
const NETWORK_CACHE_TTL = 5 * 60 * 1000 // 5分钟
|
||||
|
||||
// 优化后
|
||||
const NETWORK_CACHE_TTL = 60 * 1000 // 1分钟
|
||||
|
||||
// 新增方法
|
||||
export async function invalidateAndRefresh(): Promise<NetworkStatus> {
|
||||
clearNetworkCache()
|
||||
return await initializeNetwork(true)
|
||||
}
|
||||
```
|
||||
|
||||
### 3. 批量更新的上传组件(14个文件)
|
||||
|
||||
所有上传组件移除硬编码的 `chunkSize: 5 * 1024 * 1024`,改为使用默认配置:
|
||||
|
||||
1. `hooks/useBatchFilesUpload.ts`
|
||||
2. `components/UploadModal.tsx`
|
||||
3. `components/upload/AIOriginalUploader.tsx`
|
||||
4. `components/upload/batch-upload-handlers.ts`
|
||||
5. `components/upload/file-upload-handlers.ts`
|
||||
6. `components/upload/ProductPackageUploader.tsx`
|
||||
7. `components/upload/RealPhotoUploader.tsx`
|
||||
8. `components/upload/TaskPageUploader.tsx`
|
||||
9. `components/upload/ThreeDOriginalUploader.tsx`
|
||||
10. `components/upload/VideoScreenshotUploader.tsx`
|
||||
11. `components/upload/special-batch-uploaders.ts` (4处)
|
||||
|
||||
**统一改动**:
|
||||
```typescript
|
||||
// 优化前
|
||||
const result = await chunkUpload(file, metadata, {
|
||||
chunkSize: 5 * 1024 * 1024,
|
||||
// ...
|
||||
})
|
||||
|
||||
// 优化后
|
||||
const result = await chunkUpload(file, metadata, {
|
||||
// chunkSize使用默认配置:内网20MB,公网10MB
|
||||
// ...
|
||||
})
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 技术细节
|
||||
|
||||
### 超时时间计算
|
||||
|
||||
根据分片大小和最低速度(500KB/s)动态计算,加上50%缓冲:
|
||||
|
||||
```typescript
|
||||
export function getChunkTimeout(chunkSize: number): number {
|
||||
const minSpeed = 500 * 1024 // 500KB/s
|
||||
const baseTimeout = (chunkSize / minSpeed) * 1000
|
||||
const timeout = Math.ceil(baseTimeout * 1.5)
|
||||
|
||||
// 最小60秒,最大180秒
|
||||
return Math.max(60000, Math.min(180000, timeout))
|
||||
}
|
||||
```
|
||||
|
||||
**计算结果**:
|
||||
- 5MB分片:15秒 → 60秒(最小值)
|
||||
- 10MB分片:30秒 → 60秒(最小值)
|
||||
- 20MB分片:60秒 → 90秒
|
||||
- 50MB分片:150秒 → 180秒(最大值)
|
||||
|
||||
### 网络检测流程
|
||||
|
||||
```
|
||||
用户访问页面
|
||||
↓
|
||||
前端调用 initializeNetwork()
|
||||
↓
|
||||
调用 /api/network-status
|
||||
↓
|
||||
服务器端 detectIsIntranet()
|
||||
↓
|
||||
检查 hostname + 客户端IP
|
||||
↓
|
||||
返回 isIntranet: true/false
|
||||
↓
|
||||
缓存结果(1分钟)
|
||||
↓
|
||||
上传时调用 getOptimalChunkSize()
|
||||
↓
|
||||
返回对应的分片大小
|
||||
```
|
||||
|
||||
### 缓存机制
|
||||
|
||||
**缓存时间**: 1分钟(从5分钟缩短)
|
||||
|
||||
**失效触发**:
|
||||
1. 缓存过期(1分钟后)
|
||||
2. 手动调用 `clearNetworkCache()`
|
||||
3. 手动调用 `invalidateAndRefresh()`
|
||||
4. 浏览器 `online` 事件触发
|
||||
5. 页面可见性变化且缓存超过1分钟
|
||||
|
||||
**优势**:
|
||||
- 更快响应网络环境变化(VPN连接/断开)
|
||||
- 减少误判导致的性能问题
|
||||
- 保持合理的检测频率(避免过度请求)
|
||||
|
||||
---
|
||||
|
||||
## 兼容性说明
|
||||
|
||||
### 向后兼容
|
||||
|
||||
✅ 完全向后兼容,不影响现有功能
|
||||
✅ 如果网络检测失败,自动降级到10MB(公网配置)
|
||||
✅ 可以手动指定 `chunkSize` 覆盖默认配置
|
||||
|
||||
### 浏览器兼容性
|
||||
|
||||
| 浏览器 | 支持情况 | 说明 |
|
||||
|--------|---------|------|
|
||||
| Chrome | ✅ 完全支持 | 推荐使用 |
|
||||
| Firefox | ✅ 完全支持 | 推荐使用 |
|
||||
| Edge | ✅ 完全支持 | 推荐使用 |
|
||||
| Safari | ⚠️ 基本支持 | 私密模式可能影响检测 |
|
||||
| 移动浏览器 | ⚠️ 基本支持 | 部分浏览器可能检测不准 |
|
||||
|
||||
**降级策略**:
|
||||
- 如果检测失败,使用10MB分片(公网配置,更保守)
|
||||
- 如果网络API不可用,回退到前端判断(基于hostname)
|
||||
|
||||
---
|
||||
|
||||
## 风险评估
|
||||
|
||||
| 风险项 | 严重程度 | 缓解措施 | 状态 |
|
||||
|--------|---------|---------|------|
|
||||
| 公网用户超时 | 🟢 低 | 10MB在19.6秒完成,远低于60秒 | ✅ 已缓解 |
|
||||
| 内存占用增加 | 🟢 低 | 40-80MB增加可接受 | ✅ 可接受 |
|
||||
| 断点续传损失 | 🟡 中 | 10-20MB损失可接受 | ✅ 可接受 |
|
||||
| 网络检测失败 | 🟢 低 | 自动降级到10MB | ✅ 已处理 |
|
||||
| 浏览器兼容性 | 🟡 中 | Safari等可能检测不准 | ⚠️ 需监控 |
|
||||
|
||||
---
|
||||
|
||||
## 测试建议
|
||||
|
||||
### 内网测试
|
||||
|
||||
1. **访问方式**: 直接访问 `http://192.168.58.20:4320`
|
||||
2. **测试文件**: 上传100MB+文件
|
||||
3. **验证点**:
|
||||
- 浏览器控制台显示"检测到内网访问"
|
||||
- 分片大小为20MB(查看网络请求)
|
||||
- 上传速度明显提升
|
||||
- 请求数减少75%
|
||||
|
||||
### 公网测试
|
||||
|
||||
1. **访问方式**: 访问 `https://3d.yydd.ai`
|
||||
2. **测试文件**: 上传100MB+文件
|
||||
3. **验证点**:
|
||||
- 浏览器控制台显示"检测到公网访问"
|
||||
- 分片大小为10MB(查看网络请求)
|
||||
- 请求数减少50%
|
||||
- 无超时错误
|
||||
|
||||
### 网络切换测试
|
||||
|
||||
1. **场景**: 内网用户断开VPN切换到公网
|
||||
2. **操作**:
|
||||
- 在内网上传文件(观察20MB分片)
|
||||
- 断开VPN
|
||||
- 等待1分钟(缓存过期)
|
||||
- 再次上传文件
|
||||
3. **验证点**:
|
||||
- 第二次上传自动切换到10MB分片
|
||||
- 控制台显示"网络状态变化"
|
||||
|
||||
---
|
||||
|
||||
## 监控指标
|
||||
|
||||
### 关键指标
|
||||
|
||||
1. **分片大小分布**
|
||||
- 内网用户使用20MB的比例
|
||||
- 公网用户使用10MB的比例
|
||||
- 降级到默认值的比例
|
||||
|
||||
2. **上传性能**
|
||||
- 平均上传速度(内网 vs 公网)
|
||||
- 平均请求数(优化前 vs 优化后)
|
||||
- 超时错误率
|
||||
|
||||
3. **网络检测准确性**
|
||||
- 检测成功率
|
||||
- 误判率(内网误判为公网,反之)
|
||||
- 检测耗时
|
||||
|
||||
### 日志关键字
|
||||
|
||||
```
|
||||
[ChunkConfig] 检测到内网访问,使用 20MB 分片
|
||||
[ChunkConfig] 检测到公网访问,使用 10MB 分片
|
||||
[ChunkConfig] 网络检测失败,使用默认配置(公网10MB)
|
||||
[Network] 网络状态变化: 内网 → 外网
|
||||
[ChunkUpload] Chunk 0/23 完成 # 20MB分片,总共23个
|
||||
[ChunkUpload] Chunk 0/46 完成 # 10MB分片,总共46个
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 后续优化建议
|
||||
|
||||
### 短期优化(1-2周)
|
||||
|
||||
1. **添加客户端主动测试**
|
||||
```typescript
|
||||
// 测试是否能连接到内网MinIO
|
||||
const canAccessIntranet = await testIntranetConnectivity()
|
||||
```
|
||||
|
||||
2. **增强错误处理**
|
||||
- 检测失败时的详细日志
|
||||
- 自动重试机制
|
||||
- 用户友好的错误提示
|
||||
|
||||
3. **添加性能监控**
|
||||
- 上传速度统计
|
||||
- 分片大小使用情况
|
||||
- 网络检测准确性
|
||||
|
||||
### 中期优化(1-2月)
|
||||
|
||||
1. **支持IPv6**
|
||||
- 识别IPv6内网地址
|
||||
- 处理IPv6的X-Forwarded-For
|
||||
|
||||
2. **智能分片大小**
|
||||
- 根据实际上传速度动态调整
|
||||
- 第一个chunk用5MB测速,后续根据速度选择10MB或20MB
|
||||
|
||||
3. **多重检测机制**
|
||||
- 结合hostname、IP、Referer等多个维度
|
||||
- 加权计算,提高准确性
|
||||
|
||||
### 长期优化(3-6月)
|
||||
|
||||
1. **机器学习优化**
|
||||
- 根据历史数据预测最优分片大小
|
||||
- 自适应调整超时时间
|
||||
|
||||
2. **边缘计算**
|
||||
- 在CDN边缘节点进行网络检测
|
||||
- 减少检测延迟
|
||||
|
||||
---
|
||||
|
||||
## 回滚方案
|
||||
|
||||
如果出现问题,可以快速回滚:
|
||||
|
||||
### 方案1:禁用动态配置(推荐)
|
||||
|
||||
修改 `lib/chunk-upload-config.ts`:
|
||||
```typescript
|
||||
export async function getOptimalChunkSize(): Promise<number> {
|
||||
return 5 * 1024 * 1024 // 强制使用5MB
|
||||
}
|
||||
```
|
||||
|
||||
### 方案2:Git回滚
|
||||
|
||||
```bash
|
||||
git revert <commit-hash>
|
||||
```
|
||||
|
||||
### 方案3:环境变量控制
|
||||
|
||||
添加环境变量 `DISABLE_ADAPTIVE_CHUNK_SIZE=true`,在代码中检查:
|
||||
```typescript
|
||||
if (process.env.DISABLE_ADAPTIVE_CHUNK_SIZE === 'true') {
|
||||
return 5 * 1024 * 1024
|
||||
}
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 总结
|
||||
|
||||
### 实施成果
|
||||
|
||||
✅ 创建分片上传配置模块(`lib/chunk-upload-config.ts`)
|
||||
✅ 修改核心分片上传逻辑支持动态配置
|
||||
✅ 批量更新14个上传组件
|
||||
✅ 缩短网络检测缓存时间到1分钟
|
||||
✅ 增强网络缓存失效机制
|
||||
|
||||
### 预期收益
|
||||
|
||||
**内网用户**:
|
||||
- 请求数减少75%
|
||||
- 上传速度提升40%+
|
||||
- 大文件上传时间缩短57%
|
||||
|
||||
**公网用户**:
|
||||
- 请求数减少50%
|
||||
- 上传时间节省10%
|
||||
- 超时风险可控
|
||||
|
||||
**系统整体**:
|
||||
- 服务器负载降低
|
||||
- 用户体验提升
|
||||
- 网络资源利用更高效
|
||||
|
||||
### 下一步
|
||||
|
||||
1. 部署到测试环境验证
|
||||
2. 内外网分别测试上传性能
|
||||
3. 监控关键指标
|
||||
4. 根据反馈调整参数
|
||||
5. 部署到生产环境
|
||||
|
||||
---
|
||||
|
||||
**文档版本**: 1.0
|
||||
**最后更新**: 2026-01-24
|
||||
**维护人员**: Claude Code
|
||||
@ -1,396 +0,0 @@
|
||||
# 单个Chunk上传慢的根本原因排查
|
||||
|
||||
**问题:** 单个5MB chunk上传需要20秒,理论只需0.4秒
|
||||
**差距:** 50倍慢
|
||||
**目标:** 找出这19.6秒去哪了
|
||||
|
||||
---
|
||||
|
||||
## 当前代码分析
|
||||
|
||||
### 服务端处理流程
|
||||
|
||||
```typescript
|
||||
// app/api/materials/upload/chunk/route.ts
|
||||
export async function POST(req: NextRequest) {
|
||||
const requestStartTime = Date.now()
|
||||
|
||||
// 1. 认证(t1)
|
||||
const session = await getServerSession(authOptions)
|
||||
|
||||
// 2. 解析FormData(t2)
|
||||
const formData = await req.formData()
|
||||
|
||||
// 3. 获取会话(t3)
|
||||
const sessionData = await getUploadSession(uploadId)
|
||||
|
||||
// 4. 创建目录(t4)
|
||||
await mkdir(tempDir, { recursive: true })
|
||||
|
||||
// 5. 转换Buffer(t5)
|
||||
const chunkBuffer = Buffer.from(await chunk.arrayBuffer())
|
||||
|
||||
// 6. 写入文件(t6)
|
||||
await writeFile(chunkFilePath, chunkBuffer)
|
||||
|
||||
// 7. 更新会话(t7)
|
||||
await updateChunk(uploadId, chunkIndex, chunkFilePath)
|
||||
|
||||
// 总耗时
|
||||
const totalTime = Date.now() - requestStartTime
|
||||
}
|
||||
```
|
||||
|
||||
### 已有的性能监控
|
||||
|
||||
代码已经添加了详细的性能监控,但**没有看到日志输出**,说明:
|
||||
1. 要么没有最近的上传
|
||||
2. 要么所有chunk都<1秒(不太可能)
|
||||
3. 要么日志没有被正确输出
|
||||
|
||||
---
|
||||
|
||||
## 可能的瓶颈
|
||||
|
||||
### 🔴 1. 网络传输时间(最可能)
|
||||
|
||||
**问题:** 5MB数据从用户 → FRP → 服务器的传输时间
|
||||
|
||||
**分析:**
|
||||
```
|
||||
用户上行带宽:假设100Mbps = 12.5MB/s
|
||||
理论传输时间:5MB / 12.5MB/s = 0.4秒
|
||||
|
||||
但实际可能:
|
||||
- 用户实际带宽:可能只有10-20Mbps(1-2MB/s)
|
||||
- FRP转发开销:每次转发增加延迟
|
||||
- 网络波动:丢包、重传
|
||||
- 实际传输时间:可能5-10秒
|
||||
```
|
||||
|
||||
**验证方法:**
|
||||
```typescript
|
||||
// 在chunk route添加
|
||||
console.log(`[UploadChunk] Request received at ${new Date().toISOString()}`)
|
||||
console.log(`[UploadChunk] Chunk size: ${chunk.size} bytes`)
|
||||
```
|
||||
|
||||
### 🔴 2. FormData解析时间
|
||||
|
||||
**问题:** `await req.formData()` 需要等待整个chunk接收完成
|
||||
|
||||
**分析:**
|
||||
```
|
||||
FormData解析包括:
|
||||
1. 接收HTTP请求体(5MB数据)
|
||||
2. 解析multipart/form-data格式
|
||||
3. 创建File对象
|
||||
|
||||
如果网络慢,这一步会很慢!
|
||||
```
|
||||
|
||||
**关键发现:**
|
||||
- `formData` 时间 = 网络接收时间 + 解析时间
|
||||
- 如果 `formDataTime` 很大(如15-18秒),说明网络接收慢
|
||||
- 这是**最可能的瓶颈**
|
||||
|
||||
### 🔴 3. 认证开销
|
||||
|
||||
**问题:** `getServerSession(authOptions)` 可能涉及数据库查询
|
||||
|
||||
**分析:**
|
||||
```typescript
|
||||
// lib/auth.ts
|
||||
export const authOptions: NextAuthOptions = {
|
||||
// 可能每次都查询数据库验证session
|
||||
callbacks: {
|
||||
async session({ session, token }) {
|
||||
// 可能有数据库查询
|
||||
}
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
**如果 `authTime` > 100ms,说明认证慢**
|
||||
|
||||
### 🟡 4. 会话管理开销
|
||||
|
||||
**当前实现:** 使用内存Map
|
||||
|
||||
```typescript
|
||||
// lib/upload-sessions.ts
|
||||
const memorySessions = new Map<string, UploadSession>()
|
||||
|
||||
export async function getUploadSession(uploadId: string) {
|
||||
return memorySessions.get(uploadId) || null // O(1),很快
|
||||
}
|
||||
|
||||
export async function updateChunk(uploadId, chunkIndex, chunkPath) {
|
||||
session.chunks.set(chunkIndex, chunkPath) // O(1),很快
|
||||
memorySessions.set(uploadId, session)
|
||||
}
|
||||
```
|
||||
|
||||
**结论:** 内存Map很快,不是瓶颈
|
||||
|
||||
### 🟡 5. 磁盘写入时间
|
||||
|
||||
**已测试:** 磁盘速度308MB/s,写入5MB只需16ms
|
||||
|
||||
**结论:** 不是瓶颈
|
||||
|
||||
---
|
||||
|
||||
## 测试方案
|
||||
|
||||
### 方案1:添加更详细的日志(立即执行)
|
||||
|
||||
修改 `app/api/materials/upload/chunk/route.ts`:
|
||||
|
||||
```typescript
|
||||
export async function POST(req: NextRequest) {
|
||||
const requestStartTime = Date.now()
|
||||
console.log(`[UploadChunk] ⏱️ Request received at ${new Date().toISOString()}`)
|
||||
|
||||
try {
|
||||
// 认证
|
||||
const t1 = Date.now()
|
||||
const session = await getServerSession(authOptions)
|
||||
const authTime = Date.now() - t1
|
||||
console.log(`[UploadChunk] ⏱️ Auth: ${authTime}ms`)
|
||||
|
||||
if (!session) {
|
||||
return NextResponse.json({ error: '请先登录' }, { status: 401 })
|
||||
}
|
||||
|
||||
// 解析FormData
|
||||
const t2 = Date.now()
|
||||
console.log(`[UploadChunk] ⏱️ Starting FormData parse...`)
|
||||
const formData = await req.formData()
|
||||
const formDataTime = Date.now() - t2
|
||||
console.log(`[UploadChunk] ⏱️ FormData: ${formDataTime}ms`)
|
||||
|
||||
const uploadId = formData.get('uploadId') as string
|
||||
const chunkIndex = parseInt(formData.get('chunkIndex') as string)
|
||||
const chunk = formData.get('chunk') as File
|
||||
const fileName = formData.get('fileName') as string
|
||||
|
||||
console.log(`[UploadChunk] ⏱️ Chunk ${chunkIndex}, size: ${(chunk.size / 1024 / 1024).toFixed(2)}MB`)
|
||||
|
||||
// ... 其他代码保持不变 ...
|
||||
|
||||
// 最后输出总结
|
||||
const totalTime = Date.now() - requestStartTime
|
||||
console.log(`[UploadChunk] ⏱️ TOTAL: ${totalTime}ms`, {
|
||||
auth: `${authTime}ms (${(authTime/totalTime*100).toFixed(1)}%)`,
|
||||
formData: `${formDataTime}ms (${(formDataTime/totalTime*100).toFixed(1)}%)`,
|
||||
getSession: `${getSessionTime}ms`,
|
||||
mkdir: `${mkdirTime}ms`,
|
||||
buffer: `${bufferTime}ms`,
|
||||
writeFile: `${writeFileTime}ms`,
|
||||
updateChunk: `${updateChunkTime}ms`,
|
||||
})
|
||||
|
||||
return NextResponse.json({
|
||||
success: true,
|
||||
uploadedChunks: sessionData.chunks.size + 1,
|
||||
totalChunks: sessionData.totalChunks,
|
||||
serverProcessTime: totalTime // 返回给前端
|
||||
})
|
||||
} catch (error) {
|
||||
console.error('[UploadChunk] Error:', error)
|
||||
return NextResponse.json(
|
||||
{ error: '上传块失败' },
|
||||
{ status: 500 }
|
||||
)
|
||||
}
|
||||
}
|
||||
```
|
||||
|
||||
### 方案2:前端添加计时(立即执行)
|
||||
|
||||
修改 `lib/chunk-upload.ts`:
|
||||
|
||||
```typescript
|
||||
async function uploadChunk(
|
||||
uploadId: string,
|
||||
chunkIndex: number,
|
||||
chunk: Blob,
|
||||
fileName: string,
|
||||
options: {
|
||||
onChunkProgress?: (loaded: number, total: number) => void
|
||||
onRequest?: (xhr: XMLHttpRequest | null) => void
|
||||
} = {}
|
||||
): Promise<void> {
|
||||
const startTime = Date.now()
|
||||
let uploadStartTime = 0
|
||||
let firstByteTime = 0
|
||||
|
||||
const formData = new FormData()
|
||||
formData.append('uploadId', uploadId)
|
||||
formData.append('chunkIndex', chunkIndex.toString())
|
||||
formData.append('chunk', chunk)
|
||||
formData.append('fileName', fileName)
|
||||
|
||||
return new Promise((resolve, reject) => {
|
||||
const xhr = new XMLHttpRequest()
|
||||
|
||||
options.onRequest?.(xhr)
|
||||
|
||||
xhr.open('POST', '/api/materials/upload/chunk')
|
||||
|
||||
// 记录开始上传时间
|
||||
xhr.upload.onloadstart = () => {
|
||||
uploadStartTime = Date.now()
|
||||
console.log(`[ChunkUpload] Chunk ${chunkIndex} upload started`)
|
||||
}
|
||||
|
||||
xhr.upload.onprogress = (event) => {
|
||||
if (event.lengthComputable) {
|
||||
if (firstByteTime === 0 && event.loaded > 0) {
|
||||
firstByteTime = Date.now()
|
||||
console.log(`[ChunkUpload] Chunk ${chunkIndex} first byte sent: ${firstByteTime - uploadStartTime}ms`)
|
||||
}
|
||||
options.onChunkProgress?.(event.loaded, event.total)
|
||||
|
||||
// 计算上传速度
|
||||
const elapsed = (Date.now() - uploadStartTime) / 1000
|
||||
const speed = event.loaded / elapsed / 1024 / 1024
|
||||
console.log(`[ChunkUpload] Chunk ${chunkIndex} progress: ${(event.loaded/event.total*100).toFixed(1)}%, speed: ${speed.toFixed(2)}MB/s`)
|
||||
}
|
||||
}
|
||||
|
||||
xhr.onload = () => {
|
||||
options.onRequest?.(null)
|
||||
const totalTime = Date.now() - startTime
|
||||
const uploadTime = Date.now() - uploadStartTime
|
||||
|
||||
console.log(`[ChunkUpload] Chunk ${chunkIndex} completed:`, {
|
||||
total: `${totalTime}ms`,
|
||||
upload: `${uploadTime}ms`,
|
||||
server: `${totalTime - uploadTime}ms`,
|
||||
size: `${(chunk.size / 1024 / 1024).toFixed(2)}MB`,
|
||||
avgSpeed: `${(chunk.size / 1024 / 1024 / (uploadTime / 1000)).toFixed(2)}MB/s`
|
||||
})
|
||||
|
||||
if (xhr.status >= 200 && xhr.status < 300) {
|
||||
try {
|
||||
const response = JSON.parse(xhr.responseText)
|
||||
if (response.serverProcessTime) {
|
||||
console.log(`[ChunkUpload] Chunk ${chunkIndex} server process: ${response.serverProcessTime}ms`)
|
||||
}
|
||||
} catch (e) {}
|
||||
resolve()
|
||||
} else {
|
||||
reject(new Error(`上传块 ${chunkIndex} 失败: ${xhr.status}`))
|
||||
}
|
||||
}
|
||||
|
||||
xhr.onerror = () => {
|
||||
options.onRequest?.(null)
|
||||
const totalTime = Date.now() - startTime
|
||||
console.error(`[ChunkUpload] Chunk ${chunkIndex} failed after ${totalTime}ms`)
|
||||
reject(new Error(`上传块 ${chunkIndex} 失败: 网络错误`))
|
||||
}
|
||||
|
||||
xhr.onabort = () => {
|
||||
options.onRequest?.(null)
|
||||
reject(new Error('上传已取消'))
|
||||
}
|
||||
|
||||
xhr.send(formData)
|
||||
})
|
||||
}
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 预期结果
|
||||
|
||||
### 如果是网络传输慢
|
||||
|
||||
```
|
||||
[ChunkUpload] Chunk 0 upload started
|
||||
[ChunkUpload] Chunk 0 progress: 10.0%, speed: 0.25MB/s ← 慢!
|
||||
[ChunkUpload] Chunk 0 progress: 50.0%, speed: 0.25MB/s
|
||||
[ChunkUpload] Chunk 0 progress: 100.0%, speed: 0.25MB/s
|
||||
[ChunkUpload] Chunk 0 completed: { total: 20000ms, upload: 19500ms, server: 500ms }
|
||||
↑ 网络传输占了19.5秒
|
||||
|
||||
[UploadChunk] ⏱️ FormData: 19000ms ← 接收数据占了19秒
|
||||
[UploadChunk] ⏱️ TOTAL: 19500ms
|
||||
```
|
||||
|
||||
**结论:** 瓶颈在网络传输,不是服务器处理
|
||||
|
||||
### 如果是服务器处理慢
|
||||
|
||||
```
|
||||
[ChunkUpload] Chunk 0 completed: { total: 20000ms, upload: 500ms, server: 19500ms }
|
||||
↑ 服务器处理占了19.5秒
|
||||
|
||||
[UploadChunk] ⏱️ FormData: 100ms
|
||||
[UploadChunk] ⏱️ Auth: 15000ms ← 认证占了15秒!
|
||||
[UploadChunk] ⏱️ TOTAL: 19500ms
|
||||
```
|
||||
|
||||
**结论:** 瓶颈在服务器处理(可能是认证、数据库等)
|
||||
|
||||
---
|
||||
|
||||
## 下一步行动
|
||||
|
||||
### 1. 立即部署日志增强版本
|
||||
|
||||
```bash
|
||||
# 修改代码后部署
|
||||
.\deploy-remote-build.ps1 -Target production
|
||||
```
|
||||
|
||||
### 2. 让用户再次上传
|
||||
|
||||
- 上传同样大小的文件
|
||||
- 观察日志输出
|
||||
|
||||
### 3. 分析日志
|
||||
|
||||
```bash
|
||||
# 实时查看日志
|
||||
ssh root@192.168.58.20 "docker logs -f --tail 100 youyidian-3d-material 2>&1 | grep -E 'ChunkUpload|UploadChunk'"
|
||||
```
|
||||
|
||||
### 4. 根据结果决定优化方向
|
||||
|
||||
**如果网络传输慢(最可能):**
|
||||
- ✅ 实施并发上传(隐藏网络延迟)
|
||||
- ✅ 考虑增大chunk大小(减少请求数)
|
||||
- ✅ 优化FRP配置(禁用压缩、调整参数)
|
||||
|
||||
**如果服务器处理慢:**
|
||||
- ✅ 优化认证(缓存session)
|
||||
- ✅ 优化会话管理(已经用内存Map,很快)
|
||||
- ✅ 优化磁盘IO(已经很快,308MB/s)
|
||||
|
||||
---
|
||||
|
||||
## 总结
|
||||
|
||||
**当前状态:**
|
||||
- ✅ 已有性能监控代码
|
||||
- ❌ 没有看到实际日志输出
|
||||
- ❌ 无法确定瓶颈在哪
|
||||
|
||||
**需要做的:**
|
||||
1. 增强日志输出(前端+后端)
|
||||
2. 让用户再次上传
|
||||
3. 分析日志找出瓶颈
|
||||
4. 针对性优化
|
||||
|
||||
**最可能的结果:**
|
||||
- 网络传输占90%时间(19秒)
|
||||
- 服务器处理占10%时间(1秒)
|
||||
- 并发上传可以隐藏网络延迟,提速4-8倍
|
||||
|
||||
---
|
||||
|
||||
*创建时间:2026-01-21 19:45*
|
||||
236
docs/缓存策略说明.md
236
docs/缓存策略说明.md
@ -1,236 +0,0 @@
|
||||
# 由壹点3D素材 - 缓存策略说明
|
||||
|
||||
## 设计目标
|
||||
|
||||
1. **零网络依赖** - 所有依赖完全本地化
|
||||
2. **最快部署** - 典型部署时间 < 1 分钟
|
||||
3. **最小写入** - 避免不必要的 SSD 写入
|
||||
4. **智能构建** - 只在必要时重新构建
|
||||
|
||||
---
|
||||
|
||||
## 缓存架构
|
||||
|
||||
### 永久缓存目录(/opt/build-cache/)
|
||||
|
||||
所有缓存文件一次性解压,永久存储,构建时直接使用:
|
||||
|
||||
```
|
||||
/opt/build-cache/
|
||||
├── alpine-apk/ # 已解压的 Alpine 包(*.apk 文件)
|
||||
│ ├── ffmpeg-*.apk
|
||||
│ ├── python3-*.apk
|
||||
│ └── ...(约 50 个 .apk 文件)
|
||||
├── node_modules/ # 已解压的 npm 依赖
|
||||
│ ├── .bin/
|
||||
│ ├── next/
|
||||
│ ├── react/
|
||||
│ └── ...(完整的 node_modules)
|
||||
└── (基础镜像已加载到 Docker)
|
||||
```
|
||||
|
||||
### 构建目录(/opt/youyidian-3d-build/)
|
||||
|
||||
工作目录,只存放代码文件:
|
||||
|
||||
```
|
||||
/opt/youyidian-3d-build/
|
||||
├── app/ # 应用代码
|
||||
├── components/ # 组件代码
|
||||
├── Dockerfile # 构建文件
|
||||
├── .build-hash # 依赖哈希(用于智能构建检测)
|
||||
└── ... # 其他代码文件
|
||||
```
|
||||
|
||||
**关键优化:Docker 构建时直接挂载缓存目录**
|
||||
- ✅ 零解压(已提前解压)
|
||||
- ✅ 零复制(BuildKit 挂载)
|
||||
- ✅ 零网络(完全离线)
|
||||
|
||||
---
|
||||
|
||||
## 部署流程
|
||||
|
||||
### 首次部署(2-3 分钟)
|
||||
|
||||
**准备阶段(一次性,运行 `setup-build-cache.ps1`):**
|
||||
1. 上传 alpine-packages.tar.gz → 解压到 `/opt/build-cache/alpine-apk/`
|
||||
2. 上传 node_modules.tar.gz → 解压到 `/opt/build-cache/node_modules/`
|
||||
3. 加载基础镜像到 Docker
|
||||
|
||||
**部署阶段:**
|
||||
1. 上传代码到构建目录(15MB,10 秒)
|
||||
2. 构建镜像(直接挂载缓存,无解压、无网络,60-90 秒)
|
||||
3. 推送到 Registry(10 秒)
|
||||
4. 部署到生产服务器(10 秒)
|
||||
|
||||
### 后续部署(30-60 秒)
|
||||
|
||||
**场景 1:只有代码变化(最常见)**
|
||||
- 上传代码(15MB,10 秒)
|
||||
- 检测到依赖未变化 → **跳过构建**
|
||||
- 直接使用已有镜像
|
||||
- 推送到 Registry(已存在,秒级)
|
||||
- 部署到生产服务器(10 秒)
|
||||
- **总耗时:~30 秒**
|
||||
|
||||
**场景 2:依赖变化(少见)**
|
||||
- 上传代码(15MB,10 秒)
|
||||
- 检测到依赖变化 → 重新构建
|
||||
- 利用 Docker 层缓存(只重建变化的层)
|
||||
- 推送到 Registry(增量推送)
|
||||
- 部署到生产服务器
|
||||
- **总耗时:1-2 分钟**
|
||||
|
||||
---
|
||||
|
||||
## 智能构建检测
|
||||
|
||||
### 检测逻辑
|
||||
|
||||
```
|
||||
计算本地 package-lock.json 的 MD5 哈希
|
||||
↓
|
||||
对比构建机上保存的哈希值
|
||||
↓
|
||||
相同?
|
||||
├─ 是 → 跳过构建,使用已有镜像(节省 2-3 分钟)
|
||||
└─ 否 → 重新构建,保存新哈希
|
||||
```
|
||||
|
||||
### 哈希文件位置
|
||||
|
||||
```
|
||||
/opt/youyidian-3d-build/.build-hash
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## Docker 层缓存
|
||||
|
||||
Dockerfile 分层设计,最大化缓存复用:
|
||||
|
||||
```dockerfile
|
||||
# 层 1:基础镜像(永不变化)
|
||||
FROM node:18-alpine
|
||||
|
||||
# 层 2:系统包(挂载已解压的缓存,零解压)
|
||||
RUN --mount=type=bind,source=/opt/build-cache/alpine-apk,target=/cache/apk \
|
||||
apk add --no-network /cache/apk/*.apk
|
||||
|
||||
# 层 3:依赖包(挂载已解压的缓存,只复制)
|
||||
RUN --mount=type=bind,source=/opt/build-cache/node_modules,target=/cache/node_modules \
|
||||
cp -a /cache/node_modules .
|
||||
|
||||
# 层 4:应用代码(经常变化,但构建快)
|
||||
COPY . .
|
||||
RUN npm run build
|
||||
```
|
||||
|
||||
**性能优化:**
|
||||
- 层 2:从"解压+安装"(20秒)→"直接安装"(5秒)
|
||||
- 层 3:从"解压+复制"(30秒)→"直接复制"(10秒)
|
||||
- 总节省:约 35 秒/次构建
|
||||
|
||||
---
|
||||
|
||||
## SSD 写入优化
|
||||
|
||||
### 避免的写入操作
|
||||
|
||||
❌ **不做的事:**
|
||||
1. 不解压缓存文件(提前解压,一次性)
|
||||
2. 不复制缓存文件(BuildKit 挂载)
|
||||
3. 不重复下载依赖(完全本地化)
|
||||
4. 不清理缓存目录(永久保留)
|
||||
|
||||
✅ **只做必要的写入:**
|
||||
1. 代码文件更新(15MB)
|
||||
2. Docker 镜像层(只写变化的层)
|
||||
3. 构建产物(.next 等,约 50MB)
|
||||
|
||||
### 写入量对比
|
||||
|
||||
| 操作 | 传统方式 | 优化后 | 节省 |
|
||||
|------|---------|--------|------|
|
||||
| 首次部署 | ~800MB | ~400MB(一次性) | 50% |
|
||||
| 代码变化 | ~400MB | ~80MB | 80% |
|
||||
| 依赖变化 | ~600MB | ~150MB | 75% |
|
||||
|
||||
### 时间对比
|
||||
|
||||
| 操作 | 传统方式 | 优化后 | 节省 |
|
||||
|------|---------|--------|------|
|
||||
| 首次部署 | 5-8 分钟 | 2-3 分钟 | 60% |
|
||||
| 代码变化 | 2-3 分钟 | 30-60 秒 | 70% |
|
||||
| 依赖变化 | 3-5 分钟 | 1-2 分钟 | 60% |
|
||||
|
||||
---
|
||||
|
||||
## 网络依赖
|
||||
|
||||
### 完全本地化
|
||||
|
||||
✅ **已本地化:**
|
||||
- 基础镜像:node:18-alpine (181MB)
|
||||
- 系统包:Alpine apk (184MB)
|
||||
- npm 依赖:node_modules (201MB)
|
||||
|
||||
❌ **无需网络:**
|
||||
- Docker Hub
|
||||
- npm registry
|
||||
- Alpine 镜像源
|
||||
|
||||
🎯 **结果:构建过程 100% 离线**
|
||||
|
||||
---
|
||||
|
||||
## 维护
|
||||
|
||||
### 更新缓存(当依赖升级时)
|
||||
|
||||
```powershell
|
||||
# 1. 本地更新依赖
|
||||
npm install
|
||||
|
||||
# 2. 重新打包 node_modules
|
||||
tar -czf .build-cache/node_modules.tar.gz node_modules/
|
||||
|
||||
# 3. 重新运行缓存初始化(会自动检测并更新)
|
||||
.\setup-build-cache.ps1
|
||||
|
||||
# 4. 下次部署会自动使用新缓存
|
||||
```
|
||||
|
||||
**注意:** 缓存更新后,构建机上的旧 node_modules 会被替换,无需手动清理。
|
||||
|
||||
### 清理旧镜像
|
||||
|
||||
```bash
|
||||
# 在构建机上
|
||||
docker image prune -af --filter "until=24h"
|
||||
|
||||
# 在生产服务器上
|
||||
docker image prune -af --filter "until=24h"
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 性能指标
|
||||
|
||||
### 目标性能
|
||||
|
||||
| 指标 | 目标值 | 实际值 |
|
||||
|------|--------|--------|
|
||||
| 首次部署 | < 3 分钟 | 2-3 分钟 |
|
||||
| 代码变化部署 | < 1 分钟 | 30-60 秒 |
|
||||
| 依赖变化部署 | < 2 分钟 | 1-2 分钟 |
|
||||
| 网络依赖 | 0% | 0% |
|
||||
| SSD 写入 | 最小化 | < 80MB/次 |
|
||||
| 解压操作 | 0 次 | 0 次(提前解压) |
|
||||
|
||||
---
|
||||
|
||||
**文档版本**:v1.0
|
||||
**更新时间**:2025-01-17
|
||||
**维护人员**:开发团队
|
||||
@ -1,93 +0,0 @@
|
||||
f8148b30-d83f-4e6a-800e-fa047efd9b16
|
||||
f8148b30-d83f-4e6a-800e-fa047efd9b16
|
||||
f8148b30-d83f-4e6a-800e-fa047efd9b16
|
||||
f8148b30-d83f-4e6a-800e-fa047efd9b16
|
||||
f8148b30-d83f-4e6a-800e-fa047efd9b16
|
||||
f8148b30-d83f-4e6a-800e-fa047efd9b16
|
||||
f8148b30-d83f-4e6a-800e-fa047efd9b16
|
||||
f8148b30-d83f-4e6a-800e-fa047efd9b16
|
||||
695c48f0-53a9-4870-aa07-76261fdf4a31
|
||||
2d10faf8-346e-4435-9dcc-c3cd28a02d2c
|
||||
228c7c9b-eafa-4b52-b94c-198373e3902f
|
||||
dc49b1b0-2b5f-414e-b099-bb0388734cef
|
||||
0418b190-ec90-47ed-a868-9917d0207b6a
|
||||
81802ea6-2b28-46d6-8fc7-931e88b338f3
|
||||
36c377fe-49c4-432b-a717-a243c0e7ab89
|
||||
d18ce556-e3f1-49e5-beb3-a39fe044546f
|
||||
ffb8a024-667d-4284-abd9-85a11e94fd54
|
||||
5875c1db-0f3b-4760-9f7e-045446d37aac
|
||||
d6b9cf44-0631-4237-a67a-495a13604b5e
|
||||
cb880417-0f44-4541-8bbe-cf82b388b0b1
|
||||
101aea94-7460-4ae6-8980-a5a87698574d
|
||||
a2e9568b-eca1-4896-abfa-512f8b2f8047
|
||||
310b405f-a1df-4f89-87b0-ea61960162fb
|
||||
581173bc-672d-411b-81a4-eb58b5db7d37
|
||||
0dab1ccb-6c17-4a87-85f9-062573c3fac9
|
||||
a9fff2da-562b-492d-93de-d3d7f6af5a83
|
||||
b985e22b-5ecc-495d-8405-0ff760fe25f5
|
||||
7d01a3ab-8a99-4966-9f5e-53b5ef6cfad1
|
||||
104cd397-c076-46d4-82c5-913d928f8903
|
||||
b51db545-c44c-4e45-9fad-6c3dda015d14
|
||||
8d1a37b6-36bd-43da-abb0-85c01bf74884
|
||||
00790594-1a70-45c7-aa14-08f67743fc22
|
||||
0dbc5c23-785a-4d10-80e7-2b2106ec2564
|
||||
2691cc24-c863-4c74-9f55-51b3c99dfc3e
|
||||
c4f3c139-ca97-4497-a0c1-843cbedbe92f
|
||||
93f088a0-ce01-479a-86b7-cac9a26375e0
|
||||
b3b5b584-5cb9-47cd-a79a-e8ff9cd18242
|
||||
c1cb5ed5-6285-467e-8d55-d9bd58ecf9dc
|
||||
80dc7ae2-4012-4ca4-9a77-01c3e74b48f7
|
||||
1630671b-0151-4c40-a2ad-82e2a5626436
|
||||
f10fc951-0028-487c-a387-bc560a38690b
|
||||
f3e583bf-29cf-440f-821d-cd1c076fd11d
|
||||
c3077ae7-3504-4773-b181-e572a101daae
|
||||
38ac3492-aba1-4faa-ba68-c03fdd805635
|
||||
71bcd09b-ded4-43f9-82b8-c077f125dca1
|
||||
ca07a531-7349-42df-9a5e-7fed9bee02d8
|
||||
ccd0dd74-df91-4913-83d3-b990987805ad
|
||||
7ef32d4e-ac2d-4bdc-8309-bb12d0bb661b
|
||||
d76161d3-ae0f-4d58-8821-b335b1434354
|
||||
77aea4ac-1818-4307-9e09-2a9f09117dfa
|
||||
d9239fdb-e12e-4f38-9ba2-98865cfac6ab
|
||||
2ee26169-fdd7-446e-afe2-dade5baecc58
|
||||
7a2ca8a5-c996-4765-a689-3ee5739e57d6
|
||||
a973ff26-d93d-4d5e-8918-5e7bc4fad067
|
||||
3546d607-f096-4a08-859e-9b137bcc7c55
|
||||
de1b6a95-7872-4dd6-9cde-c433ad99f0bb
|
||||
cca4a251-9561-4fee-bd38-7dd9c36d0bf4
|
||||
3546d607-f096-4a08-859e-9b137bcc7c55
|
||||
cca4a251-9561-4fee-bd38-7dd9c36d0bf4
|
||||
1e931624-40e4-496c-a755-6d5cb7a6ee73
|
||||
cd90df0b-e124-4194-b35c-ea90bd98ad36
|
||||
326330ab-90f6-4c52-bc20-52c183758cac
|
||||
0a5c935c-5023-4f25-b2e2-d1bad5cba6e4
|
||||
650154bb-cc79-4a93-8e09-06e4fb8238e0
|
||||
404a427e-42a8-4251-ac57-01846c07dcab
|
||||
05099a39-3afc-4f16-b2dd-0faa84b042b0
|
||||
cd90df0b-e124-4194-b35c-ea90bd98ad36
|
||||
326330ab-90f6-4c52-bc20-52c183758cac
|
||||
0a5c935c-5023-4f25-b2e2-d1bad5cba6e4
|
||||
650154bb-cc79-4a93-8e09-06e4fb8238e0
|
||||
404a427e-42a8-4251-ac57-01846c07dcab
|
||||
05099a39-3afc-4f16-b2dd-0faa84b042b0
|
||||
699eb818-7cca-45b9-be71-6fbbce017f81
|
||||
15c9cea9-bcb7-4674-9ce3-a5b55ee7d2fe
|
||||
b704d316-db31-472e-80ee-0997f73af0f0
|
||||
7c1fd57e-1f3e-49e7-9408-fdf364b84d9a
|
||||
b704d316-db31-472e-80ee-0997f73af0f0
|
||||
7c1fd57e-1f3e-49e7-9408-fdf364b84d9a
|
||||
737e34de-a83e-49c6-bfb3-3ec0610dc061
|
||||
29125d36-bbfd-44ef-8db5-76a73802e115
|
||||
ab5eabe5-64cd-46fd-9665-7ece31d0455c
|
||||
c49e0e33-045c-49e4-8aad-8d1831646ed3
|
||||
1a6b7912-e942-424b-b576-50c0f416c509
|
||||
465fbe8f-03c1-4ef8-aa91-aa15c51531b5
|
||||
e8b376b3-ef2a-462f-b636-67aaceabfe82
|
||||
737e34de-a83e-49c6-bfb3-3ec0610dc061
|
||||
1a6b7912-e942-424b-b576-50c0f416c509
|
||||
465fbe8f-03c1-4ef8-aa91-aa15c51531b5
|
||||
27c63885-68c3-405a-86d7-b1f94eebd9cb
|
||||
301919a3-e270-4ddf-bdd6-d9714a431a77
|
||||
0b9fe895-240a-4ee7-b0fe-b6e0aaf1689a
|
||||
8a8e53a9-9b9e-407d-8776-00f09156d73f
|
||||
8a8e53a9-9b9e-407d-8776-00f09156d73f
|
||||
@ -1,25 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T14:51:41.608Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768920743170.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T14:52:23.273Z"
|
||||
},
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T14:52:24.285Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T14:52:24.291Z"
|
||||
}
|
||||
]
|
||||
@ -1,25 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T14:52:48.713Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768920813164.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T14:53:33.269Z"
|
||||
},
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T14:53:34.275Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T14:53:34.281Z"
|
||||
}
|
||||
]
|
||||
@ -1,20 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T14:57:39.321Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T14:57:39.338Z"
|
||||
},
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T14:57:40.341Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T14:57:40.349Z"
|
||||
}
|
||||
]
|
||||
@ -1,25 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T14:58:50.113Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768921191789.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T14:59:51.898Z"
|
||||
},
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T14:59:52.910Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T14:59:52.917Z"
|
||||
}
|
||||
]
|
||||
@ -1,20 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:00:20.029Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:00:20.045Z"
|
||||
},
|
||||
{
|
||||
"materialId": "2d10faf8-346e-4435-9dcc-c3cd28a02d2c",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": "TASK202601161127525854-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:00:21.055Z",
|
||||
"error": "terminated",
|
||||
"endTime": "2026-01-20T15:02:21.127Z"
|
||||
}
|
||||
]
|
||||
@ -1,11 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:04:06.711Z",
|
||||
"error": "Failed to parse URL from uploads/materials/XG0176_若兰_亿家达_主图.zip",
|
||||
"endTime": "2026-01-20T15:04:10.347Z"
|
||||
}
|
||||
]
|
||||
@ -1,16 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:04:37.500Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768921547692.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:05:47.803Z"
|
||||
}
|
||||
]
|
||||
@ -1,16 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:17:13.231Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768922238899.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:17:19.009Z"
|
||||
}
|
||||
]
|
||||
@ -1,16 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:25:26.376Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768922733168.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:25:33.278Z"
|
||||
}
|
||||
]
|
||||
@ -1,16 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:31:36.258Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768923103286.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:31:43.417Z"
|
||||
}
|
||||
]
|
||||
@ -1,11 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:33:35.806Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:33:35.831Z"
|
||||
}
|
||||
]
|
||||
@ -1,16 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "f8148b30-d83f-4e6a-800e-fa047efd9b16",
|
||||
"productModel": "XG0176",
|
||||
"taskNo": "TASK202601151456438524-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:33:53.142Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_若兰_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768923240223.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:34:00.356Z"
|
||||
}
|
||||
]
|
||||
@ -1,15 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "695c48f0-53a9-4870-aa07-76261fdf4a31",
|
||||
"productModel": "CZ0093",
|
||||
"taskNo": "TASK202601161637102363-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:40:04.052Z",
|
||||
"assetsDownloaded": 1,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CZ0093_上生_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CZ0093_all_695c48f0-53a9-4870-aa07-76261fdf4a31_1768923605237.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:40:05.324Z"
|
||||
}
|
||||
]
|
||||
@ -1,133 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:41:40.825Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:41:40.842Z"
|
||||
},
|
||||
{
|
||||
"materialId": "2d10faf8-346e-4435-9dcc-c3cd28a02d2c",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": "TASK202601161127525854-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:41:41.844Z",
|
||||
"assetsDownloaded": 47,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-SN0208-389_瑶光_朴美_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-SN0208-389_瑶光_朴美_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-SN0208-389_瑶光_朴美_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-SN0208-389_all_2d10faf8-346e-4435-9dcc-c3cd28a02d2c_1768923722086.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:42:02.541Z"
|
||||
},
|
||||
{
|
||||
"materialId": "228c7c9b-eafa-4b52-b94c-198373e3902f",
|
||||
"productModel": "DNZ0247-185",
|
||||
"taskNo": "TASK202601161049011252-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:42:03.543Z",
|
||||
"assetsDownloaded": 32,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0247-185_瑶光_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0247-185_瑶光_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0247-185_all_228c7c9b-eafa-4b52-b94c-198373e3902f_1768923735908.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:42:16.100Z"
|
||||
},
|
||||
{
|
||||
"materialId": "dc49b1b0-2b5f-414e-b099-bb0388734cef",
|
||||
"productModel": "HXD0055",
|
||||
"taskNo": "TASK202601161020158321-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:42:17.108Z",
|
||||
"assetsDownloaded": 26,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\HXD0055_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\HXD0055_若兰_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\HXD0055_all_dc49b1b0-2b5f-414e-b099-bb0388734cef_1768923745085.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:42:25.188Z"
|
||||
},
|
||||
{
|
||||
"materialId": "0418b190-ec90-47ed-a868-9917d0207b6a",
|
||||
"productModel": "DNZ0117",
|
||||
"taskNo": "TASK202601151408302015-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:42:26.200Z",
|
||||
"assetsDownloaded": 9,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0117_苏蕙_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0117_苏蕙_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0117_all_0418b190-ec90-47ed-a868-9917d0207b6a_1768923749371.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:42:29.449Z"
|
||||
},
|
||||
{
|
||||
"materialId": "81802ea6-2b28-46d6-8fc7-931e88b338f3",
|
||||
"productModel": "SZ0135",
|
||||
"taskNo": "TASK202601161633198963-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:42:30.453Z",
|
||||
"assetsDownloaded": 20,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZ0135_苏蕙_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZ0135_all_81802ea6-2b28-46d6-8fc7-931e88b338f3_1768923755688.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:42:35.757Z"
|
||||
},
|
||||
{
|
||||
"materialId": "36c377fe-49c4-432b-a717-a243c0e7ab89",
|
||||
"productModel": "BG0037-605",
|
||||
"taskNo": "TASK202601161402598214-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:42:36.771Z",
|
||||
"assetsDownloaded": 220,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\BG0037-605_高恬琳_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\BG0037-605_all_36c377fe-49c4-432b-a717-a243c0e7ab89_1768923813218.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:43:33.840Z"
|
||||
},
|
||||
{
|
||||
"materialId": "d18ce556-e3f1-49e5-beb3-a39fe044546f",
|
||||
"productModel": "SJ0339",
|
||||
"taskNo": "TASK202601161724017457-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:43:34.856Z",
|
||||
"assetsDownloaded": 22,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0339_佘太君_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0339_all_d18ce556-e3f1-49e5-beb3-a39fe044546f_1768923828519.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:43:49.087Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ffb8a024-667d-4284-abd9-85a11e94fd54",
|
||||
"productModel": "CJ0252",
|
||||
"taskNo": "TASK202601161629520328-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:43:50.098Z",
|
||||
"assetsDownloaded": 5,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_上生_欧意朗_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_all_ffb8a024-667d-4284-abd9-85a11e94fd54_1768923834666.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:43:54.885Z"
|
||||
},
|
||||
{
|
||||
"materialId": "5875c1db-0f3b-4760-9f7e-045446d37aac",
|
||||
"productModel": "SZ0135",
|
||||
"taskNo": null,
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:43:55.899Z",
|
||||
"assetsDownloaded": 1,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZ0135_苏蕙_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZ0135_all_5875c1db-0f3b-4760-9f7e-045446d37aac_1768923838917.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:43:59.125Z"
|
||||
}
|
||||
]
|
||||
@ -1,128 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:44:27.485Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:44:27.500Z"
|
||||
},
|
||||
{
|
||||
"materialId": "d6b9cf44-0631-4237-a67a-495a13604b5e",
|
||||
"productModel": "SJZ0008-9085",
|
||||
"taskNo": "TASK202601191541221732-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:44:28.510Z",
|
||||
"assetsDownloaded": 8,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJZ0008-9085_飞鸿_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJZ0008-9085_all_d6b9cf44-0631-4237-a67a-495a13604b5e_1768923877837.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:44:38.227Z"
|
||||
},
|
||||
{
|
||||
"materialId": "cb880417-0f44-4541-8bbe-cf82b388b0b1",
|
||||
"productModel": "SZ0068",
|
||||
"taskNo": "TASK202601161205109377-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:44:39.232Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZ0068_苏蕙_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZ0068_all_cb880417-0f44-4541-8bbe-cf82b388b0b1_1768923890578.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:44:51.047Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ef59dd88-d45a-47a8-9526-3ee03168874f",
|
||||
"productModel": "CYJ0062",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:44:52.058Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:44:52.066Z"
|
||||
},
|
||||
{
|
||||
"materialId": "101aea94-7460-4ae6-8980-a5a87698574d",
|
||||
"productModel": "CYJ0062",
|
||||
"taskNo": "TASK202601201000475671-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:44:53.070Z",
|
||||
"assetsDownloaded": 44,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CYJ0062_紫苏_欧意朗_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CYJ0062_紫苏_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CYJ0062_all_101aea94-7460-4ae6-8980-a5a87698574d_1768923909498.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:45:10.352Z"
|
||||
},
|
||||
{
|
||||
"materialId": "a2e9568b-eca1-4896-abfa-512f8b2f8047",
|
||||
"productModel": "XG0143",
|
||||
"taskNo": "TASK202601191330553662-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:45:11.364Z",
|
||||
"assetsDownloaded": 30,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0143_乐游_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0143_乐游_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0143_乐游_卓禾_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0143_all_a2e9568b-eca1-4896-abfa-512f8b2f8047_1768923924497.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:45:25.212Z"
|
||||
},
|
||||
{
|
||||
"materialId": "310b405f-a1df-4f89-87b0-ea61960162fb",
|
||||
"productModel": "CTG0219-0803",
|
||||
"taskNo": "TASK202601191429302051-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:45:26.218Z",
|
||||
"assetsDownloaded": 4,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CTG0219-0803_曹丕_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CTG0219-0803_all_310b405f-a1df-4f89-87b0-ea61960162fb_1768923928212.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:45:28.346Z"
|
||||
},
|
||||
{
|
||||
"materialId": "581173bc-672d-411b-81a4-eb58b5db7d37",
|
||||
"productModel": "CJ0222-336",
|
||||
"taskNo": "TASK202601161122097500-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:45:29.351Z",
|
||||
"assetsDownloaded": 15,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0222-336_余笙_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0222-336_all_581173bc-672d-411b-81a4-eb58b5db7d37_1768923939951.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:45:40.889Z"
|
||||
},
|
||||
{
|
||||
"materialId": "0dab1ccb-6c17-4a87-85f9-062573c3fac9",
|
||||
"productModel": "CJ0222-336-BU",
|
||||
"taskNo": "TASK202601201344429773-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:45:41.902Z",
|
||||
"assetsDownloaded": 1,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0222-336-BU_余笙_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0222-336-BU_all_0dab1ccb-6c17-4a87-85f9-062573c3fac9_1768923944485.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:45:44.805Z"
|
||||
},
|
||||
{
|
||||
"materialId": "a9fff2da-562b-492d-93de-d3d7f6af5a83",
|
||||
"productModel": "DNZ0247-181",
|
||||
"taskNo": "TASK202601201327005834-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:45:45.810Z",
|
||||
"assetsDownloaded": 24,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0247-181_瑶光_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0247-181_瑶光_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0247-181_all_a9fff2da-562b-492d-93de-d3d7f6af5a83_1768923956465.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:45:57.136Z"
|
||||
}
|
||||
]
|
||||
@ -1,126 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:46:20.624Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:46:20.640Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ef59dd88-d45a-47a8-9526-3ee03168874f",
|
||||
"productModel": "CYJ0062",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:46:21.655Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:46:21.662Z"
|
||||
},
|
||||
{
|
||||
"materialId": "b985e22b-5ecc-495d-8405-0ff760fe25f5",
|
||||
"productModel": "SZ0015",
|
||||
"taskNo": "TASK202601201114348022-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:46:22.671Z",
|
||||
"assetsDownloaded": 180,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZ0015_苏蕙_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZ0015_all_b985e22b-5ecc-495d-8405-0ff760fe25f5_1768924053857.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:47:37.508Z"
|
||||
},
|
||||
{
|
||||
"materialId": "7d01a3ab-8a99-4966-9f5e-53b5ef6cfad1",
|
||||
"productModel": "CJ0252",
|
||||
"taskNo": "TASK202601201149497501-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:47:38.518Z",
|
||||
"assetsDownloaded": 1,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_上生_欧意朗_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_all_7d01a3ab-8a99-4966-9f5e-53b5ef6cfad1_1768924066254.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:47:47.315Z"
|
||||
},
|
||||
{
|
||||
"materialId": "104cd397-c076-46d4-82c5-913d928f8903",
|
||||
"productModel": "DNZ0203SZ0157-024",
|
||||
"taskNo": "TASK202601201006286282-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:47:48.322Z",
|
||||
"assetsDownloaded": 9,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0203SZ0157-024_瑶光_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0203SZ0157-024_all_104cd397-c076-46d4-82c5-913d928f8903_1768924073887.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:47:54.262Z"
|
||||
},
|
||||
{
|
||||
"materialId": "b51db545-c44c-4e45-9fad-6c3dda015d14",
|
||||
"productModel": "GBPM-BJ0192",
|
||||
"taskNo": "TASK202601201359535123-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:47:55.263Z",
|
||||
"assetsDownloaded": 76,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-BJ0192_苏蕙_朴美_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-BJ0192_苏蕙_朴美_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-BJ0192_苏蕙_朴美_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-BJ0192_all_b51db545-c44c-4e45-9fad-6c3dda015d14_1768924133671.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:48:58.055Z"
|
||||
},
|
||||
{
|
||||
"materialId": "8d1a37b6-36bd-43da-abb0-85c01bf74884",
|
||||
"productModel": "DNZ0302SZ0517-024-BU",
|
||||
"taskNo": "TASK202601201424077779-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:48:59.056Z",
|
||||
"assetsDownloaded": 9,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0302SZ0517-024-BU_瑶光_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0302SZ0517-024-BU_all_8d1a37b6-36bd-43da-abb0-85c01bf74884_1768924144215.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:49:04.592Z"
|
||||
},
|
||||
{
|
||||
"materialId": "00790594-1a70-45c7-aa14-08f67743fc22",
|
||||
"productModel": "CBG0039-685",
|
||||
"taskNo": "TASK202601160942298162-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:49:05.602Z",
|
||||
"assetsDownloaded": 15,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CBG0039-685_曹丕_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CBG0039-685_all_00790594-1a70-45c7-aa14-08f67743fc22_1768924151754.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:49:11.878Z"
|
||||
},
|
||||
{
|
||||
"materialId": "0dbc5c23-785a-4d10-80e7-2b2106ec2564",
|
||||
"productModel": "JG0004",
|
||||
"taskNo": "TASK202601201339588164-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:49:12.885Z",
|
||||
"assetsDownloaded": 1,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\JG0004_悠然_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\JG0004_all_0dbc5c23-785a-4d10-80e7-2b2106ec2564_1768924155399.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:49:15.618Z"
|
||||
},
|
||||
{
|
||||
"materialId": "2691cc24-c863-4c74-9f55-51b3c99dfc3e",
|
||||
"productModel": "DNZ0002-623",
|
||||
"taskNo": "TASK202601191713442026-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:49:16.627Z",
|
||||
"assetsDownloaded": 6,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0002-623_飞鸿_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0002-623_all_2691cc24-c863-4c74-9f55-51b3c99dfc3e_1768924160568.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:49:20.942Z"
|
||||
}
|
||||
]
|
||||
@ -1,62 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:49:46.491Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:49:46.506Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ef59dd88-d45a-47a8-9526-3ee03168874f",
|
||||
"productModel": "CYJ0062",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:49:47.523Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:49:47.530Z"
|
||||
},
|
||||
{
|
||||
"materialId": "c4f3c139-ca97-4497-a0c1-843cbedbe92f",
|
||||
"productModel": "DNZ0154",
|
||||
"taskNo": "TASK202601201149194381-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:49:48.546Z",
|
||||
"assetsDownloaded": 64,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0154_苏蕙_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0154_苏蕙_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0154_all_c4f3c139-ca97-4497-a0c1-843cbedbe92f_1768924214819.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:50:15.934Z"
|
||||
},
|
||||
{
|
||||
"materialId": "93f088a0-ce01-479a-86b7-cac9a26375e0",
|
||||
"productModel": "DNZ0260-373",
|
||||
"taskNo": "TASK202601200938059614-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:50:16.948Z",
|
||||
"assetsDownloaded": 25,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0260-373_瑶光_欧意朗_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0260-373_瑶光_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0260-373_all_93f088a0-ce01-479a-86b7-cac9a26375e0_1768924226477.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:50:27.146Z"
|
||||
},
|
||||
{
|
||||
"materialId": "b3b5b584-5cb9-47cd-a79a-e8ff9cd18242",
|
||||
"productModel": "DNZ0199",
|
||||
"taskNo": "TASK202601201533348846-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:50:28.149Z",
|
||||
"assetsDownloaded": 21,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0199_苏蕙_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0199_苏蕙_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0199_all_b3b5b584-5cb9-47cd-a79a-e8ff9cd18242_1768924238592.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:50:39.261Z"
|
||||
}
|
||||
]
|
||||
@ -1,20 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:53:30.803Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:53:30.820Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ef59dd88-d45a-47a8-9526-3ee03168874f",
|
||||
"productModel": "CYJ0062",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:53:31.824Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:53:31.839Z"
|
||||
}
|
||||
]
|
||||
@ -1,20 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "2c1837b8-6927-4a8c-8226-ab919124d11f",
|
||||
"productModel": "GBPM-SN0208-389",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:55:17.311Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:55:17.327Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ef59dd88-d45a-47a8-9526-3ee03168874f",
|
||||
"productModel": "CYJ0062",
|
||||
"taskNo": null,
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T15:55:18.333Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T15:55:18.341Z"
|
||||
}
|
||||
]
|
||||
@ -1,133 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "c1cb5ed5-6285-467e-8d55-d9bd58ecf9dc",
|
||||
"productModel": "CJ0247-533",
|
||||
"taskNo": "TASK202601161744291258-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:55:54.819Z",
|
||||
"assetsDownloaded": 32,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0247-533_余笙_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0247-533_all_c1cb5ed5-6285-467e-8d55-d9bd58ecf9dc_1768924673118.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:58:05.763Z"
|
||||
},
|
||||
{
|
||||
"materialId": "80dc7ae2-4012-4ca4-9a77-01c3e74b48f7",
|
||||
"productModel": "GBGJ-DNZ0379",
|
||||
"taskNo": "TASK202601161540424935-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:58:06.767Z",
|
||||
"assetsDownloaded": 10,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBGJ-DNZ0379_苏蕙_顾家_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBGJ-DNZ0379_苏蕙_顾家_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBGJ-DNZ0379_all_80dc7ae2-4012-4ca4-9a77-01c3e74b48f7_1768924691257.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:58:11.614Z"
|
||||
},
|
||||
{
|
||||
"materialId": "1630671b-0151-4c40-a2ad-82e2a5626436",
|
||||
"productModel": "SZT0169",
|
||||
"taskNo": "TASK202601171040171816-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:58:12.618Z",
|
||||
"assetsDownloaded": 2,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZT0169_佘太君_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZT0169_all_1630671b-0151-4c40-a2ad-82e2a5626436_1768924704437.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:58:26.174Z"
|
||||
},
|
||||
{
|
||||
"materialId": "f10fc951-0028-487c-a387-bc560a38690b",
|
||||
"productModel": "DNZ0204-608",
|
||||
"taskNo": "TASK202601161030231265-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:58:27.178Z",
|
||||
"assetsDownloaded": 12,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0204-608_瑶光_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0204-608_all_f10fc951-0028-487c-a387-bc560a38690b_1768924710861.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:58:31.095Z"
|
||||
},
|
||||
{
|
||||
"materialId": "f3e583bf-29cf-440f-821d-cd1c076fd11d",
|
||||
"productModel": "ZSJ0006",
|
||||
"taskNo": "TASK202601170953515009-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:58:32.108Z",
|
||||
"assetsDownloaded": 22,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\ZSJ0006_紫苏_亿家达_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\ZSJ0006_all_f3e583bf-29cf-440f-821d-cd1c076fd11d_1768924722684.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:58:43.608Z"
|
||||
},
|
||||
{
|
||||
"materialId": "c3077ae7-3504-4773-b181-e572a101daae",
|
||||
"productModel": "CJ0227-929",
|
||||
"taskNo": "TASK202601161715466096-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:58:44.615Z",
|
||||
"assetsDownloaded": 23,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0227-929_余笙_亿家达_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0227-929_all_c3077ae7-3504-4773-b181-e572a101daae_1768924739157.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:59:00.469Z"
|
||||
},
|
||||
{
|
||||
"materialId": "38ac3492-aba1-4faa-ba68-c03fdd805635",
|
||||
"productModel": "AD0024",
|
||||
"taskNo": "TASK202601161359289218-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:59:01.483Z",
|
||||
"assetsDownloaded": 48,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0024_若兰_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0024_all_38ac3492-aba1-4faa-ba68-c03fdd805635_1768924769062.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:59:31.757Z"
|
||||
},
|
||||
{
|
||||
"materialId": "71bcd09b-ded4-43f9-82b8-c077f125dca1",
|
||||
"productModel": "SJ0345",
|
||||
"taskNo": "TASK202601171730043453-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:59:32.766Z",
|
||||
"assetsDownloaded": 12,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0345_紫苏_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0345_all_71bcd09b-ded4-43f9-82b8-c077f125dca1_1768924778696.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T15:59:39.220Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ca07a531-7349-42df-9a5e-7fed9bee02d8",
|
||||
"productModel": "CJ0034-568",
|
||||
"taskNo": "TASK202601161137230890-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T15:59:40.223Z",
|
||||
"assetsDownloaded": 111,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0034-568_余笙_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0034-568_all_ca07a531-7349-42df-9a5e-7fed9bee02d8_1768924807599.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:00:09.479Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ccd0dd74-df91-4913-83d3-b990987805ad",
|
||||
"productModel": "CJ0252",
|
||||
"taskNo": "TASK202601161624467049-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:00:10.488Z",
|
||||
"assetsDownloaded": 1,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_上生_亿家达_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_all_ccd0dd74-df91-4913-83d3-b990987805ad_1768924817920.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:00:18.972Z"
|
||||
}
|
||||
]
|
||||
@ -1,135 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "7ef32d4e-ac2d-4bdc-8309-bb12d0bb661b",
|
||||
"productModel": "DYR",
|
||||
"taskNo": "TASK202601171606458301-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:01:26.749Z",
|
||||
"assetsDownloaded": 1,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DYR_上生_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DYR_all_7ef32d4e-ac2d-4bdc-8309-bb12d0bb661b_1768924888370.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:01:28.564Z"
|
||||
},
|
||||
{
|
||||
"materialId": "d76161d3-ae0f-4d58-8821-b335b1434354",
|
||||
"productModel": "CJ0252",
|
||||
"taskNo": "TASK202601171049580555-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:01:29.577Z",
|
||||
"assetsDownloaded": 20,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_上生_欧意朗_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_上生_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_all_d76161d3-ae0f-4d58-8821-b335b1434354_1768924895597.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:01:36.021Z"
|
||||
},
|
||||
{
|
||||
"materialId": "77aea4ac-1818-4307-9e09-2a9f09117dfa",
|
||||
"productModel": "CJ0252",
|
||||
"taskNo": "TASK202601171054169437-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:01:37.031Z",
|
||||
"assetsDownloaded": 20,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_上生_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_上生_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0252_all_77aea4ac-1818-4307-9e09-2a9f09117dfa_1768924903283.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:01:43.714Z"
|
||||
},
|
||||
{
|
||||
"materialId": "d9239fdb-e12e-4f38-9ba2-98865cfac6ab",
|
||||
"productModel": "BG0029-544",
|
||||
"taskNo": "TASK202601171030458400-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:01:44.715Z",
|
||||
"assetsDownloaded": 20,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\BG0029-544_飞鸿_亿家达_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\BG0029-544_all_d9239fdb-e12e-4f38-9ba2-98865cfac6ab_1768924914900.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:01:55.884Z"
|
||||
},
|
||||
{
|
||||
"materialId": "2ee26169-fdd7-446e-afe2-dade5baecc58",
|
||||
"productModel": "XG0242",
|
||||
"taskNo": "TASK202601191044080590-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:01:56.888Z",
|
||||
"assetsDownloaded": 6,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0242_乐游_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0242_all_2ee26169-fdd7-446e-afe2-dade5baecc58_1768924918763.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:01:58.924Z"
|
||||
},
|
||||
{
|
||||
"materialId": "7a2ca8a5-c996-4765-a689-3ee5739e57d6",
|
||||
"productModel": "DSG0052",
|
||||
"taskNo": null,
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:01:59.938Z",
|
||||
"assetsDownloaded": 4,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0052_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0052_all_7a2ca8a5-c996-4765-a689-3ee5739e57d6_1768924921498.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:02:01.656Z"
|
||||
},
|
||||
{
|
||||
"materialId": "a973ff26-d93d-4d5e-8918-5e7bc4fad067",
|
||||
"productModel": "DSG0052",
|
||||
"taskNo": "TASK202601161054260586-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:02:02.660Z",
|
||||
"assetsDownloaded": 4,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0052_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0052_all_a973ff26-d93d-4d5e-8918-5e7bc4fad067_1768924924911.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:02:05.077Z"
|
||||
},
|
||||
{
|
||||
"materialId": "3546d607-f096-4a08-859e-9b137bcc7c55",
|
||||
"productModel": "DNZ0258",
|
||||
"taskNo": "TASK202601191050583077-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:02:06.092Z",
|
||||
"assetsDownloaded": 84,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0258_苏蕙_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0258_all_3546d607-f096-4a08-859e-9b137bcc7c55_1768924972609.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:02:54.312Z"
|
||||
},
|
||||
{
|
||||
"materialId": "de1b6a95-7872-4dd6-9cde-c433ad99f0bb",
|
||||
"productModel": "GBGJ-DNZ0366",
|
||||
"taskNo": "TASK202601161316507431-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:02:55.314Z",
|
||||
"assetsDownloaded": 8,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBGJ-DNZ0366_苏蕙_顾家_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBGJ-DNZ0366_all_de1b6a95-7872-4dd6-9cde-c433ad99f0bb_1768924980649.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:03:00.853Z"
|
||||
},
|
||||
{
|
||||
"materialId": "cca4a251-9561-4fee-bd38-7dd9c36d0bf4",
|
||||
"productModel": "DNZ0117",
|
||||
"taskNo": "TASK202601191134380453-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:03:01.860Z",
|
||||
"assetsDownloaded": 42,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0117_苏蕙_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0117_苏蕙_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0117_all_cca4a251-9561-4fee-bd38-7dd9c36d0bf4_1768925014564.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:03:35.816Z"
|
||||
}
|
||||
]
|
||||
@ -1,130 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "3546d607-f096-4a08-859e-9b137bcc7c55",
|
||||
"productModel": "DNZ0258",
|
||||
"taskNo": "TASK202601191050583077-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:02:40.695Z",
|
||||
"assetsDownloaded": 84,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0258_苏蕙_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0258_all_3546d607-f096-4a08-859e-9b137bcc7c55_1768925008891.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:03:30.302Z"
|
||||
},
|
||||
{
|
||||
"materialId": "de1b6a95-7872-4dd6-9cde-c433ad99f0bb",
|
||||
"productModel": "GBGJ-DNZ0366",
|
||||
"taskNo": "TASK202601161316507431-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T16:03:31.311Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T16:03:31.320Z"
|
||||
},
|
||||
{
|
||||
"materialId": "cca4a251-9561-4fee-bd38-7dd9c36d0bf4",
|
||||
"productModel": "DNZ0117",
|
||||
"taskNo": "TASK202601191134380453-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:03:32.324Z",
|
||||
"assetsDownloaded": 42,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0117_苏蕙_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0117_苏蕙_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0117_all_cca4a251-9561-4fee-bd38-7dd9c36d0bf4_1768925032476.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:03:53.638Z"
|
||||
},
|
||||
{
|
||||
"materialId": "1e931624-40e4-496c-a755-6d5cb7a6ee73",
|
||||
"productModel": "GBGJ-DNZ0366",
|
||||
"taskNo": "TASK202601191112440382-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:03:54.649Z",
|
||||
"assetsDownloaded": 2,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBGJ-DNZ0366_若兰_顾家_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBGJ-DNZ0366_all_1e931624-40e4-496c-a755-6d5cb7a6ee73_1768925036302.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:03:56.373Z"
|
||||
},
|
||||
{
|
||||
"materialId": "cd90df0b-e124-4194-b35c-ea90bd98ad36",
|
||||
"productModel": "CJ0034-568-BU",
|
||||
"taskNo": "TASK202601191145541166-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:03:57.385Z",
|
||||
"assetsDownloaded": 63,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0034-568-BU_余笙_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0034-568-BU_all_cd90df0b-e124-4194-b35c-ea90bd98ad36_1768925079573.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:04:40.660Z"
|
||||
},
|
||||
{
|
||||
"materialId": "326330ab-90f6-4c52-bc20-52c183758cac",
|
||||
"productModel": "XG0132",
|
||||
"taskNo": "TASK202601161347340444-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:04:41.669Z",
|
||||
"assetsDownloaded": 7,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0132_乐游_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0132_all_326330ab-90f6-4c52-bc20-52c183758cac_1768925087288.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:04:47.459Z"
|
||||
},
|
||||
{
|
||||
"materialId": "0a5c935c-5023-4f25-b2e2-d1bad5cba6e4",
|
||||
"productModel": "DSG0052",
|
||||
"taskNo": "TASK202601191112042240-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:04:48.464Z",
|
||||
"assetsDownloaded": 4,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0052_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0052_all_0a5c935c-5023-4f25-b2e2-d1bad5cba6e4_1768925091020.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:04:51.185Z"
|
||||
},
|
||||
{
|
||||
"materialId": "650154bb-cc79-4a93-8e09-06e4fb8238e0",
|
||||
"productModel": "XG0148",
|
||||
"taskNo": "TASK202601170949480206-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:04:52.191Z",
|
||||
"assetsDownloaded": 16,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0148_乐游_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0148_乐游_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0148_all_650154bb-cc79-4a93-8e09-06e4fb8238e0_1768925099196.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:04:59.613Z"
|
||||
},
|
||||
{
|
||||
"materialId": "404a427e-42a8-4251-ac57-01846c07dcab",
|
||||
"productModel": "DSG0095",
|
||||
"taskNo": "TASK202601161107108287-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:05:00.628Z",
|
||||
"assetsDownloaded": 9,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0095_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0095_all_404a427e-42a8-4251-ac57-01846c07dcab_1768925103468.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:05:03.599Z"
|
||||
},
|
||||
{
|
||||
"materialId": "05099a39-3afc-4f16-b2dd-0faa84b042b0",
|
||||
"productModel": "CZ0070",
|
||||
"taskNo": "TASK202601191117065271-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:05:04.613Z",
|
||||
"assetsDownloaded": 16,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CZ0070_瑶光_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CZ0070_all_05099a39-3afc-4f16-b2dd-0faa84b042b0_1768925112027.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:05:12.355Z"
|
||||
}
|
||||
]
|
||||
@ -1,134 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "cd90df0b-e124-4194-b35c-ea90bd98ad36",
|
||||
"productModel": "CJ0034-568-BU",
|
||||
"taskNo": "TASK202601191145541166-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:03:57.284Z",
|
||||
"assetsDownloaded": 63,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0034-568-BU_余笙_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CJ0034-568-BU_all_cd90df0b-e124-4194-b35c-ea90bd98ad36_1768925081965.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:04:42.081Z"
|
||||
},
|
||||
{
|
||||
"materialId": "326330ab-90f6-4c52-bc20-52c183758cac",
|
||||
"productModel": "XG0132",
|
||||
"taskNo": "TASK202601161347340444-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:04:43.091Z",
|
||||
"assetsDownloaded": 7,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0132_乐游_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0132_all_326330ab-90f6-4c52-bc20-52c183758cac_1768925087895.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:04:47.937Z"
|
||||
},
|
||||
{
|
||||
"materialId": "0a5c935c-5023-4f25-b2e2-d1bad5cba6e4",
|
||||
"productModel": "DSG0052",
|
||||
"taskNo": "TASK202601191112042240-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:04:48.941Z",
|
||||
"assetsDownloaded": 4,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0052_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0052_all_0a5c935c-5023-4f25-b2e2-d1bad5cba6e4_1768925091297.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:04:51.355Z"
|
||||
},
|
||||
{
|
||||
"materialId": "650154bb-cc79-4a93-8e09-06e4fb8238e0",
|
||||
"productModel": "XG0148",
|
||||
"taskNo": "TASK202601170949480206-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:04:52.367Z",
|
||||
"assetsDownloaded": 16,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0148_乐游_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0148_乐游_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0148_all_650154bb-cc79-4a93-8e09-06e4fb8238e0_1768925099802.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:04:59.851Z"
|
||||
},
|
||||
{
|
||||
"materialId": "404a427e-42a8-4251-ac57-01846c07dcab",
|
||||
"productModel": "DSG0095",
|
||||
"taskNo": "TASK202601161107108287-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:05:00.864Z",
|
||||
"assetsDownloaded": 9,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0095_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0095_all_404a427e-42a8-4251-ac57-01846c07dcab_1768925103793.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:05:03.833Z"
|
||||
},
|
||||
{
|
||||
"materialId": "05099a39-3afc-4f16-b2dd-0faa84b042b0",
|
||||
"productModel": "CZ0070",
|
||||
"taskNo": "TASK202601191117065271-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:05:04.846Z",
|
||||
"assetsDownloaded": 16,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CZ0070_瑶光_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CZ0070_all_05099a39-3afc-4f16-b2dd-0faa84b042b0_1768925112617.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:05:12.664Z"
|
||||
},
|
||||
{
|
||||
"materialId": "699eb818-7cca-45b9-be71-6fbbce017f81",
|
||||
"productModel": "SJ0005",
|
||||
"taskNo": "TASK202601191439591449-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:05:13.666Z",
|
||||
"assetsDownloaded": 63,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0005_佘太君_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0005_all_699eb818-7cca-45b9-be71-6fbbce017f81_1768925141997.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:05:43.734Z"
|
||||
},
|
||||
{
|
||||
"materialId": "15c9cea9-bcb7-4674-9ce3-a5b55ee7d2fe",
|
||||
"productModel": "SZT0026-512",
|
||||
"taskNo": "TASK202601161742138347-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:05:44.745Z",
|
||||
"assetsDownloaded": 28,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZT0026-512_飞鸿_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZT0026-512_飞鸿_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SZT0026-512_all_15c9cea9-bcb7-4674-9ce3-a5b55ee7d2fe_1768925163035.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:06:04.043Z"
|
||||
},
|
||||
{
|
||||
"materialId": "b704d316-db31-472e-80ee-0997f73af0f0",
|
||||
"productModel": "DSG0095",
|
||||
"taskNo": "TASK202601191443479852-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:06:05.043Z",
|
||||
"assetsDownloaded": 9,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0095_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0095_all_b704d316-db31-472e-80ee-0997f73af0f0_1768925168175.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:06:08.296Z"
|
||||
},
|
||||
{
|
||||
"materialId": "7c1fd57e-1f3e-49e7-9408-fdf364b84d9a",
|
||||
"productModel": "DSG0048",
|
||||
"taskNo": "TASK202601161051162049-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:06:09.301Z",
|
||||
"assetsDownloaded": 4,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0048_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0048_all_7c1fd57e-1f3e-49e7-9408-fdf364b84d9a_1768925170943.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:06:11.009Z"
|
||||
}
|
||||
]
|
||||
@ -1,135 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "15c9cea9-bcb7-4674-9ce3-a5b55ee7d2fe",
|
||||
"productModel": "SZT0026-512",
|
||||
"taskNo": "TASK202601161742138347-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T16:05:44.889Z",
|
||||
"assetsDownloaded": 28,
|
||||
"error": "ENOENT: no such file or directory, open 'D:\\AI Code\\gongxiangp2\\uploads\\temp\\migrate-15c9cea9-bcb7-4674-9ce3-a5b55ee7d2fe\\main-8-分类置物-取之有道.jpg'",
|
||||
"endTime": "2026-01-20T16:06:04.061Z"
|
||||
},
|
||||
{
|
||||
"materialId": "b704d316-db31-472e-80ee-0997f73af0f0",
|
||||
"productModel": "DSG0095",
|
||||
"taskNo": "TASK202601191443479852-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:06:05.073Z",
|
||||
"assetsDownloaded": 9,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0095_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0095_all_b704d316-db31-472e-80ee-0997f73af0f0_1768925168351.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:06:08.409Z"
|
||||
},
|
||||
{
|
||||
"materialId": "7c1fd57e-1f3e-49e7-9408-fdf364b84d9a",
|
||||
"productModel": "DSG0048",
|
||||
"taskNo": "TASK202601161051162049-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:06:09.410Z",
|
||||
"assetsDownloaded": 4,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0048_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0048_all_7c1fd57e-1f3e-49e7-9408-fdf364b84d9a_1768925170966.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:06:11.032Z"
|
||||
},
|
||||
{
|
||||
"materialId": "737e34de-a83e-49c6-bfb3-3ec0610dc061",
|
||||
"productModel": "AD0320",
|
||||
"taskNo": "TASK202601190938146715-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:06:12.041Z",
|
||||
"assetsDownloaded": 59,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0320_紫苏_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0320_紫苏_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0320_紫苏_亿家达_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0320_all_737e34de-a83e-49c6-bfb3-3ec0610dc061_1768925213298.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:06:56.008Z"
|
||||
},
|
||||
{
|
||||
"materialId": "29125d36-bbfd-44ef-8db5-76a73802e115",
|
||||
"productModel": "XG0132",
|
||||
"taskNo": "TASK202601191534060576-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:06:57.022Z",
|
||||
"assetsDownloaded": 7,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0132_乐游_欧意朗_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0132_all_29125d36-bbfd-44ef-8db5-76a73802e115_1768925220469.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:07:00.633Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ab5eabe5-64cd-46fd-9665-7ece31d0455c",
|
||||
"productModel": "DSG0048",
|
||||
"taskNo": "TASK202601191548580482-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:07:01.639Z",
|
||||
"assetsDownloaded": 4,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0048_朝菌_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DSG0048_all_ab5eabe5-64cd-46fd-9665-7ece31d0455c_1768925222763.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:07:02.837Z"
|
||||
},
|
||||
{
|
||||
"materialId": "c49e0e33-045c-49e4-8aad-8d1831646ed3",
|
||||
"productModel": "XG0148",
|
||||
"taskNo": "TASK202601191656235202-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:07:03.839Z",
|
||||
"assetsDownloaded": 16,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0148_乐游_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0148_乐游_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\XG0148_all_c49e0e33-045c-49e4-8aad-8d1831646ed3_1768925233628.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:07:14.005Z"
|
||||
},
|
||||
{
|
||||
"materialId": "1a6b7912-e942-424b-b576-50c0f416c509",
|
||||
"productModel": "CFZW0152",
|
||||
"taskNo": "TASK202601191701491995-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:07:15.015Z",
|
||||
"assetsDownloaded": 6,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CFZW0152_上生_亿家达_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CFZW0152_all_1a6b7912-e942-424b-b576-50c0f416c509_1768925238481.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:07:18.738Z"
|
||||
},
|
||||
{
|
||||
"materialId": "465fbe8f-03c1-4ef8-aa91-aa15c51531b5",
|
||||
"productModel": "SJ0204",
|
||||
"taskNo": "TASK202601191040107232-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:07:19.741Z",
|
||||
"assetsDownloaded": 16,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0204_悠然_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0204_悠然_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0204_all_465fbe8f-03c1-4ef8-aa91-aa15c51531b5_1768925255012.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:07:35.987Z"
|
||||
},
|
||||
{
|
||||
"materialId": "e8b376b3-ef2a-462f-b636-67aaceabfe82",
|
||||
"productModel": "GBPM-AD0312",
|
||||
"taskNo": "TASK202601191543095743-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:07:36.990Z",
|
||||
"assetsDownloaded": 56,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-AD0312_若兰_朴美_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-AD0312_若兰_朴美_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-AD0312_若兰_朴美_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\GBPM-AD0312_all_e8b376b3-ef2a-462f-b636-67aaceabfe82_1768925292010.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:08:13.749Z"
|
||||
}
|
||||
]
|
||||
@ -1,120 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "737e34de-a83e-49c6-bfb3-3ec0610dc061",
|
||||
"productModel": "AD0320",
|
||||
"taskNo": "TASK202601190938146715-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:06:33.698Z",
|
||||
"assetsDownloaded": 59,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0320_紫苏_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0320_紫苏_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0320_紫苏_亿家达_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\AD0320_all_737e34de-a83e-49c6-bfb3-3ec0610dc061_1768925233286.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:07:14.445Z"
|
||||
},
|
||||
{
|
||||
"materialId": "29125d36-bbfd-44ef-8db5-76a73802e115",
|
||||
"productModel": "XG0132",
|
||||
"taskNo": "TASK202601191534060576-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T16:07:15.451Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T16:07:15.457Z"
|
||||
},
|
||||
{
|
||||
"materialId": "ab5eabe5-64cd-46fd-9665-7ece31d0455c",
|
||||
"productModel": "DSG0048",
|
||||
"taskNo": "TASK202601191548580482-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T16:07:16.460Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T16:07:16.468Z"
|
||||
},
|
||||
{
|
||||
"materialId": "c49e0e33-045c-49e4-8aad-8d1831646ed3",
|
||||
"productModel": "XG0148",
|
||||
"taskNo": "TASK202601191656235202-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T16:07:17.470Z",
|
||||
"error": "没有可迁移的资产",
|
||||
"endTime": "2026-01-20T16:07:17.478Z"
|
||||
},
|
||||
{
|
||||
"materialId": "1a6b7912-e942-424b-b576-50c0f416c509",
|
||||
"productModel": "CFZW0152",
|
||||
"taskNo": "TASK202601191701491995-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:07:18.482Z",
|
||||
"assetsDownloaded": 6,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CFZW0152_上生_亿家达_详情图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\CFZW0152_all_1a6b7912-e942-424b-b576-50c0f416c509_1768925242277.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:07:22.529Z"
|
||||
},
|
||||
{
|
||||
"materialId": "465fbe8f-03c1-4ef8-aa91-aa15c51531b5",
|
||||
"productModel": "SJ0204",
|
||||
"taskNo": "TASK202601191040107232-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:07:23.536Z",
|
||||
"assetsDownloaded": 16,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0204_悠然_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0204_悠然_卓禾_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\SJ0204_all_465fbe8f-03c1-4ef8-aa91-aa15c51531b5_1768925256736.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:07:36.912Z"
|
||||
},
|
||||
{
|
||||
"materialId": "e8b376b3-ef2a-462f-b636-67aaceabfe82",
|
||||
"productModel": "GBPM-AD0312",
|
||||
"taskNo": "TASK202601191543095743-01-01",
|
||||
"status": "failed",
|
||||
"startTime": "2026-01-20T16:07:37.922Z",
|
||||
"assetsDownloaded": 56,
|
||||
"error": "ENOENT: no such file or directory, open 'D:\\AI Code\\gongxiangp2\\uploads\\temp\\migrate-e8b376b3-ef2a-462f-b636-67aaceabfe82\\main-14-主图3.jpg'",
|
||||
"endTime": "2026-01-20T16:08:13.769Z"
|
||||
},
|
||||
{
|
||||
"materialId": "27c63885-68c3-405a-86d7-b1f94eebd9cb",
|
||||
"productModel": "ZWJ0075",
|
||||
"taskNo": "TASK202601191703194716-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:08:14.783Z",
|
||||
"assetsDownloaded": 8,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\ZWJ0075_苏蕙_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\ZWJ0075_all_27c63885-68c3-405a-86d7-b1f94eebd9cb_1768925300632.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:08:21.196Z"
|
||||
},
|
||||
{
|
||||
"materialId": "301919a3-e270-4ddf-bdd6-d9714a431a77",
|
||||
"productModel": "BG0063-4896",
|
||||
"taskNo": "TASK202601191322492275-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:08:22.197Z",
|
||||
"assetsDownloaded": 11,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\BG0063-4896_飞鸿_卓禾_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\BG0063-4896_all_301919a3-e270-4ddf-bdd6-d9714a431a77_1768925307469.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:08:27.851Z"
|
||||
},
|
||||
{
|
||||
"materialId": "0b9fe895-240a-4ee7-b0fe-b6e0aaf1689a",
|
||||
"productModel": "LRSF0016-473",
|
||||
"taskNo": "TASK202601151420593045-01-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:08:28.861Z",
|
||||
"assetsDownloaded": 1,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\LRSF0016-473_曹丕_亿家达_主图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\LRSF0016-473_all_0b9fe895-240a-4ee7-b0fe-b6e0aaf1689a_1768925310180.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:08:30.308Z"
|
||||
}
|
||||
]
|
||||
@ -1,15 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "8a8e53a9-9b9e-407d-8776-00f09156d73f",
|
||||
"productModel": "DNZ0154-845",
|
||||
"taskNo": "TASK202601161710355211-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:09:06.981Z",
|
||||
"assetsDownloaded": 26,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0154-845_瑶光_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0154-845_all_8a8e53a9-9b9e-407d-8776-00f09156d73f_1768925357359.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:09:17.912Z"
|
||||
}
|
||||
]
|
||||
@ -1,15 +0,0 @@
|
||||
[
|
||||
{
|
||||
"materialId": "8a8e53a9-9b9e-407d-8776-00f09156d73f",
|
||||
"productModel": "DNZ0154-845",
|
||||
"taskNo": "TASK202601161710355211-02-01",
|
||||
"status": "success",
|
||||
"startTime": "2026-01-20T16:09:09.627Z",
|
||||
"assetsDownloaded": 26,
|
||||
"zipFilesCreated": [
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0154-845_瑶光_亿家达_SKU图.zip",
|
||||
"D:\\AI Code\\gongxiangp2\\uploads\\materials\\DNZ0154-845_all_8a8e53a9-9b9e-407d-8776-00f09156d73f_1768925361071.zip"
|
||||
],
|
||||
"endTime": "2026-01-20T16:09:21.324Z"
|
||||
}
|
||||
]
|
||||
@ -1,147 +0,0 @@
|
||||
/**
|
||||
* 分析老素材情况
|
||||
* 查询所有老素材(2025-10-27之前)的数量和文件路径
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
async function analyzeOldMaterials() {
|
||||
try {
|
||||
console.log('开始分析老素材情况...\n');
|
||||
|
||||
// 老素材分界点
|
||||
const oldMaterialDate = new Date('2025-10-27T23:59:59.999Z');
|
||||
|
||||
// 1. 统计老素材总数
|
||||
const oldMaterialsCount = await prisma.material.count({
|
||||
where: {
|
||||
createdAt: { lte: oldMaterialDate },
|
||||
deletedAt: null,
|
||||
},
|
||||
});
|
||||
|
||||
console.log(`📊 老素材总数: ${oldMaterialsCount}`);
|
||||
|
||||
// 2. 按素材类型统计
|
||||
const materialsByType = await prisma.material.groupBy({
|
||||
by: ['materialType'],
|
||||
where: {
|
||||
createdAt: { lte: oldMaterialDate },
|
||||
deletedAt: null,
|
||||
},
|
||||
_count: true,
|
||||
});
|
||||
|
||||
console.log('\n📋 按素材类型统计:');
|
||||
materialsByType.forEach((item) => {
|
||||
console.log(` - ${item.materialType}: ${item._count} 个`);
|
||||
});
|
||||
|
||||
// 3. 查询有源文件的老素材(zipFilePath 不为空)
|
||||
const oldMaterialsWithFiles = await prisma.material.findMany({
|
||||
where: {
|
||||
createdAt: { lte: oldMaterialDate },
|
||||
deletedAt: null,
|
||||
zipFilePath: { not: '' },
|
||||
},
|
||||
select: {
|
||||
id: true,
|
||||
materialType: true,
|
||||
zipFilePath: true,
|
||||
zipFileName: true,
|
||||
previewUrl: true,
|
||||
createdAt: true,
|
||||
},
|
||||
take: 10, // 只取前10个样本
|
||||
});
|
||||
|
||||
console.log(`\n📦 有源文件的老素材: ${oldMaterialsWithFiles.length > 0 ? '样本' : '无'}`);
|
||||
if (oldMaterialsWithFiles.length > 0) {
|
||||
console.log('\n样本数据(前10个):');
|
||||
oldMaterialsWithFiles.forEach((material, index) => {
|
||||
console.log(`\n [${index + 1}] ${material.materialType}`);
|
||||
console.log(` ID: ${material.id}`);
|
||||
console.log(` 文件路径: ${material.zipFilePath}`);
|
||||
console.log(` 文件名: ${material.zipFileName}`);
|
||||
console.log(` 预览图: ${material.previewUrl.substring(0, 80)}...`);
|
||||
console.log(` 创建时间: ${material.createdAt.toISOString()}`);
|
||||
});
|
||||
}
|
||||
|
||||
// 4. 统计不同路径模式的老素材
|
||||
const allOldMaterials = await prisma.material.findMany({
|
||||
where: {
|
||||
createdAt: { lte: oldMaterialDate },
|
||||
deletedAt: null,
|
||||
},
|
||||
select: {
|
||||
zipFilePath: true,
|
||||
previewUrl: true,
|
||||
},
|
||||
});
|
||||
|
||||
const pathPatterns = {
|
||||
http103: 0, // http://103.118.245.6/...
|
||||
uploadsRelative: 0, // uploads/material-*.zip
|
||||
empty: 0, // 空路径
|
||||
other: 0, // 其他
|
||||
};
|
||||
|
||||
allOldMaterials.forEach((material) => {
|
||||
const path = material.zipFilePath || '';
|
||||
if (path.includes('103.118.245.6')) {
|
||||
pathPatterns.http103++;
|
||||
} else if (path.startsWith('uploads/')) {
|
||||
pathPatterns.uploadsRelative++;
|
||||
} else if (path === '') {
|
||||
pathPatterns.empty++;
|
||||
} else {
|
||||
pathPatterns.other++;
|
||||
}
|
||||
});
|
||||
|
||||
console.log('\n\n📁 老素材文件路径模式统计:');
|
||||
console.log(` - 包含 103.118.245.6: ${pathPatterns.http103} 个`);
|
||||
console.log(` - uploads/ 相对路径: ${pathPatterns.uploadsRelative} 个`);
|
||||
console.log(` - 空路径: ${pathPatterns.empty} 个`);
|
||||
console.log(` - 其他: ${pathPatterns.other} 个`);
|
||||
|
||||
// 5. 检查预览图URL模式
|
||||
const previewUrlPatterns = {
|
||||
old: 0, // s3.1080p.hk/jsxiangche
|
||||
new: 0, // s3.yydd.ai/gongxiangpan/由壹点AI/
|
||||
other: 0,
|
||||
};
|
||||
|
||||
allOldMaterials.forEach((material) => {
|
||||
const url = material.previewUrl || '';
|
||||
if (url.includes('s3.1080p.hk') || url.includes('jsxiangche')) {
|
||||
previewUrlPatterns.old++;
|
||||
} else if (url.includes('由壹点AI/')) {
|
||||
previewUrlPatterns.new++;
|
||||
} else {
|
||||
previewUrlPatterns.other++;
|
||||
}
|
||||
});
|
||||
|
||||
console.log('\n\n🖼️ 老素材预览图URL模式统计:');
|
||||
console.log(` - 老S3 (s3.1080p.hk/jsxiangche): ${previewUrlPatterns.old} 个`);
|
||||
console.log(` - 新S3 (由壹点AI/): ${previewUrlPatterns.new} 个`);
|
||||
console.log(` - 其他: ${previewUrlPatterns.other} 个`);
|
||||
|
||||
console.log('\n\n✅ 分析完成!');
|
||||
console.log('\n💡 结论:');
|
||||
console.log(' - 如果 "uploads/ 相对路径" 数量 > 0,这些文件在 192.168.58.20 上已丢失');
|
||||
console.log(' - 如果 "包含 103.118.245.6" 数量 > 0,需要检查外网服务器文件是否还在');
|
||||
console.log(' - 预览图在 S3 上,应该还在(除非 S3 也被清理了)');
|
||||
|
||||
} catch (error) {
|
||||
console.error('❌ 分析失败:', error);
|
||||
} finally {
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
}
|
||||
|
||||
analyzeOldMaterials();
|
||||
@ -1,89 +0,0 @@
|
||||
/**
|
||||
* 检查所有已迁移的"任务-详情"素材
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
async function main() {
|
||||
console.log('='.repeat(60));
|
||||
console.log('检查所有已迁移的"任务-详情"素材');
|
||||
console.log('='.repeat(60));
|
||||
|
||||
// 查询所有有 zipFilePath 的素材(已迁移)
|
||||
const materials = await prisma.material.findMany({
|
||||
where: {
|
||||
materialType: '任务-详情',
|
||||
deletedAt: null,
|
||||
zipFilePath: { not: '' },
|
||||
},
|
||||
select: {
|
||||
id: true,
|
||||
productModel: true,
|
||||
zipFilePath: true,
|
||||
},
|
||||
orderBy: { createdAt: 'desc' },
|
||||
});
|
||||
|
||||
console.log(`找到 ${materials.length} 个已迁移的素材\n`);
|
||||
|
||||
for (const material of materials) {
|
||||
// 统计各类型资产数量
|
||||
const mainPreviewCount = await prisma.materialAsset.count({
|
||||
where: { materialId: material.id, assetType: 'main-preview' },
|
||||
});
|
||||
|
||||
const skuPreviewCount = await prisma.materialAsset.count({
|
||||
where: { materialId: material.id, assetType: 'sku-preview' },
|
||||
});
|
||||
|
||||
const detailPreviewCount = await prisma.materialAsset.count({
|
||||
where: { materialId: material.id, assetType: 'detail-preview' },
|
||||
});
|
||||
|
||||
const mainS3Count = await prisma.materialAsset.count({
|
||||
where: {
|
||||
materialId: material.id,
|
||||
assetType: 'main',
|
||||
fileUrl: { startsWith: 'https://' }
|
||||
},
|
||||
});
|
||||
|
||||
const skuS3Count = await prisma.materialAsset.count({
|
||||
where: {
|
||||
materialId: material.id,
|
||||
assetType: 'sku',
|
||||
fileUrl: { startsWith: 'https://' }
|
||||
},
|
||||
});
|
||||
|
||||
const detailS3Count = await prisma.materialAsset.count({
|
||||
where: {
|
||||
materialId: material.id,
|
||||
assetType: 'detail',
|
||||
fileUrl: { startsWith: 'https://' }
|
||||
},
|
||||
});
|
||||
|
||||
// 检查是否有重复
|
||||
const hasDuplicates =
|
||||
(mainPreviewCount > 0 && mainS3Count > 0) ||
|
||||
(skuPreviewCount > 0 && skuS3Count > 0) ||
|
||||
(detailPreviewCount > 0 && detailS3Count > 0);
|
||||
|
||||
if (hasDuplicates) {
|
||||
console.log(`❌ ${material.productModel} (${material.id})`);
|
||||
console.log(` 主图: preview=${mainPreviewCount}, S3=${mainS3Count}`);
|
||||
console.log(` SKU: preview=${skuPreviewCount}, S3=${skuS3Count}`);
|
||||
console.log(` 详情: preview=${detailPreviewCount}, S3=${detailS3Count}`);
|
||||
console.log('');
|
||||
} else {
|
||||
console.log(`✅ ${material.productModel} - 正常`);
|
||||
}
|
||||
}
|
||||
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
|
||||
main();
|
||||
@ -1,71 +0,0 @@
|
||||
/**
|
||||
* 检查剩余需要迁移的素材详情
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
async function main() {
|
||||
const materials = await prisma.material.findMany({
|
||||
where: {
|
||||
materialType: '任务-详情',
|
||||
deletedAt: null,
|
||||
productModel: { in: ['CYJ0062', 'GBPM-SN0208-389'] },
|
||||
},
|
||||
select: {
|
||||
id: true,
|
||||
productModel: true,
|
||||
taskNo: true,
|
||||
zipFilePath: true,
|
||||
zipFileSize: true,
|
||||
user: {
|
||||
select: {
|
||||
realName: true,
|
||||
username: true,
|
||||
},
|
||||
},
|
||||
assets: {
|
||||
select: {
|
||||
assetType: true,
|
||||
fileUrl: true,
|
||||
fileName: true,
|
||||
},
|
||||
orderBy: { sortOrder: 'asc' },
|
||||
},
|
||||
},
|
||||
orderBy: { createdAt: 'desc' },
|
||||
});
|
||||
|
||||
console.log(`找到 ${materials.length} 个素材\n`);
|
||||
|
||||
for (const material of materials) {
|
||||
const authorName = material.user?.realName || material.user?.username || '未知';
|
||||
console.log('='.repeat(80));
|
||||
console.log(`SPU: ${material.productModel}`);
|
||||
console.log(`作者: ${authorName}`);
|
||||
console.log(`任务号: ${material.taskNo || '无'}`);
|
||||
console.log(`zipFilePath: ${material.zipFilePath || '空'}`);
|
||||
console.log(`zipFileSize: ${material.zipFileSize || 0}`);
|
||||
console.log('\n资产列表:');
|
||||
|
||||
const s3Assets = material.assets.filter(a => a.fileUrl.startsWith('https://'));
|
||||
const localAssets = material.assets.filter(a => a.fileUrl.startsWith('uploads/'));
|
||||
|
||||
console.log(` S3 预览图: ${s3Assets.length} 个`);
|
||||
s3Assets.forEach(a => {
|
||||
console.log(` - ${a.assetType}: ${a.fileName}`);
|
||||
});
|
||||
|
||||
console.log(` 本地 zip: ${localAssets.length} 个`);
|
||||
localAssets.forEach(a => {
|
||||
console.log(` - ${a.assetType}: ${a.fileName}`);
|
||||
});
|
||||
|
||||
console.log('');
|
||||
}
|
||||
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
|
||||
main();
|
||||
@ -1,40 +0,0 @@
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
prisma.material.findFirst({
|
||||
where: { productModel: 'XG0176', materialType: '任务-详情' },
|
||||
include: {
|
||||
assets: {
|
||||
orderBy: { assetType: 'asc' },
|
||||
},
|
||||
},
|
||||
}).then(m => {
|
||||
if (!m) {
|
||||
console.log('未找到素材');
|
||||
return;
|
||||
}
|
||||
|
||||
console.log(`素材: ${m.productModel} (${m.id})`);
|
||||
console.log(`总资产数: ${m.assets.length}`);
|
||||
console.log('');
|
||||
|
||||
// 按类型分组
|
||||
const byType = m.assets.reduce((acc, asset) => {
|
||||
if (!acc[asset.assetType]) {
|
||||
acc[asset.assetType] = [];
|
||||
}
|
||||
acc[asset.assetType].push(asset);
|
||||
return acc;
|
||||
}, {} as Record<string, typeof m.assets>);
|
||||
|
||||
Object.keys(byType).sort().forEach(type => {
|
||||
console.log(`${type}: ${byType[type].length} 个`);
|
||||
byType[type].forEach((asset, i) => {
|
||||
console.log(` [${i}] ${asset.fileName}`);
|
||||
console.log(` ${asset.fileUrl.substring(0, 80)}...`);
|
||||
});
|
||||
console.log('');
|
||||
});
|
||||
|
||||
prisma.$disconnect();
|
||||
});
|
||||
@ -1,11 +0,0 @@
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
prisma.material.findFirst({
|
||||
where: { productModel: 'XG0176', materialType: '任务-详情' }
|
||||
}).then(m => {
|
||||
console.log('zipFilePath:', m?.zipFilePath);
|
||||
console.log('zipFileSize:', m?.zipFileSize);
|
||||
console.log('zipFileName:', m?.zipFileName);
|
||||
prisma.$disconnect();
|
||||
});
|
||||
@ -1,138 +0,0 @@
|
||||
/**
|
||||
* 列出除了本次迁移的57个素材以外的所有素材详情
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
import { readFile } from 'fs/promises';
|
||||
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
async function main() {
|
||||
// 1. 读取所有迁移日志,获取本次迁移的素材ID
|
||||
const migratedIds = new Set<string>();
|
||||
|
||||
const logFiles = [
|
||||
'logs/migration-log-1768923605237.json',
|
||||
'logs/migration-log-1768923722086.json',
|
||||
'logs/migration-log-1768923840136.json',
|
||||
'logs/migration-log-1768923958151.json',
|
||||
'logs/migration-log-1768924161945.json',
|
||||
'logs/migration-log-1768924240279.json',
|
||||
'logs/migration-log-1768924412848.json',
|
||||
'logs/migration-log-1768924519354.json',
|
||||
'logs/migration-log-1768924819982.json',
|
||||
'logs/migration-log-1768925016822.json',
|
||||
'logs/migration-log-1768925113364.json',
|
||||
'logs/migration-log-1768925172010.json',
|
||||
'logs/migration-log-1768925294759.json',
|
||||
'logs/migration-log-1768925311310.json',
|
||||
'logs/migration-log-1768925358913.json',
|
||||
'logs/migration-log-1768925362330.json',
|
||||
];
|
||||
|
||||
for (const logFile of logFiles) {
|
||||
try {
|
||||
const content = await readFile(logFile, 'utf-8');
|
||||
const logs = JSON.parse(content);
|
||||
for (const log of logs) {
|
||||
if (log.status === 'success') {
|
||||
migratedIds.add(log.materialId);
|
||||
}
|
||||
}
|
||||
} catch (error) {
|
||||
// 文件不存在,跳过
|
||||
}
|
||||
}
|
||||
|
||||
console.log(`本次迁移成功的素材数量: ${migratedIds.size}\n`);
|
||||
|
||||
// 2. 查询所有素材
|
||||
const allMaterials = await prisma.material.findMany({
|
||||
where: {
|
||||
materialType: '任务-详情',
|
||||
deletedAt: null,
|
||||
},
|
||||
select: {
|
||||
id: true,
|
||||
productModel: true,
|
||||
taskNo: true,
|
||||
createdAt: true,
|
||||
zipFilePath: true,
|
||||
zipFileSize: true,
|
||||
user: {
|
||||
select: {
|
||||
realName: true,
|
||||
username: true,
|
||||
},
|
||||
},
|
||||
assets: {
|
||||
select: {
|
||||
assetType: true,
|
||||
fileUrl: true,
|
||||
},
|
||||
},
|
||||
},
|
||||
orderBy: { createdAt: 'desc' },
|
||||
});
|
||||
|
||||
console.log(`总素材数: ${allMaterials.length}\n`);
|
||||
|
||||
// 3. 找出未被本次迁移的素材
|
||||
const nonMigratedMaterials = allMaterials.filter(m => !migratedIds.has(m.id));
|
||||
|
||||
console.log(`除了本次迁移的57个以外的素材数量: ${nonMigratedMaterials.length}\n`);
|
||||
console.log('='.repeat(100));
|
||||
console.log('详细列表:');
|
||||
console.log('='.repeat(100));
|
||||
|
||||
for (const material of nonMigratedMaterials) {
|
||||
const authorName = material.user?.realName || material.user?.username || '未知';
|
||||
|
||||
// 统计资产类型
|
||||
const s3Previews = material.assets.filter(a =>
|
||||
['main-preview', 'sku-preview', 'detail-preview'].includes(a.assetType) &&
|
||||
a.fileUrl.startsWith('https://')
|
||||
);
|
||||
const localZips = material.assets.filter(a =>
|
||||
['main', 'sku', 'detail', 'all'].includes(a.assetType) &&
|
||||
a.fileUrl.startsWith('uploads/')
|
||||
);
|
||||
const psdFiles = material.assets.filter(a => a.assetType === 'psd');
|
||||
|
||||
const totalAssets = material.assets.length;
|
||||
|
||||
// 判断类型
|
||||
let type = '';
|
||||
if (totalAssets === 0) {
|
||||
type = '空记录';
|
||||
} else if (localZips.length > 0) {
|
||||
type = '新逻辑上传';
|
||||
} else {
|
||||
type = '未知';
|
||||
}
|
||||
|
||||
console.log(`SPU: ${material.productModel.padEnd(25)} | 作者: ${authorName.padEnd(12)} | 任务号: ${(material.taskNo || '无').padEnd(30)} | 类型: ${type}`);
|
||||
console.log(` - 总资产: ${totalAssets} 个 | S3预览图: ${s3Previews.length} 个 | 本地zip: ${localZips.length} 个 | PSD: ${psdFiles.length} 个`);
|
||||
console.log(` - zipFilePath: ${material.zipFilePath || '空'}`);
|
||||
console.log(` - zipFileSize: ${material.zipFileSize || 0}`);
|
||||
console.log('');
|
||||
}
|
||||
|
||||
console.log('='.repeat(100));
|
||||
console.log('统计:');
|
||||
console.log('='.repeat(100));
|
||||
|
||||
const emptyRecords = nonMigratedMaterials.filter(m => m.assets.length === 0);
|
||||
const newLogicUploads = nonMigratedMaterials.filter(m =>
|
||||
m.assets.length > 0 &&
|
||||
m.assets.some(a => ['main', 'sku', 'detail', 'all'].includes(a.assetType) && a.fileUrl.startsWith('uploads/'))
|
||||
);
|
||||
|
||||
console.log(`空记录: ${emptyRecords.length} 个`);
|
||||
console.log(`新逻辑上传: ${newLogicUploads.length} 个`);
|
||||
console.log(`总计: ${nonMigratedMaterials.length} 个`);
|
||||
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
|
||||
main();
|
||||
@ -1,88 +0,0 @@
|
||||
/**
|
||||
* 列出未被本次迁移的素材
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
import { readFile } from 'fs/promises';
|
||||
import path from 'path';
|
||||
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
async function main() {
|
||||
// 1. 读取所有迁移日志,获取本次迁移的素材ID
|
||||
const migratedIds = new Set<string>();
|
||||
|
||||
// 读取最近的迁移日志(从今天开始)
|
||||
const logFiles = [
|
||||
'logs/migration-log-1768923605237.json', // XG0176
|
||||
'logs/migration-log-1768923722086.json', // 第一批
|
||||
'logs/migration-log-1768923840136.json', // 第一批
|
||||
'logs/migration-log-1768923958151.json', // 第二批
|
||||
'logs/migration-log-1768924161945.json', // 第三批
|
||||
'logs/migration-log-1768924240279.json', // 第四批
|
||||
'logs/migration-log-1768924412848.json', // 验证
|
||||
'logs/migration-log-1768924519354.json', // 验证
|
||||
'logs/migration-log-1768924819982.json', // 新一批1
|
||||
'logs/migration-log-1768925113364.json', // 新一批2
|
||||
'logs/migration-log-1768925294759.json', // 新一批3
|
||||
'logs/migration-log-1768925358913.json', // 新一批4
|
||||
];
|
||||
|
||||
for (const logFile of logFiles) {
|
||||
try {
|
||||
const content = await readFile(logFile, 'utf-8');
|
||||
const logs = JSON.parse(content);
|
||||
for (const log of logs) {
|
||||
if (log.status === 'success') {
|
||||
migratedIds.add(log.materialId);
|
||||
}
|
||||
}
|
||||
} catch (error) {
|
||||
// 文件不存在,跳过
|
||||
}
|
||||
}
|
||||
|
||||
console.log(`本次迁移成功的素材数量: ${migratedIds.size}`);
|
||||
console.log('');
|
||||
|
||||
// 2. 查询所有素材
|
||||
const allMaterials = await prisma.material.findMany({
|
||||
where: {
|
||||
materialType: '任务-详情',
|
||||
deletedAt: null,
|
||||
},
|
||||
select: {
|
||||
id: true,
|
||||
productModel: true,
|
||||
taskNo: true,
|
||||
createdAt: true,
|
||||
user: {
|
||||
select: {
|
||||
realName: true,
|
||||
username: true,
|
||||
},
|
||||
},
|
||||
},
|
||||
orderBy: { createdAt: 'desc' },
|
||||
});
|
||||
|
||||
console.log(`总素材数: ${allMaterials.length}`);
|
||||
console.log('');
|
||||
|
||||
// 3. 找出未被本次迁移的素材
|
||||
const nonMigratedMaterials = allMaterials.filter(m => !migratedIds.has(m.id));
|
||||
|
||||
console.log(`未被本次迁移的素材数量: ${nonMigratedMaterials.length}`);
|
||||
console.log('');
|
||||
console.log('未被本次迁移的素材列表:');
|
||||
console.log('='.repeat(80));
|
||||
|
||||
for (const material of nonMigratedMaterials) {
|
||||
const authorName = material.user?.realName || material.user?.username || '未知';
|
||||
console.log(`SPU: ${material.productModel.padEnd(20)} | 作者: ${authorName.padEnd(15)} | 任务号: ${material.taskNo || '无'}`);
|
||||
}
|
||||
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
|
||||
main();
|
||||
@ -1,189 +0,0 @@
|
||||
# 任务-详情老素材迁移指南
|
||||
|
||||
## 概述
|
||||
|
||||
本脚本用于将"任务-详情"老素材(只有S3预览图)迁移到新逻辑(本地zip文件)。
|
||||
|
||||
## 安全措施
|
||||
|
||||
1. **保留老数据**:不删除原有的资产记录,只新增记录
|
||||
2. **分批迁移**:每次处理5个素材,避免一次性迁移导致问题
|
||||
3. **演练模式**:可以先运行演练模式,不实际修改数据库
|
||||
4. **完整日志**:记录每个素材的迁移状态和错误信息
|
||||
5. **错误处理**:单个素材失败不影响其他素材
|
||||
|
||||
## 使用步骤
|
||||
|
||||
### 1. 数据库备份(必须!)
|
||||
|
||||
```bash
|
||||
# 在生产服务器上备份数据库
|
||||
ssh root@192.168.58.20
|
||||
docker exec gongxiangpan-postgres-1 pg_dump -U gongxiangpan lobechat > /root/backup/lobechat_before_migration_$(date +%Y%m%d_%H%M%S).sql
|
||||
```
|
||||
|
||||
### 2. 演练模式测试
|
||||
|
||||
```bash
|
||||
# 修改脚本配置
|
||||
# CONFIG.dryRun = true
|
||||
# CONFIG.batchSize = 2
|
||||
|
||||
# 运行演练
|
||||
npx tsx scripts/migrate-product-package-old-materials.ts
|
||||
```
|
||||
|
||||
### 3. 小批量测试
|
||||
|
||||
```bash
|
||||
# 修改脚本配置
|
||||
# CONFIG.dryRun = false
|
||||
# CONFIG.batchSize = 2
|
||||
|
||||
# 迁移2个素材
|
||||
npx tsx scripts/migrate-product-package-old-materials.ts
|
||||
```
|
||||
|
||||
### 4. 验证测试结果
|
||||
|
||||
- 检查首页预览图是否正常显示
|
||||
- 测试下载功能是否正常
|
||||
- 检查详情页是否正常
|
||||
- 检查外部接口是否正常
|
||||
|
||||
### 5. 批量迁移
|
||||
|
||||
```bash
|
||||
# 修改脚本配置
|
||||
# CONFIG.batchSize = 10
|
||||
|
||||
# 多次运行,每次迁移10个
|
||||
npx tsx scripts/migrate-product-package-old-materials.ts
|
||||
```
|
||||
|
||||
## 配置说明
|
||||
|
||||
```typescript
|
||||
const CONFIG = {
|
||||
batchSize: 5, // 每批处理的素材数量
|
||||
dryRun: false, // 是否为演练模式(不实际修改数据库)
|
||||
skipDownload: false, // 是否跳过下载(用于测试打包逻辑)
|
||||
};
|
||||
```
|
||||
|
||||
## 迁移流程
|
||||
|
||||
1. 查询需要迁移的素材(zipFilePath为空或zipFileSize=0)
|
||||
2. 从S3下载预览图到临时目录
|
||||
3. 将预览图打包成分类zip(main.zip、sku.zip、detail.zip)
|
||||
4. 打包总zip(all.zip,包含三个分类zip)
|
||||
5. 新增资产记录:
|
||||
- `main-preview`/`sku-preview`/`detail-preview`(指向S3预览图)
|
||||
- `main`/`sku`/`detail`(指向本地zip文件)
|
||||
- `all`(指向总zip文件)
|
||||
6. 更新素材记录(zipFilePath、zipFileName、zipFileSize)
|
||||
7. 清理临时文件
|
||||
|
||||
## 数据变化
|
||||
|
||||
### 迁移前
|
||||
|
||||
```
|
||||
materials 表:
|
||||
- zipFilePath: NULL 或 ''
|
||||
- zipFileSize: 0
|
||||
|
||||
material_assets 表:
|
||||
- assetType: 'main' (S3预览图)
|
||||
- assetType: 'sku' (S3预览图)
|
||||
- assetType: 'detail' (S3预览图)
|
||||
- assetType: 'psd' (本地文件)
|
||||
```
|
||||
|
||||
### 迁移后
|
||||
|
||||
```
|
||||
materials 表:
|
||||
- zipFilePath: 'uploads/materials/xxx_all_xxx.zip'
|
||||
- zipFileSize: 12345678
|
||||
|
||||
material_assets 表(新增,老记录保留):
|
||||
- assetType: 'main-preview' (S3预览图,新增)
|
||||
- assetType: 'sku-preview' (S3预览图,新增)
|
||||
- assetType: 'detail-preview' (S3预览图,新增)
|
||||
- assetType: 'main' (本地zip,新增)
|
||||
- assetType: 'sku' (本地zip,新增)
|
||||
- assetType: 'detail' (本地zip,新增)
|
||||
- assetType: 'all' (本地zip,新增)
|
||||
- assetType: 'psd' (本地文件,保留)
|
||||
```
|
||||
|
||||
## 回滚方案
|
||||
|
||||
如果迁移后发现问题,可以执行回滚:
|
||||
|
||||
```sql
|
||||
-- 1. 删除新增的资产记录
|
||||
DELETE FROM material_assets
|
||||
WHERE material_id IN (
|
||||
SELECT id FROM materials
|
||||
WHERE "materialType" = '任务-详情'
|
||||
AND "zipFilePath" IS NOT NULL
|
||||
AND "zipFilePath" != ''
|
||||
)
|
||||
AND asset_type IN ('main-preview', 'sku-preview', 'detail-preview', 'all')
|
||||
AND created_at > '2026-01-20 14:00:00'; -- 迁移开始时间
|
||||
|
||||
-- 2. 恢复素材记录
|
||||
UPDATE materials
|
||||
SET
|
||||
"zipFilePath" = '',
|
||||
"zipFileName" = '',
|
||||
"zipFileSize" = 0
|
||||
WHERE "materialType" = '任务-详情'
|
||||
AND "zipFilePath" IS NOT NULL
|
||||
AND "zipFilePath" != ''
|
||||
AND updated_at > '2026-01-20 14:00:00'; -- 迁移开始时间
|
||||
```
|
||||
|
||||
## 注意事项
|
||||
|
||||
1. **必须先备份数据库**
|
||||
2. **先小批量测试,验证无误后再批量迁移**
|
||||
3. **迁移过程中不要停止脚本**
|
||||
4. **保留迁移日志文件**
|
||||
5. **迁移完成后验证功能**
|
||||
|
||||
## 监控指标
|
||||
|
||||
- 迁移成功率
|
||||
- 下载失败的文件数
|
||||
- 打包失败的素材数
|
||||
- 数据库更新失败的素材数
|
||||
- 平均迁移时间
|
||||
|
||||
## 常见问题
|
||||
|
||||
### Q: 迁移失败怎么办?
|
||||
|
||||
A: 单个素材失败不影响其他素材,可以查看日志文件了解失败原因,修复后重新运行脚本。
|
||||
|
||||
### Q: 迁移过程中可以停止吗?
|
||||
|
||||
A: 可以,但建议等当前素材处理完成后再停止。已迁移的素材不会重复迁移。
|
||||
|
||||
### Q: 如何验证迁移是否成功?
|
||||
|
||||
A:
|
||||
1. 检查日志文件中的成功/失败统计
|
||||
2. 在首页查看素材预览图是否正常
|
||||
3. 测试下载功能
|
||||
4. 检查数据库中的记录是否正确
|
||||
|
||||
### Q: 迁移后老数据会被删除吗?
|
||||
|
||||
A: 不会,老数据会被保留,只是新增了新的记录。
|
||||
|
||||
## 联系方式
|
||||
|
||||
如有问题,请联系开发团队。
|
||||
@ -1,629 +0,0 @@
|
||||
/**
|
||||
* 迁移"任务-详情"老素材脚本
|
||||
*
|
||||
* 功能:
|
||||
* 1. 从S3下载预览图
|
||||
* 2. 将预览图打包成分类zip(main.zip、sku.zip、detail.zip、all.zip)
|
||||
* 3. 生成新的预览图资产记录(main-preview、sku-preview、detail-preview)
|
||||
* 4. 更新数据库
|
||||
*
|
||||
* 安全措施:
|
||||
* - 保留老数据不删除
|
||||
* - 分批迁移(每次处理指定数量)
|
||||
* - 完整的错误处理和回滚机制
|
||||
* - 详细的日志记录
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
import { mkdir, writeFile, unlink, readFile } from 'fs/promises';
|
||||
import path from 'path';
|
||||
import archiver from 'archiver';
|
||||
import { createWriteStream } from 'fs';
|
||||
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
// 配置
|
||||
const CONFIG = {
|
||||
batchSize: 10, // 每批处理的素材数量
|
||||
dryRun: false, // 是否为演练模式(不实际修改数据库)
|
||||
skipDownload: false, // 是否跳过下载(用于测试打包逻辑)
|
||||
targetProductModel: undefined, // 只迁移指定型号(用于测试)
|
||||
};
|
||||
|
||||
// 日志记录
|
||||
interface MigrationLog {
|
||||
materialId: string;
|
||||
productModel: string;
|
||||
taskNo: string | null;
|
||||
status: 'pending' | 'downloading' | 'packing' | 'saving' | 'success' | 'failed';
|
||||
error?: string;
|
||||
startTime: Date;
|
||||
endTime?: Date;
|
||||
assetsDownloaded?: number;
|
||||
zipFilesCreated?: string[];
|
||||
}
|
||||
|
||||
const migrationLogs: MigrationLog[] = [];
|
||||
|
||||
/**
|
||||
* 从S3下载文件
|
||||
*/
|
||||
async function downloadFromS3(url: string, savePath: string): Promise<void> {
|
||||
const response = await fetch(url);
|
||||
if (!response.ok) {
|
||||
throw new Error(`下载失败: ${url}, 状态码: ${response.status}`);
|
||||
}
|
||||
const buffer = await response.arrayBuffer();
|
||||
await writeFile(savePath, Buffer.from(buffer));
|
||||
}
|
||||
|
||||
/**
|
||||
* 创建zip文件
|
||||
*/
|
||||
async function createZip(
|
||||
files: Array<{ path: string; name: string }>,
|
||||
outputPath: string
|
||||
): Promise<number> {
|
||||
return new Promise((resolve, reject) => {
|
||||
const output = createWriteStream(outputPath);
|
||||
const archive = archiver('zip', { zlib: { level: 9 } });
|
||||
|
||||
let fileSize = 0;
|
||||
|
||||
output.on('close', () => {
|
||||
fileSize = archive.pointer();
|
||||
resolve(fileSize);
|
||||
});
|
||||
|
||||
archive.on('error', (err) => reject(err));
|
||||
output.on('error', (err) => reject(err));
|
||||
|
||||
archive.pipe(output);
|
||||
|
||||
for (const file of files) {
|
||||
archive.file(file.path, { name: file.name });
|
||||
}
|
||||
|
||||
archive.finalize();
|
||||
});
|
||||
}
|
||||
|
||||
/**
|
||||
* 清理文件系统不安全的字符
|
||||
*/
|
||||
function sanitizeFileName(name: string): string {
|
||||
return name.replace(/[\/\\:*?"<>|]/g, '_');
|
||||
}
|
||||
|
||||
/**
|
||||
* 迁移单个素材
|
||||
*/
|
||||
async function migrateMaterial(materialId: string): Promise<MigrationLog> {
|
||||
const log: MigrationLog = {
|
||||
materialId,
|
||||
productModel: '',
|
||||
taskNo: null,
|
||||
status: 'pending',
|
||||
startTime: new Date(),
|
||||
};
|
||||
|
||||
try {
|
||||
// 1. 查询素材信息
|
||||
console.log(`\n[${materialId}] 开始迁移...`);
|
||||
const material = await prisma.material.findUnique({
|
||||
where: { id: materialId },
|
||||
include: {
|
||||
assets: {
|
||||
where: {
|
||||
assetType: { in: ['main', 'sku', 'detail', 'psd'] },
|
||||
},
|
||||
orderBy: { sortOrder: 'asc' },
|
||||
},
|
||||
user: {
|
||||
select: {
|
||||
realName: true,
|
||||
username: true,
|
||||
},
|
||||
},
|
||||
},
|
||||
});
|
||||
|
||||
if (!material) {
|
||||
throw new Error('素材不存在');
|
||||
}
|
||||
|
||||
log.productModel = material.productModel;
|
||||
log.taskNo = material.taskNo;
|
||||
|
||||
console.log(`[${materialId}] 素材信息: ${material.productModel}, 任务号: ${material.taskNo || '无'}`);
|
||||
|
||||
// 2. 按类型分组资产(只选择 S3 上的预览图,排除本地 zip 文件)
|
||||
const mainAssets = material.assets.filter((a) => a.assetType === 'main' && a.fileUrl.startsWith('https://'));
|
||||
const skuAssets = material.assets.filter((a) => a.assetType === 'sku' && a.fileUrl.startsWith('https://'));
|
||||
const detailAssets = material.assets.filter((a) => a.assetType === 'detail' && a.fileUrl.startsWith('https://'));
|
||||
const psdAssets = material.assets.filter((a) => a.assetType === 'psd');
|
||||
|
||||
console.log(`[${materialId}] 资产统计: 主图=${mainAssets.length}, SKU=${skuAssets.length}, 详情=${detailAssets.length}, PSD=${psdAssets.length}`);
|
||||
|
||||
if (mainAssets.length === 0 && skuAssets.length === 0 && detailAssets.length === 0) {
|
||||
throw new Error('没有可迁移的资产');
|
||||
}
|
||||
|
||||
// 3. 创建临时目录
|
||||
const tempDir = path.join(process.cwd(), 'uploads', 'temp', `migrate-${materialId}`);
|
||||
await mkdir(tempDir, { recursive: true });
|
||||
|
||||
const tempFiles: string[] = [];
|
||||
|
||||
try {
|
||||
// 4. 下载预览图
|
||||
log.status = 'downloading';
|
||||
console.log(`[${materialId}] 开始下载预览图...`);
|
||||
|
||||
const downloadedFiles: {
|
||||
main: Array<{ path: string; name: string; size: number }>;
|
||||
sku: Array<{ path: string; name: string; size: number }>;
|
||||
detail: Array<{ path: string; name: string; size: number }>;
|
||||
} = { main: [], sku: [], detail: [] };
|
||||
|
||||
let downloadCount = 0;
|
||||
|
||||
// 下载主图
|
||||
for (let i = 0; i < mainAssets.length; i++) {
|
||||
const asset = mainAssets[i];
|
||||
const originalFileName = asset.fileName || `main-${i}.jpg`;
|
||||
const ext = path.extname(originalFileName);
|
||||
const baseName = path.basename(originalFileName, ext);
|
||||
|
||||
// 确保 zip 包内的文件名唯一(添加序号前缀)
|
||||
const uniqueFileName = mainAssets.length > 1
|
||||
? `${String(i + 1).padStart(2, '0')}_${baseName}${ext}`
|
||||
: originalFileName;
|
||||
|
||||
const filePath = path.join(tempDir, `main-${i}-${originalFileName}`);
|
||||
|
||||
if (!CONFIG.skipDownload) {
|
||||
await downloadFromS3(asset.fileUrl, filePath);
|
||||
}
|
||||
|
||||
downloadedFiles.main.push({
|
||||
path: filePath,
|
||||
name: uniqueFileName, // 使用唯一文件名
|
||||
size: Number(asset.fileSize || 0),
|
||||
});
|
||||
tempFiles.push(filePath);
|
||||
downloadCount++;
|
||||
}
|
||||
|
||||
// 下载SKU图
|
||||
for (let i = 0; i < skuAssets.length; i++) {
|
||||
const asset = skuAssets[i];
|
||||
const originalFileName = asset.fileName || `sku-${i}.jpg`;
|
||||
const ext = path.extname(originalFileName);
|
||||
const baseName = path.basename(originalFileName, ext);
|
||||
|
||||
// 确保 zip 包内的文件名唯一(添加序号前缀)
|
||||
const uniqueFileName = skuAssets.length > 1
|
||||
? `${String(i + 1).padStart(2, '0')}_${baseName}${ext}`
|
||||
: originalFileName;
|
||||
|
||||
const filePath = path.join(tempDir, `sku-${i}-${originalFileName}`);
|
||||
|
||||
if (!CONFIG.skipDownload) {
|
||||
await downloadFromS3(asset.fileUrl, filePath);
|
||||
}
|
||||
|
||||
downloadedFiles.sku.push({
|
||||
path: filePath,
|
||||
name: uniqueFileName, // 使用唯一文件名
|
||||
size: Number(asset.fileSize || 0),
|
||||
});
|
||||
tempFiles.push(filePath);
|
||||
downloadCount++;
|
||||
}
|
||||
|
||||
// 下载详情图
|
||||
for (let i = 0; i < detailAssets.length; i++) {
|
||||
const asset = detailAssets[i];
|
||||
const originalFileName = asset.fileName || `detail-${i}.jpg`;
|
||||
const ext = path.extname(originalFileName);
|
||||
const baseName = path.basename(originalFileName, ext);
|
||||
|
||||
// 确保 zip 包内的文件名唯一(添加序号前缀)
|
||||
const uniqueFileName = detailAssets.length > 1
|
||||
? `${String(i + 1).padStart(2, '0')}_${baseName}${ext}`
|
||||
: originalFileName;
|
||||
|
||||
const filePath = path.join(tempDir, `detail-${i}-${originalFileName}`);
|
||||
|
||||
if (!CONFIG.skipDownload) {
|
||||
await downloadFromS3(asset.fileUrl, filePath);
|
||||
}
|
||||
|
||||
downloadedFiles.detail.push({
|
||||
path: filePath,
|
||||
name: uniqueFileName, // 使用唯一文件名
|
||||
size: Number(asset.fileSize || 0),
|
||||
});
|
||||
tempFiles.push(filePath);
|
||||
downloadCount++;
|
||||
}
|
||||
|
||||
log.assetsDownloaded = downloadCount;
|
||||
console.log(`[${materialId}] 下载完成: ${downloadCount} 个文件`);
|
||||
|
||||
// 5. 打包分类zip
|
||||
log.status = 'packing';
|
||||
console.log(`[${materialId}] 开始打包zip文件...`);
|
||||
|
||||
const uploadsDir = path.join(process.cwd(), 'uploads', 'materials');
|
||||
await mkdir(uploadsDir, { recursive: true });
|
||||
|
||||
const timestamp = Date.now();
|
||||
const sanitizedProductModel = sanitizeFileName(material.productModel);
|
||||
const authorName = material.user?.realName || material.user?.username || '未知作者';
|
||||
const sanitizedAuthorName = sanitizeFileName(authorName);
|
||||
const categoryName = material.categoryName || '未知店铺';
|
||||
const sanitizedCategoryName = sanitizeFileName(categoryName);
|
||||
|
||||
const zipInfos: {
|
||||
main?: { filePath: string; fileName: string; fileSize: number };
|
||||
sku?: { filePath: string; fileName: string; fileSize: number };
|
||||
detail?: { filePath: string; fileName: string; fileSize: number };
|
||||
all: { filePath: string; fileName: string; fileSize: number };
|
||||
} = {} as any;
|
||||
|
||||
const zipFilesForAll: Array<{ path: string; name: string }> = [];
|
||||
const createdZipPaths: string[] = [];
|
||||
|
||||
// 打包主图
|
||||
if (downloadedFiles.main.length > 0) {
|
||||
const zipFileName = `${sanitizedProductModel}_${sanitizedAuthorName}_${sanitizedCategoryName}_主图.zip`;
|
||||
const zipFilePath = path.join(uploadsDir, zipFileName);
|
||||
const relativeZipPath = `uploads/materials/${zipFileName}`; // 强制使用正斜杠
|
||||
|
||||
const fileSize = await createZip(downloadedFiles.main, zipFilePath);
|
||||
|
||||
zipInfos.main = {
|
||||
filePath: relativeZipPath,
|
||||
fileName: zipFileName,
|
||||
fileSize,
|
||||
};
|
||||
|
||||
zipFilesForAll.push({ path: zipFilePath, name: zipFileName });
|
||||
createdZipPaths.push(zipFilePath);
|
||||
console.log(`[${materialId}] 主图打包完成: ${zipFileName} (${fileSize} bytes)`);
|
||||
}
|
||||
|
||||
// 打包SKU图
|
||||
if (downloadedFiles.sku.length > 0) {
|
||||
const zipFileName = `${sanitizedProductModel}_${sanitizedAuthorName}_${sanitizedCategoryName}_SKU图.zip`;
|
||||
const zipFilePath = path.join(uploadsDir, zipFileName);
|
||||
const relativeZipPath = `uploads/materials/${zipFileName}`; // 强制使用正斜杠
|
||||
|
||||
const fileSize = await createZip(downloadedFiles.sku, zipFilePath);
|
||||
|
||||
zipInfos.sku = {
|
||||
filePath: relativeZipPath,
|
||||
fileName: zipFileName,
|
||||
fileSize,
|
||||
};
|
||||
|
||||
zipFilesForAll.push({ path: zipFilePath, name: zipFileName });
|
||||
createdZipPaths.push(zipFilePath);
|
||||
console.log(`[${materialId}] SKU图打包完成: ${zipFileName} (${fileSize} bytes)`);
|
||||
}
|
||||
|
||||
// 打包详情图
|
||||
if (downloadedFiles.detail.length > 0) {
|
||||
const zipFileName = `${sanitizedProductModel}_${sanitizedAuthorName}_${sanitizedCategoryName}_详情图.zip`;
|
||||
const zipFilePath = path.join(uploadsDir, zipFileName);
|
||||
const relativeZipPath = `uploads/materials/${zipFileName}`; // 强制使用正斜杠
|
||||
|
||||
const fileSize = await createZip(downloadedFiles.detail, zipFilePath);
|
||||
|
||||
zipInfos.detail = {
|
||||
filePath: relativeZipPath,
|
||||
fileName: zipFileName,
|
||||
fileSize,
|
||||
};
|
||||
|
||||
zipFilesForAll.push({ path: zipFilePath, name: zipFileName });
|
||||
createdZipPaths.push(zipFilePath);
|
||||
console.log(`[${materialId}] 详情图打包完成: ${zipFileName} (${fileSize} bytes)`);
|
||||
}
|
||||
|
||||
// 打包总zip
|
||||
const allZipFileName = `${sanitizedProductModel}_all_${materialId}_${timestamp}.zip`;
|
||||
const allZipFilePath = path.join(uploadsDir, allZipFileName);
|
||||
const relativeAllZipPath = `uploads/materials/${allZipFileName}`; // 强制使用正斜杠
|
||||
|
||||
const allFileSize = await createZip(zipFilesForAll, allZipFilePath);
|
||||
|
||||
zipInfos.all = {
|
||||
filePath: relativeAllZipPath,
|
||||
fileName: allZipFileName,
|
||||
fileSize: allFileSize,
|
||||
};
|
||||
|
||||
createdZipPaths.push(allZipFilePath);
|
||||
console.log(`[${materialId}] 总zip打包完成: ${allZipFileName} (${allFileSize} bytes)`);
|
||||
|
||||
log.zipFilesCreated = createdZipPaths;
|
||||
|
||||
// 6. 保存到数据库
|
||||
if (!CONFIG.dryRun) {
|
||||
log.status = 'saving';
|
||||
console.log(`[${materialId}] 开始保存到数据库...`);
|
||||
|
||||
await prisma.$transaction(async (tx) => {
|
||||
// 6.0 删除老的资产记录
|
||||
// 删除老的预览图记录(*-preview)
|
||||
await tx.materialAsset.deleteMany({
|
||||
where: {
|
||||
materialId,
|
||||
assetType: { in: ['main-preview', 'sku-preview', 'detail-preview'] },
|
||||
},
|
||||
});
|
||||
|
||||
// 删除老的 S3 预览图记录(assetType='main'/'sku'/'detail')
|
||||
await tx.materialAsset.deleteMany({
|
||||
where: {
|
||||
materialId,
|
||||
assetType: { in: ['main', 'sku', 'detail'] },
|
||||
fileUrl: { startsWith: 'https://' },
|
||||
},
|
||||
});
|
||||
|
||||
// 删除旧的 zip 文件资产记录(如果存在)
|
||||
await tx.materialAsset.deleteMany({
|
||||
where: {
|
||||
materialId,
|
||||
assetType: { in: ['main', 'sku', 'detail', 'all'] },
|
||||
fileUrl: { startsWith: 'uploads/' },
|
||||
},
|
||||
});
|
||||
|
||||
// 6.1 创建新的 *-preview 记录(用于前端展示)
|
||||
const newAssetRecords: any[] = [];
|
||||
|
||||
// 主图预览
|
||||
mainAssets.forEach((asset, index) => {
|
||||
newAssetRecords.push({
|
||||
materialId,
|
||||
assetType: 'main-preview',
|
||||
fileUrl: asset.fileUrl,
|
||||
fileName: asset.fileName,
|
||||
fileSize: asset.fileSize,
|
||||
sortOrder: index,
|
||||
});
|
||||
});
|
||||
|
||||
// SKU图预览
|
||||
skuAssets.forEach((asset, index) => {
|
||||
newAssetRecords.push({
|
||||
materialId,
|
||||
assetType: 'sku-preview',
|
||||
fileUrl: asset.fileUrl,
|
||||
fileName: asset.fileName,
|
||||
fileSize: asset.fileSize,
|
||||
sortOrder: index,
|
||||
});
|
||||
});
|
||||
|
||||
// 详情图预览
|
||||
detailAssets.forEach((asset, index) => {
|
||||
newAssetRecords.push({
|
||||
materialId,
|
||||
assetType: 'detail-preview',
|
||||
fileUrl: asset.fileUrl,
|
||||
fileName: asset.fileName,
|
||||
fileSize: asset.fileSize,
|
||||
sortOrder: index,
|
||||
});
|
||||
});
|
||||
|
||||
// 6.2 新增 zip 文件资产记录
|
||||
if (zipInfos.main) {
|
||||
newAssetRecords.push({
|
||||
materialId,
|
||||
assetType: 'main',
|
||||
fileUrl: zipInfos.main.filePath,
|
||||
fileName: zipInfos.main.fileName,
|
||||
fileSize: BigInt(zipInfos.main.fileSize),
|
||||
sortOrder: 0,
|
||||
});
|
||||
}
|
||||
|
||||
if (zipInfos.sku) {
|
||||
newAssetRecords.push({
|
||||
materialId,
|
||||
assetType: 'sku',
|
||||
fileUrl: zipInfos.sku.filePath,
|
||||
fileName: zipInfos.sku.fileName,
|
||||
fileSize: BigInt(zipInfos.sku.fileSize),
|
||||
sortOrder: 0,
|
||||
});
|
||||
}
|
||||
|
||||
if (zipInfos.detail) {
|
||||
newAssetRecords.push({
|
||||
materialId,
|
||||
assetType: 'detail',
|
||||
fileUrl: zipInfos.detail.filePath,
|
||||
fileName: zipInfos.detail.fileName,
|
||||
fileSize: BigInt(zipInfos.detail.fileSize),
|
||||
sortOrder: 0,
|
||||
});
|
||||
}
|
||||
|
||||
newAssetRecords.push({
|
||||
materialId,
|
||||
assetType: 'all',
|
||||
fileUrl: zipInfos.all.filePath,
|
||||
fileName: zipInfos.all.fileName,
|
||||
fileSize: BigInt(zipInfos.all.fileSize),
|
||||
sortOrder: 0,
|
||||
});
|
||||
|
||||
// 批量创建新资产记录
|
||||
await tx.materialAsset.createMany({
|
||||
data: newAssetRecords,
|
||||
});
|
||||
|
||||
// 6.3 更新素材记录
|
||||
await tx.material.update({
|
||||
where: { id: materialId },
|
||||
data: {
|
||||
zipFilePath: zipInfos.all.filePath,
|
||||
zipFileName: zipInfos.all.fileName,
|
||||
zipFileSize: BigInt(zipInfos.all.fileSize),
|
||||
},
|
||||
});
|
||||
|
||||
console.log(`[${materialId}] 数据库更新完成: 新增 ${newAssetRecords.length} 条资产记录`);
|
||||
});
|
||||
} else {
|
||||
console.log(`[${materialId}] [DRY RUN] 跳过数据库保存`);
|
||||
}
|
||||
|
||||
// 7. 清理临时文件
|
||||
for (const file of tempFiles) {
|
||||
try {
|
||||
await unlink(file);
|
||||
} catch (err) {
|
||||
console.warn(`[${materialId}] 清理临时文件失败: ${file}`);
|
||||
}
|
||||
}
|
||||
|
||||
log.status = 'success';
|
||||
log.endTime = new Date();
|
||||
console.log(`[${materialId}] ✅ 迁移成功`);
|
||||
|
||||
} catch (error) {
|
||||
// 清理临时文件
|
||||
for (const file of tempFiles) {
|
||||
try {
|
||||
await unlink(file);
|
||||
} catch (err) {
|
||||
// 忽略清理错误
|
||||
}
|
||||
}
|
||||
throw error;
|
||||
}
|
||||
|
||||
} catch (error) {
|
||||
log.status = 'failed';
|
||||
log.error = error instanceof Error ? error.message : String(error);
|
||||
log.endTime = new Date();
|
||||
console.error(`[${materialId}] ❌ 迁移失败: ${log.error}`);
|
||||
}
|
||||
|
||||
return log;
|
||||
}
|
||||
|
||||
/**
|
||||
* 主函数
|
||||
*/
|
||||
async function main() {
|
||||
console.log('='.repeat(60));
|
||||
console.log('任务-详情老素材迁移脚本');
|
||||
console.log('='.repeat(60));
|
||||
console.log(`配置: 批量大小=${CONFIG.batchSize}, 演练模式=${CONFIG.dryRun}`);
|
||||
console.log('');
|
||||
|
||||
try {
|
||||
// 1. 查询需要迁移的素材
|
||||
// 查询条件:有 S3 预览图但没有本地 zip 文件的素材
|
||||
const allMaterials = await prisma.material.findMany({
|
||||
where: {
|
||||
materialType: '任务-详情',
|
||||
deletedAt: null,
|
||||
...(CONFIG.targetProductModel ? { productModel: CONFIG.targetProductModel } : {}),
|
||||
},
|
||||
select: {
|
||||
id: true,
|
||||
productModel: true,
|
||||
taskNo: true,
|
||||
assets: {
|
||||
select: {
|
||||
assetType: true,
|
||||
fileUrl: true,
|
||||
},
|
||||
},
|
||||
},
|
||||
orderBy: { createdAt: 'asc' },
|
||||
});
|
||||
|
||||
// 过滤出有 S3 预览图但没有本地 zip 文件的素材
|
||||
const materials = allMaterials
|
||||
.filter(m => {
|
||||
const hasS3Previews = m.assets.some(a =>
|
||||
['main', 'sku', 'detail'].includes(a.assetType) && a.fileUrl.startsWith('https://')
|
||||
);
|
||||
const hasLocalZips = m.assets.some(a =>
|
||||
['main', 'sku', 'detail', 'all'].includes(a.assetType) && a.fileUrl.startsWith('uploads/')
|
||||
);
|
||||
return hasS3Previews && !hasLocalZips;
|
||||
})
|
||||
.slice(0, CONFIG.batchSize)
|
||||
.map(m => ({ id: m.id, productModel: m.productModel, taskNo: m.taskNo }));
|
||||
|
||||
console.log(`找到 ${materials.length} 个需要迁移的素材`);
|
||||
console.log('');
|
||||
|
||||
if (materials.length === 0) {
|
||||
console.log('没有需要迁移的素材');
|
||||
return;
|
||||
}
|
||||
|
||||
// 2. 逐个迁移
|
||||
for (let i = 0; i < materials.length; i++) {
|
||||
const material = materials[i];
|
||||
console.log(`\n进度: ${i + 1}/${materials.length}`);
|
||||
|
||||
const log = await migrateMaterial(material.id);
|
||||
migrationLogs.push(log);
|
||||
|
||||
// 短暂延迟,避免过载
|
||||
await new Promise((resolve) => setTimeout(resolve, 1000));
|
||||
}
|
||||
|
||||
// 3. 输出统计
|
||||
console.log('\n' + '='.repeat(60));
|
||||
console.log('迁移完成统计');
|
||||
console.log('='.repeat(60));
|
||||
|
||||
const successCount = migrationLogs.filter((l) => l.status === 'success').length;
|
||||
const failedCount = migrationLogs.filter((l) => l.status === 'failed').length;
|
||||
|
||||
console.log(`总计: ${migrationLogs.length} 个素材`);
|
||||
console.log(`成功: ${successCount} 个`);
|
||||
console.log(`失败: ${failedCount} 个`);
|
||||
|
||||
if (failedCount > 0) {
|
||||
console.log('\n失败的素材:');
|
||||
migrationLogs
|
||||
.filter((l) => l.status === 'failed')
|
||||
.forEach((l) => {
|
||||
console.log(` - ${l.productModel} (${l.materialId}): ${l.error}`);
|
||||
});
|
||||
}
|
||||
|
||||
// 4. 保存日志到文件
|
||||
const logFileName = `migration-log-${Date.now()}.json`;
|
||||
const logFilePath = path.join(process.cwd(), 'logs', logFileName);
|
||||
await mkdir(path.dirname(logFilePath), { recursive: true });
|
||||
await writeFile(logFilePath, JSON.stringify(migrationLogs, null, 2));
|
||||
console.log(`\n日志已保存到: ${logFilePath}`);
|
||||
|
||||
} catch (error) {
|
||||
console.error('迁移过程中发生错误:', error);
|
||||
process.exit(1);
|
||||
} finally {
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
}
|
||||
|
||||
// 执行
|
||||
main();
|
||||
@ -1,177 +0,0 @@
|
||||
# "任务-详情"素材迁移最终报告
|
||||
|
||||
**迁移时间**:2026-01-20
|
||||
**执行人**:AI 助手
|
||||
**状态**:✅ 迁移完成
|
||||
|
||||
---
|
||||
|
||||
## 一、迁移目标
|
||||
|
||||
将所有使用老逻辑的"任务-详情"素材迁移到新逻辑:
|
||||
- **老逻辑**:只有 S3 预览图,下载时动态打包
|
||||
- **新逻辑**:本地保存原图 zip,S3 保存预览图,下载时直接返回 zip
|
||||
|
||||
---
|
||||
|
||||
## 二、迁移统计
|
||||
|
||||
### 总体情况
|
||||
|
||||
| 项目 | 数量 | 说明 |
|
||||
|------|------|------|
|
||||
| 总素材数 | 77 个 | 所有"任务-详情"素材 |
|
||||
| ✅ 成功迁移 | 57 个 | 从老逻辑迁移到新逻辑 |
|
||||
| ✅ 新逻辑上传 | 18 个 | 使用新逻辑上传,无需迁移 |
|
||||
| ❌ 空记录 | 2 个 | 无任务号,无资产,不需要迁移 |
|
||||
|
||||
### 迁移过程
|
||||
|
||||
**第一轮迁移**(修复 zipFilePath='' 的素材):
|
||||
- 第一批:9 个成功
|
||||
- 第二批:8 个成功
|
||||
- 第三批:8 个成功
|
||||
- 第四批:3 个成功
|
||||
- **小计:28 个素材**
|
||||
|
||||
**第二轮迁移**(修复有 zipFilePath 但没有本地 zip 文件的素材):
|
||||
- 第一批:10 个成功
|
||||
- 第二批:9 个成功(1 个空素材失败)
|
||||
- 第三批:9 个成功(1 个文件名问题)
|
||||
- 第四批:1 个成功
|
||||
- **小计:29 个素材**
|
||||
|
||||
**总计本次迁移:57 个素材成功**
|
||||
|
||||
---
|
||||
|
||||
## 三、验证结果
|
||||
|
||||
使用 `scripts/verify-migrated-files.ts` 验证所有素材:
|
||||
|
||||
```
|
||||
总计: 77 个素材
|
||||
✅ 所有文件存在: 75 个
|
||||
⚠️ 部分文件缺失: 0 个
|
||||
❌ 所有文件缺失: 0 个
|
||||
❌ 没有 zip 记录: 2 个(空记录)
|
||||
```
|
||||
|
||||
**结论**:所有 75 个有效素材的本地 zip 文件均存在,迁移成功!
|
||||
|
||||
---
|
||||
|
||||
## 四、空记录详情
|
||||
|
||||
2 个空记录(无任务号,无资产):
|
||||
|
||||
| SPU | 作者 | 任务号 | 说明 |
|
||||
|-----|------|--------|------|
|
||||
| CYJ0062 | 紫苏 | 无 | 测试数据或上传失败 |
|
||||
| GBPM-SN0208-389 | 瑶光 | 无 | 测试数据或上传失败 |
|
||||
|
||||
这些记录可以忽略或删除。
|
||||
|
||||
---
|
||||
|
||||
## 五、迁移脚本
|
||||
|
||||
### 主要脚本
|
||||
|
||||
| 脚本 | 说明 |
|
||||
|------|------|
|
||||
| `scripts/migrate-product-package-old-materials.ts` | 迁移脚本 |
|
||||
| `scripts/verify-migrated-files.ts` | 验证脚本 |
|
||||
| `scripts/check-remaining-materials.ts` | 检查剩余素材脚本 |
|
||||
| `scripts/list-non-migrated-materials.ts` | 列出未迁移素材脚本 |
|
||||
|
||||
### 使用方法
|
||||
|
||||
```bash
|
||||
# 迁移素材
|
||||
npx tsx scripts/migrate-product-package-old-materials.ts
|
||||
|
||||
# 验证迁移结果
|
||||
npx tsx scripts/verify-migrated-files.ts
|
||||
|
||||
# 检查剩余素材
|
||||
npx tsx scripts/check-remaining-materials.ts
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 六、迁移日志
|
||||
|
||||
所有迁移日志保存在 `logs/` 目录:
|
||||
|
||||
```
|
||||
logs/migration-log-1768923605237.json # XG0176
|
||||
logs/migration-log-1768923722086.json # 第一批
|
||||
logs/migration-log-1768923840136.json # 第一批
|
||||
logs/migration-log-1768923958151.json # 第二批
|
||||
logs/migration-log-1768924161945.json # 第三批
|
||||
logs/migration-log-1768924240279.json # 第四批
|
||||
logs/migration-log-1768924819982.json # 新一批1
|
||||
logs/migration-log-1768925113364.json # 新一批2
|
||||
logs/migration-log-1768925294759.json # 新一批3
|
||||
logs/migration-log-1768925358913.json # 新一批4
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 七、数据库备份
|
||||
|
||||
迁移前已备份数据库:
|
||||
|
||||
```
|
||||
/root/backup/lobechat_before_migration_20260120_225017.sql (3.8MB)
|
||||
```
|
||||
|
||||
---
|
||||
|
||||
## 八、后续工作
|
||||
|
||||
### 可选清理工作
|
||||
|
||||
1. **删除空记录**(可选):
|
||||
```sql
|
||||
DELETE FROM materials
|
||||
WHERE material_type = '任务-详情'
|
||||
AND deleted_at IS NULL
|
||||
AND task_no IS NULL
|
||||
AND NOT EXISTS (
|
||||
SELECT 1 FROM material_asset
|
||||
WHERE material_id = materials.id
|
||||
);
|
||||
```
|
||||
|
||||
2. **清理迁移日志**(可选):
|
||||
- 迁移日志可以保留作为历史记录
|
||||
- 如需清理,可删除 `logs/migration-log-*.json` 文件
|
||||
|
||||
### 监控建议
|
||||
|
||||
1. 定期检查下载功能是否正常
|
||||
2. 监控存储空间使用情况
|
||||
3. 关注任务平台接口调用情况
|
||||
|
||||
---
|
||||
|
||||
## 九、总结
|
||||
|
||||
✅ **迁移工作已全部完成!**
|
||||
|
||||
- 所有 75 个有效素材已成功迁移到新逻辑
|
||||
- 所有本地 zip 文件均已验证存在
|
||||
- 下载功能正常工作
|
||||
- 任务平台接口兼容新老格式
|
||||
|
||||
**用户体验**:
|
||||
- 下载速度更快(直接返回 zip,无需动态打包)
|
||||
- 预览图质量优化(800×1200,200KB)
|
||||
- 原图完整保存(本地 zip 文件)
|
||||
|
||||
---
|
||||
|
||||
**报告生成时间**:2026-01-20
|
||||
**报告版本**:1.0.0
|
||||
@ -1,16 +0,0 @@
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
prisma.material.update({
|
||||
where: {
|
||||
id: 'f8148b30-d83f-4e6a-800e-fa047efd9b16'
|
||||
},
|
||||
data: {
|
||||
zipFilePath: '',
|
||||
zipFileName: '',
|
||||
zipFileSize: BigInt(0),
|
||||
}
|
||||
}).then(() => {
|
||||
console.log('✅ XG0176 已重置');
|
||||
prisma.$disconnect();
|
||||
});
|
||||
@ -1,204 +0,0 @@
|
||||
/**
|
||||
* 恢复被误删的老资产记录
|
||||
*
|
||||
* 从备份数据库中恢复 XG0176 素材的老资产记录
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
// XG0176 素材的老资产记录(从备份中提取)
|
||||
const OLD_ASSETS = [
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'main',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/main-1768468700756-ijjnvb0.webp',
|
||||
fileName: '买家秀1.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 0,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468700815-q5w6p65.webp',
|
||||
fileName: 'XG013202.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 0,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468700838-qaepw84.webp',
|
||||
fileName: 'XG013207.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 1,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468700851-zuvkpkc.webp',
|
||||
fileName: 'XG013212.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 2,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468700930-mak6wa7.webp',
|
||||
fileName: 'XG013218.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 3,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701025-d1kzumc.webp',
|
||||
fileName: 'XG014805.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 4,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701082-hdneh4f.webp',
|
||||
fileName: 'XG014808.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 5,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701145-lnajgol.webp',
|
||||
fileName: 'XG014811.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 6,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701155-rxdclvw.webp',
|
||||
fileName: 'XG017601.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 7,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701205-k8eratf.webp',
|
||||
fileName: 'XG017602.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 8,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701275-hhqf538.webp',
|
||||
fileName: 'xg017603.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 9,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701333-8tkk5vb.webp',
|
||||
fileName: 'xg017604.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 10,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701375-6pi0ak0.webp',
|
||||
fileName: 'XG017610.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 11,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701392-456m2q8.webp',
|
||||
fileName: 'XG017611.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 12,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701448-8itfhtm.webp',
|
||||
fileName: 'XG017612.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 13,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701528-5x525v6.webp',
|
||||
fileName: 'XG017613.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 14,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701563-2yqb0ia.webp',
|
||||
fileName: 'XG017614.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 15,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701616-0d467x5.webp',
|
||||
fileName: 'XG017615.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 16,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701627-t80jbug.webp',
|
||||
fileName: 'XG017907.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 17,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701709-y1yfv5e.webp',
|
||||
fileName: 'XG017908.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 18,
|
||||
},
|
||||
{
|
||||
materialId: 'f8148b30-d83f-4e6a-800e-fa047efd9b16',
|
||||
assetType: 'sku',
|
||||
fileUrl: 'https://s3.yydd.ai/gongxiangpan/由壹点AI/product-package/sku-1768468701730-twc1ovy.webp',
|
||||
fileName: 'XG017909.jpg',
|
||||
fileSize: BigInt(0),
|
||||
sortOrder: 19,
|
||||
},
|
||||
];
|
||||
|
||||
async function main() {
|
||||
console.log('='.repeat(60));
|
||||
console.log('恢复被误删的老资产记录');
|
||||
console.log('='.repeat(60));
|
||||
console.log(`将恢复 ${OLD_ASSETS.length} 条资产记录`);
|
||||
console.log('');
|
||||
|
||||
try {
|
||||
await prisma.materialAsset.createMany({
|
||||
data: OLD_ASSETS,
|
||||
});
|
||||
|
||||
console.log('✅ 恢复完成');
|
||||
} catch (error) {
|
||||
console.error('恢复失败:', error);
|
||||
process.exit(1);
|
||||
} finally {
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
}
|
||||
|
||||
main();
|
||||
@ -1,47 +0,0 @@
|
||||
/**
|
||||
* 恢复 XG0176 的预览图记录
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
async function main() {
|
||||
console.log('='.repeat(60));
|
||||
console.log('恢复 XG0176 的预览图记录');
|
||||
console.log('='.repeat(60));
|
||||
|
||||
const materialId = 'f8148b30-d83f-4e6a-800e-fa047efd9b16';
|
||||
|
||||
// 查询所有 S3 预览图(assetType='main'/'sku'/'detail')
|
||||
const s3Assets = await prisma.materialAsset.findMany({
|
||||
where: {
|
||||
materialId,
|
||||
assetType: { in: ['main', 'sku', 'detail'] },
|
||||
fileUrl: { startsWith: 'https://' },
|
||||
},
|
||||
orderBy: { sortOrder: 'asc' },
|
||||
});
|
||||
|
||||
console.log(`找到 ${s3Assets.length} 个 S3 预览图`);
|
||||
|
||||
// 为每个 S3 预览图创建对应的 *-preview 记录
|
||||
const newRecords = s3Assets.map((asset) => ({
|
||||
materialId,
|
||||
assetType: `${asset.assetType}-preview` as any,
|
||||
fileUrl: asset.fileUrl,
|
||||
fileName: asset.fileName,
|
||||
fileSize: asset.fileSize,
|
||||
sortOrder: asset.sortOrder,
|
||||
}));
|
||||
|
||||
await prisma.materialAsset.createMany({
|
||||
data: newRecords,
|
||||
});
|
||||
|
||||
console.log(`✅ 已创建 ${newRecords.length} 条预览图记录`);
|
||||
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
|
||||
main();
|
||||
@ -1,14 +0,0 @@
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
prisma.material.update({
|
||||
where: { id: 'f8148b30-d83f-4e6a-800e-fa047efd9b16' },
|
||||
data: {
|
||||
zipFilePath: 'uploads/materials/XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768922733168.zip',
|
||||
zipFileName: 'XG0176_all_f8148b30-d83f-4e6a-800e-fa047efd9b16_1768922733168.zip',
|
||||
zipFileSize: BigInt(912688),
|
||||
}
|
||||
}).then(() => {
|
||||
console.log('✅ zipFilePath 已恢复');
|
||||
prisma.$disconnect();
|
||||
});
|
||||
@ -1,116 +0,0 @@
|
||||
/**
|
||||
* 回滚已迁移的素材
|
||||
*
|
||||
* 用于回滚迁移失败或路径错误的素材
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
import { unlink } from 'fs/promises';
|
||||
import path from 'path';
|
||||
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
// 要回滚的素材型号
|
||||
const PRODUCT_MODEL = 'XG0176';
|
||||
|
||||
async function main() {
|
||||
console.log('='.repeat(60));
|
||||
console.log('回滚已迁移的素材');
|
||||
console.log('='.repeat(60));
|
||||
console.log(`素材型号: ${PRODUCT_MODEL}`);
|
||||
console.log('');
|
||||
|
||||
try {
|
||||
// 1. 查询素材
|
||||
const material = await prisma.material.findFirst({
|
||||
where: {
|
||||
productModel: PRODUCT_MODEL,
|
||||
materialType: '任务-详情',
|
||||
deletedAt: null,
|
||||
},
|
||||
include: {
|
||||
assets: true,
|
||||
},
|
||||
});
|
||||
|
||||
if (!material) {
|
||||
console.log('未找到素材');
|
||||
return;
|
||||
}
|
||||
|
||||
console.log(`找到素材: ${material.id}`);
|
||||
console.log(`当前 zipFilePath: ${material.zipFilePath}`);
|
||||
console.log(`当前 zipFileSize: ${material.zipFileSize}`);
|
||||
console.log('');
|
||||
|
||||
// 2. 删除新增的资产记录(只删除新增的,保留老的 main/sku/detail)
|
||||
const assetsToDelete = material.assets.filter(
|
||||
(a) =>
|
||||
a.assetType === 'main-preview' ||
|
||||
a.assetType === 'sku-preview' ||
|
||||
a.assetType === 'detail-preview' ||
|
||||
(a.assetType === 'main' && a.fileUrl.startsWith('uploads/')) ||
|
||||
(a.assetType === 'sku' && a.fileUrl.startsWith('uploads/')) ||
|
||||
(a.assetType === 'detail' && a.fileUrl.startsWith('uploads/')) ||
|
||||
a.assetType === 'all'
|
||||
);
|
||||
|
||||
console.log(`将删除 ${assetsToDelete.length} 条资产记录:`);
|
||||
assetsToDelete.forEach((a) => {
|
||||
console.log(` - ${a.assetType}: ${a.fileName}`);
|
||||
});
|
||||
console.log('');
|
||||
|
||||
// 3. 删除生成的zip文件(只删除本地zip文件)
|
||||
const zipFiles = material.assets.filter(
|
||||
(a) =>
|
||||
((a.assetType === 'main' || a.assetType === 'sku' || a.assetType === 'detail') &&
|
||||
a.fileUrl.startsWith('uploads/')) ||
|
||||
a.assetType === 'all'
|
||||
);
|
||||
|
||||
console.log(`将删除 ${zipFiles.length} 个zip文件:`);
|
||||
for (const asset of zipFiles) {
|
||||
const filePath = path.join(process.cwd(), asset.fileUrl);
|
||||
console.log(` - ${filePath}`);
|
||||
|
||||
try {
|
||||
await unlink(filePath);
|
||||
console.log(` ✅ 删除成功`);
|
||||
} catch (err) {
|
||||
console.log(` ⚠️ 删除失败: ${err}`);
|
||||
}
|
||||
}
|
||||
console.log('');
|
||||
|
||||
// 4. 执行数据库回滚
|
||||
await prisma.$transaction(async (tx) => {
|
||||
// 删除新增的资产记录(逐个删除,避免误删老记录)
|
||||
for (const asset of assetsToDelete) {
|
||||
await tx.materialAsset.delete({
|
||||
where: { id: asset.id },
|
||||
});
|
||||
}
|
||||
|
||||
// 恢复素材记录
|
||||
await tx.material.update({
|
||||
where: { id: material.id },
|
||||
data: {
|
||||
zipFilePath: '',
|
||||
zipFileName: '',
|
||||
zipFileSize: BigInt(0),
|
||||
},
|
||||
});
|
||||
});
|
||||
|
||||
console.log('✅ 回滚完成');
|
||||
|
||||
} catch (error) {
|
||||
console.error('回滚失败:', error);
|
||||
process.exit(1);
|
||||
} finally {
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
}
|
||||
|
||||
main();
|
||||
@ -1,148 +0,0 @@
|
||||
/**
|
||||
* 验证已迁移素材的文件是否真实存在
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
import { exec } from 'child_process';
|
||||
import { promisify } from 'util';
|
||||
|
||||
const execAsync = promisify(exec);
|
||||
const prisma = new PrismaClient();
|
||||
|
||||
async function checkFileExists(filePath: string): Promise<boolean> {
|
||||
try {
|
||||
const remotePath = `/mnt/PoolOne/apps/youyidian-3d/${filePath}`;
|
||||
const { stdout } = await execAsync(`ssh root@192.168.58.20 "test -f ${remotePath} && echo 'exists' || echo 'not_found'"`);
|
||||
return stdout.trim() === 'exists';
|
||||
} catch (error) {
|
||||
return false;
|
||||
}
|
||||
}
|
||||
|
||||
async function main() {
|
||||
console.log('开始验证所有"任务-详情"素材的文件...\n');
|
||||
|
||||
// 查询所有素材(不管 zipFilePath 是否为空)
|
||||
const materials = await prisma.material.findMany({
|
||||
where: {
|
||||
materialType: '任务-详情',
|
||||
deletedAt: null,
|
||||
},
|
||||
select: {
|
||||
id: true,
|
||||
productModel: true,
|
||||
zipFilePath: true,
|
||||
zipFileName: true,
|
||||
taskNo: true,
|
||||
user: {
|
||||
select: {
|
||||
realName: true,
|
||||
username: true,
|
||||
},
|
||||
},
|
||||
assets: {
|
||||
where: {
|
||||
assetType: { in: ['main', 'sku', 'detail', 'all'] },
|
||||
},
|
||||
select: {
|
||||
assetType: true,
|
||||
fileUrl: true,
|
||||
fileName: true,
|
||||
},
|
||||
},
|
||||
},
|
||||
orderBy: { createdAt: 'desc' },
|
||||
});
|
||||
|
||||
console.log(`找到 ${materials.length} 个"任务-详情"素材\n`);
|
||||
|
||||
const results = {
|
||||
total: materials.length,
|
||||
allFilesExist: 0,
|
||||
someFilesMissing: 0,
|
||||
allFilesMissing: 0,
|
||||
noZipRecords: 0,
|
||||
details: [] as any[],
|
||||
};
|
||||
|
||||
for (const material of materials) {
|
||||
const authorName = material.user?.realName || material.user?.username || '未知';
|
||||
const zipAssets = material.assets.filter(a => a.fileUrl.startsWith('uploads/'));
|
||||
|
||||
if (zipAssets.length === 0) {
|
||||
console.log(`❌ ${material.productModel.padEnd(20)} (${authorName.padEnd(10)}): 没有本地 zip 文件记录 | 任务号: ${material.taskNo || '无'}`);
|
||||
results.noZipRecords++;
|
||||
results.details.push({
|
||||
productModel: material.productModel,
|
||||
authorName,
|
||||
taskNo: material.taskNo,
|
||||
status: 'no_zip_records',
|
||||
zipFilePath: material.zipFilePath,
|
||||
});
|
||||
continue;
|
||||
}
|
||||
|
||||
const fileChecks = await Promise.all(
|
||||
zipAssets.map(async (asset) => {
|
||||
const exists = await checkFileExists(asset.fileUrl);
|
||||
return { assetType: asset.assetType, fileUrl: asset.fileUrl, exists };
|
||||
})
|
||||
);
|
||||
|
||||
const existsCount = fileChecks.filter(c => c.exists).length;
|
||||
const missingFiles = fileChecks.filter(c => !c.exists);
|
||||
|
||||
if (existsCount === zipAssets.length) {
|
||||
console.log(`✅ ${material.productModel.padEnd(20)} (${authorName.padEnd(10)}): 所有文件存在 (${existsCount}/${zipAssets.length})`);
|
||||
results.allFilesExist++;
|
||||
} else if (existsCount > 0) {
|
||||
console.log(`⚠️ ${material.productModel.padEnd(20)} (${authorName.padEnd(10)}): 部分文件缺失 (${existsCount}/${zipAssets.length})`);
|
||||
missingFiles.forEach(f => console.log(` - 缺失: ${f.assetType} (${f.fileUrl})`));
|
||||
results.someFilesMissing++;
|
||||
results.details.push({
|
||||
productModel: material.productModel,
|
||||
authorName,
|
||||
taskNo: material.taskNo,
|
||||
status: 'partial',
|
||||
missingFiles: missingFiles.map(f => f.assetType),
|
||||
});
|
||||
} else {
|
||||
console.log(`❌ ${material.productModel.padEnd(20)} (${authorName.padEnd(10)}): 所有文件缺失 (0/${zipAssets.length}) | 任务号: ${material.taskNo || '无'}`);
|
||||
missingFiles.forEach(f => console.log(` - 缺失: ${f.assetType} (${f.fileUrl})`));
|
||||
results.allFilesMissing++;
|
||||
results.details.push({
|
||||
productModel: material.productModel,
|
||||
authorName,
|
||||
taskNo: material.taskNo,
|
||||
status: 'all_missing',
|
||||
zipFilePath: material.zipFilePath,
|
||||
});
|
||||
}
|
||||
}
|
||||
|
||||
console.log('\n' + '='.repeat(80));
|
||||
console.log('验证结果统计');
|
||||
console.log('='.repeat(80));
|
||||
console.log(`总计: ${results.total} 个素材`);
|
||||
console.log(`✅ 所有文件存在: ${results.allFilesExist} 个`);
|
||||
console.log(`⚠️ 部分文件缺失: ${results.someFilesMissing} 个`);
|
||||
console.log(`❌ 所有文件缺失: ${results.allFilesMissing} 个`);
|
||||
console.log(`❌ 没有 zip 记录: ${results.noZipRecords} 个`);
|
||||
console.log(`\n需要迁移的素材总数: ${results.allFilesMissing + results.noZipRecords} 个`);
|
||||
|
||||
if (results.details.length > 0) {
|
||||
console.log('\n' + '='.repeat(80));
|
||||
console.log('需要迁移的素材详情:');
|
||||
console.log('='.repeat(80));
|
||||
results.details.forEach(d => {
|
||||
console.log(` - ${d.productModel.padEnd(20)} (${d.authorName.padEnd(10)}): ${d.status.padEnd(20)} | 任务号: ${d.taskNo || '无'}`);
|
||||
if (d.missingFiles) {
|
||||
console.log(` 缺失类型: ${d.missingFiles.join(', ')}`);
|
||||
}
|
||||
});
|
||||
}
|
||||
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
|
||||
main();
|
||||
@ -1,146 +0,0 @@
|
||||
/**
|
||||
* 验证已恢复的源文件是否可以正常下载
|
||||
* 检查本地 uploads 目录中的文件在数据库中的对应素材
|
||||
*/
|
||||
|
||||
import { PrismaClient } from '@prisma/client';
|
||||
import { readdir } from 'fs/promises';
|
||||
import path from 'path';
|
||||
|
||||
// 连接到生产数据库
|
||||
const prisma = new PrismaClient({
|
||||
datasources: {
|
||||
db: {
|
||||
url: 'postgresql://postgres:jsjj8888@192.168.58.20:5432/lobechat',
|
||||
},
|
||||
},
|
||||
});
|
||||
|
||||
async function verifyRestoredFiles() {
|
||||
try {
|
||||
console.log('开始验证已恢复的源文件...\n');
|
||||
|
||||
// 读取本地 uploads 目录中的文件
|
||||
const uploadsDir = path.join(process.cwd(), 'uploads');
|
||||
const files = await readdir(uploadsDir);
|
||||
|
||||
// 过滤出音频和视频文件
|
||||
const audioFiles = files.filter(f => f.endsWith('.mp3'));
|
||||
const videoFiles = files.filter(f => f.endsWith('.mp4'));
|
||||
|
||||
console.log(`找到 ${audioFiles.length} 个音频文件`);
|
||||
console.log(`找到 ${videoFiles.length} 个视频文件\n`);
|
||||
|
||||
// 随机抽取样本
|
||||
const sampleAudio = audioFiles.sort(() => 0.5 - Math.random()).slice(0, 5);
|
||||
const sampleVideo = videoFiles;
|
||||
|
||||
console.log('=== 抽样检测文件 ===');
|
||||
console.log('\n音频文件样本:');
|
||||
sampleAudio.forEach(f => console.log(` - ${f}`));
|
||||
console.log('\n视频文件样本:');
|
||||
sampleVideo.forEach(f => console.log(` - ${f}`));
|
||||
console.log('\n');
|
||||
|
||||
// 查找对应的素材
|
||||
const results = [];
|
||||
|
||||
// 检查音频文件
|
||||
for (const fileName of sampleAudio) {
|
||||
const filePath = `uploads/${fileName}`;
|
||||
|
||||
const material = await prisma.material.findFirst({
|
||||
where: {
|
||||
zipFilePath: filePath,
|
||||
deletedAt: null,
|
||||
},
|
||||
select: {
|
||||
id: true,
|
||||
materialType: true,
|
||||
productModel: true,
|
||||
authorName: true,
|
||||
zipFilePath: true,
|
||||
},
|
||||
});
|
||||
|
||||
results.push({
|
||||
fileName,
|
||||
fileType: '音频',
|
||||
found: !!material,
|
||||
material: material || null,
|
||||
});
|
||||
}
|
||||
|
||||
// 检查视频文件
|
||||
for (const fileName of sampleVideo) {
|
||||
const filePath = `/uploads/${fileName}`;
|
||||
|
||||
const material = await prisma.material.findFirst({
|
||||
where: {
|
||||
videoSourceUrl: filePath,
|
||||
deletedAt: null,
|
||||
},
|
||||
select: {
|
||||
id: true,
|
||||
materialType: true,
|
||||
productModel: true,
|
||||
authorName: true,
|
||||
videoSourceUrl: true,
|
||||
},
|
||||
});
|
||||
|
||||
results.push({
|
||||
fileName,
|
||||
fileType: '视频',
|
||||
found: !!material,
|
||||
material: material || null,
|
||||
});
|
||||
}
|
||||
|
||||
// 输出结果
|
||||
console.log('=== 检测结果 ===\n');
|
||||
|
||||
const foundCount = results.filter(r => r.found).length;
|
||||
const notFoundCount = results.filter(r => !r.found).length;
|
||||
|
||||
console.log(`✅ 找到对应素材: ${foundCount} 个`);
|
||||
console.log(`❌ 未找到对应素材: ${notFoundCount} 个\n`);
|
||||
|
||||
if (foundCount > 0) {
|
||||
console.log('找到的素材详情:');
|
||||
console.log('-'.repeat(100));
|
||||
results.filter(r => r.found).forEach((r, index) => {
|
||||
console.log(`${index + 1}. ${r.fileType} - ${r.fileName}`);
|
||||
console.log(` 素材ID: ${r.material!.id}`);
|
||||
console.log(` 类型: ${r.material!.materialType}`);
|
||||
console.log(` 型号: ${r.material!.productModel}`);
|
||||
console.log(` 作者: ${r.material!.authorName}`);
|
||||
console.log(` 正式环境访问: http://192.168.58.20:4320/share/${r.material!.id}`);
|
||||
console.log('');
|
||||
});
|
||||
}
|
||||
|
||||
if (notFoundCount > 0) {
|
||||
console.log('未找到对应素材的文件:');
|
||||
console.log('-'.repeat(100));
|
||||
results.filter(r => !r.found).forEach((r, index) => {
|
||||
console.log(`${index + 1}. ${r.fileType} - ${r.fileName}`);
|
||||
});
|
||||
console.log('');
|
||||
}
|
||||
|
||||
console.log('=== 下一步操作 ===');
|
||||
console.log('1. 访问上面列出的素材详情页(正式环境)');
|
||||
console.log('2. 点击下载按钮,验证是否能正常下载');
|
||||
console.log('3. 如果下载成功,说明源文件已成功恢复');
|
||||
console.log('');
|
||||
console.log('正式系统地址: http://192.168.58.20:4320');
|
||||
|
||||
} catch (error) {
|
||||
console.error('验证失败:', error);
|
||||
} finally {
|
||||
await prisma.$disconnect();
|
||||
}
|
||||
}
|
||||
|
||||
verifyRestoredFiles();
|
||||
Loading…
x
Reference in New Issue
Block a user