Skip to content

添加FLIP训练功能#26

Merged
yangapku merged 5 commits intoOFA-Sys:masterfrom
zwkkk:master
Dec 12, 2022
Merged

添加FLIP训练功能#26
yangapku merged 5 commits intoOFA-Sys:masterfrom
zwkkk:master

Conversation

@zwkkk
Copy link
Copy Markdown
Contributor

@zwkkk zwkkk commented Dec 8, 2022

No description provided.

@yangapku yangapku changed the title add flip 添加FLIP训练功能 Dec 8, 2022
@yangapku
Copy link
Copy Markdown
Member

yangapku commented Dec 8, 2022

@zwkkk 感谢贡献代码!您可以把加入FLIP后,实验的具体setting(下游数据集、模型规模、使用GPU规格、训练轮数)以及对比直接使用Chinese-CLIP的结果,在这里简单汇报下哈!

@zwkkk
Copy link
Copy Markdown
Contributor Author

zwkkk commented Dec 8, 2022

下游数据集:
MUGE,电商图文检索
实验设置:
16卡V100 32G,CN-CLIPViT-H/14版本,batch选取原则:尽量装满GPU

实验1:
备注:有添加一些额外数据
mask 比例50%,lr=1e-6,
取8轮的pt,cn-clip,batch/gpu:8,训练时间14h,MUGE retrival test测试,mean recall:81.71
取8轮的pt,cn-clip+mask,batch/gpu:28,训练时间5.5h,MUGE retrival test测试,mean recall:82.25 | test开启mask,mask 50%,推理速度快100%,mean recall:80.88

实验2:
无添加额外数据:
mask 比例50% ,lr=5e-6
cn-clip+mask, batch/gpu:28,8轮 81.36,4轮 82.00。2轮 82.09,1轮 81.29

@yangapku yangapku merged commit 1e618b0 into OFA-Sys:master Dec 12, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants