跳转到内容

Chess Data in Pre-training

Created by TonyWang

But actually it’s it’s more that I think this is public information, I think I saw it on the internet. Um a huge amount of like data of chess made it into the pre-training set. And just because it’s in the data distribution, basically the model improved a lot more than it would just by default.

但实际上,我认为这更像是公开信息,我记得我在网上看到过。嗯,大量的国际象棋数据进入了预训练集。仅仅因为它存在于数据分布中,模型基本上比默认情况下改进得更多。

  • 原文笔记:未捕获原文笔记链接
  • Obsidian 链接:未捕获
  • 选区行号:未捕获

But actually it’s it’s more that I think this is public information, I think I saw it on the internet. Um a huge amount of like data of chess made it into the pre-training set. And just because it’s in the data distribution, basically the model improved a lot more than it would just by default.

  1. it’s more that… (更像是…)
  2. I think… (我认为…)
  3. a huge amount of… (大量的…)
  4. made it into… (进入了…)
  5. just because… (仅仅因为…)
  6. a lot more than… (比…多得多)
  1. 重复的 ‘it’s it’s’ 是口语中的犹豫或强调,非正式用法
  2. ‘more that’ 引导比较从句,表示 ‘更像是’
  3. ‘made it into’ 是固定短语,表示 ‘成功进入’
  4. ‘just because’ 引导原因状语从句
  5. ‘a lot more than’ 是比较级结构,修饰动词 ‘improved’
  6. ‘by default’ 是固定短语,表示 ‘默认情况下’
  1. {“word”:“actually”,“phonetic”:“/ˈæktʃuəli/”,“part of speech”:“adv.”,“中文含义”:“实际上”,“usage”:“用于纠正或强调事实”}
  2. {“word”:“public information”,“phonetic”:“/ˈpʌblɪk ˌɪnfərˈmeɪʃən/”,“part of speech”:“n.”,“中文含义”:“公开信息”,“usage”:“指可公开获取的数据”}
  3. {“word”:“huge amount”,“phonetic”:“/hjuːdʒ əˈmaʊnt/”,“part of speech”:“n.”,“中文含义”:“大量”,“usage”:“修饰不可数名词,如 data”}
  4. {“word”:“data”,“phonetic”:“/ˈdeɪtə/”,“part of speech”:“n.”,“中文含义”:“数据”,“usage”:“复数形式,常与 of 连用”}
  5. {“word”:“pre-training set”,“phonetic”:“/priːˈtreɪnɪŋ set/”,“part of speech”:“n.”,“中文含义”:“预训练集”,“usage”:“机器学习术语,指训练前的数据集”}
  6. {“word”:“distribution”,“phonetic”:“/ˌdɪstrɪˈbjuːʃən/”,“part of speech”:“n.”,“中文含义”:“分布”,“usage”:“指数据在空间或统计上的分布”}
  7. {“word”:“basically”,“phonetic”:“/ˈbeɪsɪkli/”,“part of speech”:“adv.”,“中文含义”:“基本上”,“usage”:“用于总结或简化说明”}
  8. {“word”:“improved”,“phonetic”:“/ɪmˈpruːvd/”,“part of speech”:“v.”,“中文含义”:“改进”,“usage”:“过去式,表示性能提升”}
  9. {“word”:“default”,“phonetic”:“/dɪˈfɔːlt/”,“part of speech”:“n.”,“中文含义”:“默认”,“usage”:“常与 by 连用,表示默认状态”}
  1. 将 ‘it’s more that’ 联想为 ‘更像是’,强调对比
  2. ‘made it into’ 可记忆为 ‘挤进去了’,形象化进入过程
  3. ‘a huge amount of’ 与 ‘a large number of’ 对比,前者用于不可数名词
  4. ‘by default’ 可联想电脑默认设置,表示 ‘不额外操作’