v1.2.0rc1
Pre-releaseWhat's new
Added π
- Added dataset reader support for SQuAD 2.0 with both the
SquadReaderandTransformerSquadReader. - Updated the SQuAD v1.1 metric to work with SQuAD 2.0 as well.
- Updated the
TransformerQAmodel to work for SQuAD 2.0. - Added official support for Python 3.8.
- Added a json template for model cards.
- Added
training_configas a field in model cards. - Added a
BeamSearchGeneratorregistrable class which can be provided to aNextTokenLMmodel
to utilize beam search for predicting a sequence of tokens, instead of a single next token.
BeamSearchGeneratoris an abstract class, so a concrete registered implementation needs to be used.
One implementation is provided so far:TransformerBeamSearchGenerator, registered astransformer,
which will work with anyNextTokenLMthat uses aPretrainedTransformerEmbedder. - Added an
overridesparameter topretrained.load_predictor().
Changed β οΈ
rc-transformer-qapretrained model is now an updated version trained on SQuAD v2.0.skip_invalid_examplesparameter in SQuAD dataset readers has been deprecated. Please use
skip_impossible_questionsinstead.
Fixed β
- Fixed
lm-masked-language-modelpretrained model. - Fixed BART for latest
transformersversion. - Fixed BiDAF predictor and BiDAF predictor tests.
- Fixed a bug with
Seq2SeqDatasetReaderthat would cause an exception when
the desired behavior is to not add start or end symbols to either the source or the target
and the defaultstart_symbolorend_symbolare not part of the tokenizer's vocabulary.
Commits
8b5c42c Don't use PretrainedModelInitializer when loading a model (#141)
f789c53 add beam search to NextTokenLm (#149)
414cb48 Bidaf predictor and test quick fix (#154)
2d03ab0 fix docstrings to render correctly in docs (#150)
cdd505e Update mkdocs-material requirement from <6.1.0,>=5.5.0 to >=5.5.0,<6.2.0 (#152)
4cee3bd Model cards update (#148)
223ef71 Bump mypy from 0.782 to 0.790 (#147)
18008d0 fix TransformerQA predictor test (#145)
e827130 update masked lm language model (#143)
83e668c update how env variables set (#140)
d90953a run pretrained tests on CPU-only runner (#142)
0b3853a SQuAD 2.0 support (#134)
bcaf3c8 Fix some typos
0b05944 tick version for nightly releases
a330876 fix seq2seq reader bug (#139)
dd36890 Adding more documentation to model cards spec (#137)
436e047 Update mkdocs-material requirement from <5.6.0,>=5.5.0 to >=5.5.0,<6.1.0 (#138)
0cb9e0f Model cards update (#136)
5fabe32 official support Python 3.8 π (#135)
16513bd Bump conllu from 4.1 to 4.2 (#133)
a1f9a05 Create Dependabot config file (#132)
3425192 remove TODO
2d7e1f6 Fixes for new transformers release (#130)
57908bb allow multiple token embedders, but only use first with non-empty type (#129)