✨ Highlights ✨
HSTU architecture from "Actions Speak Louder then Words..." is now available in RecTools as HSTUModel
, fully compatible with our fit
/ recommend
paradigm and capable of context-aware recommendations.
Added
- HSTU Model from "Actions Speak Louder then Words..." implemented in the class
HSTUModel
(#290) leave_one_out_mask
function (rectools.models.nn.transformers.utils.leave_one_out_mask
) for applying leave-one-out validation during transformer models training.(#292)logits_t
argument toTransformerLightningModuleBase
. It is used to scale logits when computing the loss. (#290)use_scale_factor
argument toLearnableInversePositionalEncoding
. It scales embeddings by the square root of their dimension — following the original approach from the "Attention Is All You Need" (#290)- Optional
context
argument torecommend
method of models andget_context
function torectools.dataset.context.py
(#290)
Fixed
- [Breaking] Corrected computation of
cosine
distance inDistanceSimilarityModule
(#290) - Installation issue with
cupy
extra on macOS (#293) torch.dtype object has no attribute 'kind'
error inTorchRanker
(#293)
Removed
- [Breaking]
Dropout
module fromIdEmbeddingsItemNet
. This changes model behaviour during training, so model results starting from this release might slightly differ from previous RecTools versions even when the random seed is fixed.(#290)