Benchmarks¶
Rating¶
All this results refer to the training phase.
FilmTrust¶
Additional information:
- Loading time: 0.748s
- Training dataset: users=1,508; items=2,071; ratings=35,497; sparsity: 1.14%
- No optimizers for SGD used.
Algorithm | RMSE | MAE | Train time | Settings |
---|---|---|---|---|
Global Average | 0.919 | 0.715 | 0.000s | - |
Item Average | 0.861 | 0.674 | 0.000s | - |
User Average | 0.785 | 0.606 | 0.000s | - |
User-Item Baseline | 0.738 | 0.566 | 0.001s | - |
BRISMF | 0.712 | 0.551 | 0.820s/iter | num_factors=10; num_iter=15, learning_rate=0.01; lmbda=0.1 |
SVD++ | 0.707 | 0.546 | 1.974s/iter | num_factors=10; num_iter=15; learning_rate=0.01; lmbda=0.1; |
TrustSVD | 0.677 | 0.520 | 3.604s/iter | num_factors=10; num_iter=15; learning_rate=0.01; lmbda=0.12; social_lmbda=0.9 |
MovieLens100K¶
Additional information:
- Loading time: 0.748s
- Training dataset: users=943; items=1,682; ratings=100,000; sparsity: 6.30%
- No optimizers for SGD used.
Algorithm | RMSE | MAE | Train time | Settings |
---|---|---|---|---|
Global Average | 1.126 | 0.945 | 0.001s | - |
Item Average | 1.000 | 0.799 | 0.001s | - |
User Average | 1.031 | 0.826 | 0.001s | - |
User-Item Baseline | 0.938 | 0.738 | 0.001s | - |
BRISMF | 0.810 | 0.642 | 2.027s/iter | num_factors=15; num_iter=15, learning_rate=0.07; lmbda=0.1 |
SVD++ | 0.823 | 0.648 | 7.252s/iter | num_factors=15; num_iter=15; learning_rate=0.02; bias_learning_rate=0.01; lmbda=0.1; bias_lmbda=0.007 |
MovieLens1M¶
Additional information:
- Loading time: 5.144s
- Training dataset: users=6,040; items=3,706; ratings=1,000,209; sparsity: 4.47%
- No optimizers for SGD used.
Algorithm | RMSE | MAE | Train time | Settings |
---|---|---|---|---|
Global Average | 1.117 | 0.934 | 0.010s | - |
Item Average | 0.975 | 0.779 | 0.018s | - |
User Average | 1.028 | 0.823 | 0.021s | - |
User-Item Baseline | 0.924 | 0.727 | 0.027s | - |
BRISMF | 0.886 | 0.704 | 19.757s/iter | num_factors=15; num_iter=15, learning_rate=0.07; lmbda=0.1 |
SVD++ | 0.858 | 0.677 | 98.249s/iter | num_factors=15; num_iter=15; learning_rate=0.02; bias_learning_rate=0.01; lmbda=0.1; bias_lmbda=0.007 |
MovieLens10M¶
Additional information:
- Loading time: 55.312s
- Training dataset: users=71,567; items=10,681; ratings=10,000,054; sparsity: 1.308%
- No optimizers for SGD used.
Algorithm | RMSE | MAE | Train time | Settings |
---|---|---|---|---|
Global Average | 1.060 | 0.856 | 0.150s | - |
Item Average | 0.942 | 0.737 | 0.271s | - |
User Average | 0.970 | 0.763 | 0.293s | - |
User-Item Baseline | 0.877 | 0.677 | 0.393s | - |
BRISMF | - | - | 230.656s/iter | num_factors=15; num_iter=15, learning_rate=0.07; lmbda=0.1 |
Ranking¶
Epinions¶
Additional information:
- Loading time (training dataset): 0.094s
- Loading time (test dataset): 1.392s
- Training dataset: users=4,718; items=49,288; ratings=23,590; sparsity: 0.0101%
- Testing dataset: users=4,718; items=49,288; ratings=322,445; sparsity: 0.1386%
- No optimizers for SGD used.
Algorit hm | MRR (train) | MRR (test) | Train time | Settings |
---|---|---|---|---|
CLiMF | 0.0758 | 0.3975 | 1.323s/i ter | num_factors=10; num_iter=10; learning_rate=0.0001; lmda=0.001 |