Benchmarks

Rating

All this results refer to the training phase.

FilmTrust

Additional information:

  • Loading time: 0.748s
  • Training dataset: users=1,508; items=2,071; ratings=35,497; sparsity: 1.14%
  • No optimizers for SGD used.
Algorithm RMSE MAE Train time Settings
Global Average 0.919 0.715 0.000s -
Item Average 0.861 0.674 0.000s -
User Average 0.785 0.606 0.000s -
User-Item Baseline 0.738 0.566 0.001s -
BRISMF 0.712 0.551 0.820s/iter num_factors=10; num_iter=15, learning_rate=0.01; lmbda=0.1
SVD++ 0.707 0.546 1.974s/iter num_factors=10; num_iter=15; learning_rate=0.01; lmbda=0.1;
TrustSVD 0.677 0.520 3.604s/iter num_factors=10; num_iter=15; learning_rate=0.01; lmbda=0.12; social_lmbda=0.9

MovieLens100K

Additional information:

  • Loading time: 0.748s
  • Training dataset: users=943; items=1,682; ratings=100,000; sparsity: 6.30%
  • No optimizers for SGD used.
Algorithm RMSE MAE Train time Settings
Global Average 1.126 0.945 0.001s -
Item Average 1.000 0.799 0.001s -
User Average 1.031 0.826 0.001s -
User-Item Baseline 0.938 0.738 0.001s -
BRISMF 0.810 0.642 2.027s/iter num_factors=15; num_iter=15, learning_rate=0.07; lmbda=0.1
SVD++ 0.823 0.648 7.252s/iter num_factors=15; num_iter=15; learning_rate=0.02; bias_learning_rate=0.01; lmbda=0.1; bias_lmbda=0.007

MovieLens1M

Additional information:

  • Loading time: 5.144s
  • Training dataset: users=6,040; items=3,706; ratings=1,000,209; sparsity: 4.47%
  • No optimizers for SGD used.
Algorithm RMSE MAE Train time Settings
Global Average 1.117 0.934 0.010s -
Item Average 0.975 0.779 0.018s -
User Average 1.028 0.823 0.021s -
User-Item Baseline 0.924 0.727 0.027s -
BRISMF 0.886 0.704 19.757s/iter num_factors=15; num_iter=15, learning_rate=0.07; lmbda=0.1
SVD++ 0.858 0.677 98.249s/iter num_factors=15; num_iter=15; learning_rate=0.02; bias_learning_rate=0.01; lmbda=0.1; bias_lmbda=0.007

MovieLens10M

Additional information:

  • Loading time: 55.312s
  • Training dataset: users=71,567; items=10,681; ratings=10,000,054; sparsity: 1.308%
  • No optimizers for SGD used.
Algorithm RMSE MAE Train time Settings
Global Average 1.060 0.856 0.150s -
Item Average 0.942 0.737 0.271s -
User Average 0.970 0.763 0.293s -
User-Item Baseline 0.877 0.677 0.393s -
BRISMF - - 230.656s/iter num_factors=15; num_iter=15, learning_rate=0.07; lmbda=0.1

Ranking

Epinions

Additional information:

  • Loading time (training dataset): 0.094s
  • Loading time (test dataset): 1.392s
  • Training dataset: users=4,718; items=49,288; ratings=23,590; sparsity: 0.0101%
  • Testing dataset: users=4,718; items=49,288; ratings=322,445; sparsity: 0.1386%
  • No optimizers for SGD used.
Algorit hm MRR (train) MRR (test) Train time Settings
CLiMF 0.0758 0.3975 1.323s/i ter num_factors=10; num_iter=10; learning_rate=0.0001; lmda=0.001