Recommendation systems · End-to-end case study

PickMyMovie

An explainable hybrid recommender that turns a few liked films into a diverse shortlist, backed by a reproducible temporal evaluation rather than an untested similarity demo.

62,423movies in the catalog
25,000,095historical ratings processed
1,000held-out users in the reported evaluation
4ranking strategies compared

The problem

Recommendation demos often produce plausible-looking results without showing whether the model retrieves what users actually choose next. PickMyMovie needed to work as a useful product and withstand technical scrutiny.

The constraints were deliberate: no account system, no required third-party API, a serverless-friendly artifact, understandable explanations, and honest handling of cold-start and popularity bias.

System design

1. StreamRead ratings in bounded memory.
2. BuildCreate rating summaries and support-shrunk item neighbors.
3. RankBlend content, collaborative, and confidence signals.
4. ExplainDiversify the shortlist and expose a reason for each result.

Method

  • Content signal: cosine similarity over inverse-frequency weighted genre vectors.
  • Collaborative signal: item-to-item cosine over positive ratings, with minimum support and shrinkage to reduce unreliable small-sample similarities.
  • Quality signal: a small confidence-weighted rating term that cannot dominate personalization.
  • Diversity layer: a genre-overlap penalty prevents near-identical cards from filling the visible shortlist.

The blend was selected on validation users. The held-out test set was used once for the comparison below.

Evaluation

For each eligible user, the latest positive rating became the test target, the second latest became validation, and earlier ratings formed training history. The recorded run scanned 10,000 users, evaluated a deterministic sample of 1,000, and ranked within the 5,000 most-observed candidate movies.

StrategyRecall@10NDCG@10MRR@10Coverage@10
Popularity baseline5.0%0.02300.01490.28%
Genre content1.2%0.00600.004234.14%
Collaborative9.3%0.04310.028418.70%
Selected hybrid8.9%0.04140.027220.18%

The collaborative model achieved the strongest held-out relevance in this run. The validation-selected hybrid traded 0.4 percentage point of Recall@10 for broader catalog coverage and averaged 37.9 ms per offline ranking. With one held-out target per user, Recall@10 is equivalent to hit rate. These results apply only to the documented sample and candidate universe.

Engineering decisions

  • Two streaming passes avoid loading the 678 MB ratings file into memory.
  • A compact JSON artifact keeps inference dependency-free and suitable for a Python serverless function.
  • The browser stores picks locally; the server receives movie IDs but stores no visitor profile.
  • API contract tests, model tests, syntax checks, Docker support, and CI cover the deployable path.
  • The portfolio uses a same-domain rewrite while the recommender remains independently deployable.

Limitations

The snapshot ends in 2019, so this is not a current-release catalog. Sparse and new titles receive weaker collaborative evidence. Genre metadata cannot capture tone, cast, plot, or context, and offline implicit-feedback metrics do not prove user satisfaction.

Those limitations are kept visible instead of being hidden behind an unsupported performance claim. The next rigorous experiment would repeat the protocol across multiple user samples and confidence intervals before making a broader claim.