Neural Collaborative Filtering
Neural Collaborative Filtering (NCF)
PMF's dot product is a linear operation. If the true user-item interaction pattern is non-linear (e.g., "I like films that combine sci-fi AND comedy, but not sci-fi OR comedy independently"), matrix factorization cannot capture it.
Neural Collaborative Filtering (NCF) replaces or augments the dot product with a neural network, enabling the model to learn arbitrarily complex interaction patterns.
NCF consists of three components:
- Generalized Matrix Factorization (GMF): Applies an element-wise product of user and item embeddings, similar to MF but learned with a neural network weight. This captures linear interactions.
- Multi-Layer Perceptron (MLP): Concatenates user and item embeddings and passes them through several fully connected layers with non-linear activations (e.g., ReLU). This learns non-linear user-item interaction patterns.
- NeuMF Layer: The final output layer combines the GMF and MLP outputs, effectively ensembling linear and non-linear interaction signals into a unified prediction. A sigmoid activation produces an interaction probability.
Click any node
Select a component in the diagram to see a detailed explanation of its role in NCF.
Interactive NCF architecture. Hover over each layer to see its role. Toggle GMF-only, MLP-only, and full NeuMF to compare model expressiveness on a toy dataset.
NCF introduces non-linearity to model user-item interactions. Describe a concrete recommendation scenario where you believe the interaction between a user preference and an item attribute is genuinely non-linear. Why would a linear model fail there?