US Patent 11874879 Deep multi-modal pairwise ranking model for crowdsourced food data

A method and system for providing more relevant search results and recommendation from a food database is disclosed. The method includes receiving a query, a first candidate food, and a second candidate food. The method includes generating vectors based on the query and food names of the first and second candidate foods using at least one embedding function of a machine learning model. The method includes determining nutrition content vectors from the nutritional data of the first and second candidate foods. The method includes generating a nutrition content vector based on the query using another embedding function of the machine learning model. The method includes determining which of the first and second candidate food is more relevant to the query based at least in part on the nutrition content vectors. The method includes providing search results or recommendation based on the determined relevance.