US Patent 11068663 Session embeddings for summarizing activity

The disclosed embodiments provide a system for processing data. During operation, the system obtains a first sentence representing a first sequence of actions between a user and a set of jobs. Next, the system applies a language model to token embeddings of a first set of tokens in the first sentence and position embeddings of token positions in the first sentence to produce a first set of output embeddings. The system then combines the first set of output embeddings into a first session embedding that encodes the first sequence of actions. Finally, the system outputs the first session embedding for use in characterizing job-seeking activity of the user.