Seminars

Magnet seminars are usually held in room B21 on Thursdays, 11am. Check below for upcoming seminars and potential changes of schedule/location. You may also import the Magnet seminars public feed into your favorite calendar app. For further information, contact Aurélien.

Upcoming seminars

Seminar calendar Add to google calendar
WhenWhat
Thu, November 14, 2019
11:00 am
12:00 pm

Where? Inria B21
Add event to google
Institutional tag: 

Inria MAGNET

Thematic tag(s): 

Machine learning




To facilitate training with gradients, supervised learning methods often
transform selecting a single element within a set of outputs to predicting a
probability distribution over this set (using e.g. the softmax operator). In
this talk, we will understand this transformation as a functional smoothing of
the output selection mechanism. Engineering this Nesterov smoothing yields new modelling perspective. First, we will observe that
selecting an output within a combinatorial set (e.g. a sequence of tags) is
often solved using dynamic programming algorithms. Smoothing turn DP algorithms
into differentiable operators, that may predict potentially sparse
probabilities over the output set. Secondly, we will design a smoothing that
takes into account a cost function defined on the output set. This approach
transforms the softmax operator into a cost-informed geometric softmax, that
has the further capabilities of predicting distributions over a continuous set.


Dates: 

Thursday, November 14, 2019 - 11:00 to 12:00

Location: 

Inria B21

Speaker(s): 

Arthur Mensch

Previous seminars (over the past year)