Adding topical tags to Livebooks?

[RichMorin]

Several thousand Livebooks are now archived on GitHub and indexed on Notesclub. So, finding particular kinds of Livebooks is already challenging (and can be expected to get worse).

In order to assist in filtering and searching, it would be useful to have a standardized way to add topical tags to Livebooks (akin to the ones used on ElixirForum). If this is already in existence, please give me a link to the relevant URL(s). If not, let's consider what syntax (etc) would be most appropriate.

On a related note, given that Livebooks can be written in any (human) language, it would be useful to have a way to select for Livebooks in particular languages. That said, I have no idea how this might be done...

-r

[jonatanklosko]

From the perspective of Livebook user, adding tags may not have much value, because notebooks are stored in individual files anywhere in the file system, rather than in a database. And if that's the case, then people are unlikely to actually add any tags even if we have UI for that. They would rather put notebooks under distinct directories.

There is certainly a number of ways for a service like Notesclub to automatically determine tags or useful metadata. One idea would be to analyze dependencies in the setup cell and allow filtering based on that, this way people can easily filter out all :nx notebooks, or :explorer notebooks. The language could be detected using a machine learning model. Similarly notebooks could be tagged, perhaps by using zero-shot classification into a number of selected categories (which doesn't sound to crazy with Bumblebee at hand :)).

[RichMorin]

I like the idea of analyzing dependencies in the setup cell (and perhaps elsewhere in the Livebook). I get the impression that Notesclub is already doing something of this sort. The zero-shot classification notion is also intriguing; I hope someone (above my pay grade :-) gives it a try.

In the meanwhile, how about defining and promoting a simple syntax for adding tags and/or categories to Livebooks? This would provide a known way to look for them and could also reduce the false positives that an ML-based approach might generate. Here is a (naive) proposal:

livemd_cats = [:introduction, :tutorial]
livemd_tags = ["machine learning", :ML]

-r

[jonatanklosko]

As said, I don't think tags are particularly useful within Livebook, and so I don't think we should have anything specific to tags, especially custom syntax :) If we ever introduce a Front Matter, we could revisit that, but that's not in plans.