Support Keyword Extration

[danielboros1990]

Hi guys, thank you for the awesome work.

Do you plan to add Keyword extraction module in the future, like in the rust-bert crate with support of XLM-Roberta models?

[sonam-pankaj95]

Hey @danielboros1990 , Thank you for your query. Currently, there is no plan for extraction on the roadmap, possibly because we are unsure of the applications it could be helpful for. Please let us know how you plan to use it.

We would be glad to hear back from you.

Thank You

[dancixx]

@sonam-pankaj95 If you want to embed text in a different way, like using keywords for sparse embedding, it would be very cool if this project would support Bert-based keyword extraction like KeyBERT: https://github.com/MaartenGr/keyBERT

[sonam-pankaj95]

Thank you, @dancixx, for explaining this. However, we already support Sparse BERT, which generates embeddings for keywords.

Let me know if there is a difference. Looking forward to hearing from you.

Check out this: https://github.com/StarlightSearch/EmbedAnything/blob/main/examples/hybridsearch.py