#خبر
در حال حاضر BERT از فارسی پشتیبانی میکند.
Persian (Farsi)
https://github.com/google-research/bert/blob/master/multilingual.md#list-of-languages

پست مدیوم مرتبط در مورد چند زبانگی bert
Hallo multilingual BERT, cómo funcionas?
https://medium.com/omnius/hallo-multilingual-bert-c%C3%B3mo-funcionas-2b3406cc4dc2

پست فارسی از آقای خوشمهر در مورد BERT و کاربردهایش:
معرفی BERT، تحولی در NLP
http://blog.class.vision/1397/09/bert-in-nlp/

#bert #nlp

Better Language Models and Their Implications

یک مدل زیانی جدید با قدرت خیلی زیاد که از ترس سوء استفاده نسخه کامل منتشر نشده!

#gpt2

OpenAI has a new language model, so powerful they aren't releasing the full version! I know, it sounds like some bad sci fi.

The results are absolutely stunning. Prepare to be flooded in a year or so with high-quality text hallucinated by neural nets.

It's another transformer-based model, yet again cementing the dominance of transformer architectures in NLP. It has 1.5 billion parameters.

Paper: https://d4mucfpksywv.cloudfront.net/better-language-models/language-models.pdf
Code: https://github.com/openai/gpt-2
Blog: https://blog.openai.com/better-language-models/


—————————————-
اخبار و توئیت های مرتبط:
🖊توئیت Andrej Karpathy - خطر نوشتن بیشتر در فاضای مجازی ...
🖊تولید شعر با مدل GPT2
🖊هوش مصنوعی openAI میتواند اخبار جعلی بنویسد
🙏Thanks to: @vahidreza01
#deeplearning #artificialintelligence #machinelearning #nlp

Language, trees, and geometry in neural networks

A visualization technique to understand BERT.
https://twitter.com/burkov/status/1139391818443808769

#bert #NLP

An overview of old and new nlp pretrained models use-cases (Excluding XLNet):
https://www.youtube.com/watch?v=0EtD5ybnh_s
#NLP

Empirically, XLNet outperforms BERT on 20 tasks, often by a large margin, and achieves state-of-the-art results on 18 tasks including question answering, natural language inference, sentiment analysis, and document ranking.

https://arxiv.org/abs/1906.08237#
#NLP

طبقه بندی متن با استفاده از Flair

Flair delivers state-of-the-art performance in solving NLP problems such as named entity recognition (NER), part-of-speech tagging (PoS), sense disambiguation and text classification. It’s an NLP framework built on top of PyTorch.

لینک پست: https://towardsdatascience.com/text-classification-with-state-of-the-art-nlp-library-flair-b541d7add21f
کد: https://github.com/zalandoresearch/flair

#text_classification #nlp #flair

A curated list of resources dedicated to Natural Language Processing (NLP)
https://github.com/keon/awesome-nlp
#nlp #deep_learning

A cool 3D representation of the structure of BERT language model

Blogpost: https://peltarion.com/knowledge-center/documentation/modeling-view/build-an-ai-model/blocks/bert-encoder
#NLP #deep_learning

The Cost of Training NLP Models: A Concise Overview

Abstract: We review the cost of training large-scale language models, and the drivers of these costs. The intended audience includes engineers and scientists budgeting their model-training experiments, as well as non-practitioners trying to make sense of the economics of modern-day Natural Language Processing (NLP).

https://arxiv.org/abs/2004.08900
#nlp #deep_learning

Grounding Language in Play: A scalable approach for controlling robots with natural language

https://language-play.github.io/
#nlp #reinforcement_learning #deep_learning