Coleman Hindes·Jul 14, 2021Beyond Few-Shot Learning: Fine-tuning with GPT-3For this article I’m going to assume you have some background knowledge on GPT-3, a large text generation and classification model created by OpenAI. If not, please check out these articles https://www.technologyreview.com/2020/07/20/1005454/openai-machine-learning-language-generator-gpt-3-nlp/ https://medium.com/@colemanhindes/how-to-finesse-openais-gpt-3-api-a-tutorial-c43dc4f59c7c Much of the hype around GPT-3 comes from its ability to generalize from limited input https://arxiv.org/abs/2005.14165. After…Artificial Intelligence3 min readArtificial Intelligence3 min read
Josue NascimentoinIA em Saúde: NeuralMed·Jul 17, 2021Distillation Bert model with Hugging Face.BERT is a bidirectional transformer model, pre-training with a lot of unlabeled textual data to learn language representations that can be used to fine-tune specific machine learning tasks. The Bert base language is trained with BooksCorpus that have 800M of words and Wikipedia with 2500M of words, which results in…Bert2 min readBert2 min read
Javier IdeamiinTowards Data Science·Mar 17, 2021Member-onlyTowards the end of deep learning and the beginning of AGIHow recent neuroscience research points the way towards defeating adversarial examples and achieving a more resilient, consistent and flexible form of artificial intelligence — Deep Learning14 min readDeep Learning14 min read
Alan DaviesinTowards Data Science·Jul 22, 2021A Natural Language Processing (NLP) PrimerOverview of common NLP tasks using Python — Natural Language Processing NLP is used to analyse textual data. This could be data from web sites, scanned documents, books, journals, Tweets, YouTube comments to name but a few sources. This primer introduces some of the common NLP tasks that can be carried out using Python. Examples mostly use the…NLP22 min readNLP22 min read
Chris LemkeinTowards Data Science·Jul 24, 2021Data preprocessing in NLPData cleaning and data augmentation (not only) for text simplification — Introduction This is the second article about my project of text simplification using transformers. If you have not read the first one, feel free to do so, but it is not mandatory to understand this article. Feel free to check out the GitHub repo for this project. Data preprocessing is not…NLP10 min readNLP10 min read
