Auto Added by WPeMatico
This is a high-level, introductory article about Large Language Models (LLMs), the core technology that enables the much-en-vogue chatbots as well as other Natural Language Processing (NLP) applications. It is directed at a general audience, possibly with some technical and/or scientific background, but no knowledge is assumed of either deep learning or NLP. Having looked […]
What are Large Language Models? What are they not? Read More »
Implementing a language model from scratch is, arguably, the best way to develop an accurate idea of how its engine works. Here, we use torch to code GPT-2, the immediate successor to the original GPT. In the end, you’ll dispose of an R-native model that can make direct use of Hugging Face’s pre-trained GPT-2 model
GPT-2 from scratch with torch Read More »
We are proud to introduce the {mall} package. With {mall}, you can use a local LLM to run NLP operations across a data frame. (sentiment, summarization, translation, etc). {mall} has been simultaneously released to CRAN and PyPi (as an extension to Polars).
Introducing mall for R…and Python Read More »
The text package attempts to provide user-friendly access and pipelines to HuggingFace’s transformer language models in R.
Introducing the text package Read More »
Nowadays, Microsoft, Google, Facebook, and OpenAI are sharing lots of state-of-the-art models in the field of Natural Language Processing. However, fewer materials exist how to use these models from R. In this post, we will show how R users can access and benefit from these models as well.
State-of-the-art NLP models from R Read More »
A deep learning model – BERT from Google AI Research – has yielded state-of-the-art results in a wide variety of Natural Language Processing (NLP) tasks. In this tutorial, we will show how to load and train the BERT model from R, using Keras.
Is society ready to deal with challenges brought about by artificially-generated information – fake images, fake videos, fake text? While this post won’t answer that question, it should help form an opinion on the threat exerted by fake text as of this writing, autumn 2019. We introduce gpt2, an R package that wraps OpenAI’s public
Innocent unicorns considered harmful? How to experiment with GPT-2 from R Read More »
As sequence to sequence prediction tasks get more involved, attention mechanisms have proven helpful. A prominent example is neural machine translation. Following a recent Google Colaboratory notebook, we show how to implement attention in R.
Attention-based Neural Machine Translation with Keras Read More »
Image captioning is a challenging task at intersection of vision and language. Here, we demonstrate using Keras and eager execution to incorporate an attention mechanism that allows the network to concentrate on image features relevant to the current state of text generation.
Attention-based Image Captioning with Keras Read More »
Two-class classification, or binary classification, may be the most widely applied kind of machine-learning problem. In this excerpt from the book Deep Learning with R, you’ll learn to classify movie reviews as positive or negative, based on the text content of the reviews.
Deep Learning for Text Classification with Keras Read More »
