{"id":2721,"date":"2017-06-15T17:02:59","date_gmt":"2017-06-16T00:02:59","guid":{"rendered":"https:\/\/www.springboard.com\/?p=2721"},"modified":"2023-07-07T02:40:48","modified_gmt":"2023-07-07T09:40:48","slug":"machine-learning-with-r","status":"publish","type":"post","link":"https:\/\/www.springboard.com\/blog\/data-science\/machine-learning-with-r\/","title":{"rendered":"Machine Learning With R: Building Text Classifiers"},"content":{"rendered":"\n

In this tutorial, we will be using a host of R packages in order to run a quick classifier algorithm on some Amazon reviews. This classifier should be able to predict whether a review is positive or negative with a fairly high degree of accuracy. In an effort to provide a clear working example of what classification can be used for, this data, retrieved from the Stanford Network Analysis Project, has been parsed into small text chunks and labelled appropriately. You can retrieve these files from the Github repo linked <\/span>here<\/a><\/strong>.<\/span><\/p>\n\n\n\n

Related<\/strong>: Text Mining in R: A Tutorial<\/a><\/em><\/p>\n\n\n\n

Before we begin, it is important to mention that data curation — making sure that your information is properly categorized and labelled — is one of the most important parts of the whole process! In machine learning, the labelling and classification of your data will often dictate the accuracy of your model. That being said, it is worth going over how these files have been organized and labelled: the \u201cTrain\u201d directory contains 400 1-star book reviews labeled \u201cNeg\u201d (for negative) and 400 5-star book reviews labelled \u201cPos\u201d (for positive). This is our \u201cgold standard\u201d: we know these reviews are positive or negative based on the stars that the user assigned to them when they wrote the review. We will use the files in the \u201cTrain\u201d directory in order to train our classifier, which will then use what it learned about our training directory in order to predict whether or not the reviews in our \u201cTest\u201d directory are negative or positive. In this way, we will develop a machine learned classifier that can accurately predict whether an Amazon book review — or any short text — reflects a positive or a negative customer experience with a given product. Thinking more broadly, this process reflects a bare-bones entry-level attempt at using R to learn and makepredictions about human writing. This is a very effective use case of machine learning with R. <\/span><\/p>\n\n\n\n

Want more data?\u00a0 Check out our list of free public datasets<\/a>.<\/em><\/p>\n\n\n\n

A Look at Machine Learning in R<\/h2>\n\n\n\n

This tutorial is run with Jupyter Notebook in R.<\/a><\/p>\n\n\n\n

You can run it in anything that complies and executes R scripts.<\/p>\n\n\n\n

We will be using the R \u201ccaret,\u201d \u201ctm,\u201c and \u201ckernlab\u201d packages to parse and machine-read the data and then subsequently train the model. If you don’t have those packages, use the following command to get them installed. For more instructions on how to install R packages, click here<\/a>.<\/span><\/p>\n\n\n\n

install.packages(\"kernlab\")\ninstall.packages(\"caret\")\ninstall.packages(\"tm\")\ninstall.packages(\"dplyr\")\ninstall.packages(\"splitstackshape\")\ninstall.packages(\"e1071\")<\/pre>\n\n\n\n
The \u201cdplyr\u201d and \u201csplitstackshape\u201d packages will help us manipulate the data and organize it in such a way that the model can make use of the data. Now, we can activate the installed libraries and start doing machine learning with R. <\/span><\/p>\n\n\n\n
library(\"kernlab\") \nlibrary(\"caret\") \nlibrary(\"tm\") \nlibrary(\"dplyr\") \nlibrary(\"splitstackshape\")\nlibrary(\"e1071\")<\/pre>\n\n\n\n
Our first step is ingesting and cleaning all of the data. For that you will need the \u201ctm” package, which uses the \u201cVCorpus\u201d functions and \u201ctm_map\u201d functions to make our data usable to the classifier. Below is a fairly large chunk of code, but hopefully the annotation makes it fairly straightforward with what is happening in R:<\/span><\/p>\n\n\n
Get To Know Other\tData Science Students<\/h4>
\"Samuel<\/a>
Samuel Okoye<\/p>
IT Consultant at Kforce<\/p><\/div>
<\/div>
Read Story<\/a><\/p><\/div><\/div>
\"Peter<\/a>
Peter Liu<\/p>
Business Intelligence Analyst at Indeed<\/p><\/div>
Read Story<\/a><\/p><\/div><\/div>
\"Diana<\/a>
Diana Xie<\/p>
Machine Learning Engineer at IQVIA<\/p><\/div>
Read Story<\/a><\/p><\/div><\/div><\/div><\/div>\n\n\n\n
# Step 1. Ingest your training data and clean it.<\/strong><\/p>\n\n\n\n
train <- VCorpus(DirSource(\"Training\", encoding = \"UTF-8\"), readerControl=list(language=\"English\"))<\/span>\ntrain <- tm_map(train, content_transformer(stripWhitespace))<\/span>\ntrain <- tm_map(train, content_transformer(tolower))<\/span>\ntrain <- tm_map(train, content_transformer(removeNumbers))<\/span>\ntrain <- tm_map(train, content_transformer(removePunctuation))<\/span><\/pre>\n\n\n\n
# Step 2. Create your document term matrices for the training data.<\/strong><\/p>\n\n\n\n
train.dtm <- as.matrix(DocumentTermMatrix(train, control=list(wordLengths=c(1,Inf))))<\/span><\/pre>\n\n\n\n
# Step 3. Repeat steps 1 & 2 above for the Test set.<\/strong><\/p>\n\n\n\n
test <- VCorpus(DirSource(\"Test\", encoding = \"UTF-8\"), readerControl=list(language=\"English\"))<\/span>\ntest <- tm_map(test, content_transformer(stripWhitespace))<\/span>\ntest <- tm_map(test, content_transformer(tolower))<\/span>\ntest <- tm_map(test, content_transformer(removeNumbers))<\/span>\ntest <- tm_map(test, content_transformer(removePunctuation))<\/span>\ntest.dtm <- as.matrix(DocumentTermMatrix(test, control=list(wordLengths=c(1,Inf))))<\/span><\/pre>\n\n\n\n
The code above should net you two data new data matrices: one \u201ctrain.dtm,\u201d containing all of the words from the \u201cTraining\u201d folder, and a \u201ctest.dtm\u201d matrix, containing all of the words from the \u201cTest\u201d folder. For the vast majority of the tutorial, we will be working with the \u201ctrain.dtm\u201d in order to create, train, and validate our results. Iterating with your training data and then working with your test data is an essential part of doing machine learning with R. <\/span><\/p>\n\n\n\n
Our next two steps involve two important aspects of the data manipulation process that we will need in order to make sure that the classifier function works: 1) the first step involves making sure that our data sets have the same amount of columns, meaning that we only take overlapping words from both matrices, and 2) making sure that our data has a column that dictates whether the files are \u201cNeg\u201d (negative) or \u201cPos\u201d (positive). Since we know these values for the training data, we have to separate out the labels from the original files and append them to the \u201ccorpus\u201d column in the data. For our testing data, we do not have these labels, so we put dummy values instead (that will then be filled later). <\/span><\/p>\n\n\n\n
# Step 4. Make test and train matrices of identical length (find intersection)<\/strong><\/p>\n\n\n\n
train.df <- data.frame(train.dtm[,intersect(colnames(train.dtm), colnames(test.dtm))])<\/span>\ntest.df <- data.frame(test.dtm[,intersect(colnames(test.dtm), colnames(train.dtm))])<\/span><\/pre>\n\n\n\n
# Step 5. Retrieve the correct labels for training data and put dummy values for testing data<\/strong><\/p>\n\n\n\n
label.df <- data.frame(row.names(train.df))<\/span>\ncolnames(label.df) <- c(\"filenames\")<\/span>\nlabel.df<- cSplit(label.df, 'filenames', sep=\"_\", type.convert=FALSE)<\/span>\ntrain.df$corpus<- label.df$filenames_1<\/span>\ntest.df$corpus <- c(\"Neg\")<\/span><\/pre>\n\n\n\n
If all of these steps run successfully, you are ready to start running your classifier! It is important that we will not be running cross-validation of the model in this tutorial, although more advanced users and researchers should look into creating folds within the data and cross-validating your model across multiple cuts of the data in order to be sure that the results that you are getting are accurate. <\/span><\/p>\n\n\n\n
In any case, this model will only run one validation using the confusion matrix, below, which will spit out metrics for us to measure the accuracy of the predictive machine learning model we just built:<\/span><\/p>\n\n\n\n
# Step 6. Create folds of your data, then run the training once to inspect results<\/strong><\/p>\n\n\n\n
df.train <- train.df<\/span>\ndf.test <- train.df<\/span>\ndf.model<-ksvm(corpus~., data= df.train, kernel=\"rbfdot\")<\/span>\ndf.pred<-predict(df.model, df.test)<\/span>\ncon.matrix<-confusionMatrix(df.pred, df.test$corpus)<\/span>\nprint(con.matrix)<\/span><\/pre>\n\n\n\n
As you can see above, we are using the training dataframes for both training and testing our model. If the process runs successfully, you should see this output:<\/span><\/p>\n\n\n\n
       Reference<\/span>\n\nPrediction Neg Pos<\/span>\n\n       Neg 343   0<\/span>\n\n       Pos  57 400<\/span>                               <\/span>\n\n               Accuracy : 0.9288          <\/span>\n\n                 95% CI : (0.9087, 0.9456)<\/span>\n\n    No Information Rate : 0.5             <\/span>\n\n    P-Value [Acc > NIR] : < 2.2e-16       <\/span>                                  <\/span>\n\n                  Kappa : 0.8575          <\/span>\n\n Mcnemar's Test P-Value : 1.195e-13       <\/span>\n\n                                        <\/span>\n            Sensitivity : 0.8575          <\/span>\n\n            Specificity : 1.0000          <\/span>\n\n         Pos Pred Value : 1.0000          <\/span>\n\n         Neg Pred Value : 0.8753          <\/span>\n\n             Prevalence : 0.5000          <\/span>\n\n         Detection Rate : 0.4288          <\/span>\n\n   Detection Prevalence : 0.4288          <\/span>\n\n      Balanced Accuracy : 0.9287          <\/span>\n                                   <\/span>\n       'Positive' Class : Neg         <\/span><\/pre>\n\n\n\n
In the simplest terms possible, the confusion matrix provides you with the back-end output and analysis of the model\u2019s performance in predicting the same files that it was trained on. The \u201cAccuracy\u201d field, for instance, gives us a quick estimate of what percent of the files the classifier predicted correctly: in our case, it was at a very high 92.8%! That means that roughly 93 percent of the time the classifier was successful in determining whether or not a file was positive or negative just based on its content.<\/span><\/p>\n\n\n\n
\"machine<\/figure>\n\n\n\n
In a more advanced scenario, you would need to cross-validate your data by running the same process on several more \u201cfolds,\u201d which are basically random subsets of your training data. For the example used above, it is clear that our classifier is pretty good at determining whether an Amazon Book Review is negative or positive, so we can move on to our testing. We’ve built something useful with our new knowledge of machine learning with R — not it’s time to put it to use! Luckily, to run the model on your testing data and to validate our knowledge of machine learning with R requires only one small change — the variable of your \u201cdf.test\u201d:<\/span><\/p>\n\n\n\n
# Step 7. Run the final prediction on the test data and re-attach file names. <\/strong><\/p>\n\n\n\n
df.test <- test.df<\/span>\ndf.pred <- predict(df.model, df.test)<\/span>\nresults <- as.data.frame(df.pred)<\/span>\nrownames(results) <- rownames(test.df)<\/span>\nprint(results)<\/span><\/pre>\n\n\n\n
The code above runs the predict() model on the test data, and plops the results in the \u201cresults\u201d data frame. We can then reattach the original filenames to the rownames of the new results vector, and produce the machine learning predictions of your test directory.<\/span><\/p>\n\n\n\n
In conclusion, the process of building something with machine learning with R, enumerated above, helps you build a quick-start classifier that can categorize the sentiment of online book reviews with a fairly high degree of accuracy. Such a classifier is useful when you have a large quantity of user-submitted text that needs to be analyzed for sentiments around a product or a service, and can more generally help a researcher build an algorithm that can weed out bad or good reviews automatically for either research or moderation purposes. R is an extremely important language in data science<\/a>. Every aspiring data scientist<\/a> should have a sound knowledge of R.<\/span> We hope this tutorial has given you a sense of the power of machine learning with R!<\/span><\/p>\n\n\n\n
Since you\u2019re here\u2026
<\/strong>Curious about a career in data science? Experiment with our free data science learning path<\/a>, or join our Data Science Bootcamp<\/a>, where you\u2019ll get your tuition back if you don’t land a job after graduating. We\u2019re confident because our courses work \u2013 check out our student success stories<\/a> to get inspired.<\/p>\n","protected":false},"excerpt":{"rendered":"
In this tutorial, we will be using a host of R packages in order to run a quick classifier algorithm on some Amazon reviews. This classifier should be able to predict whether a review is positive or negative with a fairly high degree of accuracy. In an effort to provide a clear working example of […]<\/p>\n","protected":false},"author":23,"featured_media":19144,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_acf_changed":false,"_eb_attr":"","_eb_data_table":"","footnotes":""},"categories":[67],"tags":[],"marketing_tags":[],"class_list":{"0":"post-2721","1":"post","2":"type-post","3":"status-publish","4":"format-standard","5":"has-post-thumbnail","7":"category-data-science"},"acf":[],"_links":{"self":[{"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/posts\/2721"}],"collection":[{"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/users\/23"}],"replies":[{"embeddable":true,"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/comments?post=2721"}],"version-history":[{"count":3,"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/posts\/2721\/revisions"}],"predecessor-version":[{"id":47506,"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/posts\/2721\/revisions\/47506"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/media\/19144"}],"wp:attachment":[{"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/media?parent=2721"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/categories?post=2721"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/tags?post=2721"},{"taxonomy":"marketing_tags","embeddable":true,"href":"https:\/\/www.springboard.com\/blog\/wp-json\/wp\/v2\/marketing_tags?post=2721"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}