{"id":10285,"date":"2021-01-24T08:24:40","date_gmt":"2021-01-24T16:24:40","guid":{"rendered":"https:\/\/www.springboard.com\/?p=10285"},"modified":"2022-08-22T04:15:36","modified_gmt":"2022-08-22T11:15:36","slug":"springboard-tutorial-top-machine-learning-frameworks","status":"publish","type":"post","link":"https:\/\/www.springboard.com\/blog\/data-science\/springboard-tutorial-top-machine-learning-frameworks\/","title":{"rendered":"Springboard Tutorial: An Overview of Top Machine Learning Frameworks"},"content":{"rendered":"\n

According to Gartner, 85 percent of machine learning projects fail, leaving most organizations without a positive ROI.<\/span><\/p>\n\n\n\n

To avoid spending unnecessary time, money, and energy reinventing the wheel, many organizations have started employing machine learning frameworks. These frameworks simplify the process of algorithm development for engineers, making ML easier, more scalable, and more accessible. <\/span><\/p>\n\n\n\n

Machine learning frameworks support basic tensor operations (math behind algorithms), automatic differentiation (to prevent calculation errors through backpropagation, a method of doing forward and then backward passes to compute the gradient), and systems techniques, like minibatching and Adam optimization. <\/span><\/p>\n\n\n\n

The most popular machine learning frameworks have strong community support, usually with major company backing. Which framework you choose, depends on your goals: what problem you\u2019re looking to solve, how much experience you have, and how quickly you need results.<\/span><\/p>\n\n\n\n

Want to learn more about becoming a machine learning engineer? Check out Springboard’s comprehensive career guide here.<\/em><\/p>\n\n\n\n

Four key machine learning frameworks<\/h3>\n\n\n\n

Here\u2019s an overview of four key frameworks:<\/span><\/p>\n\n\n\n

\"mle<\/figure>\n\n\n\n

SciKit-Learn<\/b><\/h3>\n\n\n\n

SciKit<\/span><\/a> is a popular free machine learning library in Python that is built on NumPy, (an extremely important library for data scientists<\/a> and machine learning enthusiasts)<\/span> SciPy, and matplotlib. You can use it for classification, regression, clustering, dimensionality reduction, model selection, K-nearest neighbor, support-vector machines (SVMs), stochastic gradient descent models, and preprocessing (feature extraction and normalization). <\/span><\/p>\n\n\n\n

More reading: How a Machine Learning Algorithm Helped Make Hurricane Damage Assessments Safer, Cheaper, and More Effective<\/a><\/em><\/p>\n\n\n\n

This <\/span>tutorial<\/span><\/a> walks you through the process of importing the <\/span>Sales_Win_Loss data set<\/span><\/a> from IBM\u2019s Watson repository with the pandas module and using Scikit-learn to create a model to predict the effectiveness of various sales campaigns. <\/span><\/p>\n\n\n\n

This is an example of displaying data with the head() method. The tail() method is similar, but it returns the last few records instead. <\/span><\/p>\n\n\n\n

\"scikit<\/figure>\n\n\n\n

To investigate the different data types, use the dtypes() method.<\/span><\/p>\n\n\n\n

\"scikit<\/figure>\n\n\n\n

After you explore the data, you can then set up data visualization in libraries like Seaborn. <\/span><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Scikit is accessible and easy to learn for beginners, but not necessarily as well-suited for deep learning as some of the other frameworks.<\/span><\/p>\n\n\n\n

Looking for more information on SciKit-Learn? Check out our complete guide to SciKit-Learn with a logistic regression example<\/a>.<\/em><\/p>\n\n\n

Get To Know Other\tData Science Students<\/h4>
\"Mengqin<\/a>

Mengqin (Cassie) Gong<\/p>

Data Scientist at Whatsapp<\/p><\/div>

<\/div>

Read Story<\/a><\/p><\/div><\/div>

\"George<\/a>

George Mendoza<\/p>

Lead Solutions Manager at Hypergiant<\/p><\/div>

Read Story<\/a><\/p><\/div><\/div>

\"Diana<\/a>

Diana Xie<\/p>

Machine Learning Engineer at IQVIA<\/p><\/div>

Read Story<\/a><\/p><\/div><\/div><\/div><\/div>\n\n\n\n

TensorFlow<\/b><\/h3>\n\n\n\n

Designed by Google, TensorFlow is an open-source library for numerical computation and machine learning, which can work with CPU and GPU. It allows you to handle regression, classification, and neural network problems.<\/span><\/p>\n\n\n\n

Neural networks follow a typical <\/span>structure<\/span><\/a>.<\/span><\/p>\n\n\n\n

You can build neural network models using the Keras programming interface. Easy to use with a simple API, Keras allows you to classify images and text. It can also scale to solve more complex problems, with the ability to adapt to multiple programming languages (Python, Javascript, C++, Java, Go). <\/span><\/p>\n\n\n\n

This <\/span>example<\/span><\/a> analyzes sentiment from a dataset of 40,000 Tweets. After processing and vectorizing the Tweets, the first step involves subclassing the tf.keras. Model class, defining layers in the __init__() method, and creating a forward pass method using the call method.<\/span><\/p>\n\n\n\n

With input or output tensors, you can also create functional or sequential mod<\/span>el APIs.<\/span><\/p>\n\n\n\n

\"tensorflow<\/figure>\n\n\n\n

Here is a basic snippet of TensorFlow machine learning code and a <\/span>walkthrough<\/span><\/a> of how to build a simple model from scratch:<\/span><\/p>\n\n\n\n

import<\/span><\/i> tensorflow <\/span><\/i>as<\/span><\/i> tf<\/span><\/i><\/p>\n\n\n\n

mnist <\/span><\/i>=<\/span><\/i> tf<\/span><\/i>.<\/span><\/i>keras<\/span><\/i>.<\/span><\/i>datasets<\/span><\/i>.<\/span><\/i>mnist<\/span><\/i><\/p>\n\n\n\n

(<\/span><\/i>x_train<\/span><\/i>,<\/span><\/i> y_train<\/span><\/i>),(<\/span><\/i>x_test<\/span><\/i>,<\/span><\/i> y_test<\/span><\/i>)<\/span><\/i> =<\/span><\/i> mnist<\/span><\/i>.<\/span><\/i>load_data<\/span><\/i>()<\/span><\/i><\/p>\n\n\n\n

x_train<\/span><\/i>,<\/span><\/i> x_test <\/span><\/i>=<\/span><\/i> x_train <\/span><\/i>\/<\/span><\/i> 255.0<\/span><\/i>,<\/span><\/i> x_test <\/span><\/i>\/<\/span><\/i> 255.0<\/span><\/i><\/p>\n\n\n\n

model <\/span><\/i>=<\/span><\/i> tf<\/span><\/i>.<\/span><\/i>keras<\/span><\/i>.<\/span><\/i>models<\/span><\/i>.<\/span><\/i>Sequential<\/span><\/i>([<\/span><\/i><\/p>\n\n\n\n

tf<\/span><\/i>.<\/span><\/i>keras<\/span><\/i>.<\/span><\/i>layers<\/span><\/i>.<\/span><\/i>Flatten<\/span><\/i>(<\/span><\/i>input_shape<\/span><\/i>=(<\/span><\/i>28<\/span><\/i>,<\/span><\/i> 28<\/span><\/i>)),<\/span><\/i><\/p>\n\n\n\n

tf<\/span><\/i>.<\/span><\/i>keras<\/span><\/i>.<\/span><\/i>layers<\/span><\/i>.<\/span><\/i>Dense<\/span><\/i>(<\/span><\/i>128<\/span><\/i>,<\/span><\/i> activation<\/span><\/i>=<\/span><\/i>‘relu’<\/span><\/i>),<\/span><\/i><\/p>\n\n\n\n

tf<\/span><\/i>.<\/span><\/i>keras<\/span><\/i>.<\/span><\/i>layers<\/span><\/i>.<\/span><\/i>Dropout<\/span><\/i>(<\/span><\/i>0.2<\/span><\/i>),<\/span><\/i><\/p>\n\n\n\n

tf<\/span><\/i>.<\/span><\/i>keras<\/span><\/i>.<\/span><\/i>layers<\/span><\/i>.<\/span><\/i>Dense<\/span><\/i>(<\/span><\/i>10<\/span><\/i>,<\/span><\/i> activation<\/span><\/i>=<\/span><\/i>‘softmax’<\/span><\/i>)<\/span><\/i><\/p>\n\n\n\n

])<\/span><\/i><\/p>\n\n\n\n

model<\/span><\/i>.<\/span><\/i>compile<\/span><\/i>(<\/span><\/i>optimizer<\/span><\/i>=<\/span><\/i>‘adam’<\/span><\/i>,<\/span><\/i><\/p>\n\n\n\n

loss<\/span><\/i>=<\/span><\/i>‘sparse_categorical_crossentropy’<\/span><\/i>,<\/span><\/i><\/p>\n\n\n\n

metrics<\/span><\/i>=[<\/span><\/i>‘accuracy’<\/span><\/i>])<\/span><\/i><\/p>\n\n\n\n

model<\/span><\/i>.<\/span><\/i>fit<\/span><\/i>(<\/span><\/i>x_train<\/span><\/i>,<\/span><\/i> y_train<\/span><\/i>,<\/span><\/i> epochs<\/span><\/i>=<\/span><\/i>5<\/span><\/i>)<\/span><\/i><\/p>\n\n\n\n

model<\/span><\/i>.<\/span><\/i>evaluate<\/span><\/i>(<\/span><\/i>x_test<\/span><\/i>,<\/span><\/i> y_test<\/span><\/i>)<\/span><\/p>\n\n\n\n

TensorFlow is ideal in many cases because you can find a repository of already implemented models on <\/span>Github<\/span><\/a>. It also performs deep learning through neural networks and provides visualizations through TensorBoard, generating everything from distributions and histograms to audio files.<\/span><\/p>\n\n\n\n

For coders with different levels of expertise, here are some additional <\/span>tutorials<\/span><\/a> that run on Jupyter notebooks and in Google Colab.<\/span><\/p>\n\n\n\n

Looking for more information about TensorFlow? Check out our guide to PyThorch vs. TensorFlow<\/a>.<\/em><\/p>\n\n\n\n

PyTorch<\/b><\/h3>\n\n\n\n

Used by Facebook, PyTorch is a framework designed for computer vision, reinforcement learning, and natural language processing and is frequently the tool of choice for rigorous <\/span>research<\/span><\/a>.<\/span><\/p>\n\n\n\n

On the PyTorch website, you can also find <\/span>tutorials<\/span><\/a> on constructing neural networks. These <\/span>case studies<\/span><\/a> show how to classify handwritten digits, objects, sentiments, and images. <\/span><\/p>\n\n\n\n

This <\/span>tutorial<\/span><\/a> walks through the example of fitting y=sin\u2061(x) with a third-order polynomial and training a network of four parameters with gradient descent \u201cto fit random data by minimizing the Euclidean distance between the network output and the true output.\u201d<\/span><\/p>\n\n\n\n

It builds off of NumPy\u2014in fact, a PyTorch Tensor is an n-dimensional array similar to the NumPy array, but Tensors can use GPUs to make the speed 50x faster.<\/span><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Several useful PyTorch packages and libraries provide a framework for accomplishing different tasks. In the example above, you need to manually implement forward and backward passes, but it is possible to automate with the autograd package.<\/span><\/p>\n\n\n\n

The nn package serves a similar function to the <\/span>Keras<\/span><\/a>, <\/span>TensorFlow-Slim<\/span><\/a>, and <\/span>TFLearn<\/span><\/a> packages, by creating Modules (like neural network layers), which receive input Tensors and produce output Tensors. <\/span><\/p>\n\n\n\n

You can update the weights of models manually by using learning parameters like torch.no_grad(), but the optim package and other optimizers, such as <\/span>AdaGrad, RMSProp, and Adam, will make this work more scalable.<\/span><\/p>\n\n\n\n

PyTorch is more challenging to learn than TensorFlow, but it is easier to customize and faster to train. <\/span><\/p>\n\n\n\n

Looking for more information about PyTorch? Check out our guide to PyThorch vs. TensorFlow<\/a>.<\/em><\/p>\n\n\n\n

Spark<\/b> MLlib<\/b><\/h3>\n\n\n\n

Founded in 2009 at UC Berkeley, <\/span>Spark<\/span><\/a> is a unified analytics engine and open-source cluster-computer framework that can write applications in Java, Scala, Python, R (a popular programming language in the domain of data science<\/a> to do statistical analysis), and SQL and run on Hadoop, Apache Mesos, Kubernetes or in the cloud. It can also run on a standalone cluster. The basic <\/span>architecture<\/span><\/a> includes drivers converting code into tasks and executors. Executors run on the nodes containing the tasks and put the nodes to work. <\/span><\/p>\n\n\n\n

Spark has a machine learning library called <\/span>MLlib<\/span><\/a>, which performs functions like classification, regression, clustering, optimization, dimensionality reduction, collaborative filtering, and feature extraction and transformation. <\/span><\/p>\n\n\n\n

This <\/span>tutorial<\/span><\/a> builds off of a <\/span>Boston Housing<\/span><\/a> dataset. The goal is to use the 14 features, which consist of CRIM (per capita crime rate), RM (average number of rooms per dwelling), PTRATIO (pupil-teacher ratio by town), NOX (nitric oxide concentration), and others, to predict the value of MEDV (median housing price). It involves installing Python, Spark, the findspark library, Numpy, and Jupyter. <\/span><\/p>\n\n\n\n

The first problem is one of regression, trying to use the features to predict the label of home value. <\/span><\/p>\n\n\n\n

\"\"<\/h3>\n\n\n\n

By using the assembler to create the features column, you can represent the values in a table.<\/span><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n

Afterward, you can split the data into training and testing examples to create a model and then evaluate its performance.<\/span><\/p>\n\n\n\n

\"\"<\/figure>\n\n\n\n
\"\"<\/figure>\n\n\n\n

If you want more practice, this additional tutorial employs Spark to build a <\/span>decision-tree classifier<\/span><\/a> to predict automobile gas mileage. As you can see, <\/span>MLlib<\/span><\/a> offers fast and dynamic processing, but can consume a lot of expensive memory. <\/span><\/p>\n\n\n\n

Looking for more information about Spark? Check out our guide to training a very large model using Spark<\/a>.<\/em><\/p>\n\n\n\n

More options<\/b><\/h3>\n\n\n\n

Besides these frameworks, there are others that you can explore as time permits, like:<\/span><\/p>\n\n\n\n