Installing a KubeFlow on your Local Machine

Installing KubeFlow on your Local Machine

KubeFlow is an open-source ML toolkit for Kubernetes. It is a convenient tool for making Machine Learning Workflows Simple, Portable and Scalable. As, it runs on top of Kubernetes it can run on-prem Servers, GKE (Google Kubernetes Engine) and Amazon Elastic Kubernetes Service (EKS) or any other Kubernetes Service.

There are many ways of Installing Kubernetes Locally in your System:

When we check for Local KuberFlow options we are having MiniKF, in the official documentation of KubeFlow, they are using Vagrant and VirtualBox to install MiniKf. I avoided this installation as i wanted to avoid VirtualBox.

Big Data Jobs

Another option is first Installing MiniKube and then Installing Kubeflow on that. I encountered some bugs where it did not install few of the services.

The Easiest Option which I found was using MicroK8s. Following are the commands which I used to install this.

  1. First Step is to install microk8s.

sudo snap install microk8s -classic

2. Verify the status of microk8s

microk8s.status –wait-ready

Trending AI Articles:

1. Top 5 Open-Source Machine Learning Recommender System Projects With Resources

2. Deep Learning in Self-Driving Cars

3. Generalization Technique for ML models

4. Why You Should Ditch Your In-House Training Data Tools (And Avoid Building Your Own)

3. We have to enable Services which have will be used by KubeFlow.

microk8s.enable dns dashboard storage

4. For Deploying KubeFlow

microk8s.enable kubeflow

After Deploying Kubeflow we will access the KubeFlow Dashboard. We will the dashboard IP in the command line. We will also get Username and Password which we will require to access the KubeFlow Dashboard. After entering the credentials we will access the Dashboard which will look like this.

KubeFlow Dashboard

5. Stopping After Deployment

microk8s.disable kubeflow

Congrats! Hope You are Enjoying KubeFlow in your Local!

If if you encountering any Problem then,

  1. Install Multipass

snap install multipass

2. Launch multipass

multipass launch –name kubeflow-vm –mem 16G –disk 50G

multipass shell kubeflow-vm

3. Install microk8s in Multipass VM

sudo snap install microk8s –classic

sudo iptables -P FORWARD ACCEPT

sudo usermod -aG microk8s $USER

newgrp microk8s (exit Shell and Enter Shell Again)

Now Follow the steps Mentioned Above.

Congrats! Finally I really Hope You are Enjoying KubeFlow in your Local!

References:

  1. https://github.com/kubeflow/kubeflow/issues/4931
  2. https://ubuntu.com/kubeflow/install

Now, as you have installed it you can go through this article to learn more about KubeFlow and How it Works

https://neptune.ai/blog/deep-dive-into-ml-models-in-production-using-tfx-and-kubeflow

Don’t forget to give us your ? !


Installing a KubeFlow on your Local Machine was originally published in Becoming Human: Artificial Intelligence Magazine on Medium, where people are continuing the conversation by highlighting and responding to this story.

Via https://becominghuman.ai/installing-a-kubeflow-on-your-local-machine-16ff89b77020?source=rss—-5e5bef33608a—4

source https://365datascience.weebly.com/the-best-data-science-blog-2020/installing-a-kubeflow-on-your-local-machine

Published by 365Data Science

365 Data Science is an online educational career website that offers the incredible opportunity to find your way into the data science world no matter your previous knowledge and experience. We have prepared numerous courses that suit the needs of aspiring BI analysts, Data analysts and Data scientists. We at 365 Data Science are committed educators who believe that curiosity should not be hindered by inability to access good learning resources. This is why we focus all our efforts on creating high-quality educational content which anyone can access online.

Leave a comment

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Design a site like this with WordPress.com
Get started