DeepSeek, DeepSeek, DeepSeek... We can here this word from small youtube channels to American President in the recent times. It is open source, I thought Ok We can try this. I see the model have 1.5B version which is not that much efficient but, we can give a try on that ( I don't have GPUs to run the 671B 😅). Let's install 1.5b version in my desktop.
Before the installation, i want to introduce one thing called, OLLAMA which is a software to run any open source large language models in our local system or even in a server. There are some alternatives doing the same job but ollama is very easy to setup and it is too easy to work with.
Setup Ollama
This is an easy process, just go to https://ollama.com/ and donwload it, it is available for Mac, linux and windows, go ahead, download and install it.
Once the installation is done, verify it is installed properly by running the command in your terminal
ollama --version
As you can see, our Ollama installed successfully.
Installing DeepSeek:
Deepseek has various model versions from 1.5B to 671B , you can see the list of available models here
To install DeepSeek in our local machine, open your terminal and run the following command
ollama run deepseek-r1:1.5b
This will pull the deepseek model file and run the model
that's it now it is installed in our local system 🥳🎉
Bonus Tip
Everything looks good for now. But it's kind of boring using the terminal. It will look cool if we have a chatgpt kind of ui right?, I got you. There is an open source repository from OpenWebUI which fulfills our need, so why can't we use that? let's install it.
If you have docker installed, it is a straight forward way.
docker pull ghcr.io/open-webui/open-webui:main
docker run -d -p 3000:8080 -v open-webui:/app/backend/data --name open-webui ghcr.io/open-webui/open-webui:main
If you don't have docker installed, don't worry they published this as a pip package, but make sure you have python 3.11 installed. you can run the following command to install webui
pip install open-webui
Once the installation is done, you can run the webapp using the following command
open-webui serve
Now our Chatgpt like webapp is ready
open http://localhost:8080 it will prompt for signup. Once signup is done you can see the Chatgpt like UI
Now we can play with it🥳🥳
If you like my blogs please do follow me on Linkedin and Instagram
Top comments (0)