How to build a Llama 2 chatbot

S_I · July 31, 2023, 2:51pm

Hi! Running the Pro version on Streamlit Cloud requires an API password from replicate, right?
Llama 2 is free to run on local hardware.

github.com

dataprofessor/llama2/blob/master/streamlit_app_v2.py

import streamlit as st
import replicate
import os

# App title
st.set_page_config(page_title="🦙💬 Llama 2 Chatbot")

# Replicate Credentials
with st.sidebar:
    st.title('🦙💬 Llama 2 Chatbot')
    if 'REPLICATE_API_TOKEN' in st.secrets:
        st.success('API key already provided!', icon='✅')
        replicate_api = st.secrets['REPLICATE_API_TOKEN']
    else:
        replicate_api = st.text_input('Enter Replicate API token:', type='password')
        if not (replicate_api.startswith('r8_') and len(replicate_api)==40):
            st.warning('Please enter your credentials!', icon='⚠️')
        else:
            st.success('Proceed to entering your prompt message!', icon='👉')

This file has been truncated. show original

os.environ['REPLICATE_API_TOKEN'] = replicate_api

Regards, Sergiu

Topic		Replies	Views
Comparing data visualisations from Code Llama, GPT-3.5, and GPT-4 Show the Community! llms	3	744	September 20, 2024
How to create an AI chatbot using one API to access multiple LLMs Using Streamlit ai , llms , ai-recipes	2	231	February 19, 2025
Deploy Streamlit LLM Demo Deployment	4	1509	July 1, 2024
Secrets on Streamlit using python Community Cloud	2	584	July 22, 2023
Build a chatbot with custom data sources, powered by LlamaIndex Show the Community! llms	14	5924	August 28, 2024

How to build a Llama 2 chatbot

Related topics

Hello there 👋🏻

Cookie settings

Strictly necessary cookies

Performance cookies

Functional cookies

Targeting cookies