Indexability for Streamlit apps 🎈

Hey community, :wave:

We’re excited to announce that all public Streamlit Community Cloud apps are now indexable by search engines. :star_struck:

Check out the docs for more info on indexing and feel free to leave any questions in the comments.

– TC :balloon:

7 Likes

That’s great news!

How long does it take for search engines to index existing public streamlit apps?
I tried my app in Google Search as suggested:

site:<your-app-url>

but it doesn’t find it yet.

Will indexing also work if the only meta description is in Markdown like this for example?

st.markdown('<h1 style="margin-bottom:0rem;margin-top:-4rem;text-align: center">GPS Time Converter</h1>', unsafe_allow_html=True)
st.markdown('<h5 style="color:grey;margin-bottom:0rem;margin-top:-1rem;text-align: center">Convert between UTC/Local Time and GPS Time</h5>', unsafe_allow_html=True)

I often don’t use st.header/st.subheader/st.text in my apps at all but prefer st.markdown because there is more flexibility in text size, colour, margins etc.
But will it be a problem with indexability?

Regards,
Sibylle

Hi,
in order to index your app, search engines need to kow about it.
In most cases search engines discover websites via links, e.g. link your app from your home page. It usually takes a few hours after detecting a page and idetifying relevant contents.

st.header and st.subheader convert the text into HTML hx structures, so they are quite the same like your exanple only without the styling. This will not be a problem. Search engine will have to render the app in the first place to see the HTML headings, which is the most important work for them to do.

2 Likes

Hi, there. My app still isn’t indexed by Google. It’s public, has been deployed several weeks ago, and has a header. Any ideas what else could be preventing it from being indexed?

Have you published it somewhere e.g. here in the streamlit forums (please see: About the Show the Community! category)?
Search engines need links to the documents they should index.

If you have a personal website, you may link to your app - ideally with some additional text - and if you want to you can submit the page from where you are linking to your app to search engines to crawl and index.

1 Like

Thank you :slightly_smiling_face:

2 Likes

Thank you for replying so quickly! I’ll make sure to post my app link for indexing then.

PS.: The “About the Show the Community! category” link sends me to a closed conversation without much info. Is it correct?

2 Likes

Hi,
sorry - thats right - it’s only the opening-post for the caregory.
Apps hosted on Streamlit cloud can be presented here: Topics tagged streamlit-cloud :balloon:
Don’t hesitate to show your work. I’m courious, too. :slight_smile:

1 Like

Thank you for the guidance! Here’s my post: Living quality around the world at street level

I hope you all like it

Hello everybody,
what about Streamlit app deployed with a custom domain but through heroku?

Nice one - very interesting project.
Aaand - see, it’s indexed:
Screenshot_20221204_index-test-of-your-app

I’d guess that the same applies for your app on heroku as for the apps on streamlit cloud. As you can see, the page (aka the app) is indexed.
It will probably take some time until search engines take care about the initial rendering. As for now Google has only indexed what is served on the url initially. In order to index the text you are using in your app it has to render ist - which means has to run all the JS stuff and wait untill it’s done. That’s time consuming so search engines often delay that task.*
You can get an idea of what the search engine sees when visiting your app here: https://search.google.com/test/mobile-friendly/result?id=OTKlllTMi0Sh4we7iQhjNA (go to “view tested site” > “screenshot” - and you’ll see the search engine stops rendering while the app is still booting)**
I’m not familiar with heroku. Maybe you can speed up the booting process.

Hope this helps :slight_smile:


*, ** I tried to simplify as much as I could, as this topic gets freaky complex quickly.

1 Like

I think it would be great if Streamlit published an apps site map page. If there’s concern about people not wanting all their public apps indexed necessarily, there could be an app setting to indicate if you want your app included on Streamlit’s apps site map.

Hi Seb,
many thanks for your answer. It helped! have a nice day
Alex