Streamlit interaction issues with Selenium

[alovictor]

Hey! I’m trying to do a tiny app to make my webscraping script more useful. So I decided to use Streamlit.
When I call the class which make the scrap, the Streamlit gets an error: " ModuleNotFoundError: No module named ‘selenium’ "
I have no ideia whats going on, because i’m using the correct env to run the app (which already have Selenium)

Specs:

• Streamlit Version: 0.61.0
• Python Version: 3.8.3
• Env: Conda
• OS: Windows
• Browser: Opera

Some screenshots:

[Charly_Wargnier]

Hi Victor
Did you make it work in the end?

[randyzwitch]

Hey @Charly_Wargnier -

I’m in the middle of writing a blog post about this, but in the meantime, you can see how to use SeleniumBase to test Streamlit apps in this repo:

randyzwitch/streamlit-folium

[Charly_Wargnier]

Cheers Randy!

I’d like to port this script to Streamlit:

DeepCrawlSEO/public/blob/master/Chrome Mixed Content Errors Fetch v1.2.ipynb

Wouldn’t it work out of the box? (that is, w.o the need for folium?)

Thanks,
Charly

[randyzwitch]

Yes, the point wasn’t to highlight folium, just that you can use the SeleniumBase Python package to easily test Streamlit apps (or, do actual work)

[Charly_Wargnier]

Thanks Randy, that makes sense!

Quick update: I tried to port one of my Colab notebook relying on Selenium to Streamlit and it (expectedly?) doesn’t work.

So here comes my project for the weekend! Porting my code to SeleniumBase to make it work in Streamlit!

[Domagoj_Kojundzic]

Hello everybody,

I am having similar issues with Selenium during Stremlit app deployment.
How to fix this problem?

Selenium web scraper - ModuleNotFoundError

Hello everyone, I am having some issues when trying to deploy a relatively simple app using Streamlit Cloud. It uses Selenium for website scraping. My GitHub repo is here: GitHub - dkujo/scraping_zse: scraping ZSE stockmarket - you can see the complete code and app description. I use Conda and have placed eviroment.ymlt file in repo. My Python version: python==3.9.7 My Streamlit version: streamlit==1.2.0 Windows 10 is installed on my machine. Screenshots of the displayed error: [image]