Streamlit interaction issues with Selenium

alovictor · July 10, 2020, 7:53pm

Hey! I’m trying to do a tiny app to make my webscraping script more useful. So I decided to use Streamlit.
When I call the class which make the scrap, the Streamlit gets an error: " ModuleNotFoundError: No module named ‘selenium’ "
I have no ideia whats going on, because i’m using the correct env to run the app (which already have Selenium)

Specs:

Streamlit Version: 0.61.0
Python Version: 3.8.3
Env: Conda
OS: Windows
Browser: Opera

Some screenshots:

Charly_Wargnier · August 21, 2020, 2:59pm

Hi Victor
Did you make it work in the end?

randyzwitch · August 21, 2020, 3:35pm

Hey @Charly_Wargnier -

I’m in the middle of writing a blog post about this, but in the meantime, you can see how to use SeleniumBase to test Streamlit apps in this repo:

Charly_Wargnier · August 21, 2020, 3:50pm

Cheers Randy!

I’d like to port this script to Streamlit:

github.com

DeepCrawlSEO/public/blob/master/Chrome Mixed Content Errors Fetch v1.2.ipynb

{
 "cells": [
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "# Chrome Mixed Content Errors Fetch"
   ]
  },
  {
   "cell_type": "markdown",
   "metadata": {},
   "source": [
    "### Configuration\n",
    "This first cell is the the only cell you should need to make changes to.\n",
    "Be sure the read all commented notes in this first cell."
   ]
  },
  {
   "cell_type": "code",

This file has been truncated. show original

Wouldn’t it work out of the box? (that is, w.o the need for folium?)

Thanks,
Charly

randyzwitch · August 21, 2020, 3:53pm

Yes, the point wasn’t to highlight folium, just that you can use the SeleniumBase Python package to easily test Streamlit apps (or, do actual work)

Charly_Wargnier · August 22, 2020, 10:25am

Thanks Randy, that makes sense!

Quick update: I tried to port one of my Colab notebook relying on Selenium to Streamlit and it (expectedly?) doesn’t work.

So here comes my project for the weekend! Porting my code to SeleniumBase to make it work in Streamlit!

Domagoj_Kojundzic · January 3, 2022, 11:08am

Hello everybody,

I am having similar issues with Selenium during Stremlit app deployment.
How to fix this problem?

Topic		Replies	Views
Selenium web scraper - ModuleNotFoundError Community Cloud	3	1001	January 4, 2023
Selenium web scraping on streamlit cloud Community Cloud selenium	24	12092	February 18, 2025
Issue with Selenium on a Streamlit app Using Streamlit	38	7837	January 31, 2024
Access app errors in pytest Using Streamlit	2	758	January 12, 2022
Error "selenium.common.exceptions.WebDriverException" although app works fine locally Deployment streamlit-cloud	10	3703	February 9, 2024

Streamlit interaction issues with Selenium

Related topics