I try to run scrapy with this os.system command: cmd =‘scrapy crawl gather_details -a domain=’+ search_text + ’ -o emails.json’ os.system(cmd) If i running on Local computer it work. Can i run scapy with this command in share.Streamlite sh: 1: scrapy: not found 2021-04-19 15:20:38.233 Uncaught…

I’ve opened a PR against your repo, which I believe fixes this issue. Fix subprocess issue estkae:main ← randyzwitch:main opened 01:41PM - 21 Apr 21 UTC (UTC) [randyzwitch] rand…

Hi @estkae , welcome to the Streamlit community! In your code repo, do you have a requirements.txt file that includes scrapy? When things work locally but not on sharing, it’s usually because people forgot to add a dependency. Best, Randy

Thanks for answer: no i did: streamlit==0.80.0 requests==2.24.0 Scrapy==2.5.0 pandas==1.2.3 tld==0.12.5 selenium==3.141.0 parsel==1.6.0 neattext==0.1.0

There are a Problem in streamlit. After the instellation of scrapy we have this issue: Collecting scrapy==2.5.0 Downloading Scrapy-2.5.0-py2.py3-none-any.whl (254 kB) After them we can not find scrapy Traceback (most recent call last): File “gather_details.py”, line 2, in import scrapy Modul…

see above [image] estkae/StreamlitEmail_app Scraping Mail URL Phone. Contribute to estkae/StreamlitEmail_app development by creating an account on GitHub.

I just forked the code and installed it on sharing, and it appears to be working [image] Successfully installed Automat-20.2.0 MarkupSafe-1.1.1 PyDispatcher-2.0.5 Send2Trash-1.5.0 Twisted-21.2.0 altair-4.1.0 argon2-cffi-20.1.0 astor-0.8.1 async-generator-1.10 attrs-20.3.0 backcall-0.2.0 base58-2.…

Thanks a lot but the Problem is Contact Detail! Bildschirmfoto 2021-04-21 um 01.47.55|690x276 In this case streamlit doesn’t find scrapy

If I had to guess, I would say that this line here doesn’t run in the same environment as the actual Streamlit app: estkae/StreamlitEmail_app/blob/main/app.py#L271 # c.start () # if os.path.exists ("contact_details"): # # Change the current working Directory # # st.text(os.un…

Run scrapy

Community Cloud

estkae April 21, 2021, 2:44pm 11

Great great you are the best Thank you. iClose all issue.
BR Karl

Topic		Replies	Views
Selenium web scraper - ModuleNotFoundError Community Cloud	2	1022	January 4, 2022
Integrating Scrapy with Streamlit Using Streamlit	0	470	December 21, 2022
Scispacy error Using Streamlit	3	2693	April 28, 2021
ModuleNotFoundError: No module named 'scipy' . I have imported scipy in requirements.txt still getting error Community Cloud heroku , streamlit-cloud	3	3062	September 1, 2022
Deploying app but cannot find spacy Community Cloud spacy	1	381	October 16, 2023

Run scrapy

Related topics