Hey, guys since my dataset is very large to fit in memory, I have been trying to use Dask to manipulate the data to get a new dataframe that could fit in memory. However, I am getting a erro that I could not resolve…
I am using this function to read the data:
And I am getting the erro below we I use the data from above, inside the functions below
My reppo
import streamlit as st
import dask.dataframe as dd
import pandas as pd
import re
import joblib
import os
from io import BytesIO
import tempfile
import scipy.sparse as ss
import numpy as np
import boto3
import logging
from sklearn.metrics.pairwise import cosine_similarity
st.set_page_config(page_title="Book Advisor", page_icon=":book")
@st.cache_resource
def get_s3_client():
s3 = boto3.client('s3',
aws_access_key_id=st.secrets["AWS_ACCESS_KEY_ID"],
aws_secret_access_key=st.secrets["AWS_SECRET_ACCESS_KEY"])
This file has been truncated. show original
system
Closed
June 24, 2024, 7:24am
2
This topic was automatically closed 180 days after the last reply. New replies are no longer allowed.