AMA: Ask me anything, a AI tool to ask question about images!

Show the Community!
1

I’ve been working on an open-source tool to visualise attentions in Visual Question Answering models, and it’s finally ready! :tada:

I’m calling it AMA: Ask me anything.
Please check out the demo at apoorvesinghal.com/vqa

Step 1. Go to the website (preferably from a laptop/computer)
Step 2. Choose an image
Step 3. Ask a question

The system will try to answer any question you ask about the image!

Example: For the bottom left image, we ask the system “What is the colour of the hat?”.
The AI system answers: white.

landing
landing3360×1900 650 KB

The app also shows the parts of the image and the question that the system looks at, to answer the question!

img_att_now
img_att_now3360×1894 837 KB

text_att
text_att3360×1900 560 KB

4 Likes
2

Well hello again @apoorve_singhal!! :grin: :rofl:

Thanks for joining our community! :partying_face: :tada: :partying_face: :tada:

As I said on LinkedIn, your app is great! Can’t wait to see what else you make!

Happy Streamlit-ing!
Marisa

1 Like
3

Hi apporva - I am getting a yaml not found error on your website

4

Hey @altafr, thanks for letting me know :smiley:

I have raised an issue with the Streamlit team here.

5

i was able to play around and it is a really impressive app! Thanks for sharing

6

please i have a problem when i want to use the following command " st.beta_set_page_config(layout=“wide”) they tell me i have a fault and the app wont run . do u know why please

7

Hey @oumaima,

First, welcome to the Streamlit Community :star_struck: :partying_face: :partying_face: :tada: :tada: :star2:

I am not sure what version of Streamlit you are using but the st.set_page_config has been out of beta for a while now. Your app should run fine locally (or in deployment) by just removing the beta_ in front of your command!

Happy Streamlit-ing!
Marisa

8

thank u , i do have a question:
i keep trying to put a graph in streamlit but i keep getting this message:
’FuncAnimation’ object has no attribute 'savefig’
do u happen to know why perhaps?

9

Hey @oumaima,

I would need to get a minimum working example of the code you are using to help with this, there is just too much I don’t know about your code to be able to accurately help you with this question!

10

this is my code , i’m also using data from a csv file and trying to show the graph in the website.


plt.style.use('fivethirtyeight')

x_vals = []
y_vals = []

index = count()


def animate(i):
    data = pd.read_csv('data.csv')
    x = data['date']
    y = data['price']

    plt.cla()

    plt.plot(x[(len(x)-1-365):], y[(len(y)-1-365):], label='Bitcoin Price by $', linewidth=2)

    plt.legend(loc='upper left')
    plt.tight_layout()


ani = FuncAnimation(plt.gcf(), animate, interval=1000)

plt.tight_layout()
plt.savefig('img&&',dpi=100)
plt.show()