Smart Museum is an application developed for iOS platforms that allows you to live your museum experience in a fashionable and delightful way! In fact, through your iPhone/iPad camera, you gain the ability to scan every artwork collected in the exposition rooms and make it interactive: a label will appear in proximity of each one of them when analyzed, and you will be told the basic information regarding that specific piece. Plus, if you desire to know more about a particular painting or photography that caught your attention, the only thing that you have to do is to tap on the dynamic label: a window containing detailed info about the artwork and his author will pop up, satisfying every question that you might have. And don't worry if you analyzed something, moved on and then you desire to go back and know more about it: all the labels are rendered with the help of ARKit technology and put in an augmented reality environment, so they will always wait for you without fleeing as long as you keep the application running!
Features
iOS application
- SKScene and augmented reality environment rendering
- Communication with backend endpoint via HTTP POST request and response handling for artwork analysis
- Render of dynamic labels containing the data fetched from the database in the AR environment
- Detailed information displayed through a scrollView when a label is tapped
- Support for the camera flashlight for easier analysis in dark environments
Backend
- Always listening endpoint that collects incoming requests from the mobile application and forwards them to the Flask application
- Einstein Vision recognition that classifies the image received from frontend and sends back the answer through the endpoint
- Postgre-SQL Database that contains information about artworks and authors and is queried when generating a response containing a successful recognition
- Python Flask application that handles all the dynamics for a correct functioning of the system
Screenshots
Architecture Overview
Take a look at our demonstration video!
This is the link to our private GitHub repository.
If you want to know more about this project, feel free to contact any member of the group. You can find our contacts in the below section.
