Vision

Social Media has changed the way we live our lives a lot. Still, this technology has not yet been made accessible to the blind. With Vision, I plan to overcome this barrier that exists for the disabled and let them enjoy social media as well!

Voice commands provided.

• Providing voice command for loading facebook
• Logging
• Adding posts
• Reading posts
• Checking safety around(if speaking passwords)
• Logging out

Privacy

• We are not saving anything and ensuring user safety is top priority
• Moreover, we are providing command for checking your surroundings to find persons if any. This would help in being alert to speak credentials

About Wit.ai

Wit.ai makes it easy for developers to build applications and devices that you can talk or text to. Our vision is to empower developers with an open and extensible natural language platform.

Setting up the project

Clone the repo

git clone https://github.com/lazyCodes7/Vision.git

Get a bot token from BotFather and enter it inside "" in bot.py or use something like os.environ.get() using a .env file

updater = Updater("", use_context=True)

Next for wit.ai go to the site and create an app and get the access token which will be used in SpeechHandling.py

wit_access_token = 'your-access-token'

The project also requires Graph API and an app has to be created for that in dev platform and entered in get_posts.py

TOKEN = "your graph-api token here"

Make sure chromedriver is installed and is on PATH. Instruction are given later on.

After the following steps, run the following command to start the bot.

python3 bot.py

After the initial start button is pressed, there is no help required from anyone and a blind person can enjoy facebook just using voice and even check their safety from time to time by saying something like "Am I safe?" to ensure privacy.

Using the automator.

Usage:

from FacebookAutomater import *
fb = FacebookAutomater()

Initiate chrome:

fb.initiate_chrome()

Load facebook:

fb.page_load()

Login to facebook

fb.do_login("Number","Password")

Create a post:

fb.page_posting("This is a post")

Logout:

fb.do_logout()

How to get ChromeDriver?

Deploying it?

The bot can also be deployed after making some minor changes. For knowing how to deploy a bot to sites like heroku, this might be useful!

Ingredients

• Python
• Telegram API
• Graph API
• Wit.ai speech to text
• gTTS
• openCV
• haar-cascades
• Selenium

Whats next for Vision?

• Covering many more social media sites
• Making a webapp, which would make it even more accessible
• Using Graph API to add features like making a comment, liking a post etc