Skip to content

S.E.N.S.E.I is an AI-powered virtual assistant designed to provide intuitive solutions and engage in seamless interactions with users through speech and text commands. It incorporates various functionalities ranging from basic greetings to complex tasks such as searching the web, controlling multimedia, retrieving information,etc.

License

Notifications You must be signed in to change notification settings

VaidikKhurana/S.E.N.S.E.I

Repository files navigation

Synthetic Entity Navigating Solutions and Engagements Intuitively (S.E.N.S.E.I) v1.5.6 blackcape S E N S E I

1. Introduction: Synthetic Entity Navigating Solutions and Engagements Intuitively (S.E.N.S.E.I) is an AI-powered virtual assistant designed to provide intuitive solutions and engage in seamless interactions with users through speech and text commands. It incorporates various functionalities ranging from basic greetings to complex tasks such as searching the web, controlling multimedia, retrieving information, managing memory, and even initiating server connections.

2. Technologies Used: The project employs several technologies and libraries including:

  • Python: The primary programming language for developing the application.
  • Pyttsx3: A Python library for text-to-speech conversion.
  • SpeechRecognition: A library for performing speech recognition.
  • Pygame: Used for playing audio files.
  • Selenium: Employed for web scraping and automation tasks.
  • Wikipedia API: Utilized for retrieving information from Wikipedia.
  • Requests and BeautifulSoup: Utilized for web scraping and extracting data from HTML/XML documents.
  • PyAutoGUI: Employed for controlling the mouse and keyboard to perform tasks such as opening applications or browser tabs.
  • Serial: Used for serial communication with Arduino to control hardware components like servo motors.
  • Socket: Utilized for establishing server connections.

3. Features and Functionalities:

  • Speech Recognition and Text-to-Speech Conversion: S.E.N.S.E.I utilizes SpeechRecognition library to understand user commands through speech input. It then converts text responses to speech using the Pyttsx3 library, providing a natural conversational experience.
  • Greeting and Casual Conversation: S.E.N.S.E.I can greet users and engage in casual conversation, making interactions more friendly and personalized.
  • Web Search and Browsing: Users can ask S.E.N.S.E.I to search the web or open browser tabs to retrieve information on various topics.
  • Weather and Time Inquiries: The assistant can provide real-time weather updates and current time information based on user requests.
  • Application Control: S.E.N.S.E.I can open, close, or perform actions within applications based on user commands.
  • Memory Management: The assistant can remember user-provided information and store it in memory for future reference.
  • Multimedia Control: Users can control multimedia playback, such as playing or pausing videos, through voice commands.
  • Light Control: S.E.N.S.E.I can interact with hardware components, such as controlling the light by rotating a servo motor.
  • Server Initiation: The assistant can initiate server connections and respond to remote commands, facilitating remote interactions.
  • Sleep Mode Activation: S.E.N.S.E.I can enter sleep mode upon user command, and it can be reactivated by clapping.
  • Web Login: Users can login to S.E.N.S.E.I by entering a default pass in the flask server to login directly
  • Facial Recognition Auth: It has built in 2FA through normal pass and faci al recognition. One may edit samples by going in faceAuth folder and Generating Samples and training the model.

NOTE: PASSWORD FOR WEBLOGIN USERNAME - sensei PASS - blackcape

4. Implementation: The project is implemented in Python, leveraging various libraries and technologies to achieve the desired functionalities. It utilizes modular design principles, separating different functionalities into functions and classes for better organization and maintainability. Additionally, error handling mechanisms are implemented to ensure smooth execution and user-friendly interactions.

5. Future Enhancements:

  • Natural Language Understanding: Improve the AI's understanding of natural language and context to provide more accurate responses.
  • Integration with IoT Devices: Expand support for controlling IoT devices such as smart home appliances, lights, and sensors.
  • Enhanced Memory Management: Implement advanced memory management techniques to store and retrieve information more efficiently.
  • Integration with APIs: Integrate with third-party APIs to access a wider range of services and information sources.
  • Adding all in one setup file: Adding a peculiar file that can setup the whole program to it's needs.

6. Using the program Run the install_packages.bat file. Run the blackcape.bat file.

6. Conclusion: Synthetic Entity Navigating Solutions and Engagements Intuitively (S.E.N.S.E.I) is a comprehensive virtual assistant designed to cater to various user needs and preferences. With its intuitive capabilities and extensive functionalities, S.E.N.S.E.I aims to simplify tasks, provide valuable information, and enhance user productivity and convenience. Through continuous development and enhancements, it strives to become an indispensable tool for users seeking seamless and efficient virtual assistance.

NOTE : THIS REPOSITORY BRANCH HAS MANUALLY UPDATED CODE OF THE LATEST RELEASE OF THE S.E.N.S.E.I PROJECT, FOR OLDER RELEASE REFER TO THE RELEASES SECTION

About

S.E.N.S.E.I is an AI-powered virtual assistant designed to provide intuitive solutions and engage in seamless interactions with users through speech and text commands. It incorporates various functionalities ranging from basic greetings to complex tasks such as searching the web, controlling multimedia, retrieving information,etc.

Resources

License

Stars

Watchers

Forks

Packages

No packages published