What is Jarvis?

• Jarvis is the name of a custom application and server we created to power our home automation

• Amazon's Alexa (which we use as an intermediary to speak to Jarvis), requires developers to choose an arbitrary name to invoke their applications. We chose Jarvis, named after the AI in the Iron Man movies

• Specifications: Ubuntu Linux, 32GB RAM, 2TB storage, 64-bit quad core Intel CPU

• Application Logic: Python, Java, PHP, BASH, Ruby

• Web Interface: HTML5, JavaScript, PHP

• Voice: Speak out loud anywhere in the house "Alexa, tell Jarvis to....."

• Graphical User Interface (GUI): Try tapping the touchscreen panels in our kitchen, gym, master bath, or master closet.

• Chatbot: An instant-messaging style interface that allows you to interact with Jarvis as if you had spoken to him with audible voice commands.

• Web Service: JSON REST

• CLI: 'jarvis' executable command-line scriptable interface

Blockchain

• A localized etheruem blockchain has been installed and configured the main linux server (Jarvis)

• Our interactive Children's Chore Chart and associated rewards are tracked as a home-grown cryptocurrency on the ethereum blockchain mentioned above

• Children's Chore Chart - say out loud "Alexa, tell Jarvis to remove one point from Blake", or

• "Alexa, ask Jarvis to report on the status of the kid's points", or

• Go to one of the touchpanels in the house and tap the "Chores" dashboard.

• Each point is a cryptocurrency token and can be exchanged for 30 minutes of electronic entertainment (TV, Video Games) or $1.00 USD

Robotic Process Automation

• Jarvis has been programmed as a virtual fitness trainer (daily custom workouts that do not repeat)

• Family scripture study is automated by Jarvis (loads the 'next chapter' in our study, reads it to us out loud, and scrolls synchronized text on screen)

• Virtual Fitness Trainer - Go in to the gym and say out loud "Alexa, tell Jarvis to start a demonstration workout", or

• Use the touchpanel in the gym to select a demo workout.

• Family Scripture Study - Ask Alexa to tell Jarvis you'd like to do a scripture study, or use the touchpanel "Scriptures" dashboard.

Data Science

• Home energy usage is monitored in real-time by Sense Energy Monitor -- which uses machine learning to detect physical devices based on their power signatures

• Alexa Voice Recognition is pervasive throughout the house via recessed ceiling mounted Amazon Echo Dot devices. Spoken commands can be routed to the home server Jarvis for actioning

• Our daughter's educational journal reports are graded daily by Jarvis, who then awards cryptocurrency based on the grade

• Jarvis can also be contacted through an interactive chatbot interface

• Sense Energy Monitor can be viewed on the Jarvis GUI. On touchpanels, tap the "Power Sense" tab.

• Alexa Voice Recognition is pervasive throughout the house. Try saying "Alexa, ask Jarvis to repeat...anything..."

• Educational Journal Grading by Jarvis, ask Jarvis how Kalani's school work is shaping up today: "Alexa, ask Jarvis how school is going."

• The Chatbot interface can be viewed on the touchpanel GUIs under the "Utilities > Chat" tab, but it's best used with a physical keyboard.

Internet of Things

• Our vehicles are outfitted with real-time GPS tracking that is relayed to our server (Jarvis) and can be viewed on wall-mounted touchpanel GUIs in the house

• Networked Sprinkler System allows Jarvis to control lawn watering

• Wifi IoT buttons are placed throughout the house to perform various on-demand automation (burglar alarm, chore completion, watch specific cartoon, toggle lights, etc)

• Connected Motion Sensors trigger actions based on the location and time of day

• Raspberry Pi Zeros are mounted on the three garage doors with Vibration Sensors to provide alerting...