TrabHCI, Technologies to Reduce the Access Barrier in Human Computer Interaction. Granted by the Finnish National Agency

IP2013 projects

IP2013 work projects
Objective Development of auxiliary tools for people with special needs using novel interfaces technologies based on gestures, handwriting and speech recognition and language understanding algorithms.
Description The students will design and develop new applications based on the technologies introduced in the course and considering the special needs context.
The technologies will be based on the Kinect sensor and will include:
  - Gesture recognition
  - Speech recognition
  - Handwritten text recognition
  - Language understanding

The natural user interface could include:
  - synthetic environments
  - avatars
  …

Language: C#
Presentation guidelines:
Projects First Week Presentations:
Choose instruments
Move Along: Design application to help disabled or handicaped people
Teddy Doctor
HelpMe
Design and development of an app focusing the mobility disabilities in children by drawing therapy
Second Week Presentations:
Hangman style
Linking words
Theremin hero
Chat up
MySelf
IP2012 projects

IP2012 work projects
1. Sudoku project info
2. Dialogue System: Speech – Text - Speech project info
3. Co, Cool MASSIVE Project, Co! (Spoken Dialogue System) project info
4. Sudoku by hand project info
5. Maze race in Second Life using Kinect gesture control project info
T1 solution
T2 solution
T3 solution
T4 solution
IP2011 projects

IP2011 work projects
1. Mastermind game for Second Life project info
2. 8-puzzle game for VRML project info
3. Missionaries and cannibals game for VRML project info
4. Battleship game for Second Life project info
5. YATZY game for Second Life project info
6. Gesture Recognition project info
7. Speech Interface for VRML project info
8. Front face detection for triggering speech project info
9. GWT visualization of Historical Stock Market data project info
10. Pose Recognition project info
Previous IP - UsIfAmI

IP2010 projects
Mary McDerby
&
Tobias Schiebeck
Visualization 1: Particle advection in SVG
Write an AVS Module that outputs an animated SVG script to show a particle
advection simulation:
Step 1: Create an AVS network that visulizes streamlines in a Vector dataset;
Output the Streamlines as polylines
Step 2: Create a module that takes Mesh+Node_Data and a file name as input and writes an SVG File of the stream line
Step 3: Animate the Streamlines in the SVG code;
Skills: C/C++, AVS/Express, SVG, asking questions
Mary McDerby
&
Tobias Schiebeck
Visualization 2: Comparison of Visualization Systems AVS/Express and OpenDX
Step 1: Visualize the mystery dataset
Step 2: Why do I pay double the price for one of the two golf balls?
Step 3: Show the locks and explain how they work
Explain what the differences and commonalities of the two tools are
which is easier to use and why.
Skills: AVS/Express, OpenDX
Oscar Saz & Alfonso Ortega
Speech project 1. Speech-Voting System
Speech project 2. Speech enable website
Sariseelia Sore
&
Torsti Rantapuska
Wolfgang Oertel
Project 01: Intelligent Virtual Object
Design Tutor: Wolfgang Oertel

Goal: A software system automating the design of virtual objects Way: The first way to prepare objects for the use under different conditions is to adapt their physical structure to the new conditions already during the design process. This concerns for example the number, localisation, orientation, size, and features of elements, aggregates, or subsystems. Within the Artificial Intelligence programming language LISP a system is to be developed that automates the design process. The system contains, on the one hand, a knowledge base describing general regularities to be fulfilled by the object. On the other hand, it contains an inference mechanism that uses the stored knowledge to control the design of the object as problem solving process. The user should have only the task to specify certain global parameters. The design result will be stored in the form of a VRML text file that can be used to visualise the concrete object and to navigate through it, interactively. The final object may contain static, but also dynamic features.

Implementation language: CLisp, VRML Application field: Intelligent Vehicles
Wolfgang Oertel
Project 02: Intelligent Virtual Object Operation
Tutor: Wolfgang Oertel

Goal: A software system automating the operation of virtual objects Way: The second way to prepare objects for the use under different conditions is to use an existing object and equip it with intelligent technical facilities. In this way the object can react quickly and correctly to changing exterior or interior parameters. This concerns elements, aggregates, or subsystems. Within the Virtual Reality modelling language VRML an example object is to be designed with different technical facilities, manually. Each installed technical component can possess several states or processes. On this basis the dynamics of the system is implemented by formulating generic rules linking the states and processes of the facilities with each other. The rules and their interpretation procedure are implemented in JavaScript. The script itself is divided into a flexible knowledge base and a fixed inference mechanism. The result of the work is a concrete object model that can be visualised and animated. The navigation through the model and interaction with it starts chains of automatic actions leading to an overall intelligent behaviour of the entire object.

Implementation language: JavaScript, VRML Application field: Intelligent Vehicles
IP2009 projects

Mary McDerby
&
Tobias Schiebeck
1. Comparison of AVS/Express and OpenDX Visualizing a Pad-Lock.
Mary McDerby
&
Tobias Schiebeck
2. Creating an AVS/Express module to write SVG.

Eduardo Lleida
Sariseelia Sore
&
Torsti Rantapuska
Wolfgang Oertel
7. Intelligent Virtual Building Design
Field: Intelligent buildings under the condition of climate change
Goal:
Software system automating the design of virtual buildings
Way:
Creation of a LISP program with knowledge bases and inference components that generates intelligently buildings in the form of a VRML program
Language:
LISP, VRML
Wolfgang Oertel
8. Intelligent Virtual Building Operation
Field:
Intelligent buildings under the condition of climate change
Goal:
Software system automating the operation of virtual buildings
Way:
Creation of a VRML program with graphical objects and animation components that behaves by JavaScript intelligently in navigation and interaction situations
Language:
JavaScript, VRML
IP 2008 projects.

Sariseelia Sore
&
Torsti Rantapuska
1. Scripting on Second Life Virtual Environment tic-tac-toe game
Wolfgang Oertel
2. Intelligent buildings: graphics and multimedia.
Walter Paetzold
3. Intelligent buildings: House Generation.
Mary McDerby
&
Tobias Schiebeck
4. Visualization of "climate modelling data2 in AVS/Express.
Mary McDerby
&
Tobias Schiebeck
5. AVS/Express module to write the geometry of an arbitrary 2D dataset out as SVG.

Eduardo Lleida
6. Speech-Enabled Building.