---- datatemplateentry project ----
template            : projects: display_template
title               : Incorporating Hand-Writing Detection and Recognition into Physical-Digital Workflows and Workspaces
participants_       : [[people:juergen_hahn|Jürgen Hahn]], [[people:nicolas_symeou|Nicolas Symeou]], [[people:raphael_wimmer|Raphael Wimmer]]
keywords_           : Interaction Techniques, Computer Vision, Machine Learning, Deep Learning
status_             : on hold
start               : 2018
end                 : 
photo_img           : projects:wip.jpg
shortdescription    : 
abstract            : to come.
----
==== Goal ====
Enable the digitisation of hand-written annotations and signatures on physical paper or etc., in order to incorporate them into the digital twin for machine processing in regard of physical-digital affordances. 

==== Status ====
==== Background ====
In order to optimally use the required technologies, the status quo of Machine Learning / Deep Learning in regard of Hand-Writing Detection and Recognition has to be familiarized with. Then, appropriate techniques are customized for the physical-digital use case. This requires custom collected data sets and a custom designed and trained neural network. Stroke coordinates, stroke progression and individual point coordinates of the strokes of letters, words, sentences serve as input for said trained NN. These are extracted via image processing and computer vision techniques. Ultimately, interaction techniques, familiar to users, are retained in the new digitised context of their workflow.

**Used Technologies:** \\
  * Machine Learning / Deep Learning
  * Computer Vision
  * Multi-Touch-Table SUR40 and Framework (see https://hci.ur.de/projects/mtt)

**Relevant Literature:** \\
  * 

**Future Extensions:**
  *  see https://hci.ur.de/projects/mtt

==== Publications ====

---- datatemplatelist ----
template: publications:list_template
cols    : %title%, authors_, date, short-description, abstract, pdf_url, bibtex_url, video_url, photo, published-in
sort    : date
filter  : %pageid%~publications:*
and     : project=hwr
----



==== News / Blog ====

---- datatemplatelist ----
template: news:list_template
cols    : %title%, date, description
sort    : ^date
filter  : tags ~~ hwr, Interaction Techniques, Computer Vision, Machine Learning, Deep Learning
----