Gesture-based robot programming using microsoft kinect

Sebastian Blankemeyer; Joshua Göke; Tobias Grimm; Benedikt Meier; Annika Raatz

doi:10.1007/978-3-030-05931-6_7

Gesture-based robot programming using microsoft kinect

Sebastian Blankemeyer^*, Joshua Göke, Tobias Grimm, Benedikt Meier, Annika Raatz

^*Corresponding author for this work

Institute for Assembly Technology and Robotics

Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review

Abstract

Companies have to face constantly changing framework conditions. Product lifecycles are reduced and the number of variants increase as a result of increasing product individualization. To ensure that production systems such as robots can achieve this flexibility, more and more programming procedures are being developed that do not require a high level of qualification. This thesis deals with an intuitive approach that can be used for programming adhesive joints. With the help of the simple pointing to surfaces, a path corresponding to the intersection line of the two planes is calculated. The required algorithm for fingertip recognition is implemented with the help of Voronoi diagrams. The recognition of the planes is based on a region growing algorithm. The accuracy of the whole process is limited by the current technical state of the art and does not yet meet the necessary requirements.

Original language	English
Title of host publication	Precision Assembly in the Digital Age
Subtitle of host publication	8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018, Revised Selected Papers
Editors	Svetan Ratchev
Publisher	Springer
Pages	72-81
Number of pages	10
Edition	1.
ISBN (Electronic)	978-3-030-05931-6
ISBN (Print)	978-3-030-05930-9
DOIs	https://doi.org/10.1007/978-3-030-05931-6_7
Publication status	Published - 31 Dec 2018
Event	8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018 - Chamonix, France Duration: 14 Jan 2018 → 16 Jan 2018

Publication series

Name	IFIP Advances in Information and Communication Technology (IFIPAICT)
Volume	530
ISSN (Print)	1868-4238
ISSN (Electronic)	1868-422X

Conference

Conference	8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018
Country/Territory	France
City	Chamonix
Period	14 Jan 2018 → 16 Jan 2018

Keywords

Gesture recognition
Intuitive human machine interface
Robot programming

ASJC Scopus subject areas

Information Systems
Computer Networks and Communications
Information Systems and Management

Access to Document

10.1007/978-3-030-05931-6_7

https://hal.inria.fr/hal-02115857/file/478022_1_En_7_Chapter.pdfLicence: CC BY 4.0

Cite this

Blankemeyer, S., Göke, J., Grimm, T., Meier, B., & Raatz, A. (2018). Gesture-based robot programming using microsoft kinect. In S. Ratchev (Ed.), Precision Assembly in the Digital Age: 8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018, Revised Selected Papers (1. ed., pp. 72-81). (IFIP Advances in Information and Communication Technology (IFIPAICT); Vol. 530). Springer. https://doi.org/10.1007/978-3-030-05931-6_7

Blankemeyer, Sebastian ; Göke, Joshua ; Grimm, Tobias et al. / Gesture-based robot programming using microsoft kinect. Precision Assembly in the Digital Age: 8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018, Revised Selected Papers. editor / Svetan Ratchev. 1. ed. Springer, 2018. pp. 72-81 (IFIP Advances in Information and Communication Technology (IFIPAICT)).

@inproceedings{13fa99014cda4f4e8b9fe4f41f43c632,

title = "Gesture-based robot programming using microsoft kinect",

abstract = "Companies have to face constantly changing framework conditions. Product lifecycles are reduced and the number of variants increase as a result of increasing product individualization. To ensure that production systems such as robots can achieve this flexibility, more and more programming procedures are being developed that do not require a high level of qualification. This thesis deals with an intuitive approach that can be used for programming adhesive joints. With the help of the simple pointing to surfaces, a path corresponding to the intersection line of the two planes is calculated. The required algorithm for fingertip recognition is implemented with the help of Voronoi diagrams. The recognition of the planes is based on a region growing algorithm. The accuracy of the whole process is limited by the current technical state of the art and does not yet meet the necessary requirements.",

keywords = "Gesture recognition, Intuitive human machine interface, Robot programming",

author = "Sebastian Blankemeyer and Joshua G{\"o}ke and Tobias Grimm and Benedikt Meier and Annika Raatz",

year = "2018",

month = dec,

day = "31",

doi = "10.1007/978-3-030-05931-6_7",

language = "English",

isbn = "978-3-030-05930-9",

series = "IFIP Advances in Information and Communication Technology (IFIPAICT)",

publisher = "Springer",

pages = "72--81",

editor = "Svetan Ratchev",

booktitle = "Precision Assembly in the Digital Age",

address = "Germany",

edition = "1.",

note = "8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018 ; Conference date: 14-01-2018 Through 16-01-2018",

}

Blankemeyer, S, Göke, J, Grimm, T, Meier, B & Raatz, A 2018, Gesture-based robot programming using microsoft kinect. in S Ratchev (ed.), Precision Assembly in the Digital Age: 8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018, Revised Selected Papers. 1. edn, IFIP Advances in Information and Communication Technology (IFIPAICT), vol. 530, Springer, pp. 72-81, 8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018, Chamonix, France, 14 Jan 2018. https://doi.org/10.1007/978-3-030-05931-6_7

Gesture-based robot programming using microsoft kinect. / Blankemeyer, Sebastian; Göke, Joshua; Grimm, Tobias et al.
Precision Assembly in the Digital Age: 8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018, Revised Selected Papers. ed. / Svetan Ratchev. 1. ed. Springer, 2018. p. 72-81 (IFIP Advances in Information and Communication Technology (IFIPAICT); Vol. 530).

Research output: Chapter in book/report/conference proceeding › Conference contribution › Research › peer review

TY - GEN

T1 - Gesture-based robot programming using microsoft kinect

AU - Blankemeyer, Sebastian

AU - Göke, Joshua

AU - Grimm, Tobias

AU - Meier, Benedikt

AU - Raatz, Annika

PY - 2018/12/31

Y1 - 2018/12/31

N2 - Companies have to face constantly changing framework conditions. Product lifecycles are reduced and the number of variants increase as a result of increasing product individualization. To ensure that production systems such as robots can achieve this flexibility, more and more programming procedures are being developed that do not require a high level of qualification. This thesis deals with an intuitive approach that can be used for programming adhesive joints. With the help of the simple pointing to surfaces, a path corresponding to the intersection line of the two planes is calculated. The required algorithm for fingertip recognition is implemented with the help of Voronoi diagrams. The recognition of the planes is based on a region growing algorithm. The accuracy of the whole process is limited by the current technical state of the art and does not yet meet the necessary requirements.

AB - Companies have to face constantly changing framework conditions. Product lifecycles are reduced and the number of variants increase as a result of increasing product individualization. To ensure that production systems such as robots can achieve this flexibility, more and more programming procedures are being developed that do not require a high level of qualification. This thesis deals with an intuitive approach that can be used for programming adhesive joints. With the help of the simple pointing to surfaces, a path corresponding to the intersection line of the two planes is calculated. The required algorithm for fingertip recognition is implemented with the help of Voronoi diagrams. The recognition of the planes is based on a region growing algorithm. The accuracy of the whole process is limited by the current technical state of the art and does not yet meet the necessary requirements.

KW - Gesture recognition

KW - Intuitive human machine interface

KW - Robot programming

UR - http://www.scopus.com/inward/record.url?scp=85059955067&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-05931-6_7

DO - 10.1007/978-3-030-05931-6_7

M3 - Conference contribution

AN - SCOPUS:85059955067

SN - 978-3-030-05930-9

T3 - IFIP Advances in Information and Communication Technology (IFIPAICT)

SP - 72

EP - 81

BT - Precision Assembly in the Digital Age

A2 - Ratchev, Svetan

PB - Springer

T2 - 8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018

Y2 - 14 January 2018 through 16 January 2018

ER -

Blankemeyer S, Göke J, Grimm T, Meier B, Raatz A. Gesture-based robot programming using microsoft kinect. In Ratchev S, editor, Precision Assembly in the Digital Age: 8th IFIP WG 5.5 International Precision Assembly Seminar, IPAS 2018, Revised Selected Papers. 1. ed. Springer. 2018. p. 72-81. (IFIP Advances in Information and Communication Technology (IFIPAICT)). doi: 10.1007/978-3-030-05931-6_7

Gesture-based robot programming using microsoft kinect

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Cite this