WO2015025305A1

WO2015025305A1 - Method and device for providing karaoke applications with augmented reality

Info

Publication number: WO2015025305A1
Application number: PCT/ID2014/000010
Authority: WO
Inventors: Michel Budi WIRJATMO
Original assignee: Pt Wirya Inovasi
Priority date: 2013-08-23
Filing date: 2014-08-22
Publication date: 2015-02-26

Abstract

This invention is related to the methods and devices used to implement a Karaoke Application with Augmented Reality. The image of the user's object will be displayed together with virtual objects in Augmented Reality applications from one screen during singing. The incorporation of karaoke activities with virtual objects / artist in Augmented Reality in a display screen in one frame will provide an entertainment experience in the Karaoke entertainment industry.

Description

METHOD AND DEVICE FOR PROVIDING KARAOKE APPLICATIONS WITH

AUGMENTED REALITY

Invention technical field

Invention relates to the methods and devices used to implement Karaoke application with Augmented Reality with an impact for the user, namely entertaining singing as if they are singing with the real singers in a display in real time.

Background of the invention

Karaoke is a form of entertainment in which a man sings with the music and lyrics text shown on a television screen.

Augmented Reality is a technology that combines two- dimensional or three-dimensional virtual objects into a real three-dimensional environment and projects the virtual objects in real time. Unlike virtual reality which completely replaces reality, Augmented Reality simply adds or complements reality.

Virtual objects display information received by the user through a display screen. This makes Augmented Reality a tool to help user' s perception and interaction between the virtual world and the real world. The information displayed by the virtual objects helps user carry out activities in the real world.

Karaoke as we all know allow a user to sing by following the text on the display screen, in which the display shows virtual animation, text and video content.

Meanwhile the simple form of Augmented Reality has been used in the field of entertainment and news for quite a long time. An example is television weather report where the reporter is shown standing in front of changing weather maps. In the studio, the reporter is actually standing in front of a blue or green screen. The real imaging is mixed with computer-generated maps using certain techniques.

Based on the description above, a description of the method performed for manufacturing process can be obtained, namely as follows:

1. Placing two separate and different media to capture images through the camera, namely the media for animation studio and media for the user's space;

2. Animating process and capturing images from the user; 3. Conducting a separate process for the incorporation of both the media and transformation of the image into a picture frame with the expected combined form, such as a reporter with weather animated background.

In all three processes above, there are disadvantages namely they needed some time apart to be allocated by the manufacturer to produce a composite image expected, such as the process of combining the images acquiring the view in the display.

In addition, a user cannot enjoy the show at real time, or in other words they will have to wait for the merged images to be displayed.

Through this invention, the inventor intends to apply a method and device that combines Karaoke and Augmented Reality, allowing user to see (in vision) and interact and feel an experience of singing together as a real object with a virtual object, namely at the same time the user and virtual feature (for example the real singer) can move at a real time together in a single frame of the display screen when the user is singing a song.

With this invention, a merger can then be maximized, so that the interaction between a user that can be real objects and virtual objects (moving objects raised by the augmented reality technology) will occur instantly so a user will enjoy the entertainment experience with the presence of movements of virtual objects in reality not only in video content instantly.

Brief description of the invention

This invention relates to a method and device used to apply Karaoke application with Augmented Reality. Previously, in Karaoke application, only video content is presented; now the inventor aims to create a method and device that can combines Karaoke with Augmented Reality, so that a user can also be real objects and feel the experience of interaction with motion virtual objects (for example the real singer) , not only in the form of video content.

In the present invention, the device needed is the integration of digital content of Augmented Reality, camera for user object and screen to display the results directly in real time.

The more detail method of work of the method and device for the application of Augmented Reality will be explained in the complete description of the invention.

DESCRIPTION OF THE DRAWINGS

Figure 1 shows the flowchart of Karaoke application with Augmented Reality;

Figure 2 shows a diagram of the parts of an application device for applying Karaoke application with Augmented Reality;

Index in relation with Figure

1 Processing Unit

2 Camera

3 Screen display 4 Karaoke device

Detailed description of the invention

This invention relates to the method and devices used to implement an application merging Karaoke with Augmented Reality .

Through this invention, the inventor intends to apply a method and device that combines Karaoke and Augmented Reality, allowing a user to see (in vision) and interact and feel an experience of singing together as a real object with a virtual object, namely at the same time the user and virtual feature (for example the real singer) can move at a real time together in a single frame of the display screen when the user is singing a song.

With this invention, a merger can then be maximized, so that the interaction between a user that can be real objects and virtual objects (moving objects raised by the augmented reality technology) will occur instantly so the user will enjoy the entertainment experience as if they are singing with the real singer in a screen.

In the present invention, the method that must be done before merging Karaoke application with Augmented Reality is as follows:

1. Performing Processing Unit(l) in advance by Augmented Reality software using a computer for integrating the virtual objects selected in each song, in this matter they can be the characters of the real singers or other virtual figures inside each digital track content;

2. Determining the input from the device namely camera(2), which figure of user's object being record and the other side selected virtual object figure for seach song based on the desired objects of the user and input from karaoke device (4) as audio in separate device;

3. Displaying instantly on the screen display (3) as output from processing unit(l) and incorporated karaoke content with augmented reality content and real objects / user's objects resulting in the user singing with virtual objects / motion real singer figure.

In this invention, the devices used to apply Karaoke application with Augmented Reality are as follows:

1. Processing Unit(l), which is used for processing input from camera in the forms of incorporation real objects and Karaoke application and Augmented Reality in the forms of virtual objects for instance the figure of the real singer into every Karaoke song provided in digital content base on software;

2. Camera(2), which will be used to display the real condition of the user's object that will be displayed along with the background;

3. Screen display (3) which will be used to display as output from processing unit(l) the result of incorporation namely camera (2) of image input in the forms of the user's real objects and Karaoke applications integrated with Augmented Reality;

4. Karaoke device(4), which will be used to receive audio analog signals from the user's objects;

In this invention, there are two components interacting simultaneously, namely the camera and Augmented Reality software in the computer so that the user' s motion objects can instantly follow the karaoke content that has been merged with Augmented Reality. Meanwhile, audio device is a separate device that is not fused to the digital processing tool.

Description of the working method of Karaoke application with Augmented Reality is as stated in figure 1, with the explanation as follows:

- Karaoke software application in processing unit(l) with Augmented Reality is activated;

- the user selects the virtual artist / figure and song; - the camera (2) has been activated will take the pictures of the user's objects;

- displaying the results directly on screen display (3) along with the user's object and artist / Augmented Reality's virtual objects during the karaoke as if the user was singing a duet with the real singer;

- By using Karaoke device (4), signal audio along singing period would be processed in separate device with processing unit(l) that only for processing audio signal ;

- The Augmented Reality's virtual objects can also be displayed to be captured if the user would like to take pictures with the Augmented Reality's object (in this case it can be the artist or other Augmented Reality's object via computer or separate camera photo;

By not limiting the invention, the need for karaoke with Augmented Reality can be expanded to meet the desired requirements for the sake of the perfect invention.

Claims

A method of applying .Karaoke Application with Augmented Reality which comprise:

Activating of image recording of user's object through camera (2) directly,

Activating karaoke applications with Augmented Reality in processing unit(l),

activating Karaoke device (4) for facilitating audio signal along singing periode,

Displaying the results of processing unit(l) by merging karaoke software with Augmented Reality through the display screen (3),

A method as in claim 1, wherein the activation of recording through the camera of figure user along singging periode.

A method as in claim 1, wherein activating processing unit(l) using Karaoke application software with Augmented Reality that results in screen display (3) the user's object and Augmented Reality virtual objects together in a display.

The device for applying Karaoke application with Augmented Reality consists of: a. Unit Processing ( 1 ) such as computers, used to processing input from the camera and Karaoke applications software with Augmented Reality;

b. Camera(2), which will be used to display the real condition of the user's object that will be displayed along with the background;

c. screen display(3), which will be used to display as output from processing unit(l) the result of incorporation namely camera (2) of image input in the forms of the user's real objects and Karaoke applications integrated with Augmented Reality;

d. Karaoke device (4), which will be used to accept analog audio signals from the user's object;