prikaz prve stranice dokumenta Automatic lip synchronization by speech signal analysis
No public access
scientific master's theses
Automatic lip synchronization by speech signal analysis
Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing, 2005. urn:nbn:hr:168:946018
Zorić, Goranka
University of Zagreb
Faculty of Electrical Engineering and Computing
Department of Telecommunications

Cite this document

Zorić, G. (2005). Automatic lip synchronization by speech signal analysis (Scientific master's theses). Retrieved from https://urn.nsk.hr/urn:nbn:hr:168:946018

Zorić, Goranka. "Automatic lip synchronization by speech signal analysis." Scientific master's theses, University of Zagreb, Faculty of Electrical Engineering and Computing, 2005. https://urn.nsk.hr/urn:nbn:hr:168:946018

Zorić, Goranka. "Automatic lip synchronization by speech signal analysis." Scientific master's theses, University of Zagreb, Faculty of Electrical Engineering and Computing, 2005. https://urn.nsk.hr/urn:nbn:hr:168:946018

Zorić, G. (2005). 'Automatic lip synchronization by speech signal analysis', Scientific master's theses, University of Zagreb, Faculty of Electrical Engineering and Computing, accessed 21 October 2020, https://urn.nsk.hr/urn:nbn:hr:168:946018

Zorić G. Automatic lip synchronization by speech signal analysis [Scientific master's theses]. Zagreb: University of Zagreb, Faculty of Electrical Engineering and Computing; 2005 [cited 2020 October 21] Available at: https://urn.nsk.hr/urn:nbn:hr:168:946018

G. Zorić, "Automatic lip synchronization by speech signal analysis", Scientific master's theses, University of Zagreb, Faculty of Electrical Engineering and Computing, Zagreb, 2005. Available at: https://urn.nsk.hr/urn:nbn:hr:168:946018

Islandora Bookmark - Please login to use this feature
Metadata
TitleAutomatic lip synchronization by speech signal analysis
Title (croatian)Automatska sinkronizacija usana pomoću analize govornog signala
AuthorGoranka Zorić
MentorIgor Sunday Pandžić (mentor)
Committee memberMaja Matijašević (predsjednik povjerenstva)
Committee memberIgor Sunday Pandžić (član povjerenstva)
Committee memberRobert Manger (član povjerenstva)
GranterUniversity of Zagreb
Faculty of Electrical Engineering and Computing
(Department of Telecommunications)
Zagreb
Defense date and country2005-10-21, Croatia
Scientific / art field,
discipline and subdiscipline		TECHNICAL SCIENCES
Electrical Engineering
Universal decimal classification
(UDC)		621.3
APPLIED SCIENCES. MEDICINE. TECHNOLOGY
Electrical engineering
Universal decimal classification
(UDC)		004
GENERALLY
Computer science and technology. Computing. Data processing
Abstract
This master thesis investigates automatic lip synchronization. It is a method for generating an animation of 3D human face model where the animation is driven only by a speech signal. The whole process is completely automatic and starts from the speech signal. The automatic lip synchronization consists of two main parts: audio to visual mapping and a face synthesis. The thesis proposes and implements a system for the automatic lip synchronization of synthetic 3D avatars based only on the speech input. The speech signal is classified into viseme classes using neural networks. The topology of neural networks is automatically configured using genetic algorithms. Visual representation of phonemes, viseme, defined in MPEG-4 FA, is used for face synthesis. The system is adopted for specificity of the Croatian language. Detailed system validation based on three different evaluation methods is done and potential applications of these technologies are discussed in details. This method is suitable for real-time and offline applications. It is speaker independent and multilingual.
Abstract (croatian)
Ovaj magistarski rad istražuje automatsku sinkronizaciju usana. To je metoda generiranja odgovarajuće animacije 3D modela ljudskog lica s obzirom na postojeći zvučni signal govora, tako da se dobiva animirani lik koji govori. Postupak je potpuno automatiziran i počinje od zvučnog signala govora. Automatska sinkronizacija govora sastoji se od dva dijela: preslikavanja iz ulaznog audio u izlazni vizualni skup parametara i sinteze lica. U radu je predložen i napravljen sistem za automatsku sinkronizaciju usana temeljen samo na govornom signalu. Klasifikacija govornog signala u grupe vizeme izvedena je pomoću neuronskih mreža. Optimalna topologija neuronskih mreža se automatski određuje pomoću genetičkih algoritama. Vizemi, vizualni predstavnici fonema, definirani su u MPEG-4 FA standardu, a koriste se za sintezu lica. Sistem je optimiziran za specifičnosti hrvatskog jezika. Za validaciju sistema korištene su tri različite metode testiranja., a potencijalne primjene ovakvih tehnologija izložene su do detalja. Opisana metoda za sinkronizaciju usana prikladna je za primjene u stvarnom vremenu ali i za offline produkcije. Neovisna je o govorniku i višejezična je.
Keywords
Keywords (croatian)
Languageenglish
URN:NBNurn:nbn:hr:168:946018
Study programmeTitle: Postgraduate master programme in electrical engineering
Study programme type: university
Study level: postgraduate
Academic / professional title: Magistar znanosti elektrotehnike (Magistar znanosti elektrotehnike)
Type of resourceText
File originBorn digital
Access conditionsClosed access
Terms of useLicence In copyright icon
RepositoryFER Repository
Created on2019-07-04 07:21:57

(©) Nacionalna i sveučilišna knjižnica u Zagrebu 2015. Sva prava pridržana. | Hrvatske bratske zajednice 4 p.p. 550, 10000 Zagreb, Hrvatska Tel. ++ 385 1 616-4040
OIB: 84838770814 | IBAN: HR66 2340 0091 1000 1008 1, Porezni broj (PDV identifikacijski broj) - VAT Number: HR84838770814
Prijava u repozitorij