Sphinx 4.0 Video Tutorial ( High Quality )

hi puneet
I followed your video tutorial. HelloWorld runs without any exception. But it is not responding for any input. Even for Ctrl-C. Any suggestion..

/regards

hi Puneet Kalra.
thank you for answer.

i need to develop speech recognition application that will recognize arabic languages

so i need some help from you

Hi Puneet,

I was trying to build an example which uses freetts and sphinx.
But i am getting Exception in thread “AWT-EventQueue-0″ java.lang.NoSuchFieldError: engineListeners
at com.sun.speech.engine.recognition.BaseRecognizer.fireRecognizerSuspended(BaseRecognizer.java:922)
at com.sun.speech.engine.recognition.BaseRecognizer.dispatchSpeechEvent(BaseRecognizer.java:1262)
at com.sun.speech.engine.SpeechEventUtilities$SpeechAWTEventTarget.processEvent(SpeechEventUtilities.java:219)

am using freetts-1.2 and sphinx4 related jars.

I looked into jsapi impl of both frameworks

the jsapi implementation of BaseEngine which contains engineListners in freetts and sphinx differs. It is defined as Collection in freetts and Vector/List in sphinx4

Please guide me on this.

Thanks & Regards

hello

thank you for a nice video.but when i implement it in netbeans the createRecognizers() return null.

Synthesizer synth = Central.createRecognizer(new SynthesizerModeDesc(Locale.ENGLISH));

can you tell me why i face the problem.

Hi puneet,

Can we do the same task of adding words dynamically without using sphinx….building hmms

If anyone can help you are most welcome..its urgent..

Hey Puneet, thanks alot for replying to my post. I did google about FSI implementation and found about Visual F# and trying to get more info on it.(Is it the one you are talking about?)
But I have no knowledge about it and was unable to find how it will be used in our project. Can you please throw some more light on it:)

Dear Puneet!!

Thanks for make available all stuff of Sphinx in very good manner. I go through ur website, you have a great interest of ROBOTICS!! thats really good buddy.

I am new user & developer of Sphinx4, so i have some basic problems.

1) I have successfully configure sphinx4 on Fedora14 and also able to run their demos (i.e. HelloWord…etc)

2) Now I try to start prepared my on Isolated Word Recognition[IWR].

3) I have recorded 50 words on my voice in a single wave file.

4) I found one tutorial to build IWR in Linux that I used and prepared the system.
/////////////////////////////////////////////////////////
Training Phase
************
Assume that we have installed SphinxTrain and Sphinx-4 under the directory /home/workshop/speech.

STEP-1
******

Do the following steps in terminal command line

1) Change to the directory ’speech’.

cd speech

2) Create a directory on the name of model which you are going to train.

3) For isolatedmodel speech, let us create directory called ‘isolatedmodel’.

mkdir ‘isolatedmodel’

4) Change to the directory ‘isolatedmodel’

cd isolatedmodel

5) create the directory called ‘wav’ using the command

mkdir wav

copy all of your wav files used for training into this directory.

6) Go back to the ‘isolatedmodel’ directory

7) Create directory named ‘etc’

mkdir ‘etc’.

In the ‘etc’ directory, create the following files using text editor ‘gedit’

a) Use the following commands in terminal to create files

gedit isolatedmodel.dic

Then save it to /home/workshop/speech/isolatedmodel/etc

gedit isolatedmodel.phone

Then save it to /home/workshop/speech/isolatedmodel/etc

gedit isolatedmodel.filler

Then save it to /home/workshop/speech/isolatedmodel/etc

gedit isolatedmodel_train.transcription

Then save it to /home/workshop/speech/isolatedmodel/etc

gedit isolatedmodel_train.fileids

Then save it to /home/workshop/speech/isolatedmodel/etc

A) isolatedmodel.dic :- phonetic dictionary

This file contains the vocabulary which is spoken in the speech data and pronunciation i.e. phonetic sequence.

a) Copy all the words from your wordlist into ‘isolatedmodel.dic’ file.

b) Sort the file using the following commands

sort -u isolatedmodel.dic > temp

mv temp isolatedmodel.dic

b) After each word,

press the tab

then give the phonetic sequence i.e. the phones that are used in the pronunciation that word.

Phonetic dictionary structure
**********************
అంకెలు a M k e l u
అంటే a M t E

B) isolatedmodel.filler :- filler words

Copy below three lines to isolatedmodel.filler
*****************************

SIL
SIL
SIL

C) isolatedmodel.phone: This file contains phones that are considered in building the phonetic dictionary

use the program ‘create-phonelist.pl’ from the workshop-material/isolated-programs to create phone list from your dictionary

a) copy ‘isolatedmodel.dic’ to your workshop-material/isolated-programs directory

b) change to the isolated-programs directory in the command line

use the following command

perl create-phonelist.pl

At the end of phone list, please add the phone ‘SIL’ to phonelist.

copy the ‘isolatedmodel.phone’ file to your ‘isolatedmodel/etc/’ directory.

D) isolatedmodel_train.transcription

This file contains the information about words or sentences that are spoken in speech data and corresponding wav file names.

structure
********
If there is one word or sentence for each wav file

word (correcsponding wav file name)

if there are multiple words in the wav file

word word word (correcsponding wav file name)

Structure
********

అంతఃపురము అంతరము అంతర్యామి అక్షరము అమృతము అమ్మ ఆవు ఇల్లు ఈగ ఉడుత (ramesh)

అంతఃపురము అంతరము అంతర్యామి అక్షరము అమృతము అమ్మ ఆవు ఇల్లు ఈగ ఉడుత (suresh)

అంతఃపురము అంతరము అంతర్యామి అక్షరము అమృతము అమ్మ ఆవు ఇల్లు ఈగ ఉడుత (mahesh)

E ) isolatedmodel_train.fileids

This file contains list of wav files you are using for the training

In the file names, you have to remove the extension .wav

Structure
*******

ramesh
suresh
mahesh

Note: Please check all the above files at the end and remove if there are empy lines in the end. They should not have any empty line in the end.

STEP-2
******

Once you have the above files ready

9) Go to the directory ’sphinxtrain’.

10) Give the following command to create model

perl scripts_pl/setup_tutorial.pl isolatedmodel

This command will copy all necessary files for training into the ‘isolatedmodel’ directory.

11) Go back to the ‘isolatedmodel directory. Copy the wave2feat binary from ‘bin’ to ‘isolatedmodel’ directory

cp ../bin/wave2feat .

12) Run the following command to extract features

./wave2feat -mswav yes -ei wav -di wav -c etc/isolatedmodel_train.fileids -eo mfc -do feat

13) Run the following command to train your acoustic model.

perl scripts_pl/RunAll.pl

Note: If you want to do any modifications to the sphinx configuration, please open the file /etc/sphinx_train.cfg

A) Number of states per HMM can be modified in the line 101

B) Number of Guassian densities can be modified in the line 107

C) Number of senones can be modified in the line 120

Testing Phase
***********

1) Copy acoustic.pl to ’speech’ directory from the directory ‘workshop-material/isolated-programs’

2) Go to the speech directory,

3) Run the perl program,

perl acoustic.pl isolatedmodel isolated

This program will create a new directory called ‘isolated’ in ’speech’ directory.

4) Copy this directory ‘isolated’ to the directory ’sphinx4/models/acoustic’

5) Copy newlm-isolated.pl to ’sphinx4/src/apps/edu/cmu/sphinx/demo’ directory from the directory ‘workshop-material/isolated-programs’

6) Go to the directory ’sphinx4/src/apps/edu/cmu/sphinx/demo’

perl newlm-isolated.pl helloisolated isolated

This program will create the new directory called ‘helloisolated’ in your ’sphinx4/src/apps/edu/cmu/sphinx/demo’ directory

7) Now, we have to create the jsgf grammar file for the isolated speech recognition. Go to the ‘workshop-material/isolated-programs’ directory.

Open ‘create-grammar.pl’ program and give appropriate file name that contains wordlist as input file.

9) Run the perl program in the command line

perl create-grammar.pl

This will create ‘hello.gram’ file. copy it to the ’sphinx4/src/apps/edu/cmu/sphinx/demo/helloisolated/’ directory.

10) Go back to ’sphinx4′ directory

11) Open ‘build.xml’ with gedit. In the build.xml file you have to add, the following lines, in the appropriate sections

in the above section, add the following two lines

in the above section, add the following lines

11) Open ‘demo.xml’ with gedit. In the demo.xml file

In the Following section,

add the following line

compile_sphinx_helloisolated,

After the above section add following lines

12) Now in the terminal command line, go to ’sphinx4′ directory.

13) Run the following command

ant

This will create all necessary jar files in your ‘bin’ and ‘lib’ directories.

14) Now, one can start testing the speech recognition system.

15) In the terminal, go the ’sphinx4′ directory.

use the command,

java -jar -Xms512m bin/HelloIsolated.jar

//////////////////////////////////////////////////////////
5) After following all instruction from tutorial i get jar file when i run this jar file I am getting following error.
/////////////error/////////////////////////////////////////
no args
Exception in thread “main” java.lang.RuntimeException: Allocation of search manager resources failed
at edu.cmu.sphinx.decoder.search.SimpleBreadthFirstSearchManager.allocate(SimpleBreadthFirstSearchManager.java:651)
at edu.cmu.sphinx.decoder.AbstractDecoder.allocate(AbstractDecoder.java:87)
at edu.cmu.sphinx.recognizer.Recognizer.allocate(Recognizer.java:168)
at edu.cmu.sphinx.demo.hellopsd.HELLOPSD.main(HELLOPSD.java:39)
Caused by: java.io.IOException: edu.cmu.sphinx.jsgf.JSGFGrammarParseException
at edu.cmu.sphinx.jsgf.JSGFGrammar.createGrammar(JSGFGrammar.java:302)
at edu.cmu.sphinx.linguist.language.grammar.Grammar.allocate(Grammar.java:116)
at edu.cmu.sphinx.linguist.flat.FlatLinguist.allocate(FlatLinguist.java:300)
at edu.cmu.sphinx.decoder.search.SimpleBreadthFirstSearchManager.allocate(SimpleBreadthFirstSearchManager.java:646)
… 3 more
Caused by: edu.cmu.sphinx.jsgf.JSGFGrammarParseException
at edu.cmu.sphinx.jsgf.parser.JSGFParser.newGrammarFromJSGF(JSGFParser.java:132)
at edu.cmu.sphinx.jsgf.parser.JSGFParser.newGrammarFromJSGF(JSGFParser.java:241)
at edu.cmu.sphinx.jsgf.JSGFGrammar.loadNamedGrammar(JSGFGrammar.java:694)
at edu.cmu.sphinx.jsgf.JSGFGrammar.commitChanges(JSGFGrammar.java:610)
at edu.cmu.sphinx.jsgf.JSGFGrammar.createGrammar(JSGFGrammar.java:298)
… 6 more

//////////////////////////////////////////////////////////////
can you tell me where I am making mistakes!!!

Thanks Brother !!!!!! I am waiting for ur response