Forrest Hill – cannot install bandmat

[Giorgia M]

Hello,

While updating the python packages, the installation of bandmat has failed. See error message:

QUOTE:
Collecting bandmat
Using cached bandmat-0.5.tar.gz
Installing collected packages: bandmat
Running setup.py install for bandmat
Complete output from command /usr/bin/python -c “import setuptools, tokenize;__file__=’/tmp/pip-build-e9MJSi/bandmat/setup.py’;exec(compile(getattr(tokenize, ‘open’, open)(__file__).read().replace(‘\r\n’, ‘\n’), __file__, ‘exec’))” install –record /tmp/pip-vYbxxB-record/install-record.txt –single-version-externally-managed –compile –user –prefix=:
running install
running build
running build_py
creating build
creating build/lib.linux-x86_64-2.7
creating build/lib.linux-x86_64-2.7/bandmat
copying bandmat/test_misc.py -> build/lib.linux-x86_64-2.7/bandmat
copying bandmat/test_linalg.py -> build/lib.linux-x86_64-2.7/bandmat
copying bandmat/test_full.py -> build/lib.linux-x86_64-2.7/bandmat
copying bandmat/test_core.py -> build/lib.linux-x86_64-2.7/bandmat
copying bandmat/__init__.py -> build/lib.linux-x86_64-2.7/bandmat
copying bandmat/test_testhelp.py -> build/lib.linux-x86_64-2.7/bandmat
copying bandmat/test_tensor.py -> build/lib.linux-x86_64-2.7/bandmat
copying bandmat/testhelp.py -> build/lib.linux-x86_64-2.7/bandmat
copying bandmat/test_overlap.py -> build/lib.linux-x86_64-2.7/bandmat
running build_ext
building ‘bandmat.full’ extension
creating build/temp.linux-x86_64-2.7
creating build/temp.linux-x86_64-2.7/bandmat
gcc -pthread -fno-strict-aliasing -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong –param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -DNDEBUG -O2 -g -pipe -Wall -Wp,-D_FORTIFY_SOURCE=2 -fexceptions -fstack-protector-strong –param=ssp-buffer-size=4 -grecord-gcc-switches -m64 -mtune=generic -D_GNU_SOURCE -fPIC -fwrapv -fPIC -I/usr/include/python2.7 -c bandmat/full.c -o build/temp.linux-x86_64-2.7/bandmat/full.o -Wno-unused-but-set-variable -O3
bandmat/full.c:237:31: fatal error: numpy/arrayobject.h: No such file or directory
#include “numpy/arrayobject.h”
^
compilation terminated.
error: command ‘gcc’ failed with exit status 1

—————————————-
Command “/usr/bin/python -c “import setuptools, tokenize;__file__=’/tmp/pip-build-e9MJSi/bandmat/setup.py’;exec(compile(getattr(tokenize, ‘open’, open)(__file__).read().replace(‘\r\n’, ‘\n’), __file__, ‘exec’))” install –record /tmp/pip-vYbxxB-record/install-record.txt –single-version-externally-managed –compile –user –prefix=” failed with error code 1 in /tmp/pip-build-e9MJSi/bandmat
UNQUOTE

It looks like this package is needed for DNN training, which has failed too.

We have tried on two different machines, and same result.

Anything we can do?

Thanks

[Felipe E]

Hi Giorgia,

Bandmat is included in the DNN code.

Could you post the error thrown by the DNN code?

Thanks,

Felipe

[Giorgia M]

Hi, I am using the iMac now (in the Psychology basement), and I get the same error. See the error thrown at DNN training.

QUOTE

ppls-atlab-010:Ossian s1566512$ python ./scripts/train.py -s rss_toy_demo -l rm msc_demo_02
— Gather corpus
— Train voice
/mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/train//rm/speakers/rss_toy_demo/msc_demo_02
/mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/voices//rm/rss_toy_demo/msc_demo_02
Load voice from /mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/recipes/msc_demo_02.cfg …
*** voice loading processor tokeniser ***
BasicTokenisers.RegexTokeniser —
*** voice loading processor token_classifier ***
BasicTokenisers.RegexClassifier —
*** voice loading processor token_safetexter ***
BasicTokenisers.SafeTextMaker —
*** voice loading processor segment_adder ***
BasicTokenisers.RegexTokeniser —
*** voice loading processor letter_safetexter ***
BasicTokenisers.SafeTextMaker —
*** voice loading processor end_silence_adder ***
SimpleChildAdder.SimpleChildAdder —
*** voice loading processor letter_vsm ***
VSMTagger.VSMTagger —
*** voice loading processor word_vsm ***
VSMTagger.VSMTagger —
*** voice loading processor punc_adder ***
SimpleChildAdder.SimpleChildAdder —
*** voice loading processor space_adder ***
SimpleChildAdder.SimpleChildAdder —
*** voice loading processor align_label_dumper ***
FeatureDumper.FeatureDumper —
*** voice loading processor speech_feature_extractor ***
FeatureExtractor.WorldExtractor —
*** voice loading processor aligner ***
Aligner.StateAligner —
*** voice loading processor pause_predictor ***
SKLProcessors.SKLDecisionTree —
*** voice loading processor phrase_adder ***
PhraseMaker.PhraseMaker —
*** voice loading processor dur_data_maker ***
FeatureDumper.FeatureDumper —
*** voice loading processor dur_label_maker ***
FeatureDumper.FeatureDumper —
*** voice loading processor duration_predictor ***
NN.NNDurationPredictor —
Traceback (most recent call last):
File “./scripts/train.py”, line 147, in <module>
main_work()
File “./scripts/train.py”, line 82, in main_work
train(opts, dirs)
File “./scripts/train.py”, line 118, in train
dirs, clear_old_data=opts.clear, max_cores=opts.max_cores)
File “/mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/scripts/main/Voice.py”, line 104, in __init__
self.config[self.run_mode].walk(self._load_item, call_on_sections=False)
File “/Users/s1566512/Library/Python/2.7/lib/python/site-packages/configobj.py”, line 894, in walk
val = function(self, entry, **keywargs)
File “/mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/scripts/main/Voice.py”, line 117, in _load_item
self.config[stage].walk(self._load_item, call_on_sections=False)
File “/Users/s1566512/Library/Python/2.7/lib/python/site-packages/configobj.py”, line 894, in walk
val = function(self, entry, **keywargs)
File “/mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/scripts/main/Voice.py”, line 123, in _load_item
self.load_processor(proc_name)
File “/mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/scripts/main/Voice.py”, line 167, in load_processor
ClassName = dynamic_load_object(class_string) ## , model=model)
File “/mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/scripts/main/Voice.py”, line 386, in dynamic_load_object
m = __import__(module )
File “/mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/scripts/processors/NN.py”, line 35, in <module>
from frontend.mlpg_fast import MLParameterGenerationFast
File “/mnt/courses.homes/s1566512/Desktop/ossian_msc_2016_test/Ossian/scripts/processors/../../tools/dnn_tts/frontend/mlpg_fast.py”, line 53, in <module>
import bandmat as bm
ImportError: No module named bandmat

UNQUOTE

Thanks

[Felipe E]

Hi Giorgia,

Uncomment the line 49 of the file mlpg_fast.py:

#import pyximport; pyximport.install()

… and try again.

Thanks,

Felipe

[Giorgia M]

Solved by:

1. uncommenting line 49 of the file mlpg_fast.py
2. commenting lines 53 and 54 of the same file
3. installing the full cython package (it wouldn’t let install only pyximport): pip install –user cython

Thanks

[Giorgia M]

Still related to Bandmat:

I have completed the DNN training with 1 hour of speech (Italian, from Tundra). I am trying to synthesise now, but one of the files involved in synthesis is mlpg_fast.py which calls bandmat on various occasions. Specifically, the error I get is related to line 69:

Error QUOTE:

File “/afs/inf.ed.ac.uk/user/s15/s1566512/ossian_msc_2016_test/Ossian/scripts/processors/../../tools/dnn_tts/frontend/mlpg_fast.py”, line 69, in build_win_mats
win_mat = bm.band_c_bm(u, l, win_coeffs).T
NameError: global name ‘bm’ is not defined

Error UNQUOTE

If I replace

win_mat = bm.band_c_bm(u, l, win_coeffs).T

with

win_mat = pyximport.band_c_bm(u, l, win_coeffs).T

I get this error:

QUOTE

File “/afs/inf.ed.ac.uk/user/s15/s1566512/ossian_msc_2016_test/Ossian/scripts/processors/../../tools/dnn_tts/frontend/mlpg_fast.py”, line 69, in build_win_mats
win_mat = pyximport.band_c_bm(u, l, win_coeffs).T
AttributeError: ‘module’ object has no attribute ‘band_c_bm’

UNQUOTE

How can I go ahead?

Thanks

[Felipe E]

Hi Georgia,

What is the error thrown if you keep the lines 49, 53 and 54 uncommented?

Thanks,

Felipe

[Giorgia M]

Hi Felipe,

The error thrown with lines 49, 53 and 54 uncommented is:

QUOTE
File “/afs/inf.ed.ac.uk/user/s15/s1566512/ossian_msc_2016_test/Ossian/scripts/processors/../../tools/dnn_tts/frontend/mlpg_fast.py”, line 53, in <module>
import bandmat as bm
ImportError: No module named bandmat
UNQUOTE

This looks like a vicious circle. I can’t escape bandmat! 😉

Thanks

[Simon]

There is a working version of bandmat here

/Volumes/Network/courses/ss/dnn/dnn_tts/bandmat

[Srikanth R]

Try installing bandmat in virtual environment of python by following below steps:

1. If you don’t have one, you can setup the python virtual environment following the steps in below link:
http://computing.help.inf.ed.ac.uk/python

2. Install bandmat: pip install bandmat

3. If you are running into any gcc errors with numpy while installing bandmat, use below export command (assuming you are using python version 2.7) and run the install command again:
export CFLAGS=-I/usr/lib64/python2.7/site-packages/numpy/core/include/

[Felipe E]

Georgia,

If all of that does not work, also you can try by: pip install -user bandmat

Felipe

[Giorgia M]

Thanks everyone.

Point 3 in Shrikanth’s post solved it. Bandmat installed on DICE machine!

[Author]

Posts