Masayuki Takigahira

Forum Replies Created

Viewing 10 posts - 46 through 55 (of 55 total)
  • Author
    Posts
  • in reply to: Sound Source Localization with suppression of constant noise #448

    I identified the cause by checking your network file (PreMeasuredNoiseSSL.n).
    The problem is very simple, the Gener_Pre_Measured_Noise_SSL sheet must be set to “iterator”. Right now it is set to “subnet”.
    In HARK, processing is repeated on an input stream on a frame-by-frame basis.
    Therefore, the type of the sheet created by the user placed next to the InputStream node in the MAIN sheet should be an iterator in general.
    The name of the sheet can be arbitrarily given, but as in the cookbook example, we often use the name “LOOP” for the sheet to be processed repeatedly.

    How to change:
    Left click on the tab of the target sheet and select it, then click “Change to iterator” from the pop menu displayed by right clicking.

    When creating a new sheet:
    If you click on the “+” button, You can change the “Type” parameter from “subnet” to “iterator”.

    Best regards,
    m.takigahira

    in reply to: Sound Source Localization with suppression of constant noise #442

    Please try the following.
    Run the sample network file I posted last time and check if there is an error.

    If an error occurred, the HARK installation itself may have failed. First, try reinstalling HARK. If there is no reason to use the current version, please consider updating to the latest version. If an error occurs during installation, please provide detailed error information, we can help you.

    If it can be executed without error, the noise correlation matrix file named cm.zip will be saved. In that is the case, there are two things you can do. The first is to edit the network file I posted. The second thing is to post your network file to this thread. We want to take a look at your network file.

    Notes:
    I confirmed that the sample network file “sep_rec_offline_output_cm_test.n” I posted last time can be executed even in the environment of HARK 2.2.0. Since it is a network file that does not use the new functions, so you probably can execute it with HARK 2.1.0 or later.

    The reason for downloading the HARK 2.3.0 recognition sample set is that the set of input WAV file and transfer function file can be easily obtained. Of course, recognition scripts for kaldi are only supported on hark 2.3.0 or higher. It will not work on the version you currently have.

    Best regards,
    m.takigahira

    in reply to: Sound Source Localization with suppression of constant noise #438

    Reference information

    You can try the attached sample network file.

    
    wget http://www.hark.jp/networks/HARK_recog_2.3.0.1_practice2.zip
    unzip HARK_recog_2.3.0.1_practice2.zip
    cd HARK_recog_2.3.0.1_practice2
    cp <your download path>/sep_rec_offline_output_cm_test.n ./
    batchflow ./sep_rec_offline_output_cm_test.n ./2SPK-jp.wav
    

    Sorry, this sample audio file is in Japanese.

    Best regards,
    m.takigahira

    in reply to: Sound Source Localization with suppression of constant noise #437

    I expect that the cause is the following.
    IterCount is a node that outputs frame count.
    In the cookbook the constant node uses 200 frames. Every 1 frame can be considered 10 ms. So 200 is the same as 2 seconds. (If ADVANCE is 160 samples in case of the 16 kHz sampling, one frame is 10 ms.)
    In other words, input data must be greater than 2 seconds.
    You can either lower the frames to match the length of the input file.
    Or you can increase the length of the input file to match the frame count.

    The detailed behavior of CMMakerFromFFTwithFlag is described in the HARK document. The HTML version can be found at the following URL.
    http://www.hark.jp/document/hark-document-en/subsec-CMMakerFromFFTwithFlag.html

    Also, although it is irrelevant to the calculation result, old description may remain in the cookbook manual.
    For example, since the format saved by CMSave has been changed to zip format, it is preferable to make the file name extension zip.
    http://www.hark.jp/document/hark-document-en/subsec-.html

    Best regards,
    m.takigahira

    in reply to: Sound Source Localization with suppression of constant noise #430

    >> It is the name of my input.wav?
    Yes.

    If type is set to string and file name is entered directly in the text box, processing will be done with the specified file.
    On the other hand, if you set the type to subnet_param and enter the string ARG1 in the text box you can specify the file at startup.
    This has the same effect as $1 written in the shell script.
    In other words, when you write ARG2, the contents specified by the 2nd argument in the runtime are reflected.
    It is often used when you want to perform the same processing with HARK for various input data.
    This method can be used on many other nodes, but sometimes it is necessary to explicitly indicate the type.
    In that case, specify as :ARG like string:ARG1, float:ARG3 or etc…

    Best regards,
    m.takigahira

    in reply to: KaldiDecoder(v2.4.0)で認識結果が返って来ない #428

    最小構成ではありませんが、私が動作している事を確認出来ているPC環境について記載させて頂きます。

    OS : Ubuntu 16.04.03
    CPU : Intel Core i7-7700@3.60GHz [Turbo Boost:4.2GHz], 4 cores(8 threads)
    Mem : 64GB

    以上、宜しくお願い致します。
    瀧ヶ平

    in reply to: KaldiDecoder(v2.4.0)で認識結果が返って来ない #424

    お問い合わせ、ありがとう御座います。

    こちらの環境でも同様な条件で確認させて頂きましたところ
    負荷が高くなる環境では同様の事象が発生する事を確認致しました。

    次期バージョンで修正を予定しておりますが
    ご提供までに暫く掛かってしまいますので
    ワークアラウンドをご紹介させて頂きます。

    HARKの特徴量送信ノードSpeechRecognitionSMNClientを
    SpeechRecognitionClientに置き換えて頂く事で
    同じPC環境でも認識結果を得られる事を確認しております。

    SpeechRecognitionSMNClientではSMN処理を行うために
    定位結果の該当発話区間における特徴量を一度バッファし、
    SMN処理後に一気に送信する処理を行っております。
    一方SpeechRecognitionClientではフレーム毎に特徴量を
    送信しており、KaldiDecoderの負荷が分散します。

    次期バージョンのリリースまでの期間、
    こちらのワークアラウンドにて対応をお願い致します。
    お手数をお掛けしてしまいますが宜しくお願い致します。

    以上、ご確認のほど宜しくお願い致します。
    瀧ヶ平

    in reply to: Sound Source Localization with suppression of constant noise #419

    Please set the VALUE parameter of Constant node of MAIN as follows.
    – Set type to subnet_param.
    – Enter ARG1 in the text box.
    If you execute network file on terminal, you can give an input WAV file by specifying a file name with the first argument.

    e.g.) ./network.n ./your_input.wav

    Please set no values to all parameters of InputStream node in MAIN.

    Best regards,
    m.takigahira

    in reply to: Thresh parameter in SourceTracker node #418

    SourceTracker’s Thresh is a parameter that judges whether the MUSIC spectrum power
    of the node connected to the preceding stage such as LocalizeMUSIC or not exceeds the threshold value.
    It is difficult to make physical meaning to the value of the MUSIC spectrum itself.
    Therefore, there is no unit.

    For MUSIC spectral power when LocalizeMUSIC is connected, please refer to the following formula (15) and (16) in the document.
    http://www.hark.jp/document/hark-document-en/subsec-LocalizeMUSIC.html

    Thresh differs depending on the user’s environment, so there is no recommended value,
    but you can know roughly the proper value by the following method.
    1. If you set DEBUG parameter to true on the LocalizeMUSIC node, the MUSIC spectrum power in each direction included in the transfer function is output to the stdout.
    2. In the result of this stdout, the value of the column whose numerical value rises when you speaking is the value of the MUSIC spectrum power in the sound source direction.
    3. You can check the average of the values shown during the speaking periods and the average of the values shown during the silence periods.
    4. You fine-adjust the intermediate value of the two values confirmed in step 3. as the initial value of SourceTracker’s Thresh parameter.

    Best regards,
    m.takigahira

    in reply to: C++ code of the nodes #413

    – Case.1
    If you are using Ubuntu distribution, you can easily get source codes using the following method.

    apt-get source <package-name>

    e.g.) In case of the HARK basic package’s source codes and HARK-Python source code required.
    apt-get source harkfd hark-sss hark-python

    – Case.2
    When you need an older version than the one you are currently releasing,
    or
    If you are using another Linux distribution (e.g. Debian, Mint, Fedora, Cent OS, Red Hat, Vine, etc…)
    you can download source code in tar.gz or tar.xz format from the following location.
    However, we do not officially support other than Ubuntu.
    If you use an OS other than Ubuntu, you may need to change configure.ac or/and Makefile.am.

    http://archive.hark.jp/harkrepos/dists/<code-name>/non-free/source/

    e.g.) Xenial, Trusty, Precise are as follows.
    http://archive.hark.jp/harkrepos/dists/xenial/non-free/source/
    http://archive.hark.jp/harkrepos/dists/trusty/non-free/source/
    http://archive.hark.jp/harkrepos/dists/precise/non-free/source/

    If you need a more older version please download from the bottom of the bottom on this page.
    http://www.hark.jp/wiki.cgi?page=Softwares

    Best regards,
    m.takigahira

Viewing 10 posts - 46 through 55 (of 55 total)