+ Reply to Thread
Page 1 of 2 12 LastLast
Results 1 to 10 of 11

Thread: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

 
  1. #1
    Forums BodyGuard AriSanguinetti's Avatar
    Join Date
    Sep 2006
    Age
    30
    Posts
    31
    Rep Power
    100

    Wink How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    Hi!

    Follow this guide in order to install Moses on Ubuntu 10.04

    Install required packages


    Code:
    apt-get install build-essential subversion zlib1g-dev autoconf automake g++ make gawk gzip tcl8.4 tcl8.4-dev tcsh tcl-dev tclx8.4 tclx8.4-dev libtool libboost-dev libboost-graph-dev libboost-iostreams-dev libboost-program-options-dev gcc-4.1 g++-4.1 git-core
    Set GCC-4.1 as default compiler

    Code:
    update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-4.4 40
    update-alternatives --install /usr/bin/gcc gcc /usr/bin/gcc-4.1 30
    update-alternatives --config gcc
    Code:
    update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-4.4 40
    update-alternatives --install /usr/bin/g++ g++ /usr/bin/g++-4.1 30
    update-alternatives --config g++
    Default folders

    Code:
    mkdir -p /opt/tools/bin
    cd /opt/tools
    Install GIZA

    Code:
    wget http://giza-pp.googlecode.com/files/giza-pp-v1.0.5.tar.gz
    tar -xzvf giza-pp-v1.0.5.tar.gz
    cd /opt/tools/giza-pp
    make
    cd /opt/tools
    cp giza-pp/GIZA++-v2/GIZA++ bin/
    cp giza-pp/mkcls-v2/mkcls bin/
    cp giza-pp/GIZA++-v2/snt2cooc.out bin/
    Install SRILM

    Code:
    mkdir /opt/tools/srilm
    cd /opt/tools/srilm
    (get srilm download, requires web registration, you'll end up with a .tgz file to copy to this directory)

    Code:
    tar -xzvf srilm.tgz
    rm  srilm.tgz
    chmod +w Makefile
    vim Makefile
    change
    Code:
    7c7
    < # SRILM = /home/speech/stolcke/project/srilm/devel
    ---
    > SRILM = /opt/tools/srilm
    Ubuntu 32 Bits

    Code:
    make World
    make all
    Ubuntu 64 Bits

    Code:
    make MACHINE_TYPE=i686-m64 World
    make MACHINE_TYPE=i686-m64 all
    Moses need a "i686" folder to run srlim, so we need to add some links. Remember to replace VERSION according to your computer.

    Code:
    cd /opt/tools/srilm/bin
    ln -s i686-VERSION i686
    cd /opt/tools/srilm/lib
    ln -s i686-VERSION i686
    Install IRSTLM

    Code:
    cd /opt/tools
    mkdir irstlm
    svn co https://irstlm.svn.sourceforge.net/svnroot/irstlm/trunk irstlm
    cd /opt/tools/irstlm
    . regenerate-makefiles.sh
    ./configure
    make
    make install
    Install MOSES

    Code:
    cd /opt/tools
    git clone https://github.com/moses-smt/mosesdecoder.git
    mv mosesdecoder moses
    cd moses
    ./regenerate-makefiles.sh
    ./configure --with-srilm=/opt/tools/srilm --with-irstlm=/usr/local/irstlm
    Code:
    make -j 2
    (The -j 2 is optional. make -j X where X is number of simultaneous tasks is a speedier option for machines with multiple processors)

    TEST

    Code:
    cd /opt/
    mkdir data
    cd data
    wget http://www.statmt.org/moses/download/sample-models.tgz
    tar -xzvf sample-models.tgz
    cd sample-models
    /opt/tools/moses/moses-cmd/src/moses -f /opt/data/sample-models/phrase-model/moses.ini < /opt/data/sample-models/phrase-model/in > out
    Install MOSES SCRIPTS

    Code:
    cd /opt/tools
    mkdir moses-scripts
    cd /opt/tools/moses/scripts
    Code:
    vim Makefile
    Code:
    13,14c13,14
    < TARGETDIR?=/home/s0565741/terabyte/bin
    < BINDIR?=/home/s0565741/terabyte/bin
    ---
    > TARGETDIR?=/opt/tools/moses-scripts
    > BINDIR?=/opt/tools/bin/
    Code:
    make release
    Once make is finished, a folder will be created with the compiled scripts using the date of the machine in the name. Now we need to set a SCRIPTS_ROOTDIR environment variable with the path to the scripts. Replace YYYYMMDD-HHMM in the following lines according to your machine.

    Code:
    vim /etc/bash.bashrc
    export SCRIPTS_ROOTDIR=/opt/tools/moses-scripts/scripts-YYYYMMDD-HHMM
    (add at the end)

    Install OTHER SCRIPTS

    Code:
    cd /opt/tools/
    wget http://homepages.inf.ed.ac.uk/jschroe1/how-to/scripts.tgz
    tar -xzvf scripts.tgz
    cd scripts
    wget ftp://jaguar.ncsl.nist.gov/mt/resources/mteval-v11b.pl
    chmod +x mteval-v11b.pl
    More Information: Moses Installation and Training Run-Through

    Hope it helps!

  2. #2
    Senior Member
    Join Date
    Sep 2011
    Age
    31
    Posts
    253
    Rep Power
    188

    Default Re: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    Muchas gracias por compartir esta información, Ari.

  3. #3
    New Member
    Join Date
    Dec 2011
    Posts
    3
    Rep Power
    0

    Default Re: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    Hello,
    it didn't work for me
    The binary file "moses" has not been created in moses-cmd.
    The rest seems to be ok. I'm using ubuntu 10.10. g++-4.1library is not available here. Can this be the problem?
    Last edited by hermeniko; 12-28-2011 at 08:22 AM.

  4. #4
    Forums BodyGuard AriSanguinetti's Avatar
    Join Date
    Sep 2006
    Age
    30
    Posts
    31
    Rep Power
    100

    Default Re: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    Quote Originally Posted by hermeniko View Post
    I'm using ubuntu 10.10. g++-4.1library is not available here. Can this be the problem?
    Yes! I can't compile Moses with a new version of g++, that's why this tutorial is for 10.04, because in 10.10 g++ 4.1 is not available.

    As far as i know, people from DoMY project ("Do Moses Yourself") compile Moses with g++ 4.3, maybe you should give it a try.

    Saludos!

  5. #5
    New Member
    Join Date
    Dec 2011
    Posts
    3
    Rep Power
    0

    Default Re: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    Hello again,
    for those who have the same problem and who doesn't want (or cannot for some reason) install ubuntu 10.04, have a look here:
    [SOLVED] How to install g++4.1 in Ubintu 10.10 - Ubuntu Forums
    This solves the problem (it did for me!)
    Cheers.

    P.S. I tried g++4.3. it didn't work.

  6. #6
    Forums BodyGuard AriSanguinetti's Avatar
    Join Date
    Sep 2006
    Age
    30
    Posts
    31
    Rep Power
    100

    Default Re: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    Quote Originally Posted by hermeniko View Post
    Hello again,
    for those who have the same problem and who doesn't want (or cannot for some reason) install ubuntu 10.04, have a look here:
    [SOLVED] How to install g++4.1 in Ubintu 10.10 - Ubuntu Forums
    This solves the problem (it did for me!)
    Cheers.

    P.S. I tried g++4.3. it didn't work.
    Thanks hermeniko!!

    It would be great if you could tell us something more about your Moses instalation, like language pairs, corpus involved, train parameters, etc.

    Saludos!

  7. #7
    New Member
    Join Date
    Dec 2011
    Posts
    3
    Rep Power
    0

    Default Re: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    Hey,

    I'm working with speech transcripts.
    The general idea is to integrate a translation module into a dialog system (to obtain a multilingual dialog system, kind of... So the aim is to build a model which would translate the outputs of the speech recognition system (which are not always perfect). So I'm trying different models which use different kinds of info (like semantic annotation, for example) and different settings. I need to pick one with the best performance
    Concerning the language pair, at the moment it is french-italian, but of course the extension to other languages is not out of question.

    Cheers,

  8. #8
    New Member
    Join Date
    Jan 2012
    Posts
    5
    Rep Power
    63

    Default Re: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    We have DoMY CE users on all Ubuntu version up to 11.04. The new 11.11 has a new kernel and updated g++ environment that break many of the underlying Moses components. The problem is in the underlying Moses components. Therefore, we don't plan to update to support 11.11. We are, however, already preparing updates for the new Ubnuntu 12.04 LTS version, which includes major internal changes to the kernel and g++ compiler framework.
    Last edited by tahoar60; 01-09-2012 at 08:15 PM.

  9. #9
    New Member
    Join Date
    Sep 2013
    Age
    27
    Posts
    1
    Rep Power
    0

    Default Re: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    hello...
    i'm ibnu.
    is this tutorial is for ubuntu 10.04 64bit or 32 bit?
    thanks.

  10. #10
    New Member
    Join Date
    Jan 2012
    Posts
    5
    Rep Power
    63

    Default Re: How to Install Moses Statistical Machine Translation System on Ubuntu 10.04

    For the latest installation instructions, follow this link:

    Quick Start | Precision Translation Tools

    Then, follow the "Next" links at the bottom of each page.

    Tom



    Quote Originally Posted by ibnuhadi View Post
    hello...
    i'm ibnu.
    is this tutorial is for ubuntu 10.04 64bit or 32 bit?
    thanks.

+ Reply to Thread
Page 1 of 2 12 LastLast

Thread Information

Users Browsing this Thread

There are currently 1 users browsing this thread. (0 members and 1 guests)

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •