Commit 18a44841 authored by Giulio Paci's avatar Giulio Paci

Imported Upstream version 1.1

parent 1a3891e1
Principal Contacts:
Cyril Allauzen <allauzen@google.com>
Michael Riley <riley@google.com>
Contributors:
Boulos Harb <harb@google.com>
Johan Schalkwyk <johans@google.com>
Masha Shugrina <shumash@google.com>
Mehryar Mohri <mohri@cs.nyu.edu>
Richard Sproat <rws@uiuc.edu>
Wojtek Skut <wojciech@google.com>
Licensed under the Apache License, Version 2.0 (the "License");
you may not use these files except in compliance with the License.
You may obtain a copy of the License at
http://www.apache.org/licenses/LICENSE-2.0
Unless required by applicable law or agreed to in writing, software
distributed under the License is distributed on an "AS IS" BASIS,
WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
See the License for the specific language governing permissions and
limitations under the License.
Installation Instructions
*************************
Copyright (C) 1994, 1995, 1996, 1999, 2000, 2001, 2002, 2004, 2005,
2006, 2007 Free Software Foundation, Inc.
This file is free documentation; the Free Software Foundation gives
unlimited permission to copy, distribute and modify it.
Basic Installation
==================
Briefly, the shell commands `./configure; make; make install' should
configure, build, and install this package. The following
more-detailed instructions are generic; see the `README' file for
instructions specific to this package.
The `configure' shell script attempts to guess correct values for
various system-dependent variables used during compilation. It uses
those values to create a `Makefile' in each directory of the package.
It may also create one or more `.h' files containing system-dependent
definitions. Finally, it creates a shell script `config.status' that
you can run in the future to recreate the current configuration, and a
file `config.log' containing compiler output (useful mainly for
debugging `configure').
It can also use an optional file (typically called `config.cache'
and enabled with `--cache-file=config.cache' or simply `-C') that saves
the results of its tests to speed up reconfiguring. Caching is
disabled by default to prevent problems with accidental use of stale
cache files.
If you need to do unusual things to compile the package, please try
to figure out how `configure' could check whether to do them, and mail
diffs or instructions to the address given in the `README' so they can
be considered for the next release. If you are using the cache, and at
some point `config.cache' contains results you don't want to keep, you
may remove or edit it.
The file `configure.ac' (or `configure.in') is used to create
`configure' by a program called `autoconf'. You need `configure.ac' if
you want to change it or regenerate `configure' using a newer version
of `autoconf'.
The simplest way to compile this package is:
1. `cd' to the directory containing the package's source code and type
`./configure' to configure the package for your system.
Running `configure' might take a while. While running, it prints
some messages telling which features it is checking for.
2. Type `make' to compile the package.
3. Optionally, type `make check' to run any self-tests that come with
the package.
4. Type `make install' to install the programs and any data files and
documentation.
5. You can remove the program binaries and object files from the
source code directory by typing `make clean'. To also remove the
files that `configure' created (so you can compile the package for
a different kind of computer), type `make distclean'. There is
also a `make maintainer-clean' target, but that is intended mainly
for the package's developers. If you use it, you may have to get
all sorts of other programs in order to regenerate files that came
with the distribution.
6. Often, you can also type `make uninstall' to remove the installed
files again.
Compilers and Options
=====================
Some systems require unusual options for compilation or linking that the
`configure' script does not know about. Run `./configure --help' for
details on some of the pertinent environment variables.
You can give `configure' initial values for configuration parameters
by setting variables in the command line or in the environment. Here
is an example:
./configure CC=c99 CFLAGS=-g LIBS=-lposix
*Note Defining Variables::, for more details.
Compiling For Multiple Architectures
====================================
You can compile the package for more than one kind of computer at the
same time, by placing the object files for each architecture in their
own directory. To do this, you can use GNU `make'. `cd' to the
directory where you want the object files and executables to go and run
the `configure' script. `configure' automatically checks for the
source code in the directory that `configure' is in and in `..'.
With a non-GNU `make', it is safer to compile the package for one
architecture at a time in the source code directory. After you have
installed the package for one architecture, use `make distclean' before
reconfiguring for another architecture.
Installation Names
==================
By default, `make install' installs the package's commands under
`/usr/local/bin', include files under `/usr/local/include', etc. You
can specify an installation prefix other than `/usr/local' by giving
`configure' the option `--prefix=PREFIX'.
You can specify separate installation prefixes for
architecture-specific files and architecture-independent files. If you
pass the option `--exec-prefix=PREFIX' to `configure', the package uses
PREFIX as the prefix for installing programs and libraries.
Documentation and other data files still use the regular prefix.
In addition, if you use an unusual directory layout you can give
options like `--bindir=DIR' to specify different values for particular
kinds of files. Run `configure --help' for a list of the directories
you can set and what kinds of files go in them.
If the package supports it, you can cause programs to be installed
with an extra prefix or suffix on their names by giving `configure' the
option `--program-prefix=PREFIX' or `--program-suffix=SUFFIX'.
Optional Features
=================
Some packages pay attention to `--enable-FEATURE' options to
`configure', where FEATURE indicates an optional part of the package.
They may also pay attention to `--with-PACKAGE' options, where PACKAGE
is something like `gnu-as' or `x' (for the X Window System). The
`README' should mention any `--enable-' and `--with-' options that the
package recognizes.
For packages that use the X Window System, `configure' can usually
find the X include and library files automatically, but if it doesn't,
you can use the `configure' options `--x-includes=DIR' and
`--x-libraries=DIR' to specify their locations.
Specifying the System Type
==========================
There may be some features `configure' cannot figure out automatically,
but needs to determine by the type of machine the package will run on.
Usually, assuming the package is built to be run on the _same_
architectures, `configure' can figure that out, but if it prints a
message saying it cannot guess the machine type, give it the
`--build=TYPE' option. TYPE can either be a short name for the system
type, such as `sun4', or a canonical name which has the form:
CPU-COMPANY-SYSTEM
where SYSTEM can have one of these forms:
OS KERNEL-OS
See the file `config.sub' for the possible values of each field. If
`config.sub' isn't included in this package, then this package doesn't
need to know the machine type.
If you are _building_ compiler tools for cross-compiling, you should
use the option `--target=TYPE' to select the type of system they will
produce code for.
If you want to _use_ a cross compiler, that generates code for a
platform different from the build platform, you should specify the
"host" platform (i.e., that on which the generated programs will
eventually be run) with `--host=TYPE'.
Sharing Defaults
================
If you want to set default values for `configure' scripts to share, you
can create a site shell script called `config.site' that gives default
values for variables like `CC', `cache_file', and `prefix'.
`configure' looks for `PREFIX/share/config.site' if it exists, then
`PREFIX/etc/config.site' if it exists. Or, you can set the
`CONFIG_SITE' environment variable to the location of the site script.
A warning: not all `configure' scripts look for a site script.
Defining Variables
==================
Variables not defined in a site shell script can be set in the
environment passed to `configure'. However, some packages may run
configure again during the build, and the customized values of these
variables may be lost. In order to avoid this problem, you should set
them in the `configure' command line, using `VAR=value'. For example:
./configure CC=/usr/local2/bin/gcc
causes the specified `gcc' to be used as the C compiler (unless it is
overridden in the site shell script).
Unfortunately, this technique does not work for `CONFIG_SHELL' due to
an Autoconf bug. Until the bug is fixed you can use this workaround:
CONFIG_SHELL=/bin/bash /bin/bash ./configure CONFIG_SHELL=/bin/bash
`configure' Invocation
======================
`configure' recognizes the following options to control how it operates.
`--help'
`-h'
Print a summary of the options to `configure', and exit.
`--version'
`-V'
Print the version of Autoconf used to generate the `configure'
script, and exit.
`--cache-file=FILE'
Enable the cache: use and save the results of the tests in FILE,
traditionally `config.cache'. FILE defaults to `/dev/null' to
disable caching.
`--config-cache'
`-C'
Alias for `--cache-file=config.cache'.
`--quiet'
`--silent'
`-q'
Do not print messages saying which checks are being made. To
suppress all normal output, redirect it to `/dev/null' (any error
messages will still be shown).
`--srcdir=DIR'
Look for the package's source code in directory DIR. Usually
`configure' can determine that directory automatically.
`configure' also accepts some other, not widely useful, options. Run
`configure --help' for more details.
SUBDIRS = src
This diff is collapsed.
OpenFst - Release 1.1
* Added compat.h to src/include/fst to fix missing defines
* Fixed bug in acyclic minimization that led to non-minimal
(but equiv) results
* Fixed missing FST typedef in various matchers in matcher.h
so that they can be cascaded
* Opened file streams binary where appropriate
OpenFst - Release 1.0
Additions to beta version:
* Matcher class added for matching labels at FST states. Includes
special matchers for sigma (any), rho ('rest'), and phi ('fail')
labels. (see matcher.h)
* Composition generalized with arbitrary filters, matchers, and state tables.
Sequence and matching composition filters provided. (see compose.h,
compose-filter.h, matcher.h, state-table.h)
* Unique n-best (see shortest-path.h)
* Pruning in determinization and epsilon removal (see determinize.h,
rmepsilon.h)
* New Fst classes:
* Compact Fsts for space-efficient representation (see compact-fst.h)
* New Weight classes:
* MinMax
* Lexicographic
* Miscellaneous bug fixes
OpenFst - Release 1.1
OpenFst is a library for constructing, combining, optimizing, and
searching weighted finite-state transducers (FSTs).
REQUIREMENTS:
This version is known to work under Linux, MacOS, and Solaris using
g++ (>= 4.1). Expected to work wherever adequate POSIX (dlopen, ssize_t),
c99 (snprintf, strtoll, long long), and tr1 (<tr1/ordered_set>,
<tr1/ordered_map>) support are available.
INSTALLATION:
Follow the generic GNU build system instructions in ./INSTALL.
(Compiling with '-Wall -Wno-sign-compare' under g++ should give no
warnings from this library).
USAGE:
Assuming you've installed under the default /usr/local, the FST
binaries are found on /usr/local/bin. To use in your own program,
include <fst/fstlib.h> and compile with '-I /usr/local/include'.
Link against /usr/local/lib/libfst.so and -ldl. Set your
LD_LIBRARY_PATH (or equivalent) to contain /usr/local/lib. The
linking is, by default, dynamic so that the Fst and Arc type DSO
extensions can be used correctly if desired.
DOCUMENTATION:
See www.openfst.org for general documentation.
See ./NEWS for updates since the last release.
This diff is collapsed.
This diff is collapsed.
/* config.h.in. Generated from configure.ac by autoheader. */
/* Define to 1 if you have the <dlfcn.h> header file. */
#undef HAVE_DLFCN_H
/* Define to 1 if you have the <inttypes.h> header file. */
#undef HAVE_INTTYPES_H
/* Define to 1 if you have the <memory.h> header file. */
#undef HAVE_MEMORY_H
/* Define to 1 if you have the <stdint.h> header file. */
#undef HAVE_STDINT_H
/* Define to 1 if you have the <stdlib.h> header file. */
#undef HAVE_STDLIB_H
/* Define to 1 if the system has the type `std::tr1::hash<long long
unsigned>'. */
#undef HAVE_STD__TR1__HASH_LONG_LONG_UNSIGNED_
/* Define to 1 if you have the <strings.h> header file. */
#undef HAVE_STRINGS_H
/* Define to 1 if you have the <string.h> header file. */
#undef HAVE_STRING_H
/* Define to 1 if you have the <sys/stat.h> header file. */
#undef HAVE_SYS_STAT_H
/* Define to 1 if you have the <sys/types.h> header file. */
#undef HAVE_SYS_TYPES_H
/* Define to 1 if you have the <unistd.h> header file. */
#undef HAVE_UNISTD_H
/* Define to 1 if the system has the type `__gnu_cxx::slist<int>'. */
#undef HAVE___GNU_CXX__SLIST_INT_
/* Name of package */
#undef PACKAGE
/* Define to the address where bug reports for this package should be sent. */
#undef PACKAGE_BUGREPORT
/* Define to the full name of this package. */
#undef PACKAGE_NAME
/* Define to the full name and version of this package. */
#undef PACKAGE_STRING
/* Define to the one symbol short name of this package. */
#undef PACKAGE_TARNAME
/* Define to the version of this package. */
#undef PACKAGE_VERSION
/* Define to 1 if you have the ANSI C header files. */
#undef STDC_HEADERS
/* Version number of package */
#undef VERSION
This diff is collapsed.
This diff is collapsed.
AC_INIT([OpenFst], [1.1], [help@www.openfst.org])
AM_INIT_AUTOMAKE([-Wall -Werror foreign])
AC_PROG_CXX
AC_PROG_LIBTOOL
AC_CONFIG_HEADERS([config.h src/include/fst/config.h])
AC_CONFIG_SRCDIR([src/lib/fst.cc])
AC_CONFIG_FILES([
Makefile
src/Makefile
src/include/Makefile
src/lib/Makefile
src/bin/Makefile
src/test/Makefile
])
AC_LANG([C++])
AC_CHECK_TYPES([std::tr1::hash<long long unsigned>], [], [],
[[#include <tr1/unordered_map>]])
AC_CHECK_TYPES([__gnu_cxx::slist<int>], [], [],
[[#include <ext/slist>]])
AC_OUTPUT
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
SUBDIRS = include lib bin test
This diff is collapsed.
AM_CPPFLAGS = -I$(srcdir)/../include
AM_LDFLAGS = -lm -ldl
lib_LTLIBRARIES = libfstmain.la
libfstmain_la_SOURCES = main.cc
libfstmain_la_LDFLAGS = -version-info 0:0:0
bin_PROGRAMS = fstarcsort fstclosure fstcompile fstcompose fstconcat \
fstconnect fstconvert fstdeterminize fstdifference fstdraw fstencode \
fstepsnormalize fstequal fstequivalent fstinfo fstintersect fstinvert \
fstmap fstminimize fstprint fstproject fstprune fstpush fstrandgen \
fstrelabel fstreplace fstreverse fstreweight fstrmepsilon \
fstshortestdistance fstshortestpath fstsynchronize fsttopsort fstunion
fstarcsort_SOURCES = fstarcsort.cc arcsort-main.h
fstarcsort_LDADD = ../lib/libfst.la libfstmain.la
fstclosure_SOURCES = fstclosure.cc closure-main.h
fstclosure_LDADD = ../lib/libfst.la libfstmain.la
fstcompile_SOURCES = fstcompile.cc compile-main.h
fstcompile_LDADD = ../lib/libfst.la libfstmain.la
fstcompose_SOURCES = fstcompose.cc compose-main.h
fstcompose_LDADD = ../lib/libfst.la libfstmain.la
fstconcat_SOURCES = fstconcat.cc concat-main.h
fstconcat_LDADD = ../lib/libfst.la libfstmain.la
fstconnect_SOURCES = fstconnect.cc connect-main.h
fstconnect_LDADD = ../lib/libfst.la libfstmain.la
fstconvert_SOURCES = fstconvert.cc convert-main.h
fstconvert_LDADD = ../lib/libfst.la libfstmain.la
fstdeterminize_SOURCES = fstdeterminize.cc determinize-main.h
fstdeterminize_LDADD = ../lib/libfst.la libfstmain.la
fstdifference_SOURCES = fstdifference.cc difference-main.h
fstdifference_LDADD = ../lib/libfst.la libfstmain.la
fstdraw_SOURCES = fstdraw.cc draw-main.h
fstdraw_LDADD = ../lib/libfst.la libfstmain.la
fstencode_SOURCES = fstencode.cc encode-main.h
fstencode_LDADD = ../lib/libfst.la libfstmain.la
fstepsnormalize_SOURCES = fstepsnormalize.cc epsnormalize-main.h
fstepsnormalize_LDADD = ../lib/libfst.la libfstmain.la
fstequal_SOURCES = fstequal.cc equal-main.h
fstequal_LDADD = ../lib/libfst.la libfstmain.la
fstequivalent_SOURCES = fstequivalent.cc equivalent-main.h
fstequivalent_LDADD = ../lib/libfst.la libfstmain.la
fstinfo_SOURCES = fstinfo.cc info-main.h
fstinfo_LDADD = ../lib/libfst.la libfstmain.la
fstintersect_SOURCES = fstintersect.cc intersect-main.h
fstintersect_LDADD = ../lib/libfst.la libfstmain.la
fstinvert_SOURCES = fstinvert.cc invert-main.h
fstinvert_LDADD = ../lib/libfst.la libfstmain.la
fstmap_SOURCES = fstmap.cc map-main.h
fstmap_LDADD = ../lib/libfst.la libfstmain.la
fstminimize_SOURCES = fstminimize.cc minimize-main.h
fstminimize_LDADD = ../lib/libfst.la libfstmain.la
fstprint_SOURCES = fstprint.cc print-main.h
fstprint_LDADD = ../lib/libfst.la libfstmain.la
fstproject_SOURCES = fstproject.cc project-main.h
fstproject_LDADD = ../lib/libfst.la libfstmain.la
fstprune_SOURCES = fstprune.cc prune-main.h
fstprune_LDADD = ../lib/libfst.la libfstmain.la
fstpush_SOURCES = fstpush.cc push-main.h
fstpush_LDADD = ../lib/libfst.la libfstmain.la
fstrandgen_SOURCES = fstrandgen.cc randgen-main.h
fstrandgen_LDADD = ../lib/libfst.la libfstmain.la
fstrelabel_SOURCES = fstrelabel.cc relabel-main.h
fstrelabel_LDADD = ../lib/libfst.la libfstmain.la
fstreplace_SOURCES = fstreplace.cc replace-main.h
fstreplace_LDADD = ../lib/libfst.la libfstmain.la
fstreverse_SOURCES = fstreverse.cc reverse-main.h
fstreverse_LDADD = ../lib/libfst.la libfstmain.la
fstreweight_SOURCES = fstreweight.cc reweight-main.h
fstreweight_LDADD = ../lib/libfst.la libfstmain.la
fstrmepsilon_SOURCES = fstrmepsilon.cc rmepsilon-main.h
fstrmepsilon_LDADD = ../lib/libfst.la libfstmain.la
fstshortestdistance_SOURCES = fstshortestdistance.cc shortest-distance-main.h
fstshortestdistance_LDADD = ../lib/libfst.la libfstmain.la
fstshortestpath_SOURCES = fstshortestpath.cc shortest-path-main.h
fstshortestpath_LDADD = ../lib/libfst.la libfstmain.la
fstsynchronize_SOURCES = fstsynchronize.cc synchronize-main.h
fstsynchronize_LDADD = ../lib/libfst.la libfstmain.la
fsttopsort_SOURCES = fsttopsort.cc topsort-main.h
fsttopsort_LDADD = ../lib/libfst.la libfstmain.la
fstunion_SOURCES = fstunion.cc union-main.h
fstunion_LDADD = ../lib/libfst.la libfstmain.la
This diff is collapsed.
// arcsort-main.h
// Licensed under the Apache License, Version 2.0 (the "License");
// you may not use this file except in compliance with the License.
// You may obtain a copy of the License at
//
// http://www.apache.org/licenses/LICENSE-2.0
//
// Unless required by applicable law or agreed to in writing, software
// distributed under the License is distributed on an "AS IS" BASIS,
// WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
// See the License for the specific language governing permissions and
// limitations under the License.
//
// Author: riley@google.com (Michael Riley)
//
// \file
// Sorts the arcs of an FST. Includes helper function for
// fstarcsort.cc that templates the main on the arc type to support
// multiple and extensible arc types.
//
#ifndef FST_ARCSORT_MAIN_H__
#define FST_ARCSORT_MAIN_H__
#include <string>
#include <fst/arcsort.h>
#include <fst/main.h>
#include <fst/vector-fst.h>
DECLARE_string(sort_type);
namespace fst {
// Main function for fstarcsort templated on the arc type.
// Call only with 'return CALL_FST_MAIN' in main().
template <class Arc>
int ArcSortMain(int argc, char **argv, istream &strm,
const FstReadOptions &opts) {
Fst<Arc> *ifst = Fst<Arc>::Read(strm, opts);
if (!ifst) return 1;
MutableFst<Arc> *ofst = 0;
if (ifst->Properties(kMutable, false)) {
ofst = down_cast<MutableFst<Arc> *>(ifst);
} else {
ofst = new VectorFst<Arc>(*ifst);
delete ifst;
}
if (FLAGS_sort_type == "ilabel") {
ILabelCompare<Arc> icomp;
ArcSort(ofst, icomp);
} else if (FLAGS_sort_type == "olabel") {
OLabelCompare<Arc> ocomp;
ArcSort(ofst, ocomp);
} else {
LOG(ERROR) << argv[0] << ": Unknown sort type \""
<< FLAGS_sort_type << "\"\n";
return 1;
}
ofst->Write(argc > 2 ? argv[2] : "");
return 0;
}
} // namespace fst
#endif // FST_ARCSORT_MAIN_H__
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.
This diff is collapsed.