jerasure/README

96 lines
3.2 KiB
Plaintext
Raw Permalink Normal View History

2013-12-05 10:56:31 +04:00
This is revision 2.0 of Jerasure. This is pretty much Jerasure 1.2 without the
This is the squashed pull request from David Glessner, squashed and reviewed by Kevin Greenan. Updated README Allow out-of-source builds. Quiet autogen.sh warnings. Use AM_CPPFLAGS instead of INCLUDES. Use $(top_srcdir). Add .gitignore to quiet git status. Add project URL to AC_INIT. Stop libtool from compiling files twice. Have git ignore .deps/. Don't override user CPPFLAGS. (PIC options appear to be set already. INCLUDES already included.) Clean configure.ac. Make it closer to autoscan output. Have autotools create INSTALL. Use AC_MSG_FAILURE if GF-Complete not found. Run autogen.sh. (autoconf 2.69, automake 1.14.1, libtool 2.4.2) Add some .gitignore files. Fix configure cpuid unknown issue. Move AX_EXT before AC_CHECK_LIB(gf_complete...) so that -lgf_complete doesn't cause CPUID conftest compile to fail. Don't check for internal gf_int.h header. GF-Complete doesn't install it. Quiet some autoreconf warnings. INCLUDES is now AM_CPPFLAGS. Use single-argument AM_INIT_AUTOMAKE. Remove some AC_REQUIRE whose conftest always failed. Quiet configure warning. (ARCH_64 doesn't appear to be used.) CPUID "unknown" fix from upstream autoconf-archive. Allow out-of-source builds. Use dependency tracking. Remove config.h.in~. Update ax_check_compile_flag.m4 from autoconf-archive. Add .gitattributes. Remove autoreconf-generated files. Remove ACLOCAL_AMFLAGS. See Automake 1.13 release notes. Add files for 'make dist'. Quiet some warnings. getcwd() in <unistd.h>. Remove some vars. Make headers compatible with C++. Quiet some warnings. Install additional headers in include/jerasure/. Quiet some configure check internal failures. Use new AX_REQUIRE_DEFINED instead of AC_REQUIRE, which expands the macro and causes internal compile failure. Fix file permissions. Remove INTEL_SSE compiler defines. (Can use HAVE_xxx or __xxx__ instead.) Set default CFLAGS to '-g -O3 -Wall'. Add more checks from autoscan. Use AC_CONFIG_AUX_DIR([build-aux]). Use processor time for timing. Use clock() instead of gettimeofday(). Use common LDADD in Makefile.am. Remove pre-autotools makefiles. Ignore *.a. (Missed earlier.) Quiet more warnings. Document need for autoreconf -fi. Removed README.nd and README.txt so changes don't need to be duplicated. Remove autogen.sh. Just use "autoreconf --force --install".
2014-03-08 23:08:36 +04:00
original Galois Field backend. Version 2.0 links directly to GF-Complete, which
is more flexible than the original, and *much* faster, because it leverages SIMD
instructions.
2014-01-30 01:35:36 +04:00
Authors: James S. Plank (University of Tennessee)
Kevin M. Greenan (Box)
------------------------------------------------------------
The online home for jerasure is:
- http://jerasure.org/jerasure/jerasure
------------------------------------------------------------
2013-12-05 10:56:31 +04:00
External Documentation:
See the file Manual.pdf for the programmer's manual and tutorial.
2013-12-05 10:56:31 +04:00
See http://jerasure.org/jerasure/gf-complete for GF-Complete.
2013-12-05 10:56:31 +04:00
NOTE: You must have GF-Complete installed (or compiled) in order to use Jerasure 2.0.
2013-12-05 10:56:31 +04:00
There are two directories of source code:
2013-12-05 10:56:31 +04:00
2013-12-05 11:11:15 +04:00
The src directory contains the jerasure code.
This is the squashed pull request from David Glessner, squashed and reviewed by Kevin Greenan. Updated README Allow out-of-source builds. Quiet autogen.sh warnings. Use AM_CPPFLAGS instead of INCLUDES. Use $(top_srcdir). Add .gitignore to quiet git status. Add project URL to AC_INIT. Stop libtool from compiling files twice. Have git ignore .deps/. Don't override user CPPFLAGS. (PIC options appear to be set already. INCLUDES already included.) Clean configure.ac. Make it closer to autoscan output. Have autotools create INSTALL. Use AC_MSG_FAILURE if GF-Complete not found. Run autogen.sh. (autoconf 2.69, automake 1.14.1, libtool 2.4.2) Add some .gitignore files. Fix configure cpuid unknown issue. Move AX_EXT before AC_CHECK_LIB(gf_complete...) so that -lgf_complete doesn't cause CPUID conftest compile to fail. Don't check for internal gf_int.h header. GF-Complete doesn't install it. Quiet some autoreconf warnings. INCLUDES is now AM_CPPFLAGS. Use single-argument AM_INIT_AUTOMAKE. Remove some AC_REQUIRE whose conftest always failed. Quiet configure warning. (ARCH_64 doesn't appear to be used.) CPUID "unknown" fix from upstream autoconf-archive. Allow out-of-source builds. Use dependency tracking. Remove config.h.in~. Update ax_check_compile_flag.m4 from autoconf-archive. Add .gitattributes. Remove autoreconf-generated files. Remove ACLOCAL_AMFLAGS. See Automake 1.13 release notes. Add files for 'make dist'. Quiet some warnings. getcwd() in <unistd.h>. Remove some vars. Make headers compatible with C++. Quiet some warnings. Install additional headers in include/jerasure/. Quiet some configure check internal failures. Use new AX_REQUIRE_DEFINED instead of AC_REQUIRE, which expands the macro and causes internal compile failure. Fix file permissions. Remove INTEL_SSE compiler defines. (Can use HAVE_xxx or __xxx__ instead.) Set default CFLAGS to '-g -O3 -Wall'. Add more checks from autoscan. Use AC_CONFIG_AUX_DIR([build-aux]). Use processor time for timing. Use clock() instead of gettimeofday(). Use common LDADD in Makefile.am. Remove pre-autotools makefiles. Ignore *.a. (Missed earlier.) Quiet more warnings. Document need for autoreconf -fi. Removed README.nd and README.txt so changes don't need to be duplicated. Remove autogen.sh. Just use "autoreconf --force --install".
2014-03-08 23:08:36 +04:00
The Examples directory contains the example programs.
2013-12-05 10:56:31 +04:00
------------------------------------------------------------
If you do not have Autoconf 2.65 or later installed, you can simply build
This is the squashed pull request from David Glessner, squashed and reviewed by Kevin Greenan. Updated README Allow out-of-source builds. Quiet autogen.sh warnings. Use AM_CPPFLAGS instead of INCLUDES. Use $(top_srcdir). Add .gitignore to quiet git status. Add project URL to AC_INIT. Stop libtool from compiling files twice. Have git ignore .deps/. Don't override user CPPFLAGS. (PIC options appear to be set already. INCLUDES already included.) Clean configure.ac. Make it closer to autoscan output. Have autotools create INSTALL. Use AC_MSG_FAILURE if GF-Complete not found. Run autogen.sh. (autoconf 2.69, automake 1.14.1, libtool 2.4.2) Add some .gitignore files. Fix configure cpuid unknown issue. Move AX_EXT before AC_CHECK_LIB(gf_complete...) so that -lgf_complete doesn't cause CPUID conftest compile to fail. Don't check for internal gf_int.h header. GF-Complete doesn't install it. Quiet some autoreconf warnings. INCLUDES is now AM_CPPFLAGS. Use single-argument AM_INIT_AUTOMAKE. Remove some AC_REQUIRE whose conftest always failed. Quiet configure warning. (ARCH_64 doesn't appear to be used.) CPUID "unknown" fix from upstream autoconf-archive. Allow out-of-source builds. Use dependency tracking. Remove config.h.in~. Update ax_check_compile_flag.m4 from autoconf-archive. Add .gitattributes. Remove autoreconf-generated files. Remove ACLOCAL_AMFLAGS. See Automake 1.13 release notes. Add files for 'make dist'. Quiet some warnings. getcwd() in <unistd.h>. Remove some vars. Make headers compatible with C++. Quiet some warnings. Install additional headers in include/jerasure/. Quiet some configure check internal failures. Use new AX_REQUIRE_DEFINED instead of AC_REQUIRE, which expands the macro and causes internal compile failure. Fix file permissions. Remove INTEL_SSE compiler defines. (Can use HAVE_xxx or __xxx__ instead.) Set default CFLAGS to '-g -O3 -Wall'. Add more checks from autoscan. Use AC_CONFIG_AUX_DIR([build-aux]). Use processor time for timing. Use clock() instead of gettimeofday(). Use common LDADD in Makefile.am. Remove pre-autotools makefiles. Ignore *.a. (Missed earlier.) Quiet more warnings. Document need for autoreconf -fi. Removed README.nd and README.txt so changes don't need to be duplicated. Remove autogen.sh. Just use "autoreconf --force --install".
2014-03-08 23:08:36 +04:00
from the tarball distribution:
http://www.kaymgee.com/Kevin_Greenan/Software_files/jerasure.tar.gz
2013-12-05 10:56:31 +04:00
Installing if you are allowed to install GF-Complete on your machine:
This is the squashed pull request from David Glessner, squashed and reviewed by Kevin Greenan. Updated README Allow out-of-source builds. Quiet autogen.sh warnings. Use AM_CPPFLAGS instead of INCLUDES. Use $(top_srcdir). Add .gitignore to quiet git status. Add project URL to AC_INIT. Stop libtool from compiling files twice. Have git ignore .deps/. Don't override user CPPFLAGS. (PIC options appear to be set already. INCLUDES already included.) Clean configure.ac. Make it closer to autoscan output. Have autotools create INSTALL. Use AC_MSG_FAILURE if GF-Complete not found. Run autogen.sh. (autoconf 2.69, automake 1.14.1, libtool 2.4.2) Add some .gitignore files. Fix configure cpuid unknown issue. Move AX_EXT before AC_CHECK_LIB(gf_complete...) so that -lgf_complete doesn't cause CPUID conftest compile to fail. Don't check for internal gf_int.h header. GF-Complete doesn't install it. Quiet some autoreconf warnings. INCLUDES is now AM_CPPFLAGS. Use single-argument AM_INIT_AUTOMAKE. Remove some AC_REQUIRE whose conftest always failed. Quiet configure warning. (ARCH_64 doesn't appear to be used.) CPUID "unknown" fix from upstream autoconf-archive. Allow out-of-source builds. Use dependency tracking. Remove config.h.in~. Update ax_check_compile_flag.m4 from autoconf-archive. Add .gitattributes. Remove autoreconf-generated files. Remove ACLOCAL_AMFLAGS. See Automake 1.13 release notes. Add files for 'make dist'. Quiet some warnings. getcwd() in <unistd.h>. Remove some vars. Make headers compatible with C++. Quiet some warnings. Install additional headers in include/jerasure/. Quiet some configure check internal failures. Use new AX_REQUIRE_DEFINED instead of AC_REQUIRE, which expands the macro and causes internal compile failure. Fix file permissions. Remove INTEL_SSE compiler defines. (Can use HAVE_xxx or __xxx__ instead.) Set default CFLAGS to '-g -O3 -Wall'. Add more checks from autoscan. Use AC_CONFIG_AUX_DIR([build-aux]). Use processor time for timing. Use clock() instead of gettimeofday(). Use common LDADD in Makefile.am. Remove pre-autotools makefiles. Ignore *.a. (Missed earlier.) Quiet more warnings. Document need for autoreconf -fi. Removed README.nd and README.txt so changes don't need to be duplicated. Remove autogen.sh. Just use "autoreconf --force --install".
2014-03-08 23:08:36 +04:00
(You can skip the autoreconf step if you're using a tarball distribution.)
2013-12-05 10:56:31 +04:00
1.) Install GF-Complete
This is the squashed pull request from David Glessner, squashed and reviewed by Kevin Greenan. Updated README Allow out-of-source builds. Quiet autogen.sh warnings. Use AM_CPPFLAGS instead of INCLUDES. Use $(top_srcdir). Add .gitignore to quiet git status. Add project URL to AC_INIT. Stop libtool from compiling files twice. Have git ignore .deps/. Don't override user CPPFLAGS. (PIC options appear to be set already. INCLUDES already included.) Clean configure.ac. Make it closer to autoscan output. Have autotools create INSTALL. Use AC_MSG_FAILURE if GF-Complete not found. Run autogen.sh. (autoconf 2.69, automake 1.14.1, libtool 2.4.2) Add some .gitignore files. Fix configure cpuid unknown issue. Move AX_EXT before AC_CHECK_LIB(gf_complete...) so that -lgf_complete doesn't cause CPUID conftest compile to fail. Don't check for internal gf_int.h header. GF-Complete doesn't install it. Quiet some autoreconf warnings. INCLUDES is now AM_CPPFLAGS. Use single-argument AM_INIT_AUTOMAKE. Remove some AC_REQUIRE whose conftest always failed. Quiet configure warning. (ARCH_64 doesn't appear to be used.) CPUID "unknown" fix from upstream autoconf-archive. Allow out-of-source builds. Use dependency tracking. Remove config.h.in~. Update ax_check_compile_flag.m4 from autoconf-archive. Add .gitattributes. Remove autoreconf-generated files. Remove ACLOCAL_AMFLAGS. See Automake 1.13 release notes. Add files for 'make dist'. Quiet some warnings. getcwd() in <unistd.h>. Remove some vars. Make headers compatible with C++. Quiet some warnings. Install additional headers in include/jerasure/. Quiet some configure check internal failures. Use new AX_REQUIRE_DEFINED instead of AC_REQUIRE, which expands the macro and causes internal compile failure. Fix file permissions. Remove INTEL_SSE compiler defines. (Can use HAVE_xxx or __xxx__ instead.) Set default CFLAGS to '-g -O3 -Wall'. Add more checks from autoscan. Use AC_CONFIG_AUX_DIR([build-aux]). Use processor time for timing. Use clock() instead of gettimeofday(). Use common LDADD in Makefile.am. Remove pre-autotools makefiles. Ignore *.a. (Missed earlier.) Quiet more warnings. Document need for autoreconf -fi. Removed README.nd and README.txt so changes don't need to be duplicated. Remove autogen.sh. Just use "autoreconf --force --install".
2014-03-08 23:08:36 +04:00
2.) autoreconf --force --install (*skip* if you are building from tarball)
3.) ./configure
4.) make
5.) sudo make install
2013-12-05 10:56:31 +04:00
This will install the library into your machine's lib directory,
the headers into include, and the example programs into bin.
This is the squashed pull request from David Glessner, squashed and reviewed by Kevin Greenan. Updated README Allow out-of-source builds. Quiet autogen.sh warnings. Use AM_CPPFLAGS instead of INCLUDES. Use $(top_srcdir). Add .gitignore to quiet git status. Add project URL to AC_INIT. Stop libtool from compiling files twice. Have git ignore .deps/. Don't override user CPPFLAGS. (PIC options appear to be set already. INCLUDES already included.) Clean configure.ac. Make it closer to autoscan output. Have autotools create INSTALL. Use AC_MSG_FAILURE if GF-Complete not found. Run autogen.sh. (autoconf 2.69, automake 1.14.1, libtool 2.4.2) Add some .gitignore files. Fix configure cpuid unknown issue. Move AX_EXT before AC_CHECK_LIB(gf_complete...) so that -lgf_complete doesn't cause CPUID conftest compile to fail. Don't check for internal gf_int.h header. GF-Complete doesn't install it. Quiet some autoreconf warnings. INCLUDES is now AM_CPPFLAGS. Use single-argument AM_INIT_AUTOMAKE. Remove some AC_REQUIRE whose conftest always failed. Quiet configure warning. (ARCH_64 doesn't appear to be used.) CPUID "unknown" fix from upstream autoconf-archive. Allow out-of-source builds. Use dependency tracking. Remove config.h.in~. Update ax_check_compile_flag.m4 from autoconf-archive. Add .gitattributes. Remove autoreconf-generated files. Remove ACLOCAL_AMFLAGS. See Automake 1.13 release notes. Add files for 'make dist'. Quiet some warnings. getcwd() in <unistd.h>. Remove some vars. Make headers compatible with C++. Quiet some warnings. Install additional headers in include/jerasure/. Quiet some configure check internal failures. Use new AX_REQUIRE_DEFINED instead of AC_REQUIRE, which expands the macro and causes internal compile failure. Fix file permissions. Remove INTEL_SSE compiler defines. (Can use HAVE_xxx or __xxx__ instead.) Set default CFLAGS to '-g -O3 -Wall'. Add more checks from autoscan. Use AC_CONFIG_AUX_DIR([build-aux]). Use processor time for timing. Use clock() instead of gettimeofday(). Use common LDADD in Makefile.am. Remove pre-autotools makefiles. Ignore *.a. (Missed earlier.) Quiet more warnings. Document need for autoreconf -fi. Removed README.nd and README.txt so changes don't need to be duplicated. Remove autogen.sh. Just use "autoreconf --force --install".
2014-03-08 23:08:36 +04:00
The configuration process assumes shared objects are searched for in
/usr/local/lib. If this is not the case on your system, you can specify a
search path at configuration time. For example:
./configure LD_LIBRARY_PATH=/usr/local/lib
------------------------------------------------------------
Installing if you can compile GF-Complete, but you cannot install it:
1.) Install GF-Complete. Let's suppose the full path to GF-Complete is
in the environment variable GFP
This is the squashed pull request from David Glessner, squashed and reviewed by Kevin Greenan. Updated README Allow out-of-source builds. Quiet autogen.sh warnings. Use AM_CPPFLAGS instead of INCLUDES. Use $(top_srcdir). Add .gitignore to quiet git status. Add project URL to AC_INIT. Stop libtool from compiling files twice. Have git ignore .deps/. Don't override user CPPFLAGS. (PIC options appear to be set already. INCLUDES already included.) Clean configure.ac. Make it closer to autoscan output. Have autotools create INSTALL. Use AC_MSG_FAILURE if GF-Complete not found. Run autogen.sh. (autoconf 2.69, automake 1.14.1, libtool 2.4.2) Add some .gitignore files. Fix configure cpuid unknown issue. Move AX_EXT before AC_CHECK_LIB(gf_complete...) so that -lgf_complete doesn't cause CPUID conftest compile to fail. Don't check for internal gf_int.h header. GF-Complete doesn't install it. Quiet some autoreconf warnings. INCLUDES is now AM_CPPFLAGS. Use single-argument AM_INIT_AUTOMAKE. Remove some AC_REQUIRE whose conftest always failed. Quiet configure warning. (ARCH_64 doesn't appear to be used.) CPUID "unknown" fix from upstream autoconf-archive. Allow out-of-source builds. Use dependency tracking. Remove config.h.in~. Update ax_check_compile_flag.m4 from autoconf-archive. Add .gitattributes. Remove autoreconf-generated files. Remove ACLOCAL_AMFLAGS. See Automake 1.13 release notes. Add files for 'make dist'. Quiet some warnings. getcwd() in <unistd.h>. Remove some vars. Make headers compatible with C++. Quiet some warnings. Install additional headers in include/jerasure/. Quiet some configure check internal failures. Use new AX_REQUIRE_DEFINED instead of AC_REQUIRE, which expands the macro and causes internal compile failure. Fix file permissions. Remove INTEL_SSE compiler defines. (Can use HAVE_xxx or __xxx__ instead.) Set default CFLAGS to '-g -O3 -Wall'. Add more checks from autoscan. Use AC_CONFIG_AUX_DIR([build-aux]). Use processor time for timing. Use clock() instead of gettimeofday(). Use common LDADD in Makefile.am. Remove pre-autotools makefiles. Ignore *.a. (Missed earlier.) Quiet more warnings. Document need for autoreconf -fi. Removed README.nd and README.txt so changes don't need to be duplicated. Remove autogen.sh. Just use "autoreconf --force --install".
2014-03-08 23:08:36 +04:00
2A.) On Linux, set the environment variable LD_LIBRARY_PATH so that it
includes $GFP/src/.libs
2B.) On a mac, set the environment variable DYLD_LIBRARY_PATH so that it
includes $GFP/src/.libs
2.) ./configure LDFLAGS=-L$GFP/src/.libs/ CPPFLAGS=-I$GFP/include
3.) make
The examples will be in the directory Examples. The include files will
be in the directory include, and the library will be called libJerasure.a
in the directory src/.libs.
2013-12-05 10:56:31 +04:00
------------------------------------------------------------
2013-12-05 10:56:31 +04:00
As long as GF-Complete is installed, Jerasure 2.0 can be used just as previous
This is the squashed pull request from David Glessner, squashed and reviewed by Kevin Greenan. Updated README Allow out-of-source builds. Quiet autogen.sh warnings. Use AM_CPPFLAGS instead of INCLUDES. Use $(top_srcdir). Add .gitignore to quiet git status. Add project URL to AC_INIT. Stop libtool from compiling files twice. Have git ignore .deps/. Don't override user CPPFLAGS. (PIC options appear to be set already. INCLUDES already included.) Clean configure.ac. Make it closer to autoscan output. Have autotools create INSTALL. Use AC_MSG_FAILURE if GF-Complete not found. Run autogen.sh. (autoconf 2.69, automake 1.14.1, libtool 2.4.2) Add some .gitignore files. Fix configure cpuid unknown issue. Move AX_EXT before AC_CHECK_LIB(gf_complete...) so that -lgf_complete doesn't cause CPUID conftest compile to fail. Don't check for internal gf_int.h header. GF-Complete doesn't install it. Quiet some autoreconf warnings. INCLUDES is now AM_CPPFLAGS. Use single-argument AM_INIT_AUTOMAKE. Remove some AC_REQUIRE whose conftest always failed. Quiet configure warning. (ARCH_64 doesn't appear to be used.) CPUID "unknown" fix from upstream autoconf-archive. Allow out-of-source builds. Use dependency tracking. Remove config.h.in~. Update ax_check_compile_flag.m4 from autoconf-archive. Add .gitattributes. Remove autoreconf-generated files. Remove ACLOCAL_AMFLAGS. See Automake 1.13 release notes. Add files for 'make dist'. Quiet some warnings. getcwd() in <unistd.h>. Remove some vars. Make headers compatible with C++. Quiet some warnings. Install additional headers in include/jerasure/. Quiet some configure check internal failures. Use new AX_REQUIRE_DEFINED instead of AC_REQUIRE, which expands the macro and causes internal compile failure. Fix file permissions. Remove INTEL_SSE compiler defines. (Can use HAVE_xxx or __xxx__ instead.) Set default CFLAGS to '-g -O3 -Wall'. Add more checks from autoscan. Use AC_CONFIG_AUX_DIR([build-aux]). Use processor time for timing. Use clock() instead of gettimeofday(). Use common LDADD in Makefile.am. Remove pre-autotools makefiles. Ignore *.a. (Missed earlier.) Quiet more warnings. Document need for autoreconf -fi. Removed README.nd and README.txt so changes don't need to be duplicated. Remove autogen.sh. Just use "autoreconf --force --install".
2014-03-08 23:08:36 +04:00
versions. There is no need to define custom Galois Fields. Jerasure will
2013-12-05 10:56:31 +04:00
determine the default field to use, if one is not specified.
If you would like to explore a using a different Galois Field implementation,
2014-01-30 01:08:53 +04:00
please see the manual.
------------------------------------------------------------
Testing GF-Complete
If the GF-Complete tools are installed in /usr/local/bin
make check
If the GF-Complete tools are installed elsewhere
make GF_COMPLETE_DIR=$(pwd)/../gf-complete/tools check
To run some tests with valgrind
make VALGRIND='valgrind --tool=memcheck --quiet' \
GF_COMPLETE_DIR=$(pwd)/../gf-complete/tools \
check