Go to file
Pádraig Brady c93d5b4aa7 shred: fix direct I/O failures for last write to file
Since direct I/O is now enabled with commit v8.21-139-gebaf961
we must handle the case where we write an odd size at the
end of a file (with --exact), or we specify an odd --size that
is larger than 64KiB, or in the very unlikely case of a device
with an odd size.  This issue was present since direct I/O
support was first added in v5.3.0, but latent since v6.0.
Theoretically this could have also been an issue after that on
systems which didn't have alignment constraints, but did have
size constraints for direct I/O.

* src/shred.c (dopass): On the first pass for a file, always
retry a write that fails with EINVAL, so we handle direct I/O
failure at either the start or end of the file.  Adjust the comment
as the original case is out of date and implicitly handled
by this more general fix.
* tests/misc/shred-exact.sh: Add a test case.
* NEWS: Add a "bug fix" entry for shred since there are
two related issues now fixed.
2013-11-08 13:33:50 +00:00
build-aux numfmt: a new command to format numbers 2013-02-04 23:40:32 +00:00
doc cp: fix --link regarding the dereferencing of symbolic links 2013-11-07 23:45:22 +01:00
gl build: fix corrupted patch causing bootstrap failures 2013-09-10 12:00:34 +01:00
gnulib@798e9bc8b8 build: update gnulib submodule to latest; also bootstrap to latest 2013-09-22 02:56:56 +01:00
gnulib-tests tests: adjust preceding change to handle general WERROR_CFLAGS values 2010-12-22 11:10:23 +01:00
lib maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
m4 maint: refactor SMACK interface to a separate module 2013-07-02 09:47:32 +01:00
man build: fix dependencies of man/sha*sum.1 2013-11-01 18:59:43 +01:00
old maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
po build: avoid new syntax-check failure 2013-05-12 04:39:36 +02:00
scripts scripts: tweak URLs in autotools-install 2013-04-22 10:26:25 -07:00
src shred: fix direct I/O failures for last write to file 2013-11-08 13:33:50 +00:00
tests shred: fix direct I/O failures for last write to file 2013-11-08 13:33:50 +00:00
.gitattributes build: allow whitespace violations in gl/lib/*.diff files 2009-10-29 08:14:42 +01:00
.gitignore maint: avoid patching help2man 2013-09-12 08:02:22 +02:00
.gitmodules global: convert indentation-TABs to spaces 2009-08-25 09:21:00 +02:00
.mailmap ls: with -Z, show SMACK security context 2013-06-24 21:00:14 +01:00
.prev-version maint: post-release administrivia 2013-02-14 16:23:45 +00:00
.vg-suppressions maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
.x-update-copyright maint: avoid patching help2man 2013-09-12 08:02:22 +02:00
AUTHORS numfmt: a new command to format numbers 2013-02-04 23:40:32 +00:00
bootstrap build: update gnulib submodule to latest; also bootstrap to latest 2013-09-22 02:56:56 +01:00
bootstrap.conf maint: refactor SMACK interface to a separate module 2013-07-02 09:47:32 +01:00
cfg.mk maint: avoid patching help2man 2013-09-12 08:02:22 +02:00
ChangeLog-2005 maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
ChangeLog-2006 maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
ChangeLog-2007 maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
ChangeLog-2008 maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
configure.ac maint: port --enable-gcc-warnings to clang 2013-05-18 17:55:07 -07:00
COPYING maint: don't change COPYING 2009-06-27 09:16:59 +02:00
dist-check.mk maint: fix build_programs definition not to use "make -C src ..." 2012-09-01 21:28:13 +02:00
HACKING maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
init.cfg tests: fix usage of require_ulimit_ 2013-04-25 11:13:48 +01:00
Makefile.am maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
NEWS shred: fix direct I/O failures for last write to file 2013-11-08 13:33:50 +00:00
README doc: link to the list of rejected feature requests 2013-05-12 13:04:27 +01:00
README-hacking maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
README-package-renamed-to-coreutils doc: mention the new coreutils@ mailing lists 2010-06-02 17:41:52 +02:00
README-prereq maint: update the instructions for building prerequisites 2013-10-15 11:05:49 +01:00
README-release maint: improve make src/fs-magic-compare 2013-03-24 02:29:57 +00:00
README-valgrind maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00
thanks-gen maint: generate much of the THANKS file 2011-01-01 10:56:49 +01:00
THANKS.in md5sum, sha*sum: improve help for --check related options 2013-11-01 22:39:34 +00:00
THANKStt.in *** empty log message *** 2002-08-26 13:04:49 +00:00
TODO maint: update all copyright year number ranges 2013-01-01 04:51:20 +01:00

These are the GNU core utilities.  This package is the union of
the GNU fileutils, sh-utils, and textutils packages.

Most of these programs have significant advantages over their Unix
counterparts, such as greater speed, additional options, and fewer
arbitrary limits.

The programs that can be built with this package are:

  [ arch base64 basename cat chcon chgrp chmod chown chroot cksum comm cp
  csplit cut date dd df dir dircolors dirname du echo env expand expr
  factor false fmt fold groups head hostid hostname id install join kill
  link ln logname ls md5sum mkdir mkfifo mknod mktemp mv nice nl nohup
  nproc numfmt od paste pathchk pinky pr printenv printf ptx pwd readlink
  realpath rm rmdir runcon seq sha1sum sha224sum sha256sum sha384sum sha512sum
  shred shuf sleep sort split stat stdbuf stty sum sync tac tail tee test
  timeout touch tr true truncate tsort tty uname unexpand uniq unlink
  uptime users vdir wc who whoami yes

See the file NEWS for a list of major changes in the current release.

If you obtained this file as part of a "git clone", then see the
README-hacking file.  If this file came to you as part of a tar archive,
then see the file INSTALL for compilation and installation instructions.

These programs are intended to conform to POSIX (with BSD and other
extensions), like the rest of the GNU system.  By default they conform
to older POSIX (1003.2-1992), and therefore support obsolete usages
like "head -10" and "chown owner.group file".  This default is
overridden at build-time by the value of <unistd.h>'s _POSIX2_VERSION
macro, and this in turn can be overridden at runtime as described in
the documentation under "Standards conformance".

The ls, dir, and vdir commands are all separate executables instead of
one program that checks argv[0] because people often rename these
programs to things like gls, gnuls, l, etc.  Renaming a program
file shouldn't affect how it operates, so that people can get the
behavior they want with whatever name they want.

Special thanks to Paul Eggert, Brian Matthews, Bruce Evans, Karl Berry,
Kaveh Ghazi, and François Pinard for help with debugging and porting
these programs.  Many thanks to all of the people who have taken the
time to submit problem reports and fixes.  All contributed changes are
attributed in the commit logs.

And thanks to the following people who have provided accounts for
portability testing on many different types of systems: Bob Proulx,
Christian Robert, François Pinard, Greg McGary, Harlan Stenn,
Joel N. Weber, Mark D. Roth, Matt Schalit, Nelson H. F. Beebe,
Réjean Payette, Sam Tardieu.

Thanks to Michael Stone for inflicting test releases of this package
on Debian's unstable distribution, and to all the kind folks who used
that distribution and found and reported bugs.

Note that each man page is now automatically generated from a template
and from the corresponding --help usage message.  Patches to the template
files (man/*.x) are welcome.  However, the authoritative documentation
is in texinfo form in the doc directory.


*****************************************
On Mac OS X 10.5.1 (Darwin 9.1), test failure
-----------------------------------------

Mac OS X 10.5.1 (Darwin 9.1) provides only partial (and incompatible)
ACL support, so although "./configure && make" succeeds, "make check"
exposes numerous failures.  The solution is to turn off ACL support
manually via "./configure --disable-acl".  For details, see
<http://thread.gmane.org/gmane.comp.gnu.coreutils.bugs/12292/focus=12318>.


*****************************************
Test failure with NLS and gettext <= 0.17
-----------------------------------------

Due to a conflict between libintl.h and gnulib's new xprintf module,
when you configure with NLS support, and with a gettext installation
older than 0.17.1 (not yet released, at the time of this writing),
then some tests fail, at least on NetBSD 1.6.  To work around it in
the mean time, you can configure with --disable-nls.  For details,
see <http://thread.gmane.org/gmane.comp.lib.gnulib.bugs/12015/>.


***********************
Pre-C99 build failure
-----------------------

There is a new, implicit build requirement:
To build the coreutils from source, you should have a C99-conforming
compiler, due to the use of declarations after non-declaration statements
in several files in src/.  There is code in configure to find and, if
possible, enable an appropriate compiler.  However, if configure doesn't
find a C99 compiler, it continues nonetheless, and your build will fail.
If that happens, simply[*] apply the included patch using the following
command, and then run make again:

  cd src && patch < c99-to-c89.diff

[*] however, as of coreutils-7.1, the "c99-to-c89.diff" file is no longer
maintained, so even if the patches still apply, the result will be an
incomplete conversion.  It's been 10 years.  Get a decent compiler! ;-)


***********************
HPUX 11.x build failure
-----------------------

A known problem exists when compiling on HPUX on both hppa and ia64
in 64-bit mode (i.e. +DD64) on HP-UX 11.0, 11.11, and 11.23.  This
is not due to a bug in the package but instead due to a bug in the
system header file which breaks things in 64-bit mode.  The default
compilation mode is 32-bit and the software compiles fine using the
default mode.  To build this software in 64-bit mode you will need
to fix the system /usr/include/inttypes.h header file.  After
correcting that file the software also compiles fine in 64-bit mode.
Here is one possible patch to correct the problem:

--- /usr/include/inttypes.h.orig	Thu May 30 01:00:00 1996
+++ /usr/include/inttypes.h	Sun Mar 23 00:20:36 2003
@@ -489 +489 @@
-#ifndef __STDC_32_MODE__
+#ifndef __LP64__


************************
OSF/1 4.0d build failure
------------------------

If you use /usr/bin/make on an OSF/1 4.0d system, it will fail due
to the presence of the "[" target.  That version of make appears to
treat "[" as some syntax relating to locks.  To work around that,
the best solution is to use GNU make.  Otherwise, simply remove
all mention of "[$(EXEEXT)" from src/Makefile.


*************************************************
"make check" failure on IRIX 6.5 and Solaris <= 9
-------------------------------------------------

Using the vendor make program to run "make check" fails on these two systems.
If you want to run all of the tests there, use GNU make.



**********************
Running tests as root:
----------------------

If you run the tests as root, note that a few of them create files
and/or run programs as a non-root user, 'nobody' by default.
If you want to use some other non-root username, specify it via
the NON_ROOT_USERNAME environment variable.  Depending on the
permissions with which the working directories have been created,
using 'nobody' may fail, because that user won't have the required
read and write access to the build and test directories.
I find that it is best to unpack and build as a non-privileged
user, and then to run the following command as that user in order
to run the privilege-requiring tests:

  sudo env PATH="$PATH" NON_ROOT_USERNAME=$USER make -k check-root

If you can run the tests as root, please do so and report any
problems.  We get much less test coverage in that mode, and it's
arguably more important that these tools work well when run by
root than when run by less privileged users.


***************
Reporting bugs:
---------------

IMPORTANT: if you take the time to report a test failure,
please be sure to include the output of running 'make check'
in verbose mode for each failing test.  For example,
if the test that fails is tests/df/df-P.sh, then you would
run this command:

  make check TESTS=tests/df/df-P.sh VERBOSE=yes SUBDIRS=. >> log 2>&1

For some tests, you can get even more detail by adding DEBUG=yes.
Then include the contents of the file 'log' in your bug report.

Send bug reports, questions, comments, etc. to bug-coreutils@gnu.org.
If you would like to suggest a patch, see the files README-hacking
and HACKING for tips.

***************************************

There are many tests, but nowhere near as many as we need.
Additions and corrections are very welcome.

If you see a problem that you've already reported, feel free to re-report
it -- it won't bother me to get a reminder.  Besides, the more messages I
get regarding a particular problem the sooner it'll be fixed -- usually.
If you sent a complete patch and, after a couple weeks you haven't
received any acknowledgement, please ping us.  A complete patch includes
a well-written ChangeLog entry, unified (diff -u format) diffs relative
to the most recent test release (or, better, relative to the latest
sources in the public repository), an explanation for why the patch is
necessary or useful, and if at all possible, enough information to
reproduce whatever problem prompted it.  Plus, you'll earn lots of
karma if you include a test case to exercise any bug(s) you fix.
Here are instructions for checking out the latest development sources:

  http://savannah.gnu.org/git/?group=coreutils

If your patch adds a new feature, please try to get some sort of consensus
that it is a worthwhile change.  One way to do that is to send mail to
coreutils@gnu.org including as much description and justification
as you can.  Based on the feedback that generates, you may be able to
convince us that it's worth adding.  Please also consult the list of
previously discussed but ultimately rejected feature requests at:
http://www.gnu.org/software/coreutils/rejected_requests.html


WARNING:  Now that we use the ./bootstrap script, you should not run
autoreconf manually.  Doing that will overwrite essential source files
with older versions, which may make the package unbuildable or introduce
subtle bugs.


WARNING:  If you modify files like configure.in, m4/*.m4, aclocal.m4,
or any Makefile.am, then don't be surprised if what gets regenerated no
longer works.  To make things work, you'll have to be using appropriate
versions of the tools listed in bootstrap.conf's buildreq string.

All of these programs except 'test' recognize the '--version' option.
When reporting bugs, please include in the subject line both the package
name/version and the name of the program for which you found a problem.

For general documentation on the coding and usage standards
this distribution follows, see the GNU Coding Standards,
http://www.gnu.org/prep/standards_toc.html.

For any copyright year range specified as YYYY-ZZZZ in this package
note that the range specifies every single year in that closed interval.

Mail suggestions and bug reports for these programs to
the address on the last line of --help output.


========================================================================

Copyright (C) 1998-2013 Free Software Foundation, Inc.

Permission is granted to copy, distribute and/or modify this document
under the terms of the GNU Free Documentation License, Version 1.3 or
any later version published by the Free Software Foundation; with no
Invariant Sections, with no Front-Cover Texts, and with no Back-Cover
Texts.  A copy of the license is included in the "GNU Free
Documentation License" file as part of this distribution.