Provided by: manpages-posix_2017a-2_all bug

PROLOG

       This  manual  page  is part of the POSIX Programmer's Manual.  The Linux implementation of this interface
       may differ (consult the corresponding Linux manual page for details of Linux behavior), or the  interface
       may not be implemented on Linux.

NAME

       sort — sort, merge, or sequence check text files

SYNOPSIS

       sort [-m] [-o output] [-bdfinru] [-t char] [-k keydef]... [file...]

       sort [-c|-C] [-bdfinru] [-t char] [-k keydef] [file]

DESCRIPTION

       The sort utility shall perform one of the following functions:

        1. Sort lines of all the named files together and write the result to the specified output.

        2. Merge lines of all the named (presorted) files together and write the result to the specified output.

        3. Check that a single input file is correctly presorted.

       Comparisons  shall  be  based  on one or more sort keys extracted from each line of input (or, if no sort
       keys are specified, the entire line up to, but not including, the terminating <newline>),  and  shall  be
       performed  using the collating sequence of the current locale. If this collating sequence does not have a
       total ordering of all characters (see  the  Base  Definitions  volume  of  POSIX.1‐2017,  Section  7.3.2,
       LC_COLLATE),  any  lines  of input that collate equally should be further compared byte-by-byte using the
       collating sequence for the POSIX locale.

OPTIONS

       The sort utility shall conform to the Base Definitions volume  of  POSIX.1‐2017,  Section  12.2,  Utility
       Syntax Guidelines, except for Guideline 9, and the -k keydef option should follow the -b, -d, -f, -i, -n,
       and -r options. In addition, '+' may be recognized as an option delimiter as well as '-'.

       The following options shall be supported:

       -c        Check  that  the  single  input file is ordered as specified by the arguments and the collating
                 sequence of the current locale. Output shall not be sent to  standard  output.  The  exit  code
                 shall indicate whether or not disorder was detected or an error occurred. If disorder (or, with
                 -u,  a duplicate key) is detected, a warning message shall be sent to standard error indicating
                 where the disorder or duplicate key was found.

       -C        Same as -c, except that a warning message shall not be sent to standard error if  disorder  or,
                 with -u, a duplicate key is detected.

       -m        Merge only; the input file shall be assumed to be already sorted.

       -o output Specify  the name of an output file to be used instead of the standard output. This file can be
                 the same as one of the input files.

       -u        Unique: suppress all but one in each set of lines having equal  keys.   If  used  with  the  -c
                 option,  check  that  there  are no lines with duplicate keys, in addition to checking that the
                 input file is sorted.

       The following options shall override the default ordering rules. When ordering options appear independent
       of any key field specifications, the requested field ordering rules shall be applied globally to all sort
       keys. When attached to a specific key (see -k), the specified ordering options shall override all  global
       ordering options for that key.

       -d        Specify  that  only  <blank>  characters  and alphanumeric characters, according to the current
                 setting of LC_CTYPE, shall be significant in comparisons. The behavior is undefined for a  sort
                 key to which -i or -n also applies.

       -f        Consider  all  lowercase  characters  that have uppercase equivalents, according to the current
                 setting of LC_CTYPE, to be the uppercase equivalent for the purposes of comparison.

       -i        Ignore all characters that are non-printable, according to the  current  setting  of  LC_CTYPE.
                 The behavior is undefined for a sort key for which -n also applies.

       -n        Restrict  the sort key to an initial numeric string, consisting of optional <blank> characters,
                 optional <hyphen-minus> character, and zero or more digits with an optional radix character and
                 thousands separators (as defined in the current locale), which shall be  sorted  by  arithmetic
                 value.  An  empty digit string shall be treated as zero. Leading zeros and signs on zeros shall
                 not affect ordering.

       -r        Reverse the sense of comparisons.

       The treatment of field separators can be altered using the options:

       -b        Ignore leading <blank> characters when determining the  starting  and  ending  positions  of  a
                 restricted  sort  key.  If  the  -b option is specified before the first -k option, it shall be
                 applied to all -k options. Otherwise, the -b option can be attached independently  to  each  -k
                 field_start or field_end option-argument (see below).

       -t char   Use  char  as the field separator character; char shall not be considered to be part of a field
                 (although it can be included in a sort key). Each occurrence of char shall be significant  (for
                 example,  <char><char>  delimits  an  empty  field). If -t is not specified, <blank> characters
                 shall be used  as  default  field  separators;  each  maximal  non-empty  sequence  of  <blank>
                 characters that follows a non-<blank> shall be a field separator.

       Sort keys can be specified using the options:

       -k keydef The  keydef  argument  is a restricted sort key field definition. The format of this definition
                 is:

                     field_start[type][,field_end[type]]

                 where field_start and field_end define a key field restricted to a portion of the line (see the
                 EXTENDED DESCRIPTION section), and type is one or more modifiers from the  list  of  characters
                 'b',  'd',  'f',  'i',  'n',  'r'.  The 'b' modifier shall behave like the -b option, but shall
                 apply only to the field_start or field_end to which it is attached. The other  modifiers  shall
                 behave  like the corresponding options, but shall apply only to the key field to which they are
                 attached; they shall have this effect if specified with field_start, field_end, or both. If any
                 modifier is attached to a field_start or to a field_end,  no  option  shall  apply  to  either.
                 Implementations  shall  support  at  least  nine  occurrences  of the -k option, which shall be
                 significant in command line order. If no -k option is specified, a  default  sort  key  of  the
                 entire line shall be used.

                 When  there  are  multiple key fields, later keys shall be compared only after all earlier keys
                 compare equal. Except when the -u option is specified, lines that otherwise compare equal shall
                 be ordered as if none of the options -d, -f, -i, -n, or -k were present (but with -r  still  in
                 effect, if it was specified) and with all bytes in the lines significant to the comparison. The
                 order in which lines that still compare equal are written is unspecified.

OPERANDS

       The following operand shall be supported:

       file      A pathname of a file to be sorted, merged, or checked. If no file operands are specified, or if
                 a  file  operand  is  '-',  the  standard input shall be used. If sort encounters an error when
                 opening or reading a file operand, it may exit without writing any output to standard output or
                 processing later operands.

STDIN

       The standard input shall be used only if no file operands are specified, or if a  file  operand  is  '-'.
       See the INPUT FILES section.

INPUT FILES

       The  input  files shall be text files, except that the sort utility shall add a <newline> to the end of a
       file ending with an incomplete last line.

ENVIRONMENT VARIABLES

       The following environment variables shall affect the execution of sort:

       LANG      Provide a default value for the internationalization variables that are unset or null. (See the
                 Base Definitions volume of POSIX.1‐2017, Section 8.2, Internationalization  Variables  for  the
                 precedence   of   internationalization  variables  used  to  determine  the  values  of  locale
                 categories.)

       LC_ALL    If set to a non-empty string value, override the values of all the  other  internationalization
                 variables.

       LC_COLLATE
                 Determine the locale for ordering rules.

       LC_CTYPE  Determine  the  locale  for the interpretation of sequences of bytes of text data as characters
                 (for example, single-byte as opposed to multi-byte characters in arguments and input files) and
                 the behavior of character classification for the -b, -d, -f, -i, and -n options.

       LC_MESSAGES
                 Determine the locale that should be used to  affect  the  format  and  contents  of  diagnostic
                 messages written to standard error.

       LC_NUMERIC
                 Determine  the locale for the definition of the radix character and thousands separator for the
                 -n option.

       NLSPATH   Determine the location of message catalogs for the processing of LC_MESSAGES.

ASYNCHRONOUS EVENTS

       Default.

STDOUT

       Unless the -o or -c options are in effect, the standard output shall contain the sorted input.

STDERR

       The standard error shall be used for diagnostic messages. When -c is specified, if disorder  is  detected
       (or  if -u is also specified and a duplicate key is detected), a message shall be written to the standard
       error which identifies the input line at which disorder (or a duplicate  key)  was  detected.  A  warning
       message  about  correcting an incomplete last line of an input file may be generated, but need not affect
       the final exit status.

OUTPUT FILES

       If the -o option is in effect, the sorted input shall be written to the file output.

EXTENDED DESCRIPTION

       The notation:

           -k field_start[type][,field_end[type]]

       shall define a key field that begins at field_start and ends at field_end inclusive,  unless  field_start
       falls  beyond  the  end  of  the line or after field_end, in which case the key field is empty. A missing
       field_end shall mean the last character of the line.

       A field comprises a maximal sequence of non-separating characters and, in the absence of option  -t,  any
       preceding field separator.

       The field_start portion of the keydef option-argument shall have the form:

           field_number[.first_character]

       Fields  and  characters  within  fields  shall  be  numbered  starting  with  1.   The  field_number  and
       first_character pieces, interpreted as positive decimal integers, shall specify the first character to be
       used as part of a sort key. If .first_character is omitted, it shall refer to the first character of  the
       field.

       The field_end portion of the keydef option-argument shall have the form:

           field_number[.last_character]

       The field_number shall be as described above for field_start.  The last_character piece, interpreted as a
       non-negative  decimal  integer,  shall  specify the last character to be used as part of the sort key. If
       last_character evaluates to zero or .last_character is omitted, it shall refer to the last  character  of
       the field specified by field_number.

       If  the  -b  option  or b type modifier is in effect, characters within a field shall be counted from the
       first non-<blank> in the field. (This shall apply separately to first_character and last_character.)

EXIT STATUS

       The following exit values shall be returned:

        0    All input files were output successfully, or -c was specified and  the  input  file  was  correctly
             sorted.

        1    Under  the  -c option, the file was not ordered as specified, or if the -c and -u options were both
             specified, two input lines were found with equal keys.

       >1    An error occurred.

CONSEQUENCES OF ERRORS

       The default requirements shall apply, except that if sort encounters an error when opening or  reading  a
       file operand, it may exit without writing any output to standard output or processing later operands.

       The following sections are informative.

APPLICATION USAGE

       The  default  value  for  -t, <blank>, has different properties from, for example, -t"<space>". If a line
       contains:

           <space><space>foo

       the following treatment would occur with default  separation  as  opposed  to  specifically  selecting  a
       <space>:
                                     ┌───────┬───────────────────┬──────────────┐
                                     │ FieldDefault-t "<space>" │
                                     ├───────┼───────────────────┼──────────────┤
                                     │   1   │ <space><space>foo │ empty        │
                                     │   2   │ emptyempty        │
                                     │   3   │ empty             │ foo          │
                                     └───────┴───────────────────┴──────────────┘

       The  leading field separator itself is included in a field when -t is not used. For example, this command
       returns an exit status of zero, meaning the input was already sorted:

           sort -c -k 2 <<eof
           y<tab>b
           x<space>a
           eof

       (assuming that a <tab> precedes the <space> in the current collating sequence). The  field  separator  is
       not  included  in a field when it is explicitly set via -t.  This is historical practice and allows usage
       such as:

           sort -t "|" -k 2n <<eof
           Atlanta|425022|Georgia
           Birmingham|284413|Alabama
           Columbia|100385|South Carolina
           eof

       where the second field can be correctly sorted  numerically  without  regard  to  the  non-numeric  field
       separator.

       The  wording  in  the  OPTIONS section clarifies that the -b, -d, -f, -i, -n, and -r options have to come
       before the first sort key specified if they are intended to apply to all specified keys. The  way  it  is
       described  in this volume of POSIX.1‐2017 matches historical practice, not historical documentation.  The
       results are unspecified if these options are specified after a -k option.

       The -f option might not work as expected in locales where there is not a one-to-one  mapping  between  an
       uppercase and a lowercase letter.

       When using sort to process pathnames, it is recommended that LC_ALL, or at least LC_CTYPE and LC_COLLATE,
       are  set  to  POSIX  or C in the environment, since pathnames can contain byte sequences that do not form
       valid characters in some locales, in which case the utility's behavior would be undefined. In  the  POSIX
       locale each byte is a valid single-byte character, and therefore this problem is avoided.

       If  the  collating  sequence of the current locale does not have a total ordering of all characters, this
       can affect the behavior of sort in the following ways:

        *  As sort -u suppresses lines with duplicate keys, it suppresses lines that collate equally but are not
           identical.

        *  The output of sort (without -u) can contain identical lines that are not adjacent,  if  it  does  not
           implement the recommended further byte-by-byte comparison of lines that collate equally. This affects
           the use of sort with comm and uniq; see the APPLICATION USAGE for those utilities.

EXAMPLES

        1. The following command sorts the contents of infile with the second field as the sort key:

               sort -k 2,2 infile

        2. The  following  command  sorts,  in  reverse  order, the contents of infile1 and infile2, placing the
           output in outfile and using the second character of the second field as the sort key  (assuming  that
           the first character of the second field is the field separator):

               sort -r -o outfile -k 2.2,2.2 infile1 infile2

        3. The  following  command sorts the contents of infile1 and infile2 using the second non-<blank> of the
           second field as the sort key:

               sort -k 2.2b,2.2b infile1 infile2

        4. The following command prints the System V password file (user database) sorted by the numeric user ID
           (the third <colon>-separated field):

               sort -t : -k 3,3n /etc/passwd

        5. The following command prints the lines of the already sorted file infile,  suppressing  all  but  one
           occurrence of lines having the same third field:

               sort -um -k 3.1,3.0 infile

RATIONALE

       Examples  in  some  historical documentation state that options -um with one input file keep the first in
       each set of lines with equal keys. This behavior was deemed to be an implementation artifact and was  not
       standardized.

       The  -z  option  was  omitted; it is not standard practice on most systems and is inconsistent with using
       sort to sort several files individually  and  then  merge  them  together.  The  text  concerning  -z  in
       historical documentation appeared to require implementations to determine the proper buffer length during
       the sort phase of operation, but not during the merge.

       The  -y  option  was  omitted because of non-portability. The -M option, present in System V, was omitted
       because of non-portability in international usage.

       An undocumented -T option exists in  some  implementations.  It  is  used  to  specify  a  directory  for
       intermediate  files. Implementations are encouraged to support the use of the TMPDIR environment variable
       instead of adding an option to support this functionality.

       The -k option was added to satisfy two objections. First, the zero-based counting used  by  sort  is  not
       consistent with other utility conventions. Second, it did not meet syntax guideline requirements.

       Historical  documentation indicates that ``setting -n implies -b''.  The description of -n already states
       that optional leading <blank>s are tolerated in doing the comparison.  If  -b  is  enabled,  rather  than
       implied,  by  -n,  this  has unusual side-effects. When a character offset is used in a column of numbers
       (for example, to sort modulo 100), that offset is measured relative to the most significant digit, not to
       the column.  Based upon a recommendation from the author of the original sort utility, the -b implication
       has been omitted from this volume of POSIX.1‐2017, and an application wishing to achieve  the  previously
       mentioned side-effects has to code the -b flag explicitly.

       Earlier  versions  of  this  standard allowed the -o option to appear after operands. Historical practice
       allowed all options to be interspersed with operands. This version of the standard allows implementations
       to accept options after operands but conforming applications should not use this form.

       Earlier versions of this standard also allowed the -number and +number  options.  These  options  are  no
       longer specified by POSIX.1‐2008 but may be present in some implementations.

       Historical  implementations  produced  a message on standard error when -c was specified and disorder was
       detected, and when -c and -u were specified and a duplicate key was detected. An earlier version of  this
       standard  contained  wording  that  did  not  make  it  clear  that  this  message  was  allowed and some
       implementations removed this message to be sure that  they  conformed  to  the  standard's  requirements.
       Confronted  with  this  difference  in  behavior,  interactive users that wanted to be sure that they got
       visual feedback instead of just exit code 1 could have used a command like:

           sort -c file || echo disorder

       whether or not the sort utility provided a message in this case. But, it was not easy for a user to  find
       where the disorder or duplicate key occurred on implementations that do not produce a message, especially
       when  some  parts  of the input line were not part of the key and when one or more of the -b, -d, -f, -i,
       -n, or -r options or keydef type modifiers were in use. POSIX.1‐2008 requires a message to be produced in
       this case. POSIX.1‐2008 also contains the -C option giving users the ability to choose either behavior.

       When a disorder or duplicate is found when the -c option  is  specified,  some  implementations  print  a
       message  containing  the  first  line  that  is  out of order or contains a duplicate key; others print a
       message specifying the line number of the offending line. This standard allows either type of message.

       Implementations are encouraged to perform the recommended further byte-by-byte comparison of  lines  that
       collate  equally,  even  though  this may affect efficiency. The impact on efficiency can be mitigated by
       only performing the additional comparison if the current locale's collating  sequence  does  not  have  a
       total  ordering  of  all  characters  (if  the  implementation  provides  a way to query this) or by only
       performing the additional comparison if the locale name associated with the LC_COLLATE  category  has  an
       '@'  modifier  in  the  name  (since  locales without an '@' modifier should have a total ordering of all
       characters — see the Base Definitions volume of POSIX.1‐2017, Section 7.3.2, LC_COLLATE).  Note  that  if
       the  implementation provides a stable sort option as an extension (usually -s), the additional comparison
       should not be performed when this option has been specified.

FUTURE DIRECTIONS

       A future version of this standard may require that if the collating sequence of the current  locale  does
       not  have a total ordering of all characters, any lines of input that collate equally when comparing them
       as whole lines are further compared byte-by-byte using the collating sequence for the POSIX locale.

SEE ALSO

       comm, join, uniq

       The Base Definitions volume of POSIX.1‐2017, Section 7.3.2, LC_COLLATE, Chapter 8, Environment Variables,
       Section 12.2, Utility Syntax Guidelines

       The System Interfaces volume of POSIX.1‐2017, toupper()

COPYRIGHT

       Portions of this text are reprinted and reproduced in electronic form from IEEE Std 1003.1-2017, Standard
       for Information  Technology  --  Portable  Operating  System  Interface  (POSIX),  The  Open  Group  Base
       Specifications  Issue  7, 2018 Edition, Copyright (C) 2018 by the Institute of Electrical and Electronics
       Engineers, Inc and The Open Group.  In the event of any discrepancy between this version and the original
       IEEE and The Open Group Standard, the original IEEE and The Open Group Standard is the referee  document.
       The original Standard can be obtained online at http://www.opengroup.org/unix/online.html .

       Any  typographical  or formatting errors that appear in this page are most likely to have been introduced
       during  the  conversion  of  the  source  files  to  man  page  format.  To  report  such   errors,   see
       https://www.kernel.org/doc/man-pages/reporting_bugs.html .

IEEE/The Open Group                                   2017                                          SORT(1POSIX)