diff options
Diffstat (limited to 'doc/wget.info')
| -rw-r--r-- | doc/wget.info | 343 |
1 files changed, 189 insertions, 154 deletions
diff --git a/doc/wget.info b/doc/wget.info index a75926a..985b614 100644 --- a/doc/wget.info +++ b/doc/wget.info @@ -1,4 +1,4 @@ -This is wget.info, produced by makeinfo version 6.3 from wget.texi. +This is wget.info, produced by makeinfo version 6.5 from wget.texi. This file documents the GNU Wget utility for downloading network data. @@ -20,7 +20,7 @@ END-INFO-DIR-ENTRY File: wget.info, Node: Top, Next: Overview, Prev: (dir), Up: (dir) -Wget 1.19.1 +Wget 1.19.2 *********** This file documents the GNU Wget utility for downloading network data. @@ -115,7 +115,8 @@ retrieval through HTTP proxies. Startup File::). Wget allows you to define “global” startup files (‘/usr/local/etc/wgetrc’ by default) for site settings. You can also specify the location of a startup file with the –config - option. + option. To disable the reading of config files, use –no-config. + If both –config and –no-config are given, –no-config is ignored. • Finally, GNU Wget is free software. This means that everyone may use it, redistribute it and/or modify it under the terms of the GNU @@ -143,18 +144,18 @@ command line. * Menu: -* URL Format:: -* Option Syntax:: -* Basic Startup Options:: -* Logging and Input File Options:: -* Download Options:: -* Directory Options:: -* HTTP Options:: -* HTTPS (SSL/TLS) Options:: -* FTP Options:: -* Recursive Retrieval Options:: -* Recursive Accept/Reject Options:: -* Exit Status:: +* URL Format:: +* Option Syntax:: +* Basic Startup Options:: +* Logging and Input File Options:: +* Download Options:: +* Directory Options:: +* HTTP Options:: +* HTTPS (SSL/TLS) Options:: +* FTP Options:: +* Recursive Retrieval Options:: +* Recursive Accept/Reject Options:: +* Exit Status:: File: wget.info, Node: URL Format, Next: Option Syntax, Prev: Invoking, Up: Invoking @@ -430,7 +431,10 @@ File: wget.info, Node: Logging and Input File Options, Next: Download Options, resolved to ‘http://foo/baz/b.html’. ‘--config=FILE’ - Specify the location of a startup file you wish to use. + Specify the location of a startup file you wish to use instead of + the default one(s). Use –no-config to disable reading of config + files. If both –config and –no-config are given, –no-config is + ignored. ‘--rejected-log=LOGFILE’ Logs all URL rejections to LOGFILE as comma separated values. The @@ -550,6 +554,11 @@ File: wget.info, Node: Download Options, Next: Directory Options, Prev: Loggi rotated to ‘.2’, ‘.3’, and so on, up to BACKUPS (and lost beyond that). +‘--no-netrc’ + Do not try to obtain credentials from ‘.netrc’ file. By default + ‘.netrc’ file is searched for credentials in case none have been + passed on command line and authentication is required. + ‘-c’ ‘--continue’ Continue getting a partially-downloaded file. This is useful when @@ -1133,6 +1142,11 @@ File: wget.info, Node: HTTP Options, Next: HTTPS (SSL/TLS) Options, Prev: Dir behavior. The old option name is still acceptable, but should now be considered deprecated. + As of version 1.19.2, Wget will also ensure that any downloaded + files with a ‘Content-Encoding’ of ‘br’, ‘compress’, ‘deflate’ or + ‘gzip’ end in the suffix ‘.br’, ‘.Z’, ‘.zlib’ and ‘.gz’ + respectively. + At some point in the future, this option may well be expanded to include suffixes for other types of content, including content types that are not parsed by Wget. @@ -1291,6 +1305,19 @@ File: wget.info, Node: HTTP Options, Next: HTTPS (SSL/TLS) Options, Prev: Dir In versions of Wget prior to 1.10 such use of ‘--header’ caused sending of duplicate headers. +‘--compression=TYPE’ + Choose the type of compression to be used. Legal values are + ‘auto’, ‘gzip’ and ‘none’. + + If ‘auto’ or ‘gzip’ are specified, Wget asks the server to compress + the file using the gzip compression format. If the server + compresses the file and responds with the ‘Content-Encoding’ header + field set appropriately, the file will be decompressed + automatically. This is the default. + + If ‘none’ is specified, wget will not ask the server to compress + the file and will not decompress any server responses. + ‘--max-redirect=NUMBER’ Specifies the maximum number of redirections to follow for a resource. The default is 20, which is usually far more than @@ -1481,7 +1508,7 @@ File: wget.info, Node: HTTP Options, Next: HTTPS (SSL/TLS) Options, Prev: Dir authentication challenges, but accept unsolicited auth info, say, in addition to form-based authentication. -‘--retry-on-http-error=CODE[,CODE,...]’ +‘--retry-on-http-error=CODE[,CODE,...]’ Consider given HTTP response codes as non-fatal, transient errors. Supply a comma-separated list of 3-digit HTTP response codes as argument. Useful to work around special circumstances where @@ -2638,9 +2665,9 @@ say. * Menu: -* Time-Stamping Usage:: -* HTTP Time-Stamping Internals:: -* FTP Time-Stamping Internals:: +* Time-Stamping Usage:: +* HTTP Time-Stamping Internals:: +* FTP Time-Stamping Internals:: File: wget.info, Node: Time-Stamping Usage, Next: HTTP Time-Stamping Internals, Prev: Time-Stamping, Up: Time-Stamping @@ -3020,11 +3047,17 @@ glob = on/off header = STRING Define a header for HTTP downloads, like using ‘--header=STRING’. +compression = STRING + Choose the compression type to be used. Legal values are ‘auto’ + (the default), ‘gzip’, and ‘none’. The same as + ‘--compression=STRING’. + adjust_extension = on/off Add a ‘.html’ extension to ‘text/html’ or ‘application/xhtml+xml’ - files that lack one, or a ‘.css’ extension to ‘text/css’ files that - lack one, like ‘-E’. Previously named ‘html_extension’ (still - acceptable, but deprecated). + files that lack one, a ‘.css’ extension to ‘text/css’ files that + lack one, and a ‘.br’, ‘.Z’, ‘.zlib’ or ‘.gz’ to compressed files + like ‘-E’. Previously named ‘html_extension’ (still acceptable, + but deprecated). http_keep_alive = on/off Turn the keep-alive feature on or off (defaults to on). Turning it @@ -3750,8 +3783,8 @@ File: wget.info, Node: Distribution, Next: Web Site, Prev: Proxies, Up: Vari Like all GNU utilities, the latest version of Wget can be found at the master GNU archive site ftp.gnu.org, and its mirrors. For example, Wget -1.19.1 can be found at -<https://ftp.gnu.org/pub/gnu/wget/wget-1.19.1.tar.gz> +1.19.2 can be found at +<https://ftp.gnu.org/pub/gnu/wget/wget-1.19.2.tar.gz> File: wget.info, Node: Web Site, Next: Mailing Lists, Prev: Distribution, Up: Various @@ -3985,7 +4018,7 @@ further downloads. ‘robots.txt’ is loaded only once per each server. Until version 1.8, Wget supported the first version of the standard, written by Martijn Koster in 1994 and available at -<http://www.robotstxt.org/robotstxt.html>. As of version 1.8, Wget has +<http://www.robotstxt.org/orig.html>. As of version 1.8, Wget has supported the additional directives specified in the internet draft ‘<draft-koster-robots-00.txt>’ titled “A Method for Web Robots Control”. The draft, which has as far as I know never made to an RFC, is available @@ -4001,8 +4034,8 @@ followed by a robot. This is achieved using the ‘META’ tag, like this: <meta name="robots" content="nofollow"> This is explained in some detail at -<http://www.robotstxt.org/wc/meta-user.html>. Wget supports this method -of robot exclusion in addition to the usual ‘/robots.txt’ exclusion. +<http://www.robotstxt.org/meta.html>. Wget supports this method of +robot exclusion in addition to the usual ‘/robots.txt’ exclusion. If you know what you are doing and really really wish to turn off the robot exclusion, set the ‘robots’ variable to ‘off’ in your ‘.wgetrc’. @@ -4675,21 +4708,22 @@ Concept Index * append to log: Logging and Input File Options. (line 11) * arguments: Invoking. (line 6) -* authentication: Download Options. (line 530) -* authentication <1>: HTTP Options. (line 38) -* authentication <2>: HTTP Options. (line 371) +* authentication: Download Options. (line 535) +* authentication <1>: HTTP Options. (line 43) +* authentication <2>: HTTP Options. (line 389) +* authentication credentials: Download Options. (line 113) * backing up converted files: Recursive Retrieval Options. (line 90) * backing up files: Download Options. (line 107) -* bandwidth, limit: Download Options. (line 325) +* bandwidth, limit: Download Options. (line 330) * base for relative links in input file: Logging and Input File Options. (line 104) * bind address: Download Options. (line 6) * bind DNS address: Download Options. (line 11) * bug reports: Reporting Bugs. (line 6) * bugs: Reporting Bugs. (line 6) -* cache: HTTP Options. (line 66) -* caching of DNS lookups: Download Options. (line 409) +* cache: HTTP Options. (line 71) +* caching of DNS lookups: Download Options. (line 414) * case fold: Recursive Accept/Reject Options. (line 62) * client DNS address: Download Options. (line 11) @@ -4698,19 +4732,20 @@ Concept Index * command line: Invoking. (line 6) * comments, HTML: Recursive Retrieval Options. (line 168) -* connect timeout: Download Options. (line 309) -* Content On Error: HTTP Options. (line 358) -* Content-Disposition: HTTP Options. (line 341) -* Content-Length, ignore: HTTP Options. (line 155) -* continue retrieval: Download Options. (line 113) -* continue retrieval <1>: Download Options. (line 172) +* connect timeout: Download Options. (line 314) +* Content On Error: HTTP Options. (line 376) +* Content-Disposition: HTTP Options. (line 359) +* Content-Encoding, choose: HTTP Options. (line 197) +* Content-Length, ignore: HTTP Options. (line 160) +* continue retrieval: Download Options. (line 118) +* continue retrieval <1>: Download Options. (line 177) * contributors: Contributors. (line 6) * conversion of links: Recursive Retrieval Options. (line 32) -* cookies: HTTP Options. (line 75) -* cookies, loading: HTTP Options. (line 85) -* cookies, saving: HTTP Options. (line 133) -* cookies, session: HTTP Options. (line 138) +* cookies: HTTP Options. (line 80) +* cookies, loading: HTTP Options. (line 90) +* cookies, saving: HTTP Options. (line 138) +* cookies, session: HTTP Options. (line 143) * cut directories: Directory Options. (line 32) * debug: Logging and Input File Options. (line 17) @@ -4726,12 +4761,12 @@ Concept Index * directory limits: Directory-Based Limits. (line 6) * directory prefix: Directory Options. (line 59) -* DNS cache: Download Options. (line 409) +* DNS cache: Download Options. (line 414) * DNS IP address, client, DNS: Download Options. (line 11) * DNS IP address, client, DNS <1>: Download Options. (line 19) * DNS server: Download Options. (line 19) -* DNS timeout: Download Options. (line 303) -* dot style: Download Options. (line 184) +* DNS timeout: Download Options. (line 308) +* dot style: Download Options. (line 189) * downloading multiple times: Download Options. (line 68) * EGD: HTTPS (SSL/TLS) Options. (line 131) @@ -4745,7 +4780,7 @@ Concept Index * FDL, GNU Free Documentation License: GNU Free Documentation License. (line 6) * features: Overview. (line 6) -* file names, restrict: Download Options. (line 428) +* file names, restrict: Download Options. (line 433) * file permissions: FTP Options. (line 73) * filling proxy cache: Recursive Retrieval Options. (line 16) @@ -4762,25 +4797,25 @@ Concept Index * ftp user: FTP Options. (line 6) * globbing, toggle: FTP Options. (line 45) * hangup: Signals. (line 6) -* header, add: HTTP Options. (line 166) +* header, add: HTTP Options. (line 171) * hosts, spanning: Spanning Hosts. (line 6) * HSTS: HTTPS (SSL/TLS) Options. (line 150) * HTML comments: Recursive Retrieval Options. (line 168) -* http password: HTTP Options. (line 38) -* http referer: HTTP Options. (line 207) +* http password: HTTP Options. (line 43) +* http referer: HTTP Options. (line 225) * http time-stamping: HTTP Time-Stamping Internals. (line 6) -* http user: HTTP Options. (line 38) -* idn support: Download Options. (line 552) +* http user: HTTP Options. (line 43) +* idn support: Download Options. (line 557) * ignore case: Recursive Accept/Reject Options. (line 62) -* ignore length: HTTP Options. (line 155) +* ignore length: HTTP Options. (line 160) * include directories: Directory-Based Limits. (line 17) -* incomplete downloads: Download Options. (line 113) -* incomplete downloads <1>: Download Options. (line 172) +* incomplete downloads: Download Options. (line 118) +* incomplete downloads <1>: Download Options. (line 177) * incremental updating: Time-Stamping. (line 6) * index.html: HTTP Options. (line 6) * input-file: Logging and Input File Options. @@ -4790,20 +4825,20 @@ Concept Index * Internet Relay Chat: Internet Relay Chat. (line 6) * invoking: Invoking. (line 6) * IP address, client: Download Options. (line 6) -* IPv6: Download Options. (line 478) +* IPv6: Download Options. (line 483) * IRC: Internet Relay Chat. (line 6) -* iri support: Download Options. (line 552) -* Keep-Alive, turning off: HTTP Options. (line 54) +* iri support: Download Options. (line 557) +* Keep-Alive, turning off: HTTP Options. (line 59) * keep-badhash: Logging and Input File Options. (line 73) * latest version: Distribution. (line 6) -* limit bandwidth: Download Options. (line 325) +* limit bandwidth: Download Options. (line 330) * link conversion: Recursive Retrieval Options. (line 32) * links: Following Links. (line 6) * list: Mailing Lists. (line 5) -* loading cookies: HTTP Options. (line 85) -* local encoding: Download Options. (line 561) +* loading cookies: HTTP Options. (line 90) +* local encoding: Download Options. (line 566) * location of wgetrc: Wgetrc Location. (line 6) * log file: Logging and Input File Options. (line 6) @@ -4818,74 +4853,74 @@ Concept Index * no-clobber: Download Options. (line 68) * nohup: Invoking. (line 6) * number of tries: Download Options. (line 26) -* offset: Download Options. (line 172) +* offset: Download Options. (line 177) * operating systems: Portability. (line 6) * option syntax: Option Syntax. (line 6) -* Other HTTP Methods: HTTP Options. (line 308) +* Other HTTP Methods: HTTP Options. (line 326) * output file: Logging and Input File Options. (line 6) * overview: Overview. (line 6) * page requisites: Recursive Retrieval Options. (line 103) * passive ftp: FTP Options. (line 61) -* password: Download Options. (line 530) -* pause: Download Options. (line 345) -* Persistent Connections, disabling: HTTP Options. (line 54) +* password: Download Options. (line 535) +* pause: Download Options. (line 350) +* Persistent Connections, disabling: HTTP Options. (line 59) * portability: Portability. (line 6) -* POST: HTTP Options. (line 240) +* POST: HTTP Options. (line 258) * preferred-location: Logging and Input File Options. (line 93) -* progress indicator: Download Options. (line 184) +* progress indicator: Download Options. (line 189) * proxies: Proxies. (line 6) -* proxy: Download Options. (line 386) -* proxy <1>: HTTP Options. (line 66) -* proxy authentication: HTTP Options. (line 198) +* proxy: Download Options. (line 391) +* proxy <1>: HTTP Options. (line 71) +* proxy authentication: HTTP Options. (line 216) * proxy filling: Recursive Retrieval Options. (line 16) -* proxy password: HTTP Options. (line 198) -* proxy user: HTTP Options. (line 198) +* proxy password: HTTP Options. (line 216) +* proxy user: HTTP Options. (line 216) * quiet: Logging and Input File Options. (line 28) -* quota: Download Options. (line 393) -* random wait: Download Options. (line 368) +* quota: Download Options. (line 398) +* random wait: Download Options. (line 373) * randomness, specifying source of: HTTPS (SSL/TLS) Options. (line 116) -* rate, limit: Download Options. (line 325) -* read timeout: Download Options. (line 314) +* rate, limit: Download Options. (line 330) +* read timeout: Download Options. (line 319) * recursion: Recursive Download. (line 6) * recursive download: Recursive Download. (line 6) -* redirect: HTTP Options. (line 192) +* redirect: HTTP Options. (line 210) * redirecting output: Advanced Usage. (line 89) -* referer, http: HTTP Options. (line 207) +* referer, http: HTTP Options. (line 225) * reject directories: Directory-Based Limits. (line 30) * reject suffixes: Types of Files. (line 39) * reject wildcards: Types of Files. (line 39) * relative links: Relative Links. (line 6) -* remote encoding: Download Options. (line 575) +* remote encoding: Download Options. (line 580) * reporting bugs: Reporting Bugs. (line 6) * required images, downloading: Recursive Retrieval Options. (line 103) -* resume download: Download Options. (line 113) -* resume download <1>: Download Options. (line 172) +* resume download: Download Options. (line 118) +* resume download <1>: Download Options. (line 177) * retries: Download Options. (line 26) -* retries, waiting between: Download Options. (line 359) +* retries, waiting between: Download Options. (line 364) * retrieving: Recursive Download. (line 6) * robot exclusion: Robot Exclusion. (line 6) * robots.txt: Robot Exclusion. (line 6) * sample wgetrc: Sample Wgetrc. (line 6) -* saving cookies: HTTP Options. (line 133) +* saving cookies: HTTP Options. (line 138) * security: Security Considerations. (line 6) * server maintenance: Robot Exclusion. (line 6) -* server response, print: Download Options. (line 269) -* server response, save: HTTP Options. (line 214) -* session cookies: HTTP Options. (line 138) +* server response, print: Download Options. (line 274) +* server response, save: HTTP Options. (line 232) +* session cookies: HTTP Options. (line 143) * signal handling: Signals. (line 6) * spanning hosts: Spanning Hosts. (line 6) * specify config: Logging and Input File Options. (line 117) -* spider: Download Options. (line 274) +* spider: Download Options. (line 279) * SSL: HTTPS (SSL/TLS) Options. (line 6) * SSL certificate: HTTPS (SSL/TLS) Options. @@ -4902,7 +4937,7 @@ Concept Index (line 11) * SSL Public Key Pin: HTTPS (SSL/TLS) Options. (line 104) -* start position: Download Options. (line 172) +* start position: Download Options. (line 177) * startup: Startup File. (line 6) * startup file: Startup File. (line 6) * suffixes, accept: Types of Files. (line 15) @@ -4914,95 +4949,95 @@ Concept Index (line 38) * time-stamping: Time-Stamping. (line 6) * time-stamping usage: Time-Stamping Usage. (line 6) -* timeout: Download Options. (line 285) -* timeout, connect: Download Options. (line 309) -* timeout, DNS: Download Options. (line 303) -* timeout, read: Download Options. (line 314) +* timeout: Download Options. (line 290) +* timeout, connect: Download Options. (line 314) +* timeout, DNS: Download Options. (line 308) +* timeout, read: Download Options. (line 319) * timestamping: Time-Stamping. (line 6) * tries: Download Options. (line 26) -* Trust server names: HTTP Options. (line 363) +* Trust server names: HTTP Options. (line 381) * types of files: Types of Files. (line 6) -* unlink: Download Options. (line 590) +* unlink: Download Options. (line 595) * updating the archives: Time-Stamping. (line 6) * URL: URL Format. (line 6) * URL syntax: URL Format. (line 6) * usage, time-stamping: Time-Stamping Usage. (line 6) -* user: Download Options. (line 530) -* user-agent: HTTP Options. (line 218) +* user: Download Options. (line 535) +* user-agent: HTTP Options. (line 236) * various: Various. (line 6) * verbose: Logging and Input File Options. (line 32) -* wait: Download Options. (line 345) -* wait, random: Download Options. (line 368) -* waiting between retries: Download Options. (line 359) +* wait: Download Options. (line 350) +* wait, random: Download Options. (line 373) +* waiting between retries: Download Options. (line 364) * WARC: HTTPS (SSL/TLS) Options. (line 229) * web site: Web Site. (line 6) -* Wget as spider: Download Options. (line 274) +* Wget as spider: Download Options. (line 279) * wgetrc: Startup File. (line 6) * wgetrc commands: Wgetrc Commands. (line 6) * wgetrc location: Wgetrc Location. (line 6) * wgetrc syntax: Wgetrc Syntax. (line 6) * wildcards, accept: Types of Files. (line 15) * wildcards, reject: Types of Files. (line 39) -* Windows file names: Download Options. (line 428) +* Windows file names: Download Options. (line 433) Tag Table: Node: Top823 Node: Overview2234 -Node: Invoking5791 -Node: URL Format6775 -Ref: URL Format-Footnote-19454 -Node: Option Syntax9560 -Node: Basic Startup Options12338 -Node: Logging and Input File Options13196 -Node: Download Options18409 -Node: Directory Options47749 -Node: HTTP Options50600 -Node: HTTPS (SSL/TLS) Options70116 -Node: FTP Options82649 -Node: Recursive Retrieval Options89711 -Node: Recursive Accept/Reject Options98968 -Node: Exit Status103173 -Node: Recursive Download104208 -Node: Following Links107447 -Node: Spanning Hosts108413 -Node: Types of Files110682 -Node: Directory-Based Limits115576 -Node: Relative Links118843 -Node: FTP Links119693 -Node: Time-Stamping120584 -Node: Time-Stamping Usage122269 -Node: HTTP Time-Stamping Internals124141 -Ref: HTTP Time-Stamping Internals-Footnote-1125489 -Node: FTP Time-Stamping Internals125692 -Node: Startup File127179 -Node: Wgetrc Location128119 -Node: Wgetrc Syntax128973 -Node: Wgetrc Commands129738 -Node: Sample Wgetrc146067 -Node: Examples152095 -Node: Simple Usage152456 -Node: Advanced Usage153905 -Node: Very Advanced Usage157721 -Node: Various159265 -Node: Proxies159974 -Node: Distribution162931 -Node: Web Site163275 -Node: Mailing Lists163575 -Node: Internet Relay Chat165312 -Node: Reporting Bugs165607 -Node: Portability168176 -Node: Signals169823 -Node: Appendices170530 -Node: Robot Exclusion170878 -Node: Security Considerations174753 -Node: Contributors175963 -Node: Copying this manual181693 -Node: GNU Free Documentation License181933 -Node: Concept Index207287 +Node: Invoking5926 +Node: URL Format6786 +Ref: URL Format-Footnote-19465 +Node: Option Syntax9571 +Node: Basic Startup Options12349 +Node: Logging and Input File Options13207 +Node: Download Options18591 +Node: Directory Options48157 +Node: HTTP Options51008 +Node: HTTPS (SSL/TLS) Options71376 +Node: FTP Options83909 +Node: Recursive Retrieval Options90971 +Node: Recursive Accept/Reject Options100228 +Node: Exit Status104433 +Node: Recursive Download105468 +Node: Following Links108707 +Node: Spanning Hosts109673 +Node: Types of Files111942 +Node: Directory-Based Limits116836 +Node: Relative Links120103 +Node: FTP Links120953 +Node: Time-Stamping121844 +Node: Time-Stamping Usage123516 +Node: HTTP Time-Stamping Internals125388 +Ref: HTTP Time-Stamping Internals-Footnote-1126736 +Node: FTP Time-Stamping Internals126939 +Node: Startup File128426 +Node: Wgetrc Location129366 +Node: Wgetrc Syntax130220 +Node: Wgetrc Commands130985 +Node: Sample Wgetrc147578 +Node: Examples153606 +Node: Simple Usage153967 +Node: Advanced Usage155416 +Node: Very Advanced Usage159232 +Node: Various160776 +Node: Proxies161485 +Node: Distribution164442 +Node: Web Site164786 +Node: Mailing Lists165086 +Node: Internet Relay Chat166823 +Node: Reporting Bugs167118 +Node: Portability169687 +Node: Signals171334 +Node: Appendices172041 +Node: Robot Exclusion172389 +Node: Security Considerations176251 +Node: Contributors177461 +Node: Copying this manual183191 +Node: GNU Free Documentation License183431 +Node: Concept Index208785 End Tag Table |