Project

General

Profile

Mod magnet » History » Revision 62

Revision 61 (nitrox, 2010-05-03 13:18) → Revision 62/117 (nitrox, 2011-09-28 00:19)

h1. a power-magnet 

 *Module: mod_magnet* 

 see [[AbsoLUAtion|AbsoLUAtion [[AbsoLUAtion|Abso *lua* tion for additional infos, code-snippets, examples ...]] 

 {{>toc}} 

 h3. Requirements 

 lighttpd 1.4.12 or higher 
 lua >= 5.1 

 h3. Overview 

 mod_magnet is a module to control the request handling in lighty. It allows you to do more complex URL rewrites and caching than you would otherwise be able to do. 

 While the lua language the mod_magnet uses is very powerful, mod_magnet is not meant to be a general replacement for your regular scripting environment. This is because    mod_magnet is executed in the core of Lighty and EVERY long-running operation is blocking ALL connections in the server. You are warned. For time-consuming or blocking scripts use mod_fastcgi and friends. 

 For performance reasons mod_magnet caches the compiled script. For each script-run the script itself is checked for freshness and recompiled if necessary. 


 h3. Installation 

 mod_magnet needs a lighty which is compiled with the lua-support option ( --with-lua). Lua 5.1 or higher are required by 
 the module. 

   server.modules = ( ..., "mod_magnet", ... ) 


 h3. Options 

 mod_magnet can attract a request in several stages in the request-handling.  

 * either at the same level as mod_rewrite, before any parsing of the URL is done 
 * or at a later stage, when the doc-root is known and the physical-path is already setup 

 It depends on the purpose of the script which stage you want to intercept. Usually you want to use the 2nd stage where the physical-path which relates to your request is known. At this level you can run checks against lighty.env["physical.path"]. 

   magnet.attract-raw-url-to = ( ... ) 
   magnet.attract-physical-path-to = ( [absolute path to lua script]    ) 

 You can define multiple scripts when separated by a comma. The scripts are executed in the specified order. If one of them returns a bad status-code, the following scripts will not be executed. 


 h3. Tables 

 Most of the interaction between mod_magnet and lighty is done through tables. Tables in lua are hashes (Perl, Ruby), dictionaries (Java, Python), associative arrays (PHP), ... 

 * lighty.request[] - certain request headers like Host, Cookie, or User-Agent are available 
 * lighty.env[] 

  * physical.path 
  * physical.rel-path 
  * physical.doc-root 
  * uri.path (the URI without the query-string) 
  * uri.path-raw  
  * uri.scheme (http or https) 
  * uri.authority (the server-name) 
  * uri.query (the URI after the ? ) 
  * request.method (e.g. GET) 
  * request.uri (uri after rewrite) 
  * request.orig-uri (before rewrite) 
  * request.protocol (e.g. HTTP/1.0) 

 * lighty.header[] - certain response headers like Location are available 
 * lighty.status[] 
 * lighty.content[] 

 You can loop with "pairs()" through the special tables "lighty.request", "lighty.env", "lighty.req_env" and "lighty.status"; "lighty.header" and and "lighty.content" are normal lua tables, so you can use them with "pairs()" too. 

 h3. lighty.env[] 

 Lighttpd has its internal variables which are exported as read/write to the magnet.  

 If "http://example.org/search.php?q=lighty" is requested this results in a request like :: 

 <pre> 
   GET /search.php?q=lighty HTTP/1.1 
   Host: example.org 
 </pre> 

 When you are using ``attract-raw-url-to`` you can access the following variables: 

 * parts of the request-line 

  * lighty.env["request.uri"] = "/search.php?q=lighty" 

 * HTTP request-headers 

  * lighty.request["Host"] = "example.org" 

 Later in the request-handling, the URL is splitted, cleaned up and turned into a physical path name: 

 * parts of the URI 

  * lighty.env["uri.path"] = "/search.php" 
  * lighty.env["uri.path-raw"] = "/search.php" 
  * lighty.env["uri.scheme"] = "http" 
  * lighty.env["uri.authority"] = "example.org" 
  * lighty.env["uri.query"] = "q=lighty" 

 * filenames, pathnames 

  * lighty.env["physical.path"] = "/my-docroot/search.php" 
  * lighty.env["physical.rel-path"] = "/search.php" 
  * lighty.env["physical.doc-root"] = "/my-docroot" 

 All of them are readable, not all of the are writable (or don't have an effect if you write to them).  

 h2. WHICH VARIABLES SUPPORT WRITING? 


 As a start, you might want to use those variables for writing: :: 

 <pre> 
   -- 1. simple rewriting is done via the request.uri 
   lighty.env["request.uri"] = ...  
   return lighty.RESTART_REQUEST 

   -- 2. changing the physical-path 
   lighty.env["physical.path"] = ... 

   -- 3. changing the query-string 
   lighty.env["uri.query"] = ... 
 </pre> 


 h3. lighty.header[] 

 If you want to set a response header for your request, you can add a field to the lighty.header[] table: :: 

   lighty.header["Content-Type"] = "text/html" 


 h3. lighty.status[] 

 mod_status support a global statistics page and mod_magnet allows to add and update values in the status page: 

 Config 

   status.statistics-url = "/server-counters" 
   magnet.attract-raw-url-to = (server.docroot + "/counter.lua") 

 counter.lua 

   lighty.status["core.connections"] = lighty.status["core.connections"] + 1 

 Result 

   core.connections: 7 
   fastcgi.backend.php-foo.0.connected: 0 
   fastcgi.backend.php-foo.0.died: 0 
   fastcgi.backend.php-foo.0.disabled: 0 
   fastcgi.backend.php-foo.0.load: 0 
   fastcgi.backend.php-foo.0.overloaded: 0 
   fastcgi.backend.php-foo.1.connected: 0 
   fastcgi.backend.php-foo.1.died: 0 
   fastcgi.backend.php-foo.1.disabled: 0 
   fastcgi.backend.php-foo.1.load: 0 
   fastcgi.backend.php-foo.1.overloaded: 0 
   fastcgi.backend.php-foo.load: 0 


 h3. Exported Functions 

 mod-magnet exports a few functions to the script: 

 * print (writes to the error-log) 
 * lighty.stat() 
 * pairs() (extends the default pairs() function) 


 h3. print() 

 print() overwrites the lua-default version and sends the content to the errorlog. 


 h3. lighty.stat() 

 lighty.stat() checks the existence of a file/dir/socket and returns the stat() information for it. 
 It is using lighty's internal stat-cache.:: 

   /** 
   * array lighty.stat(path) 
   *  
   * @param path (string) absolute path to stat() 
   * @returns array or nil on error 
   */ 

 If the call was successful you'll be able to query the following fields from the array: 

 * is_file 
 * is_dir 
 * is_char 
 * is_block 
 * is_socket 
 * is_link 
 * is_fifo 
 * st_mtime 
 * st_ctime 
 * st_atime 
 * st_uid 
 * st_gui 
 * st_size 
 * st_ino 
 * etag 
 * content-type 


 h3. Sending Content 

 You can generate your own content and send it out to the clients. :: 

 <pre> 
   lighty.content = { "<pre>", { filename = "/etc/passwd" }, "</pre>" } 
   lighty.header["Content-Type"] = "text/html" 

   return 200 
 </pre> 

 The lighty.content[] table is executed when the script is finished. The elements of the array are processed left to right and the elements can either be a string or a table. Strings are included AS IS into the output of the request. 

 * Strings 

   * are included as is 

 * Tables 

   * filename = "<absolute-path>" is required 
   * offset = <number> [default: 0] 
   * length = <number> [default: size of the file] 

 This results in sending the range [offset, length-1] of the file. 

 Internally lighty will use the sendfile() call to send out the static files at full speed. 


 h3. Status Codes 

 You might have seen it already in other examples: In case you are handling the request completly in the magnet you 
 can return your own status-codes. Examples are: Redirected, Input Validation, ... :: 

 <pre> 
   if (lighty.env["uri.scheme"] == "http") then 
     lighty.header["Location"] = "https://" .. lighty.env["uri.authority"] .. lighty.env["request.uri"] 
     return 302 
   end 
 </pre> 

 You every number above and equal to 100 is taken as final status code and finishes the request. No other modules are  
 executed after this return. 

 A special return-code is lighty.RESTART_REQUEST (currently equal to 99) which is usually used in combination with  
 changing the request.uri in a rewrite. It restarts the splitting of the request-uri again. 

 If you return nothing (or nil) the request-handling just continues. 


 h3. Debugging 

 To easy debugging we overloaded the print()-function in lua and redirect the output of print() to the error-log. :: 

 <pre> 
   print("Host: " .. lighty.request["Host"]) 
   print("Request-URI: " .. lighty.env["request.uri"]) 
 </pre> 


 h3. Examples 

 see [[AbsoLUAtion|Abso *lua* tion for additional infos, code-snippets, examples ...]] 


 h3. Porting mod_cml scripts 

 mod_cml got replaced by mod_magnet. 

 A CACHE_HIT in mod_cml 
 
 <pre> 
   output_include = { "file1", "file2" }  

   return CACHE_HIT 
 </pre> 

 becomes 

 <pre> 
   lighty.content = { { filename = "/path/to/file1" }, { filename = "/path/to/file2"} } 

   return 200 
 </pre> 

 while a CACHE_MISS like (CML) :: 

 <pre> 
   trigger_handler = "/index.php" 

   return CACHE_MISS 
 </pre> 

 becomes (magnet) 

 <pre> 
   lighty.env["request.uri"] = "/index.php" 

   return lighty.RESTART_REQUEST 

 </pre>