Browse files

Moved to RubyForge during development of 0.1.6.

git-svn-id: svn+ssh://rubyforge.org/var/svn/fastercsv/trunk@1 e365412f-4209-0410-a6b9-d67c64ae9f52
  • Loading branch information...
0 parents commit d9a7c49fb05a74922afcd5664f09b70d6a153cbe @JEG2 committed Jan 1, 2006
Showing with 19,328 additions and 0 deletions.
  1. +1 −0 AUTHORS
  2. +36 −0 CHANGELOG
  3. +340 −0 COPYING
  4. +23 −0 INSTALL
  5. +7 −0 LICENSE
  6. +60 −0 README
  7. +85 −0 Rakefile
  8. +36 −0 TODO
  9. +579 −0 lib/faster_csv.rb
  10. +1,360 −0 setup.rb
  11. +4 −0 svn-commit.tmp
  12. +121 −0 test/tc_csv_parsing.rb
  13. +90 −0 test/tc_csv_writing.rb
  14. +166 −0 test/tc_data_converters.rb
  15. +64 −0 test/tc_features.rb
  16. +141 −0 test/tc_interface.rb
  17. +39 −0 test/tc_speed.rb
  18. +16,161 −0 test/test_data.csv
  19. +15 −0 test/ts_all.rb
1 AUTHORS
@@ -0,0 +1 @@
+<b>James Edward Gray II</b>:: {james@grayproductions.net}[mailto:james@grayproductions.net]
36 CHANGELOG
@@ -0,0 +1,36 @@
+= Change Log
+
+Below is a complete listing of changes for each revision of FasterCSV.
+
+== 0.1.6
+
+* Began using a forked development/stable versioning system.
+* Reorganized initialization code for easier additions and maintenance.
+* Added a check for unknown options. Exceptions will now be thrown for them.
+* Added built-in and custom data converters. Built-in handle numbers and dates.
+* Added Array#to_csv and String#parse_csv. Both accept normal options.
+
+== 0.1.4
+
+* Fixed <tt>:col_sep</tt> escaping bug (reported by Kev Jackson).
+* Switched to the use of named parsers internally.
+
+== 0.1.3
+
+* Fixed typo in gem spec causing a require bug.
+
+== 0.1.2
+
+* Built gem with Ruby 1.8.2, to bypass YAML/RubyGems issue.
+
+== 0.1.1
+
+* Built gem with Ruby 1.8.4 Preview 1, to _try_ and bypass YAML/RubyGems issue.
+* Added missing test file to released packages.
+* Clarified call-seq documentation for open() and parse().
+* Clarified passed String positions for new(), in documentation.
+* Expanded generate() to handle appending to an existing String.
+
+== 0.1.0
+
+* Initial public release.
340 COPYING
@@ -0,0 +1,340 @@
+ GNU GENERAL PUBLIC LICENSE
+ Version 2, June 1991
+
+ Copyright (C) 1989, 1991 Free Software Foundation, Inc.
+ 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA
+ Everyone is permitted to copy and distribute verbatim copies
+ of this license document, but changing it is not allowed.
+
+ Preamble
+
+ The licenses for most software are designed to take away your
+freedom to share and change it. By contrast, the GNU General Public
+License is intended to guarantee your freedom to share and change free
+software--to make sure the software is free for all its users. This
+General Public License applies to most of the Free Software
+Foundation's software and to any other program whose authors commit to
+using it. (Some other Free Software Foundation software is covered by
+the GNU Library General Public License instead.) You can apply it to
+your programs, too.
+
+ When we speak of free software, we are referring to freedom, not
+price. Our General Public Licenses are designed to make sure that you
+have the freedom to distribute copies of free software (and charge for
+this service if you wish), that you receive source code or can get it
+if you want it, that you can change the software or use pieces of it
+in new free programs; and that you know you can do these things.
+
+ To protect your rights, we need to make restrictions that forbid
+anyone to deny you these rights or to ask you to surrender the rights.
+These restrictions translate to certain responsibilities for you if you
+distribute copies of the software, or if you modify it.
+
+ For example, if you distribute copies of such a program, whether
+gratis or for a fee, you must give the recipients all the rights that
+you have. You must make sure that they, too, receive or can get the
+source code. And you must show them these terms so they know their
+rights.
+
+ We protect your rights with two steps: (1) copyright the software, and
+(2) offer you this license which gives you legal permission to copy,
+distribute and/or modify the software.
+
+ Also, for each author's protection and ours, we want to make certain
+that everyone understands that there is no warranty for this free
+software. If the software is modified by someone else and passed on, we
+want its recipients to know that what they have is not the original, so
+that any problems introduced by others will not reflect on the original
+authors' reputations.
+
+ Finally, any free program is threatened constantly by software
+patents. We wish to avoid the danger that redistributors of a free
+program will individually obtain patent licenses, in effect making the
+program proprietary. To prevent this, we have made it clear that any
+patent must be licensed for everyone's free use or not licensed at all.
+
+ The precise terms and conditions for copying, distribution and
+modification follow.
+
+ GNU GENERAL PUBLIC LICENSE
+ TERMS AND CONDITIONS FOR COPYING, DISTRIBUTION AND MODIFICATION
+
+ 0. This License applies to any program or other work which contains
+a notice placed by the copyright holder saying it may be distributed
+under the terms of this General Public License. The "Program", below,
+refers to any such program or work, and a "work based on the Program"
+means either the Program or any derivative work under copyright law:
+that is to say, a work containing the Program or a portion of it,
+either verbatim or with modifications and/or translated into another
+language. (Hereinafter, translation is included without limitation in
+the term "modification".) Each licensee is addressed as "you".
+
+Activities other than copying, distribution and modification are not
+covered by this License; they are outside its scope. The act of
+running the Program is not restricted, and the output from the Program
+is covered only if its contents constitute a work based on the
+Program (independent of having been made by running the Program).
+Whether that is true depends on what the Program does.
+
+ 1. You may copy and distribute verbatim copies of the Program's
+source code as you receive it, in any medium, provided that you
+conspicuously and appropriately publish on each copy an appropriate
+copyright notice and disclaimer of warranty; keep intact all the
+notices that refer to this License and to the absence of any warranty;
+and give any other recipients of the Program a copy of this License
+along with the Program.
+
+You may charge a fee for the physical act of transferring a copy, and
+you may at your option offer warranty protection in exchange for a fee.
+
+ 2. You may modify your copy or copies of the Program or any portion
+of it, thus forming a work based on the Program, and copy and
+distribute such modifications or work under the terms of Section 1
+above, provided that you also meet all of these conditions:
+
+ a) You must cause the modified files to carry prominent notices
+ stating that you changed the files and the date of any change.
+
+ b) You must cause any work that you distribute or publish, that in
+ whole or in part contains or is derived from the Program or any
+ part thereof, to be licensed as a whole at no charge to all third
+ parties under the terms of this License.
+
+ c) If the modified program normally reads commands interactively
+ when run, you must cause it, when started running for such
+ interactive use in the most ordinary way, to print or display an
+ announcement including an appropriate copyright notice and a
+ notice that there is no warranty (or else, saying that you provide
+ a warranty) and that users may redistribute the program under
+ these conditions, and telling the user how to view a copy of this
+ License. (Exception: if the Program itself is interactive but
+ does not normally print such an announcement, your work based on
+ the Program is not required to print an announcement.)
+
+These requirements apply to the modified work as a whole. If
+identifiable sections of that work are not derived from the Program,
+and can be reasonably considered independent and separate works in
+themselves, then this License, and its terms, do not apply to those
+sections when you distribute them as separate works. But when you
+distribute the same sections as part of a whole which is a work based
+on the Program, the distribution of the whole must be on the terms of
+this License, whose permissions for other licensees extend to the
+entire whole, and thus to each and every part regardless of who wrote it.
+
+Thus, it is not the intent of this section to claim rights or contest
+your rights to work written entirely by you; rather, the intent is to
+exercise the right to control the distribution of derivative or
+collective works based on the Program.
+
+In addition, mere aggregation of another work not based on the Program
+with the Program (or with a work based on the Program) on a volume of
+a storage or distribution medium does not bring the other work under
+the scope of this License.
+
+ 3. You may copy and distribute the Program (or a work based on it,
+under Section 2) in object code or executable form under the terms of
+Sections 1 and 2 above provided that you also do one of the following:
+
+ a) Accompany it with the complete corresponding machine-readable
+ source code, which must be distributed under the terms of Sections
+ 1 and 2 above on a medium customarily used for software interchange; or,
+
+ b) Accompany it with a written offer, valid for at least three
+ years, to give any third party, for a charge no more than your
+ cost of physically performing source distribution, a complete
+ machine-readable copy of the corresponding source code, to be
+ distributed under the terms of Sections 1 and 2 above on a medium
+ customarily used for software interchange; or,
+
+ c) Accompany it with the information you received as to the offer
+ to distribute corresponding source code. (This alternative is
+ allowed only for noncommercial distribution and only if you
+ received the program in object code or executable form with such
+ an offer, in accord with Subsection b above.)
+
+The source code for a work means the preferred form of the work for
+making modifications to it. For an executable work, complete source
+code means all the source code for all modules it contains, plus any
+associated interface definition files, plus the scripts used to
+control compilation and installation of the executable. However, as a
+special exception, the source code distributed need not include
+anything that is normally distributed (in either source or binary
+form) with the major components (compiler, kernel, and so on) of the
+operating system on which the executable runs, unless that component
+itself accompanies the executable.
+
+If distribution of executable or object code is made by offering
+access to copy from a designated place, then offering equivalent
+access to copy the source code from the same place counts as
+distribution of the source code, even though third parties are not
+compelled to copy the source along with the object code.
+
+ 4. You may not copy, modify, sublicense, or distribute the Program
+except as expressly provided under this License. Any attempt
+otherwise to copy, modify, sublicense or distribute the Program is
+void, and will automatically terminate your rights under this License.
+However, parties who have received copies, or rights, from you under
+this License will not have their licenses terminated so long as such
+parties remain in full compliance.
+
+ 5. You are not required to accept this License, since you have not
+signed it. However, nothing else grants you permission to modify or
+distribute the Program or its derivative works. These actions are
+prohibited by law if you do not accept this License. Therefore, by
+modifying or distributing the Program (or any work based on the
+Program), you indicate your acceptance of this License to do so, and
+all its terms and conditions for copying, distributing or modifying
+the Program or works based on it.
+
+ 6. Each time you redistribute the Program (or any work based on the
+Program), the recipient automatically receives a license from the
+original licensor to copy, distribute or modify the Program subject to
+these terms and conditions. You may not impose any further
+restrictions on the recipients' exercise of the rights granted herein.
+You are not responsible for enforcing compliance by third parties to
+this License.
+
+ 7. If, as a consequence of a court judgment or allegation of patent
+infringement or for any other reason (not limited to patent issues),
+conditions are imposed on you (whether by court order, agreement or
+otherwise) that contradict the conditions of this License, they do not
+excuse you from the conditions of this License. If you cannot
+distribute so as to satisfy simultaneously your obligations under this
+License and any other pertinent obligations, then as a consequence you
+may not distribute the Program at all. For example, if a patent
+license would not permit royalty-free redistribution of the Program by
+all those who receive copies directly or indirectly through you, then
+the only way you could satisfy both it and this License would be to
+refrain entirely from distribution of the Program.
+
+If any portion of this section is held invalid or unenforceable under
+any particular circumstance, the balance of the section is intended to
+apply and the section as a whole is intended to apply in other
+circumstances.
+
+It is not the purpose of this section to induce you to infringe any
+patents or other property right claims or to contest validity of any
+such claims; this section has the sole purpose of protecting the
+integrity of the free software distribution system, which is
+implemented by public license practices. Many people have made
+generous contributions to the wide range of software distributed
+through that system in reliance on consistent application of that
+system; it is up to the author/donor to decide if he or she is willing
+to distribute software through any other system and a licensee cannot
+impose that choice.
+
+This section is intended to make thoroughly clear what is believed to
+be a consequence of the rest of this License.
+
+ 8. If the distribution and/or use of the Program is restricted in
+certain countries either by patents or by copyrighted interfaces, the
+original copyright holder who places the Program under this License
+may add an explicit geographical distribution limitation excluding
+those countries, so that distribution is permitted only in or among
+countries not thus excluded. In such case, this License incorporates
+the limitation as if written in the body of this License.
+
+ 9. The Free Software Foundation may publish revised and/or new versions
+of the General Public License from time to time. Such new versions will
+be similar in spirit to the present version, but may differ in detail to
+address new problems or concerns.
+
+Each version is given a distinguishing version number. If the Program
+specifies a version number of this License which applies to it and "any
+later version", you have the option of following the terms and conditions
+either of that version or of any later version published by the Free
+Software Foundation. If the Program does not specify a version number of
+this License, you may choose any version ever published by the Free Software
+Foundation.
+
+ 10. If you wish to incorporate parts of the Program into other free
+programs whose distribution conditions are different, write to the author
+to ask for permission. For software which is copyrighted by the Free
+Software Foundation, write to the Free Software Foundation; we sometimes
+make exceptions for this. Our decision will be guided by the two goals
+of preserving the free status of all derivatives of our free software and
+of promoting the sharing and reuse of software generally.
+
+ NO WARRANTY
+
+ 11. BECAUSE THE PROGRAM IS LICENSED FREE OF CHARGE, THERE IS NO WARRANTY
+FOR THE PROGRAM, TO THE EXTENT PERMITTED BY APPLICABLE LAW. EXCEPT WHEN
+OTHERWISE STATED IN WRITING THE COPYRIGHT HOLDERS AND/OR OTHER PARTIES
+PROVIDE THE PROGRAM "AS IS" WITHOUT WARRANTY OF ANY KIND, EITHER EXPRESSED
+OR IMPLIED, INCLUDING, BUT NOT LIMITED TO, THE IMPLIED WARRANTIES OF
+MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE. THE ENTIRE RISK AS
+TO THE QUALITY AND PERFORMANCE OF THE PROGRAM IS WITH YOU. SHOULD THE
+PROGRAM PROVE DEFECTIVE, YOU ASSUME THE COST OF ALL NECESSARY SERVICING,
+REPAIR OR CORRECTION.
+
+ 12. IN NO EVENT UNLESS REQUIRED BY APPLICABLE LAW OR AGREED TO IN WRITING
+WILL ANY COPYRIGHT HOLDER, OR ANY OTHER PARTY WHO MAY MODIFY AND/OR
+REDISTRIBUTE THE PROGRAM AS PERMITTED ABOVE, BE LIABLE TO YOU FOR DAMAGES,
+INCLUDING ANY GENERAL, SPECIAL, INCIDENTAL OR CONSEQUENTIAL DAMAGES ARISING
+OUT OF THE USE OR INABILITY TO USE THE PROGRAM (INCLUDING BUT NOT LIMITED
+TO LOSS OF DATA OR DATA BEING RENDERED INACCURATE OR LOSSES SUSTAINED BY
+YOU OR THIRD PARTIES OR A FAILURE OF THE PROGRAM TO OPERATE WITH ANY OTHER
+PROGRAMS), EVEN IF SUCH HOLDER OR OTHER PARTY HAS BEEN ADVISED OF THE
+POSSIBILITY OF SUCH DAMAGES.
+
+ END OF TERMS AND CONDITIONS
+
+ How to Apply These Terms to Your New Programs
+
+ If you develop a new program, and you want it to be of the greatest
+possible use to the public, the best way to achieve this is to make it
+free software which everyone can redistribute and change under these terms.
+
+ To do so, attach the following notices to the program. It is safest
+to attach them to the start of each source file to most effectively
+convey the exclusion of warranty; and each file should have at least
+the "copyright" line and a pointer to where the full notice is found.
+
+ <one line to give the program's name and a brief idea of what it does.>
+ Copyright (C) <year> <name of author>
+
+ This program is free software; you can redistribute it and/or modify
+ it under the terms of the GNU General Public License as published by
+ the Free Software Foundation; either version 2 of the License, or
+ (at your option) any later version.
+
+ This program is distributed in the hope that it will be useful,
+ but WITHOUT ANY WARRANTY; without even the implied warranty of
+ MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE. See the
+ GNU General Public License for more details.
+
+ You should have received a copy of the GNU General Public License
+ along with this program; if not, write to the Free Software
+ Foundation, Inc., 59 Temple Place, Suite 330, Boston, MA 02111-1307 USA
+
+
+Also add information on how to contact you by electronic and paper mail.
+
+If the program is interactive, make it output a short notice like this
+when it starts in an interactive mode:
+
+ Gnomovision version 69, Copyright (C) year name of author
+ Gnomovision comes with ABSOLUTELY NO WARRANTY; for details type `show w'.
+ This is free software, and you are welcome to redistribute it
+ under certain conditions; type `show c' for details.
+
+The hypothetical commands `show w' and `show c' should show the appropriate
+parts of the General Public License. Of course, the commands you use may
+be called something other than `show w' and `show c'; they could even be
+mouse-clicks or menu items--whatever suits your program.
+
+You should also get your employer (if you work as a programmer) or your
+school, if any, to sign a "copyright disclaimer" for the program, if
+necessary. Here is a sample; alter the names:
+
+ Yoyodyne, Inc., hereby disclaims all copyright interest in the program
+ `Gnomovision' (which makes passes at compilers) written by James Hacker.
+
+ <signature of Ty Coon>, 1 April 1989
+ Ty Coon, President of Vice
+
+This General Public License does not permit incorporating your program into
+proprietary programs. If your program is a subroutine library, you may
+consider it more useful to permit linking proprietary applications with the
+library. If this is what you want to do, use the GNU Library General
+Public License instead of this License.
23 INSTALL
@@ -0,0 +1,23 @@
+= Installing FasterCSV
+
+RubyGems is the preferred easy install method for FasterCSV. However, you can
+install FasterCSV manually as described below.
+
+== Installing the Gem
+
+FasterCSV is intended to be installed via the
+RubyGems[http://rubyforge.org/projects/rubygems/] system. To get the latest
+version, simply enter the following into your command prompt:
+
+ $ sudo gem install fastercsv
+
+You must have RubyGems[http://rubyforge.org/projects/rubygems/] installed for
+the above to work.
+
+== Installing Manually
+
+Download the latest version of FasterCSV from the
+{RubyForge project page}[http://rubyforge.org/frs/?group_id=1102]. Navigate to
+the root project directory and enter:
+
+ $ sudo ruby setup.rb
7 LICENSE
@@ -0,0 +1,7 @@
+= License Terms
+
+Distributed under the user's choice of the GPL[http://www.gnu.org/copyleft/gpl.html] (see COPYING for details) or the
+{Ruby software license}[http://www.ruby-lang.org/en/LICENSE.txt] by
+James Edward Gray II.
+
+Please email James[mailto:james@grayproductions.net] with any questions.
60 README
@@ -0,0 +1,60 @@
+= Read Me
+
+by James Edward Gray II
+
+== Description
+
+Welcome to FasterCSV.
+
+FasterCSV is intended as a replacement to Ruby's standard CSV library. It was designed to address concerns users of that library had and it has three primary goals:
+
+1. Be significantly faster than CSV while remaining a pure Ruby library.
+2. Use a smaller and easier to maintain code base.
+3. Improve on the CSV interface.
+
+Obviously, the last one is subjective. If you love CSV's interface, odds are
+good this one won't suit you. I did try to defer to that interface whenever I
+didn't have a compelling reason to change it though, so hopefully this won't be
+too radically different.
+
+== What's Different From CSV?
+
+I'm sure I'll miss something, but I'll try to mention most of the major differences I am aware of, to help others quickly get up to speed:
+
+=== CSV Parsing
+
+* FasterCSV has a stricter parser and will throw MalformedCSVErrors on
+ problematic data.
+* FasterCSV has a less liberal idea of a line ending than CSV. What you set as
+ the <tt>:row_sep</tt> is law.
+* CSV returns empty lines as <tt>[nil]</tt>. FasterCSV calls them <tt>[]</tt>.
+* FasterCSV has a much faster parser.
+
+=== Interface
+
+* FasterCSV uses Hash-style parameters to set options.
+* FasterCSV does not have generate_row() or parse_row() from CSV.
+* FasterCSV does not have CSV's Reader and Writer classes.
+* FasterCSV::open() is more like Ruby's open() than CSV::open().
+* FasterCSV objects support most standard IO methods.
+* FasterCSV has a new() method used to wrap objects like String and IO for
+ reading and writing.
+* FasterCSV::generate() is different from CSV::generate().
+* FasterCSV does not support partial reads. It works line-by-line.
+* FasterCSV does not allow the instance methods to override the separators for
+ performance reasons. They must be set in the constructor.
+
+If you use this library and find yourself missing any functionality I have trimmed, please {let me know}[mailto:james@grayproductions.net].
+
+== Documentation
+
+See FasterCSV for documentation.
+
+== Installing
+
+See the INSTALL file for instructions.
+
+== Questions and/or Comments
+
+Feel free to email {James Edward Gray II}[mailto:james@grayproductions.net] with
+any questions.
85 Rakefile
@@ -0,0 +1,85 @@
+require "rake/rdoctask"
+require "rake/testtask"
+require "rake/gempackagetask"
+
+require "rubygems"
+
+task :default => [:test]
+
+Rake::TestTask.new do |test|
+ test.libs << "test"
+ test.test_files = [ "test/ts_all.rb" ]
+ test.verbose = true
+end
+
+Rake::RDocTask.new do |rdoc|
+ rdoc.main = "README"
+ rdoc.rdoc_files.include( "README", "INSTALL",
+ "TODO", "CHANGELOG",
+ "AUTHORS", "COPYING",
+ "LICENSE", "lib/" )
+ rdoc.rdoc_dir = "doc/html"
+ rdoc.title = "FasterCSV Documentation"
+end
+
+desc "Upload current documentation to Rubyforge"
+task :upload_docs => [:rdoc] do
+ sh "scp -r doc/html/* " +
+ "bbazzarrakk@rubyforge.org:/var/www/gforge-projects/fastercsv/"
+end
+
+desc "Show library's code statistics"
+task :stats do
+ require 'code_statistics'
+ CodeStatistics.new( ["FasterCSV", "lib"],
+ ["Units", "test"] ).to_s
+end
+
+desc "Time FasterCSV and CSV"
+task :benchmark do
+ path = "test/test_data.csv"
+ sh %Q{time ruby -r csv -e 'CSV.foreach("#{path}") { |row| }'}
+ sh %Q{time ruby -r lib/faster_csv -e 'FasterCSV.foreach("#{path}") { |row| }'}
+end
+
+spec = Gem::Specification.new do |spec|
+ spec.name = "fastercsv"
+ spec.version = "0.1.6"
+ spec.platform = Gem::Platform::RUBY
+ spec.summary = "FasterCSV is CSV, but faster, smaller, and cleaner."
+
+ spec.files = Dir.glob("{lib,test}/**/*.rb").
+ reject { |item| item.include?(".svn") } +
+ Dir.glob("test/**/*.csv").
+ reject { |item| item.include?(".svn") } +
+ ["Rakefile", "setup.rb"]
+ spec.test_suite_file = "test/ts_all.rb"
+
+ spec.has_rdoc = true
+ spec.extra_rdoc_files = %w{README INSTALL TODO CHANGELOG LICENSE}
+ spec.rdoc_options << "--title" << "FasterCSV Documentation" <<
+ "--main" << "README"
+
+ spec.require_path = "lib"
+ spec.autorequire = "faster_csv"
+
+ spec.author = "James Edward Gray II"
+ spec.email = "james@grayproductions.net"
+ spec.rubyforge_project = "fastercsv"
+ spec.homepage = "http://fastercsv.rubyforge.org"
+ spec.description = <<END_DESC
+FasterCSV is intended as a complete replacement to the CSV standard library. It
+is significantly faster and smaller while still being pure Ruby code. It also
+strives for a better interface.
+END_DESC
+end
+
+Rake::GemPackageTask.new(spec) do |pkg|
+ pkg.need_zip = true
+ pkg.need_tar = true
+end
+
+desc "Add new files to Subversion"
+task :add_to_svn do
+ sh %Q{svn status | ruby -nae 'system "svn add \#{$F[1]}" if $F[0] == "?"' }
+end
36 TODO
@@ -0,0 +1,36 @@
+= To Do List
+
+The following is a list of planned expansions for FasterCSV, in no particular
+order.
+
+* Add support for accessing fields by headers (from first row of document).
+* Add "convertors" for switching numbers to Integers or Floats, dates to Date or
+ Time objects, etc.
+* Add Array#to_csv and String#parse_csv.
+* Find a good headers solution for data like this:
+ "Experiment ID: 1",,,,,,,,,,,,
+ "Subject ID: 1013938829432171e868c340.
+ Trial,stimulus,time,type,field1,field2,text_response,Abs. time of
+ response,,,,,
+ 26,undefined,14828,KEY,RETURN,UNUSED,DCS,Sat Oct 15 17:48:04 GMT-0400
+ 2005,,,,,
+ 23,undefined,15078,KEY,RETURN,UNUSED,244,Sat Oct 15 17:48:19 GMT-0400
+ 2005,,,,,
+ 7,nixontrialleft copy.pct [TAG: 1],5953,KEY,1,UNUSED,,Sat Oct 15
+ 17:49:24 GMT-0400 2005,,,,,
+ 8,nixontrialfront copy.pct [TAG: 3],6250,KEY,3,UNUSED,,Sat Oct 15
+ 17:49:31 GMT-0400 2005,,,,,
+ 9,nixontrialright copy.pct [TAG: 2],2469,KEY,2,UNUSED,,Sat Oct 15
+ 17:49:34 GMT-0400 2005,,,,,
+ #####
+ more data
+ ######
+ ,,,,,,,,,,4374.347222,,
+ ,,,,,,,,,,,,1.00
+ ,,,,,,,,,,,,0.93
+ ### and a new block starts
+ "Experiment ID: 3",,,,,,,,,,,,0.92
+ ....
+* Add FasterCSV.filter().
+* Add calculated fields.
+* Add a mode to auto-detect line endings.
579 lib/faster_csv.rb
@@ -0,0 +1,579 @@
+#!/usr/local/bin/ruby -w
+
+# = faster_csv.rb -- Faster CSV Reading and Writing
+#
+# Created by James Edward Gray II on 2005-10-31.
+# Copyright 2005 Gray Productions. All rights reserved.
+#
+# See FasterCSV for documentation.
+
+require "stringio"
+require "forwardable"
+require "enumerator"
+require "date"
+
+#
+# This class provides a complete interface to CSV files and data. It offers
+# tools to enable you to read and write to and from Strings or IO objects, as
+# needed.
+#
+# == Reading
+#
+# === From a File
+#
+# ==== A Line at a Time
+#
+# FasterCSV.foreach("path/to/file.csv") do |row|
+# # use row here...
+# end
+#
+# ==== All at Once
+#
+# arr_of_arrs = FasterCSV.read("path/to/file.csv")
+#
+# === From a String
+#
+# ==== A Line at a Time
+#
+# FasterCSV.parse("CSV,data,String") do |row|
+# # use row here...
+# end
+#
+# ==== All at Once
+#
+# arr_of_arrs = FasterCSV.parse("CSV,data,String")
+#
+# == Writing
+#
+# === To a File
+#
+# FasterCSV.open("path/to/file.csv", "w") do |csv|
+# csv << ["row", "of", "CSV", "data"]
+# csv << ["another", "row"]
+# # ...
+# end
+#
+# === To a String
+#
+# csv_string = FasterCSV.generate do |csv|
+# csv << ["row", "of", "CSV", "data"]
+# csv << ["another", "row"]
+# # ...
+# end
+#
+# == Convert a Single Line
+#
+# csv_string = ["CSV", "data"].to_csv # to CSV
+# csv_array = "CSV,String".parse_csv # from CSV
+#
+class FasterCSV
+ # The error thrown when the parser encounters illegal CSV formatting.
+ class MalformedCSVError < RuntimeError; end
+
+ #
+ # A FieldInfo Struct contains details about a field's position in the data
+ # source it was read from. FasterCSV will pass this Struct to some blocks
+ # that make decisions based on field structure. See
+ # FasterCSV.convert_fields() for an example.
+ #
+ # <b><tt>index</tt></b>:: The zero-based index of the field in its row.
+ # <b><tt>line</tt></b>:: The line of the data source this row is from.
+ #
+ FieldInfo = Struct.new(:index, :line)
+
+ #
+ # This Hash holds the built-in converters of FasterCSV that can be accessed by
+ # name. You can select Converters with FasterCSV.convert() or through the
+ # +options+ Hash passed to FasterCSV::new().
+ #
+ # <b><tt>:integer</tt></b>:: Converts any field Integer() accepts.
+ # <b><tt>:float</tt></b>:: Converts any field Float() accepts.
+ # <b><tt>:numeric</tt></b>:: A combination of <tt>:integer</tt>
+ # and <tt>:float</tt>.
+ # <b><tt>:date</tt></b>:: Converts any field Date::parse() accepts.
+ # <b><tt>:date_time</tt></b>:: Converts any field DateTime::parse() accepts.
+ # <b><tt>:all</tt></b>:: All built-in converters. A combination of
+ # <tt>:date_time</tt> and <tt>:numeric</tt>.
+ #
+ # This Hash is intetionally left unfrozen and users should feel free to add
+ # values to it that can be accessed by all FasterCSV objects.
+ #
+ # To add a combo field, the value should be an Array of names. Combo fields
+ # can be nested with other combo fields.
+ #
+ Converters = { :integer => lambda { |f| Integer(f) rescue f },
+ :float => lambda { |f| Float(f) rescue f },
+ :numeric => [:integer, :float],
+ :date => lambda { |f| Date.parse(f) rescue f },
+ :date_time => lambda { |f| DateTime.parse(f) rescue f },
+ :all => [:date_time, :numeric] }
+
+ #
+ # The options used when no overrides are given by calling code. They are:
+ #
+ # <b><tt>:col_sep</tt></b>:: <tt>","</tt>
+ # <b><tt>:row_sep</tt></b>:: <tt>$/</tt>
+ # <b><tt>:converters</tt></b>:: <tt>nil</tt>
+ #
+ DEFAULT_OPTIONS = {:col_sep => ",", :row_sep => $/, :converters => nil}
+
+ #
+ # This method is intended as the primary interface for reading CSV files. You
+ # pass a +path+ and any +options+ you wish to set for the read. Each row of
+ # file will be passed to the provided +block+ in turn.
+ #
+ # The +options+ parameter can be anthing FasterCSV::new() understands.
+ #
+ def self.foreach( path, options = Hash.new, &block )
+ open(path, options) do |csv|
+ csv.each(&block)
+ end
+ end
+
+ #
+ # :call-seq:
+ # generate( str, options = Hash.new ) { |faster_csv| ... }
+ # generate( options = Hash.new ) { |faster_csv| ... }
+ #
+ # This method wraps a String you provide, or an empty default String, in a
+ # FasterCSV object which is passed to the provided block. You can use the
+ # block to append CSV rows to the String and when the block exits, the
+ # final String will be returned.
+ #
+ # Note that a passed String *is* modfied by this method. Call dup() before
+ # passing if you need a new String.
+ #
+ # The +options+ parameter can be anthing FasterCSV::new() understands.
+ #
+ def self.generate( *args )
+ # add a default empty String, if none was given
+ if args.first.is_a? String
+ io = StringIO.new(args.shift)
+ io.seek(0, IO::SEEK_END)
+ args.unshift(io)
+ else
+ args.unshift("")
+ end
+ faster_csv = new(*args) # wrap
+ yield faster_csv # yield for appending
+ faster_csv.string # return final String
+ end
+
+ #
+ # This method is a shortcut for converting a single row (Array) into a CSV
+ # String.
+ #
+ # The +options+ parameter can be anthing FasterCSV::new() understands.
+ #
+ def self.generate_line( row, options = Hash.new )
+ (new("", options) << row).string
+ end
+
+ #
+ # :call-seq:
+ # open( filename, mode="r", options = Hash.new ) { |faster_csv| ... }
+ # open( filename, mode="r", options = Hash.new )
+ #
+ # This method opens an IO object, and wraps that with FasterCSV. This is
+ # intended as the primary interface for writing a CSV file.
+ #
+ # You may pass any +args+ Ruby's open() understands followed by an optional
+ # Hash containing any +options+ FasterCSV::new() understands.
+ #
+ # This method works like Ruby's open() call, in that it will pass a FasterCSV
+ # object to a provided block and close it when the block termminates, or it
+ # will return the FasterCSV object when no block is provided. (*Note*: This
+ # is different from the standard CSV library which passes rows to the block.
+ # Use FasterCSV::foreach() for that behavior.)
+ #
+ # An opened FasterCSV object will delegate to many IO methods, for
+ # convenience. You may call:
+ #
+ # * binmode()
+ # * close()
+ # * close_read()
+ # * close_write()
+ # * closed?()
+ # * eof()
+ # * eof?()
+ # * fcntl()
+ # * fileno()
+ # * flush()
+ # * fsync()
+ # * ioctl()
+ # * isatty()
+ # * lineno()
+ # * pid()
+ # * pos()
+ # * reopen()
+ # * rewind()
+ # * seek()
+ # * stat()
+ # * sync()
+ # * sync=()
+ # * tell()
+ # * to_i()
+ # * to_io()
+ # * tty?()
+ #
+ def self.open( *args )
+ # find the +options+ Hash
+ options = if args.last.is_a? Hash then args.pop else Hash.new end
+ # wrap a File opened with the remaining +args+
+ csv = new(File.open(*args), options)
+
+ # handle blocks like Ruby's open(), not like the CSV library
+ if block_given?
+ begin
+ yield csv
+ ensure
+ csv.close
+ end
+ else
+ csv
+ end
+ end
+
+ #
+ # :call-seq:
+ # parse( str, options = Hash.new ) { |row| ... }
+ # parse( str, options = Hash.new )
+ #
+ # This method can be used to easily parse CSV out of a String. You may either
+ # provide a +block+ which will be called with each row of the String in turn,
+ # or just use the returned Array of Arrays (when no +block+ is given).
+ #
+ # You pass your +str+ to read from, and an optional +options+ Hash containing
+ # anything FasterCSV::new() understands.
+ #
+ def self.parse( *args, &block )
+ csv = new(*args)
+ if block.nil? # slurp contents, if no block is given
+ begin
+ csv.read
+ ensure
+ csv.close
+ end
+ else # or pass each row to a provided block
+ csv.each(&block)
+ end
+ end
+
+ #
+ # This method is a shortcut for converting a single line of a CSV String into
+ # a into an Array. Note that if +line+ contains multiple rows, anything
+ # beyond the first row is ignored.
+ #
+ # The +options+ parameter can be anthing FasterCSV::new() understands.
+ #
+ def self.parse_line( line, options = Hash.new )
+ new(line, options).shift
+ end
+
+ #
+ # Use to slurp a CSV file into an Array of Arrays. Pass the +path+ to the
+ # file and any +options+ FasterCSV::new() understands.
+ #
+ def self.read( path, options = Hash.new )
+ open(path, options) { |csv| csv.read }
+ end
+
+ # Alias for FasterCSV::read().
+ def self.readlines( *args )
+ read(*args)
+ end
+
+ #
+ # This constructor will wrap either a String or IO object passed in +data+ for
+ # reading and/or writing. In addition to the FasterCSV instance methods,
+ # several IO methods are delegated. (See FasterCSV::open() for a complete
+ # list.) If you pass a String for +data+, you can later retrieve it (after
+ # writing to it, for example) with FasterCSV.string().
+ #
+ # Note that a wrapped String will be positioned at at the beginning (for
+ # reading). If you want it at the end (for writing), use
+ # FasterCSV::generate(). If you want any other positioning, pass a preset
+ # StringIO object instead.
+ #
+ # You may set any reading and/or writing preferences in the +options+ Hash.
+ # Available options are:
+ #
+ # <b><tt>:col_sep</tt></b>:: The String placed between each field.
+ # <b><tt>:row_sep</tt></b>:: The String appended to the end of each row.
+ # <b><tt>:converters</tt></b>:: An Array of names from the Converters Hash
+ # and/or lambdas that handle custom conversion.
+ # A single converter doesn't have to be in an
+ # Array.
+ #
+ # See FasterCSV::DEFAULT_OPTIONS for the default settings.
+ #
+ # Options cannot be overriden in the instance methods for performance reasons,
+ # so be sure to set what you want here.
+ #
+ def initialize( data, options = Hash.new )
+ # build the options for this read/write
+ options = DEFAULT_OPTIONS.merge(options)
+
+ # create the IO object we will read from
+ @io = if data.is_a? String then StringIO.new(data) else data end
+
+ init_separators(options)
+ init_parsers(options)
+ init_converters(options)
+
+ unless options.empty?
+ raise ArgumentError, "Unknown options: #{options.keys.join(', ')}."
+ end
+ end
+
+ ### IO and StringIO Delegation ###
+
+ extend Forwardable
+ def_delegators :@io, :binmode, :close, :close_read, :close_write, :closed?,
+ :eof, :eof?, :fcntl, :fileno, :flush, :fsync, :ioctl,
+ :isatty, :lineno, :pid, :pos, :reopen, :rewind, :seek,
+ :stat, :string, :sync, :sync=, :tell, :to_i, :to_io,
+ :tty?
+
+ ### End Delegation ###
+
+ #
+ # The primary write method for wrapped Strings and IOs, +row+ (an Array) is
+ # converted to CSV and appended to the data source.
+ #
+ # The data source must be open for writing.
+ #
+ def <<( row )
+ @io << row.map do |field|
+ if field.nil? # reverse +nil+ fields as empty unquoted fields
+ ""
+ else
+ field = String(field) # Stringify fields
+ # reverse empty fields as empty quoted fields
+ if field.empty? or field.count(%Q{\r\n#{@col_sep}"}).nonzero?
+ %Q{"#{field.gsub('"', '""')}"} # escape quoted fields
+ else
+ field # unquoted field
+ end
+ end
+ end.join(@col_sep) + @row_sep # add separators
+
+ self # for chaining
+ end
+ alias_method :add_row, :<<
+ alias_method :puts, :<<
+
+ #
+ # :call-seq:
+ # convert( name )
+ # convert { |field| ... }
+ # convert { |field, field_info| ... }
+ #
+ # You can use this method to install a FasterCSV::Converters built-in, or
+ # provide a block that handles a custom conversion.
+ #
+ # If you provide a block that takes one argument, it will be passed the field
+ # and is expected to return the converted value or the field itself. If your
+ # block takes two arguments, it will also be passed a FieldInfo Struct,
+ # containing details about the field. Again, the block should return a
+ # converted field or the field itself.
+ #
+ def convert( name = nil, &converter )
+ if name.nil? # custom converter
+ @converters << converter
+ else # named converter
+ combo = FasterCSV::Converters[name]
+ case combo
+ when Array # combo converter
+ combo.each { |converter_name| convert(converter_name) }
+ else # individual named converter
+ @converters << combo
+ end
+ end
+ end
+
+ include Enumerable
+
+ #
+ # Yields each row of the data source in turn.
+ #
+ # Support for Enumerable.
+ #
+ # The data source must be open for reading.
+ #
+ def each
+ while row = shift
+ yield row
+ end
+ end
+
+ #
+ # Slurps the remaining rows and returns an Array of Arrays.
+ #
+ # The data source must be open for reading.
+ #
+ def read
+ to_a
+ end
+ alias_method :readlines, :read
+
+ #
+ # The primary read method for wrapped Strings and IOs, a single row is pulled
+ # from the data source, parsed and returned as an Array of fields.
+ #
+ # The data source must be open for reading.
+ #
+ def shift
+ # begin with a blank line, so we can always add to it
+ line = ""
+
+ #
+ # it can take multiple calls to <tt>@io.gets()</tt> to get a full line,
+ # because of \r and/or \n characters embedded in quoted fields
+ #
+ loop do
+ # add another read to the line
+ line += @io.gets(@row_sep) rescue return nil
+ # copy the line so we can chop it up in parsing
+ parse = line.dup
+ parse.sub!(@parsers[:line_end], "")
+
+ #
+ # I believe a blank line should be an <tt>Array.new</tt>, not
+ # CSV's <tt>[nil]</tt>
+ #
+ return Array.new if parse.empty?
+
+ #
+ # shave leading empty fields if needed, because the main parser chokes
+ # on these
+ #
+ csv = if parse.sub!(@parsers[:leading_fields], "")
+ [nil] * $&.length
+ else
+ Array.new
+ end
+ #
+ # then parse the main fields with a hyper-tuned Regexp from
+ # Mastering Regular Expressions, Second Edition
+ #
+ parse.gsub!(@parsers[:csv_row]) do
+ csv << if $1.nil? # we found an unquoted field
+ if $2.empty? # switch empty unquoted fields to +nil+...
+ nil # for CSV compatibility
+ else
+ # I decided to take a strict approach to CSV parsing...
+ if $2.count("\r\n").zero? # verify correctness of field...
+ $2
+ else
+ # or throw an Exception
+ raise MalformedCSVError, 'Unquoted fields do not allow \r or \n.'
+ end
+ end
+ else # we found a quoted field...
+ $1.gsub('""', '"') # unescape contents
+ end
+ "" # gsub!'s replacement, clear the field
+ end
+
+ # if parse is empty?(), we found all the fields on the line...
+ if parse.empty?
+ if @converters.empty?
+ break csv
+ else
+ break convert_fields(csv)
+ end
+ end
+ # if we're not empty?() but at eof?(), a quoted field wasn't closed...
+ raise MalformedCSVError, "Unclosed quoted field." if @io.eof?
+ # otherwise, we need to loop and pull some more data to complete the row
+ end
+ end
+ alias_method :gets, :shift
+ alias_method :readline, :shift
+
+ private
+
+ # Stores the indicated separators for later use.
+ def init_separators( options )
+ # store the selected separators
+ @col_sep = options.delete(:col_sep)
+ @row_sep = options.delete(:row_sep)
+ end
+
+ # Pre-compiles parsers and stores them by name for access during reads.
+ def init_parsers( options )
+ # prebuild Regexps for faster parsing
+ @parsers = {
+ :leading_fields =>
+ /\A#{Regexp.escape(@col_sep)}+/, # for empty leading fields
+ :csv_row =>
+ ### The Primary Parser ###
+ / \G(?:^|#{Regexp.escape(@col_sep)}) # anchor the match
+ (?: "((?>[^"]*)(?>""[^"]*)*)" # find quoted fields
+ | # ... or ...
+ ([^"#{Regexp.escape(@col_sep)}]*) # unquoted fields
+ )/x,
+ ### End Primary Parser ###
+ :line_end =>
+ /#{Regexp.escape(@row_sep)}\Z/ # safer than chomp!()
+ }
+ end
+
+ # Loads any converters requested during construction.
+ def init_converters( options )
+ @converters = Array.new
+
+ # load converters
+ unless options[:converters].nil?
+ # allow a single converter not wrapped in an Array
+ unless options[:converters].is_a? Array
+ options[:converters] = [options[:converters]]
+ end
+ # load each converter...
+ options[:converters].each do |converter|
+ if converter.is_a? Proc # custom code block
+ convert(&converter)
+ else # by name
+ convert(converter)
+ end
+ end
+ end
+
+ options.delete(:converters)
+ end
+
+ #
+ # Processes +fields+ with <tt>@converters</tt>, returning the converted field
+ # set. Any converter that changes the field into something other than a
+ # String halts the pipeline of conversion for that field. This is primarily
+ # an efficiency shortcut.
+ #
+ def convert_fields( fields )
+ fields.enum_for(:each_with_index).map do |field, index| # map_with_index
+ @converters.each do |converter|
+ field = if converter.arity == 1 # straight field converter
+ converter[field]
+ else # FieldInfo converter
+ converter[field, FieldInfo.new(index, @io.lineno)]
+ end
+ break unless field.is_a? String # short-curcuit pipeline for speed
+ end
+ field # return final state of each field, converted or original
+ end
+ end
+end
+
+class Array
+ # Equivalent to <tt>FasterCSV::generate_line(self, options)</tt>.
+ def to_csv( options = Hash.new )
+ FasterCSV.generate_line(self, options)
+ end
+end
+
+class String
+ # Equivalent to <tt>FasterCSV::parse_line(self, options)</tt>.
+ def parse_csv( options = Hash.new )
+ FasterCSV.parse_line(self, options)
+ end
+end
1,360 setup.rb
@@ -0,0 +1,1360 @@
+#
+# setup.rb
+#
+# Copyright (c) 2000-2004 Minero Aoki
+#
+# This program is free software.
+# You can distribute/modify this program under the terms of
+# the GNU LGPL, Lesser General Public License version 2.1.
+#
+
+unless Enumerable.method_defined?(:map) # Ruby 1.4.6
+ module Enumerable
+ alias map collect
+ end
+end
+
+unless File.respond_to?(:read) # Ruby 1.6
+ def File.read(fname)
+ open(fname) {|f|
+ return f.read
+ }
+ end
+end
+
+def File.binread(fname)
+ open(fname, 'rb') {|f|
+ return f.read
+ }
+end
+
+# for corrupted windows stat(2)
+def File.dir?(path)
+ File.directory?((path[-1,1] == '/') ? path : path + '/')
+end
+
+
+class SetupError < StandardError; end
+
+def setup_rb_error(msg)
+ raise SetupError, msg
+end
+
+#
+# Config
+#
+
+if arg = ARGV.detect {|arg| /\A--rbconfig=/ =~ arg }
+ ARGV.delete(arg)
+ require arg.split(/=/, 2)[1]
+ $".push 'rbconfig.rb'
+else
+ require 'rbconfig'
+end
+
+def multipackage_install?
+ FileTest.directory?(File.dirname($0) + '/packages')
+end
+
+
+class ConfigItem
+ def initialize(name, template, default, desc)
+ @name = name.freeze
+ @template = template
+ @value = default
+ @default = default.dup.freeze
+ @description = desc
+ end
+
+ attr_reader :name
+ attr_reader :description
+
+ attr_accessor :default
+ alias help_default default
+
+ def help_opt
+ "--#{@name}=#{@template}"
+ end
+
+ def value
+ @value
+ end
+
+ def eval(table)
+ @value.gsub(%r<\$([^/]+)>) { table[$1] }
+ end
+
+ def set(val)
+ @value = check(val)
+ end
+
+ private
+
+ def check(val)
+ setup_rb_error "config: --#{name} requires argument" unless val
+ val
+ end
+end
+
+class BoolItem < ConfigItem
+ def config_type
+ 'bool'
+ end
+
+ def help_opt
+ "--#{@name}"
+ end
+
+ private
+
+ def check(val)
+ return 'yes' unless val
+ unless /\A(y(es)?|n(o)?|t(rue)?|f(alse))\z/i =~ val
+ setup_rb_error "config: --#{@name} accepts only yes/no for argument"
+ end
+ (/\Ay(es)?|\At(rue)/i =~ value) ? 'yes' : 'no'
+ end
+end
+
+class PathItem < ConfigItem
+ def config_type
+ 'path'
+ end
+
+ private
+
+ def check(path)
+ setup_rb_error "config: --#{@name} requires argument" unless path
+ path[0,1] == '$' ? path : File.expand_path(path)
+ end
+end
+
+class ProgramItem < ConfigItem
+ def config_type
+ 'program'
+ end
+end
+
+class SelectItem < ConfigItem
+ def initialize(name, template, default, desc)
+ super
+ @ok = template.split('/')
+ end
+
+ def config_type
+ 'select'
+ end
+
+ private
+
+ def check(val)
+ unless @ok.include?(val.strip)
+ setup_rb_error "config: use --#{@name}=#{@template} (#{val})"
+ end
+ val.strip
+ end
+end
+
+class PackageSelectionItem < ConfigItem
+ def initialize(name, template, default, help_default, desc)
+ super name, template, default, desc
+ @help_default = help_default
+ end
+
+ attr_reader :help_default
+
+ def config_type
+ 'package'
+ end
+
+ private
+
+ def check(val)
+ unless File.dir?("packages/#{val}")
+ setup_rb_error "config: no such package: #{val}"
+ end
+ val
+ end
+end
+
+class ConfigTable_class
+
+ def initialize(items)
+ @items = items
+ @table = {}
+ items.each do |i|
+ @table[i.name] = i
+ end
+ ALIASES.each do |ali, name|
+ @table[ali] = @table[name]
+ end
+ end
+
+ include Enumerable
+
+ def each(&block)
+ @items.each(&block)
+ end
+
+ def key?(name)
+ @table.key?(name)
+ end
+
+ def lookup(name)
+ @table[name] or raise ArgumentError, "no such config item: #{name}"
+ end
+
+ def add(item)
+ @items.push item
+ @table[item.name] = item
+ end
+
+ def remove(name)
+ item = lookup(name)
+ @items.delete_if {|i| i.name == name }
+ @table.delete_if {|name, i| i.name == name }
+ item
+ end
+
+ def new
+ dup()
+ end
+
+ def savefile
+ '.config'
+ end
+
+ def load
+ begin
+ t = dup()
+ File.foreach(savefile()) do |line|
+ k, v = *line.split(/=/, 2)
+ t[k] = v.strip
+ end
+ t
+ rescue Errno::ENOENT
+ setup_rb_error $!.message + "#{File.basename($0)} config first"
+ end
+ end
+
+ def save
+ @items.each {|i| i.value }
+ File.open(savefile(), 'w') {|f|
+ @items.each do |i|
+ f.printf "%s=%s\n", i.name, i.value if i.value
+ end
+ }
+ end
+
+ def [](key)
+ lookup(key).eval(self)
+ end
+
+ def []=(key, val)
+ lookup(key).set val
+ end
+
+end
+
+c = ::Config::CONFIG
+
+rubypath = c['bindir'] + '/' + c['ruby_install_name']
+
+major = c['MAJOR'].to_i
+minor = c['MINOR'].to_i
+teeny = c['TEENY'].to_i
+version = "#{major}.#{minor}"
+
+# ruby ver. >= 1.4.4?
+newpath_p = ((major >= 2) or
+ ((major == 1) and
+ ((minor >= 5) or
+ ((minor == 4) and (teeny >= 4)))))
+
+if c['rubylibdir']
+ # V < 1.6.3
+ _stdruby = c['rubylibdir']
+ _siteruby = c['sitedir']
+ _siterubyver = c['sitelibdir']
+ _siterubyverarch = c['sitearchdir']
+elsif newpath_p
+ # 1.4.4 <= V <= 1.6.3
+ _stdruby = "$prefix/lib/ruby/#{version}"
+ _siteruby = c['sitedir']
+ _siterubyver = "$siteruby/#{version}"
+ _siterubyverarch = "$siterubyver/#{c['arch']}"
+else
+ # V < 1.4.4
+ _stdruby = "$prefix/lib/ruby/#{version}"
+ _siteruby = "$prefix/lib/ruby/#{version}/site_ruby"
+ _siterubyver = _siteruby
+ _siterubyverarch = "$siterubyver/#{c['arch']}"
+end
+libdir = '-* dummy libdir *-'
+stdruby = '-* dummy rubylibdir *-'
+siteruby = '-* dummy site_ruby *-'
+siterubyver = '-* dummy site_ruby version *-'
+parameterize = lambda {|path|
+ path.sub(/\A#{Regexp.quote(c['prefix'])}/, '$prefix')\
+ .sub(/\A#{Regexp.quote(libdir)}/, '$libdir')\
+ .sub(/\A#{Regexp.quote(stdruby)}/, '$stdruby')\
+ .sub(/\A#{Regexp.quote(siteruby)}/, '$siteruby')\
+ .sub(/\A#{Regexp.quote(siterubyver)}/, '$siterubyver')
+}
+libdir = parameterize.call(c['libdir'])
+stdruby = parameterize.call(_stdruby)
+siteruby = parameterize.call(_siteruby)
+siterubyver = parameterize.call(_siterubyver)
+siterubyverarch = parameterize.call(_siterubyverarch)
+
+if arg = c['configure_args'].split.detect {|arg| /--with-make-prog=/ =~ arg }
+ makeprog = arg.sub(/'/, '').split(/=/, 2)[1]
+else
+ makeprog = 'make'
+end
+
+common_conf = [
+ PathItem.new('prefix', 'path', c['prefix'],
+ 'path prefix of target environment'),
+ PathItem.new('bindir', 'path', parameterize.call(c['bindir']),
+ 'the directory for commands'),
+ PathItem.new('libdir', 'path', libdir,
+ 'the directory for libraries'),
+ PathItem.new('datadir', 'path', parameterize.call(c['datadir']),
+ 'the directory for shared data'),
+ PathItem.new('mandir', 'path', parameterize.call(c['mandir']),
+ 'the directory for man pages'),
+ PathItem.new('sysconfdir', 'path', parameterize.call(c['sysconfdir']),
+ 'the directory for man pages'),
+ PathItem.new('stdruby', 'path', stdruby,
+ 'the directory for standard ruby libraries'),
+ PathItem.new('siteruby', 'path', siteruby,
+ 'the directory for version-independent aux ruby libraries'),
+ PathItem.new('siterubyver', 'path', siterubyver,
+ 'the directory for aux ruby libraries'),
+ PathItem.new('siterubyverarch', 'path', siterubyverarch,
+ 'the directory for aux ruby binaries'),
+ PathItem.new('rbdir', 'path', '$siterubyver',
+ 'the directory for ruby scripts'),
+ PathItem.new('sodir', 'path', '$siterubyverarch',
+ 'the directory for ruby extentions'),
+ PathItem.new('rubypath', 'path', rubypath,
+ 'the path to set to #! line'),
+ ProgramItem.new('rubyprog', 'name', rubypath,
+ 'the ruby program using for installation'),
+ ProgramItem.new('makeprog', 'name', makeprog,
+ 'the make program to compile ruby extentions'),
+ SelectItem.new('shebang', 'all/ruby/never', 'ruby',
+ 'shebang line (#!) editing mode'),
+ BoolItem.new('without-ext', 'yes/no', 'no',
+ 'does not compile/install ruby extentions')
+]
+class ConfigTable_class # open again
+ ALIASES = {
+ 'std-ruby' => 'stdruby',
+ 'site-ruby-common' => 'siteruby', # For backward compatibility
+ 'site-ruby' => 'siterubyver', # For backward compatibility
+ 'bin-dir' => 'bindir',
+ 'bin-dir' => 'bindir',
+ 'rb-dir' => 'rbdir',
+ 'so-dir' => 'sodir',
+ 'data-dir' => 'datadir',
+ 'ruby-path' => 'rubypath',
+ 'ruby-prog' => 'rubyprog',
+ 'ruby' => 'rubyprog',
+ 'make-prog' => 'makeprog',
+ 'make' => 'makeprog'
+ }
+end
+multipackage_conf = [
+ PackageSelectionItem.new('with', 'name,name...', '', 'ALL',
+ 'package names that you want to install'),
+ PackageSelectionItem.new('without', 'name,name...', '', 'NONE',
+ 'package names that you do not want to install')
+]
+if multipackage_install?
+ ConfigTable = ConfigTable_class.new(common_conf + multipackage_conf)
+else
+ ConfigTable = ConfigTable_class.new(common_conf)
+end
+
+
+module MetaConfigAPI
+
+ def eval_file_ifexist(fname)
+ instance_eval File.read(fname), fname, 1 if File.file?(fname)
+ end
+
+ def config_names
+ ConfigTable.map {|i| i.name }
+ end
+
+ def config?(name)
+ ConfigTable.key?(name)
+ end
+
+ def bool_config?(name)
+ ConfigTable.lookup(name).config_type == 'bool'
+ end
+
+ def path_config?(name)
+ ConfigTable.lookup(name).config_type == 'path'
+ end
+
+ def value_config?(name)
+ case ConfigTable.lookup(name).config_type
+ when 'bool', 'path'
+ true
+ else
+ false
+ end
+ end
+
+ def add_config(item)
+ ConfigTable.add item
+ end
+
+ def add_bool_config(name, default, desc)
+ ConfigTable.add BoolItem.new(name, 'yes/no', default ? 'yes' : 'no', desc)
+ end
+
+ def add_path_config(name, default, desc)
+ ConfigTable.add PathItem.new(name, 'path', default, desc)
+ end
+
+ def set_config_default(name, default)
+ ConfigTable.lookup(name).default = default
+ end
+
+ def remove_config(name)
+ ConfigTable.remove(name)
+ end
+
+end
+
+
+#
+# File Operations
+#
+
+module FileOperations
+
+ def mkdir_p(dirname, prefix = nil)
+ dirname = prefix + File.expand_path(dirname) if prefix
+ $stderr.puts "mkdir -p #{dirname}" if verbose?
+ return if no_harm?
+
+ # does not check '/'... it's too abnormal case
+ dirs = File.expand_path(dirname).split(%r<(?=/)>)
+ if /\A[a-z]:\z/i =~ dirs[0]
+ disk = dirs.shift
+ dirs[0] = disk + dirs[0]
+ end
+ dirs.each_index do |idx|
+ path = dirs[0..idx].join('')
+ Dir.mkdir path unless File.dir?(path)
+ end
+ end
+
+ def rm_f(fname)
+ $stderr.puts "rm -f #{fname}" if verbose?
+ return if no_harm?
+
+ if File.exist?(fname) or File.symlink?(fname)
+ File.chmod 0777, fname
+ File.unlink fname
+ end
+ end
+
+ def rm_rf(dn)
+ $stderr.puts "rm -rf #{dn}" if verbose?
+ return if no_harm?
+
+ Dir.chdir dn
+ Dir.foreach('.') do |fn|
+ next if fn == '.'
+ next if fn == '..'
+ if File.dir?(fn)
+ verbose_off {
+ rm_rf fn
+ }
+ else
+ verbose_off {
+ rm_f fn
+ }
+ end
+ end
+ Dir.chdir '..'
+ Dir.rmdir dn
+ end
+
+ def move_file(src, dest)
+ File.unlink dest if File.exist?(dest)
+ begin
+ File.rename src, dest
+ rescue
+ File.open(dest, 'wb') {|f| f.write File.binread(src) }
+ File.chmod File.stat(src).mode, dest
+ File.unlink src
+ end
+ end
+
+ def install(from, dest, mode, prefix = nil)
+ $stderr.puts "install #{from} #{dest}" if verbose?
+ return if no_harm?
+
+ realdest = prefix ? prefix + File.expand_path(dest) : dest
+ realdest = File.join(realdest, File.basename(from)) if File.dir?(realdest)
+ str = File.binread(from)
+ if diff?(str, realdest)
+ verbose_off {
+ rm_f realdest if File.exist?(realdest)
+ }
+ File.open(realdest, 'wb') {|f|
+ f.write str
+ }
+ File.chmod mode, realdest
+
+ File.open("#{objdir_root()}/InstalledFiles", 'a') {|f|
+ if prefix
+ f.puts realdest.sub(prefix, '')
+ else
+ f.puts realdest
+ end
+ }
+ end
+ end
+
+ def diff?(new_content, path)
+ return true unless File.exist?(path)
+ new_content != File.binread(path)
+ end
+
+ def command(str)
+ $stderr.puts str if verbose?
+ system str or raise RuntimeError, "'system #{str}' failed"
+ end
+
+ def ruby(str)
+ command config('rubyprog') + ' ' + str
+ end
+
+ def make(task = '')
+ command config('makeprog') + ' ' + task
+ end
+
+ def extdir?(dir)
+ File.exist?(dir + '/MANIFEST')
+ end
+
+ def all_files_in(dirname)
+ Dir.open(dirname) {|d|
+ return d.select {|ent| File.file?("#{dirname}/#{ent}") }
+ }
+ end
+
+ REJECT_DIRS = %w(
+ CVS SCCS RCS CVS.adm .svn
+ )
+
+ def all_dirs_in(dirname)
+ Dir.open(dirname) {|d|
+ return d.select {|n| File.dir?("#{dirname}/#{n}") } - %w(. ..) - REJECT_DIRS
+ }
+ end
+
+end
+
+
+#
+# Main Installer
+#
+
+module HookUtils
+
+ def run_hook(name)
+ try_run_hook "#{curr_srcdir()}/#{name}" or
+ try_run_hook "#{curr_srcdir()}/#{name}.rb"
+ end
+
+ def try_run_hook(fname)
+ return false unless File.file?(fname)
+ begin
+ instance_eval File.read(fname), fname, 1
+ rescue
+ setup_rb_error "hook #{fname} failed:\n" + $!.message
+ end
+ true
+ end
+
+end
+
+
+module HookScriptAPI
+
+ def get_config(key)
+ @config[key]
+ end
+
+ alias config get_config
+
+ def set_config(key, val)
+ @config[key] = val
+ end
+
+ #
+ # srcdir/objdir (works only in the package directory)
+ #
+
+ #abstract srcdir_root
+ #abstract objdir_root
+ #abstract relpath
+
+ def curr_srcdir
+ "#{srcdir_root()}/#{relpath()}"
+ end
+
+ def curr_objdir
+ "#{objdir_root()}/#{relpath()}"
+ end
+
+ def srcfile(path)
+ "#{curr_srcdir()}/#{path}"
+ end
+
+ def srcexist?(path)
+ File.exist?(srcfile(path))
+ end
+
+ def srcdirectory?(path)
+ File.dir?(srcfile(path))
+ end
+
+ def srcfile?(path)
+ File.file? srcfile(path)
+ end
+
+ def srcentries(path = '.')
+ Dir.open("#{curr_srcdir()}/#{path}") {|d|
+ return d.to_a - %w(. ..)
+ }
+ end
+
+ def srcfiles(path = '.')
+ srcentries(path).select {|fname|
+ File.file?(File.join(curr_srcdir(), path, fname))
+ }
+ end
+
+ def srcdirectories(path = '.')
+ srcentries(path).select {|fname|
+ File.dir?(File.join(curr_srcdir(), path, fname))
+ }
+ end
+
+end
+
+
+class ToplevelInstaller
+
+ Version = '3.3.1'
+ Copyright = 'Copyright (c) 2000-2004 Minero Aoki'
+
+ TASKS = [
+ [ 'all', 'do config, setup, then install' ],
+ [ 'config', 'saves your configurations' ],
+ [ 'show', 'shows current configuration' ],
+ [ 'setup', 'compiles ruby extentions and others' ],
+ [ 'install', 'installs files' ],
+ [ 'clean', "does `make clean' for each extention" ],
+ [ 'distclean',"does `make distclean' for each extention" ]
+ ]
+
+ def ToplevelInstaller.invoke
+ instance().invoke
+ end
+
+ @singleton = nil
+
+ def ToplevelInstaller.instance
+ @singleton ||= new(File.dirname($0))
+ @singleton
+ end
+
+ include MetaConfigAPI
+
+ def initialize(ardir_root)
+ @config = nil
+ @options = { 'verbose' => true }
+ @ardir = File.expand_path(ardir_root)
+ end
+
+ def inspect
+ "#<#{self.class} #{__id__()}>"
+ end
+
+ def invoke
+ run_metaconfigs
+ case task = parsearg_global()
+ when nil, 'all'
+ @config = load_config('config')
+ parsearg_config
+ init_installers
+ exec_config
+ exec_setup
+ exec_install
+ else
+ @config = load_config(task)
+ __send__ "parsearg_#{task}"
+ init_installers
+ __send__ "exec_#{task}"
+ end
+ end
+
+ def run_metaconfigs
+ eval_file_ifexist "#{@ardir}/metaconfig"
+ end
+
+ def load_config(task)
+ case task
+ when 'config'
+ ConfigTable.new
+ when 'clean', 'distclean'
+ if File.exist?(ConfigTable.savefile)
+ then ConfigTable.load
+ else ConfigTable.new
+ end
+ else
+ ConfigTable.load
+ end
+ end
+
+ def init_installers
+ @installer = Installer.new(@config, @options, @ardir, File.expand_path('.'))
+ end
+
+ #
+ # Hook Script API bases
+ #
+
+ def srcdir_root
+ @ardir
+ end
+
+ def objdir_root
+ '.'
+ end
+
+ def relpath
+ '.'
+ end
+
+ #
+ # Option Parsing
+ #
+
+ def parsearg_global
+ valid_task = /\A(?:#{TASKS.map {|task,desc| task }.join '|'})\z/
+
+ while arg = ARGV.shift
+ case arg
+ when /\A\w+\z/
+ setup_rb_error "invalid task: #{arg}" unless valid_task =~ arg
+ return arg
+
+ when '-q', '--quiet'
+ @options['verbose'] = false
+
+ when '--verbose'
+ @options['verbose'] = true
+
+ when '-h', '--help'
+ print_usage $stdout
+ exit 0
+
+ when '-v', '--version'
+ puts "#{File.basename($0)} version #{Version}"
+ exit 0
+
+ when '--copyright'
+ puts Copyright
+ exit 0
+
+ else
+ setup_rb_error "unknown global option '#{arg}'"
+ end
+ end
+
+ nil
+ end
+
+
+ def parsearg_no_options
+ unless ARGV.empty?
+ setup_rb_error "#{task}: unknown options: #{ARGV.join ' '}"
+ end
+ end
+
+ alias parsearg_show parsearg_no_options
+ alias parsearg_setup parsearg_no_options
+ alias parsearg_clean parsearg_no_options
+ alias parsearg_distclean parsearg_no_options
+
+ def parsearg_config
+ re = /\A--(#{ConfigTable.map {|i| i.name }.join('|')})(?:=(.*))?\z/
+ @options['config-opt'] = []
+
+ while i = ARGV.shift
+ if /\A--?\z/ =~ i
+ @options['config-opt'] = ARGV.dup
+ break
+ end
+ m = re.match(i) or setup_rb_error "config: unknown option #{i}"
+ name, value = *m.to_a[1,2]
+ @config[name] = value
+ end
+ end
+
+ def parsearg_install
+ @options['no-harm'] = false
+ @options['install-prefix'] = ''
+ while a = ARGV.shift
+ case a
+ when /\A--no-harm\z/
+ @options['no-harm'] = true
+ when /\A--prefix=(.*)\z/
+ path = $1
+ path = File.expand_path(path) unless path[0,1] == '/'
+ @options['install-prefix'] = path
+ else
+ setup_rb_error "install: unknown option #{a}"
+ end
+ end
+ end
+
+ def print_usage(out)
+ out.puts 'Typical Installation Procedure:'
+ out.puts " $ ruby #{File.basename $0} config"
+ out.puts " $ ruby #{File.basename $0} setup"
+ out.puts " # ruby #{File.basename $0} install (may require root privilege)"
+ out.puts
+ out.puts 'Detailed Usage:'
+ out.puts " ruby #{File.basename $0} <global option>"
+ out.puts " ruby #{File.basename $0} [<global options>] <task> [<task options>]"
+
+ fmt = " %-24s %s\n"
+ out.puts
+ out.puts 'Global options:'
+ out.printf fmt, '-q,--quiet', 'suppress message outputs'
+ out.printf fmt, ' --verbose', 'output messages verbosely'
+ out.printf fmt, '-h,--help', 'print this message'
+ out.printf fmt, '-v,--version', 'print version and quit'
+ out.printf fmt, ' --copyright', 'print copyright and quit'
+ out.puts
+ out.puts 'Tasks:'
+ TASKS.each do |name, desc|
+ out.printf fmt, name, desc
+ end
+
+ fmt = " %-24s %s [%s]\n"
+ out.puts
+ out.puts 'Options for CONFIG or ALL:'
+ ConfigTable.each do |item|
+ out.printf fmt, item.help_opt, item.description, item.help_default
+ end
+ out.printf fmt, '--rbconfig=path', 'rbconfig.rb to load',"running ruby's"
+ out.puts
+ out.puts 'Options for INSTALL:'
+ out.printf fmt, '--no-harm', 'only display what to do if given', 'off'
+ out.printf fmt, '--prefix=path', 'install path prefix', '$prefix'
+ out.puts
+ end
+
+ #
+ # Task Handlers
+ #
+
+ def exec_config
+ @installer.exec_config
+ @config.save # must be final
+ end
+
+ def exec_setup
+ @installer.exec_setup
+ end
+
+ def exec_install
+ @installer.exec_install
+ end
+
+ def exec_show
+ ConfigTable.each do |i|
+ printf "%-20s %s\n", i.name, i.value
+ end
+ end
+
+ def exec_clean
+ @installer.exec_clean
+ end
+
+ def exec_distclean
+ @installer.exec_distclean
+ end
+
+end
+
+
+class ToplevelInstallerMulti < ToplevelInstaller
+
+ include HookUtils
+ include HookScriptAPI
+ include FileOperations
+
+ def initialize(ardir)
+ super
+ @packages = all_dirs_in("#{@ardir}/packages")
+ raise 'no package exists' if @packages.empty?
+ end
+
+ def run_metaconfigs
+ eval_file_ifexist "#{@ardir}/metaconfig"
+ @packages.each do |name|
+ eval_file_ifexist "#{@ardir}/packages/#{name}/metaconfig"
+ end
+ end
+
+ def init_installers
+ @installers = {}
+ @packages.each do |pack|
+ @installers[pack] = Installer.new(@config, @options,
+ "#{@ardir}/packages/#{pack}",
+ "packages/#{pack}")
+ end
+
+ with = extract_selection(config('with'))
+ without = extract_selection(config('without'))
+ @selected = @installers.keys.select {|name|
+ (with.empty? or with.include?(name)) \
+ and not without.include?(name)
+ }
+ end
+
+ def extract_selection(list)
+ a = list.split(/,/)
+ a.each do |name|
+ setup_rb_error "no such package: #{name}" unless @installers.key?(name)
+ end
+ a
+ end
+
+ def print_usage(f)
+ super
+ f.puts 'Inluded packages:'
+ f.puts ' ' + @packages.sort.join(' ')
+ f.puts
+ end
+
+ #
+ # multi-package metaconfig API
+ #
+
+ attr_reader :packages
+
+ def declare_packages(list)
+ raise 'package list is empty' if list.empty?
+ list.each do |name|
+ raise "directory packages/#{name} does not exist"\
+ unless File.dir?("#{@ardir}/packages/#{name}")
+ end
+ @packages = list
+ end
+
+ #
+ # Task Handlers
+ #
+
+ def exec_config
+ run_hook 'pre-config'
+ each_selected_installers {|inst| inst.exec_config }
+ run_hook 'post-config'
+ @config.save # must be final
+ end
+
+ def exec_setup
+ run_hook 'pre-setup'
+ each_selected_installers {|inst| inst.exec_setup }
+ run_hook 'post-setup'
+ end
+
+ def exec_install
+ run_hook 'pre-install'
+ each_selected_installers {|inst| inst.exec_install }
+ run_hook 'post-install'
+ end
+
+ def exec_clean
+ rm_f ConfigTable.savefile
+ run_hook 'pre-clean'
+ each_selected_installers {|inst| inst.exec_clean }
+ run_hook 'post-clean'
+ end
+
+ def exec_distclean
+ rm_f ConfigTable.savefile
+ run_hook 'pre-distclean'
+ each_selected_installers {|inst| inst.exec_distclean }
+ run_hook 'post-distclean'
+ end
+
+ #
+ # lib
+ #
+
+ def each_selected_installers
+ Dir.mkdir 'packages' unless File.dir?('packages')
+ @selected.each do |pack|
+ $stderr.puts "Processing the package `#{pack}' ..." if @options['verbose']
+ Dir.mkdir "packages/#{pack}" unless File.dir?("packages/#{pack}")
+ Dir.chdir "packages/#{pack}"
+ yield @installers[pack]
+ Dir.chdir '../..'
+ end
+ end
+
+ def verbose?
+ @options['verbose']
+ end
+
+ def no_harm?
+ @options['no-harm']
+ end
+
+end
+
+
+class Installer
+
+ FILETYPES = %w( bin lib ext data )
+
+ include HookScriptAPI
+ include HookUtils
+ include FileOperations
+
+ def initialize(config, opt, srcroot, objroot)
+ @config = config
+ @options = opt
+ @srcdir = File.expand_path(srcroot)
+ @objdir = File.expand_path(objroot)
+ @currdir = '.'
+ end
+
+ def inspect
+ "#<#{self.class} #{File.basename(@srcdir)}>"
+ end
+
+ #
+ # Hook Script API base methods
+ #
+
+ def srcdir_root
+ @srcdir
+ end
+
+ def objdir_root
+ @objdir
+ end
+
+ def relpath
+ @currdir
+ end
+
+ #
+ # configs/options
+ #
+
+ def no_harm?
+ @options['no-harm']
+ end
+
+ def verbose?
+ @options['verbose']
+ end
+
+ def verbose_off
+ begin
+ save, @options['verbose'] = @options['verbose'], false
+ yield
+ ensure
+ @options['verbose'] = save
+ end
+ end
+
+ #
+ # TASK config
+ #
+
+ def exec_config
+ exec_task_traverse 'config'
+ end
+
+ def config_dir_bin(rel)
+ end
+
+ def config_dir_lib(rel)
+ end
+
+ def config_dir_ext(rel)
+ extconf if extdir?(curr_srcdir())
+ end
+
+ def extconf
+ opt = @options['config-opt'].join(' ')
+ command "#{config('rubyprog')} #{curr_srcdir()}/extconf.rb #{opt}"
+ end
+
+ def config_dir_data(rel)
+ end
+
+ #
+ # TASK setup
+ #
+
+ def exec_setup
+ exec_task_traverse 'setup'
+ end
+
+ def setup_dir_bin(rel)
+ all_files_in(curr_srcdir()).each do |fname|
+ adjust_shebang "#{curr_srcdir()}/#{fname}"
+ end
+ end
+
+ def adjust_shebang(path)
+ return if no_harm?
+ tmpfile = File.basename(path) + '.tmp'
+ begin
+ File.open(path, 'rb') {|r|
+ first = r.gets
+ return unless File.basename(config('rubypath')) == 'ruby'
+ return unless File.basename(first.sub(/\A\#!/, '').split[0]) == 'ruby'
+ $stderr.puts "adjusting shebang: #{File.basename(path)}" if verbose?
+ File.open(tmpfile, 'wb') {|w|
+ w.print first.sub(/\A\#!\s*\S+/, '#! ' + config('rubypath'))
+ w.write r.read
+ }
+ move_file tmpfile, File.basename(path)
+ }
+ ensure
+ File.unlink tmpfile if File.exist?(tmpfile)
+ end
+ end
+
+ def setup_dir_lib(rel)
+ end
+
+ def setup_dir_ext(rel)
+ make if extdir?(curr_srcdir())
+ end
+
+ def setup_dir_data(rel)
+ end
+
+ #
+ # TASK install
+ #
+
+ def exec_install
+ rm_f 'InstalledFiles'
+ exec_task_traverse 'install'
+ end
+
+ def install_dir_bin(rel)
+ install_files collect_filenames_auto(), "#{config('bindir')}/#{rel}", 0755
+ end
+
+ def install_dir_lib(rel)
+ install_files ruby_scripts(), "#{config('rbdir')}/#{rel}", 0644
+ end
+
+ def install_dir_ext(rel)
+ return unless extdir?(curr_srcdir())
+ install_files ruby_extentions('.'),
+ "#{config('sodir')}/#{File.dirname(rel)}",
+ 0555
+ end
+
+ def install_dir_data(rel)
+ install_files collect_filenames_auto(), "#{config('datadir')}/#{rel}", 0644
+ end
+
+ def install_files(list, dest, mode)
+ mkdir_p dest, @options['install-prefix']
+ list.each do |fname|
+ install fname, dest, mode, @options['install-prefix']
+ end
+ end
+
+ def ruby_scripts
+ collect_filenames_auto().select {|n| /\.rb\z/ =~ n }
+ end
+
+ # picked up many entries from cvs-1.11.1/src/ignore.c
+ reject_patterns = %w(
+ core RCSLOG tags TAGS .make.state
+ .nse_depinfo #* .#* cvslog.* ,* .del-* *.olb
+ *~ *.old *.bak *.BAK *.orig *.rej _$* *$
+
+ *.org *.in .*
+ )
+ mapping = {
+ '.' => '\.',
+ '$' => '\$',
+ '#' => '\#',
+ '*' => '.*'
+ }
+ REJECT_PATTERNS = Regexp.new('\A(?:' +
+ reject_patterns.map {|pat|
+ pat.gsub(/[\.\$\#\*]/) {|ch| mapping[ch] }
+ }.join('|') +
+ ')\z')
+
+ def collect_filenames_auto
+ mapdir((existfiles() - hookfiles()).reject {|fname|
+ REJECT_PATTERNS =~ fname
+ })
+ end
+
+ def existfiles
+ all_files_in(curr_srcdir()) | all_files_in('.')
+ end
+
+ def hookfiles
+ %w( pre-%s post-%s pre-%s.rb post-%s.rb ).map {|fmt|
+ %w( config setup install clean ).map {|t| sprintf(fmt, t) }
+ }.flatten
+ end
+
+ def mapdir(filelist)
+ filelist.map {|fname|
+ if File.exist?(fname) # objdir
+ fname
+ else # srcdir
+ File.join(curr_srcdir(), fname)
+ end
+ }
+ end
+
+ def ruby_extentions(dir)
+ Dir.open(dir) {|d|
+ ents = d.select {|fname| /\.#{::Config::CONFIG['DLEXT']}\z/ =~ fname }
+ if ents.empty?
+ setup_rb_error "no ruby extention exists: 'ruby #{$0} setup' first"
+ end
+ return ents
+ }
+ end
+
+ #
+ # TASK clean
+ #
+
+ def exec_clean
+ exec_task_traverse 'clean'
+ rm_f ConfigTable.savefile
+ rm_f 'InstalledFiles'
+ end
+
+ def clean_dir_bin(rel)
+ end
+
+ def clean_dir_lib(rel)