TODO 12 KB
Newer Older
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
1
* Decree that versions older than 2 years are not supported,
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
2 3 4 5
  maybe remove them from upgrade tests
  (or split upgrade tests in two test sets: short and long).
  We should already not support anything older than 2.019 or so
  (still used by LispWorks).
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
6 7
  Yet, we should keep supporting upgrading from what vendors provide
  — so push them to provide recent stuff.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
8

Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
9
* Moving toward cross-compilation (ASDF 3.2?)
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
10 11 12 13 14 15
   This would allow to get all or most of the benefits of XCVB
   (reproducibility, scalability, applicability to mobile platforms, etc.),
   except without the backward incompatibility of XCVB.
** Need to further split asdf:perform in two parts:
   A part that runs on the host and specifies (as SEXP or string to read)
   a form that must be evaluated on the target machine, not the host.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
16 17 18 19
   A trivial that runs on the target and doesn't require the network
   of objects related to the ASDF plan to be present,
   or even ASDF itself, for the matter (though UIOP, yes, for sanity).
** Audit all the current specializers of perform, and offer them a new way;
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
20
   they can keep the perform method to run on older versions of ASDF.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
21 22
** Modify SBCL and other implementations so they provide UIOP
   independently from ASDF?
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
23

Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83
* Implementation bugs
** CMUCL has bugs:
*** In ASDF 2.32.13, sibling-dependencies is renamed to sideway-dependencies
    in defclass component, a superclass of system, and upgrade from
    2.32 or earlier thus fails with
    Error in function KERNEL:CLASS-TYPEP:  Class is currently invalid:
    #<KERNEL::STANDARD-CLASS ASDF/SYSTEM:SYSTEM {58398145}>
    in a direct call from ASDF/FIND-SYSTEM:LOCATE-SYSTEM,
    which suggests CMUCL's PCL fails to finalize classes properly.
*** Non-default optimize settings may or may not subtly break PCL.
    For the longest time (from 2.26.136 to 3.1.0.42), ASDF had:
    (declaim (optimize (speed 1) (safety 3) (debug 3)))
    This form may or may not work around that breakage in some cases:
    (setf c::top-level-lambda-max 0)
*** At some point there was massive breakage due to uninitialized slots
    as revealed in 3.1.0.37 with
    make t l=cmucl t=test-encodings.script
    which was a different PCL bug from the above (without same workaround)
    but possibly also triggered by the non-standard declaim.

** XCL has bad bugs:
   make-pathname doesn't handle :type nil properly and
   has massive lossage in logical-pathname support.
   If using block () and return in search-for-system-definition
   instead of return-from, XCL mistakenly has the return jump
   to the end of the try function or something.
   It also takes a long time for errors to propagate into a debugging REPL —
   Maybe O(n^3) behavior or worse in walking the C++ stack?
   The backtrace frames may contains unprintable objects.
   make-pathname fails to copy the version from the defaults.
   (make-pathname :host "ASDFTEST" :directory '(:absolute "system2" "module4")
    :name nil :type nil) fails to handle the logical-pathname-ness of ASDFTEST.

** GCL is almost working again; but implementation bugs remain.
   See November 2013 discussion on gcl-devel.
    * Another GCL compiler bug:
    when I changed the definition of getcwd from
    (let ((*default-pathname-defaults* #p"")) (truename #p"")) to
    (let ((*default-pathname-defaults* *nil-pathname*)) (truename *nil-pathname*))
    to guard against e.g. a logical-pathname context while loading asdf
    and parsing #p"", calls to getcwd result in a segfault.
    * An another bug: gcl refuses dynamic-extent declaration on functions.
     uiop/stream.lisp:         #-gcl (declare (dynamic-extent ,@(when
     before `(#',beforef)) ,@(when after `(#',afterf))))
    * (typep p 'logical-pathname) should be T if p has a logical-pathname host.
    * apropos is case-sensitive and returns a same symbol many times
    * compile-file fails to return proper secondary values in case of non-style WARNING.
    * (pathname-directory #p"foo/") is incorrectly ("foo") instead of (:RELATIVE "foo")
    * Missing: chdir, combine-fasls, and plenty more UIOP functions.
    * Do whatever it takes to pass the asdf tests, add the above?
    * Have (require "asdf") and (require "ASDF") both work.
    * Trying to uiop:slurp-stream-forms from a stream with #+(or) :foo
      (or read-file-forms from an file with same) results in an error,
      rather than nil. This is probably a bug in #+ processing.
      Unhappily, debian creates such a file in
      /etc/common-lisp/asdf-output-translations.conf.d/01-common-lisp-controller.conf
    * Tests that try to catch an error fail (but catching a warning succeeds),
      which suggests brokenness in handler-bind and/or error.

** Find out why ABCL fails the timestamp propagation test.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
84 85 86

* Find an easier way to bind variables around compilation and loading of files

Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
87 88 89 90 91
* Design & Implement some out-of-line configuration mechanism for various options?
  i.e. let configuration files override some variables around some actions.
  * Could be used to override new backward-incompatible defaults
   (e.g. for operation propagation, deferred warnings, etc.)
  * Use the above variable binding mechanism.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
92

93
* Fix bugs on http://bugs.launchpad.net/asdf/+bugs
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
94

95
* fix directory-files to not return directories on CCL, etc. Add tests.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
96

97
* use cl-test-grid to see if asdf-user can :use most (all?) of UIOP.
98 99
  Unhappily, on SBCL, sb-grovel uses asdf and sb-ext,
  which causes a clash with run-program.
100
  Or has this been changed long enough ago? Can it be special-cased?
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
101

Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
102
* have a mode to explain WHY a component needs to be recompiled.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
103

104
* have a better defsystem form verifier - see lp#1007335
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
105

106 107 108
* have a function verify-strict-asd that can verify a asd is pure lp#541562
  Then if it passes, use load-strict-asd.
  If not, optionally issue a warning. Start migrating people toward that.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
109

110
* have with-input-file use the encodings mechanism?
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
111

112
* have a single test .asd that tests as many features as possible, use it for upgrade test.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
113

114
* Bug found by fe[nl]ix: infinite loop if the definitions in an asd file
115 116 117
  are not in strict defsystem-depends-on dependency order.
** At least document the issue.
** Real solution: defer parsing and evaluation of defsystem forms.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
118

119
* Learn to use cl-grid-test, to make sure ASDF changes don't break stuff,
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
120
 and that breakage gets fixed quickly.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
121 122

* Include some ABL test for stassats's (now obsolete?) thing:
123 124
   (asdf:enable-asdf-binary-locations-compatibility
    :centralize-lisp-binaries t :default-toplevel-directory *fasl-dir*)
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
125

Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
126 127
* Make load-op a generic operation that selects the proper strategy
  for each system, module or file, according to component properties and user-configuration:
128
  compile the lisp file then load the fasl (load-fasl-op on a cl-source-file),
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
129
  load the lisp file without compiling (load-source-op),
130 131
  compile all files for the system, link them and load the result
   (load-fasl-op on the system),
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
132 133 134 135
  compile all files for the system *and* its dependencies, link and load (monolithic-load-fasl-op),
  concatenate all files for the system, then load the result (load-concatenated-source-op),
  concatenate all files for the system, then link them and load the result (load-compiled-concatenated-op),
  concatenate all files for the system *and* its dependencies, link and load (monolithic-load-compiled-concatenated-op).
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
136

137 138
* operation cleanup?
** Kill backward-compat functions after all clients have moved on.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
139
** Kill original-initargs -- BEWARE, it currently has clients!
140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166
** To allow semantically distinct operations of the same class:
You'd need to have a protocol to canonicalize them
in the *OPERATIONS* memoization table, not by class name,
but by CONS of the class name and some CANONICAL-OPERATION-INITARGS.
The latter would be a generic function called on the initargs,
where any parasite initargs such as FORCE and FORCE-NOT have been removed,
since they below to the PLAN, not the OPERATION:
the OPERATE protocol would be refined to explicit split
arguments to be passed to MAKE-PLAN or to MAKE-OPERATION.
The default method for CANONICAL-OPERATION-INITARGS
would SORT (a plist->alist of) the initargs,
and that would replace the current ORIGINAL-INITARGS slot.
For this scheme to work even in presence of undisciplined users
using MAKE-INSTANCE on an operation class,
the OPERATION class would have an extra slot EFFECTIVE-OPERATION,
uninitialized by default (nil or unbound), whose accessor initializes it
if it's uninitialized, by looking up a canonical instance in *OPERATIONS*,
and if unfound registering the current operation as canonical.
Then, each component's COMPONENT-OPERATION-TIME hash-table
would be indexed by canonicalized operation object
rather than by operation class,
and POIU would have to be changed accordingly.
Of course, this entire cleanup is incompatible
with how SWANK and GBBopen currently abuse slots of operation,
so these would have to be fixed first.
And that's why I didn't do it.
It looks like SWANK can be fixed soon, though, so we'll see.
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
167

168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241
* Get rid of component-properties
** directly use component-properties:
*** yaclml.asd => misguided :features for version comparison
*** amazon-ecs-20110418-git/amazon-ecs.asd => :website property
*** hemlock.asd => bad implementation of latin1 encodings
** .asd use :properties
*** arnesi, arnesi+ => :features, misguided for version comparison and pseudo #+features
*** lkcas, thopter => :long-name
*** cl-irc cliki-bot rss cl-syslog com.informatimago.clext
   com.informatimago.clisp com.informatimago.clmisc
   com.informatimago.common-lisp.arithmetic
   om.informatimago.common-lisp.bank
   com.informatimago.common-lisp.cesarum
   com.informatimago.common-lisp com.informatimago.common-lisp.csv
   com.informatimago.common-lisp.cxx
   com.informatimago.common-lisp.data-encoding
   com.informatimago.common-lisp.diagram
   com.informatimago.common-lisp.ed
   com.informatimago.common-lisp.graphviz
   com.informatimago.common-lisp.heap
   com.informatimago.common-lisp.html-base
   com.informatimago.common-lisp.html-generator
   com.informatimago.common-lisp.html-parser
   com.informatimago.common-lisp.http
   com.informatimago.common-lisp.interactive
   com.informatimago.common-lisp.invoice
   com.informatimago.common-lisp.lisp
   com.informatimago.common-lisp.lisp.ibcl
   com.informatimago.common-lisp.lisp.stepper
   com.informatimago.common-lisp.lisp-reader
   com.informatimago.common-lisp.lisp-sexp
   com.informatimago.common-lisp.lisp-text
   com.informatimago.common-lisp.parser
   com.informatimago.common-lisp.picture
   com.informatimago.common-lisp.regexp
   com.informatimago.common-lisp.rfc2822
   com.informatimago.common-lisp.rfc3548
   com.informatimago.common-lisp.telnet
   com.informatimago.common-lisp.unix
   linc
   com.informatimago.lispdoc
   com.informatimago.lua
   com.informatimago.cocoa-playground
   com.informatimago.objcl
   com.informatimago.rdp
   com.informatimago.rdp.basic
   com.informatimago.rdp.basic.example
   com.informatimago.rdp.example
   com.informatimago.susv3
   com.informatimago.common-lisp.tools.make-depends
   com.informatimago.xcode
   spartns
   xlunit
   => (uninterned!)
   #:author-email #:date
   (#:albert #:output-dirs)
   (#:albert #:formats)
   (#:albert #:docbook #:template)
   (#:albert #:docbook #:bgcolor)
   (#:albert #:docbook #:textcolor)
   (#:albert #:docbook #:dtd)
*** portableaserve
   =>
   ("system" "author" "email")
   ("albert" "presentation" "output-dir")
   ("albert" "presentation" "formats")
   ("albert" "docbook" "dtd")
   ("albert" "docbook" "template")
*** com.clearly-useful.generic-collection-interface => :com.clearly-useful
*** metatilities
   => :ait-timeout :system-applicable-p
*** ucw ucw-core 
   =>
   version
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
242 243 244

* ASDF4: search for this tag, rename things (incompatibly, thus) and cleanup code.

245 246
* See message from 2014-01-27 05:26:44 GMT for stuff to document.
   http://thread.gmane.org/gmane.lisp.asdf.devel/3675/focus=3695
Francois-Rene Rideau's avatar
Francois-Rene Rideau committed
247 248 249 250 251 252 253

* deferred-warnings support probably needs to be redone better.
  * implement deferred warnings support on lispworks
  * work with cl-test-grid to eliminate deferred warnings from quicklisp libraries
  * https://www.mail-archive.com/asdf-devel@common-lisp.net/msg03608.html
  * czak@google.com rewrote part of deferred warnings support.
   Ask him for the code he implemented at Google.