- Jul 07, 2010
-
-
rtoy authored
mac-roman.lisp: o Fix code so that the offending codepoint on output is actually passed to the error routine. (Previously, we returned the value from the table which was always nil because the code did not have a valid output.)
-
rtoy authored
too-large codepoint, swallow the whole sequence instead of putting back the characters like we did previously. (This new way is in line with how we handle other bad sequences.) o Pass the number of octets read to the error handler in these cases. o Update the message strings to include the number of octets.
-
rtoy authored
-
- Jul 06, 2010
- Jul 05, 2010
-
-
rtoy authored
-
rtoy authored
args. o Generate different error messages for surrogate code points and code points that are too large.
-
rtoy authored
for asdf and defsystem. make-extra-dist.sh: o Fix up the grep patterns to skip over what we wanted. (Use egrep instead of grep, and change \| to |.) This makes sure that the extras tarball doesn't have asdf or defsystem. make-main-dist.sh: o Don't need to touch the asdf/defsystem files anymore.
-
rtoy authored
-
rtoy authored
o Revert previous incompatible change to STRING-DECODE and STRING-ENCODE. Change the keyword parameters back to optional parameters, and make the error parameter the last one. fd-stream.lisp: o Update use of STRING-ENCODE.
-
rtoy authored
For utf-8, also print out the value of the invalid codepoint.
-
rtoy authored
stream the data correctly causing decoding errors. code/sysmacs.lisp: o Need to copy back the in-index that fast-read-char-string-refill updated. code/stream.lisp: o Fix buffering issue when refilling the in-buffer with new data. Code was confused about the difference between in-length and in-buffer-length.
-
rtoy authored
so update code.
-
- Jul 03, 2010
-
-
rtoy authored
-
rtoy authored
-
rtoy authored
o Update comments for the various slots in DEFINE-EXTERNAL-FORMAT. fd-stream.lisp: o Declare the types for the CHAR-TO-OCTETS-ERROR and OCTETS-TO-CHAR-ERROR slots in FD-STREAM. o Update docstrings for MAKE-FD-STREAM and OPEN for :DECODING-ERROR and :ENCODING-ERROR parameters.
-
rtoy authored
variable that was shadowing another.
-
rtoy authored
parameters.
-
rtoy authored
-
rtoy authored
where the external format does not have a flush-state method.
-
rtoy authored
to signal errors on bare surrogates at the end of the output.
-
rtoy authored
o SURROGATEP is not exported from LISP.
-
rtoy authored
o Add error parameter to flush-state in external format definition so we can handle errors when flushing the state to a stream. o Add optional error parameter to flush-state macro. code/fd-stream.lisp: o For the case where an external format has flush method, EF-FLUSH was not calling it correctly. Update so the output function actuall works. o Add error handler to call to flush-state. o For the case where an external format does not have a flush method, output the state value instead of a replacement character so the external format can handle any errors.
-
- Jul 02, 2010
-
-
rtoy authored
o Forgot to add error parameter for code-to-octets and octets-to-code. o Call error handler for output errors. iso8859-2.lisp: mac-roman.lisp: o If defined, call error handler for output errors. utf-16.lisp: utf-16-be.lisp: utf-16-le.lisp: o If defined, call error handler for input and output errors. utf-32.lisp: utf-32-be.lisp: utf-32-le.lisp: o If defined, call error handler for input and output errors. (Previously, we didn't signal any output errors, but large codepoints and surrogate characters are not allowed in UTF-32 output streams.) utf-8.lisp: o Use lisp:codepoint-limit instead of #x10ffff.
-
rtoy authored
o Pass the error handler on for composed external formats. code/fd-stream.lisp: o Forgot to pass the error-handler to char-to-octets in EF-COUT. o In MAKE-FD-STREAM slightly change handling of encoding-error and decoding-error: - If :encoding-error is a character, then the external format will use that character whenever an encoding error happens instead of the default (internally specified by the external format). - If :decoding-error is a character, then the external format will use that character whenever an encoding error happens instead of the default (internally specified by the external format). If :decoding-error is T, then a cerror is signaled; if continued, the Unicode replacement character (#\U+FFFD) is used. o Fix bug in OPEN: The :decoding-error and :encoding-error keyword parameter was placed in the &aux section by mistake.
-
rtoy authored
desired replacement code. o Generate different messages for the possible caes of invalid codepoint, overlong sequence, and surrogate characters in UTF8 stream.
-
rtoy authored
o The optional error parameter doesn't need to be optional in DEFINE-EXTERNAL-FORMAT, EF-STRING-TO-OCTETS, EF-OCTETS-TO-STRING, EF-ENCODE and EF-DECODE. code/fd-stream.lisp: o Update comments for char-to-octets-error and octets-to-char-error. o Forgot to pass the error handler to char-to-octets in EF-SOUT and EF-STRLEN.
-
rtoy authored
-
rtoy authored
code/extfmts.lisp o Call the error handler for iso8859-1 output. o In OCTETS-TO-CODEPOINT and CODEPOINT-TO-OCTETS, call the external format with the error argument. o In OCTETS-TO-CHAR - Call OCTETS-TO-CODEPOINT with the error handler. - For all of the error conditions, call the error handler if defined. o Add error parameter to EF-STRING-TO-OCTETS and EF-ENCODE so we can handle errors. Call CHAR-TO-OCTETS with the error handler. o Add error parameter to STRING-TO-OCTETS and use it. o Add error parameter to EF-OCTETS-TO-STRING and EF-DECODE so we can handle errors. Call OCTETS-TO-CHAR with the error handler. o Add error parameter to OCTETS-TO-STRING and use it. o In STRING-ENCODE and STRING-DECODE, call the ef function with the error handler. o Change STRING-ENCODE to use keyword args instead of optional args. Add error parameter and use it. code/fd-stream-extfmt.lisp: o Tell OCTETS-TO-STRING about the error handler stored in the fd-stream. code/fd-stream.lisp: o OPEN, MAKE-FD-STREAM, and OPEN-FD-STREAM get DECODING-ERROR and ENCODING-ERROR keyword arguments for specifying how to handle decoding and encoding errors in external formats. code/stream.lisp: o Make sure the error handler is called in FAST-READ-CHAR-STRING-REFILL. pcl/simple-streams/external-formats/utf-8.lisp: o Initial cut at calling the error handler for the various possible invalid octet streams for a utf-8 encoding.
-
- Jul 01, 2010
-
-
rtoy authored
were returned when calling out to a C function returning a float. float-sse2.lisp: o Remove the FLOAT-MOVE vop and add a FLOAT-MOVE/SINGLE and FLOAT-MOVE/DOUBLE that can handle moving from FR0 or any XMM register to any XMM register. o Update the move vops appropriately. sse2-c-call.lisp: o Don't need to move FR0 to XMM0 anymore. This was one source of the problem. The compiler knows now to ask for a move from FR0 to some XMM register. o Update comments. vm.lisp: o Correct printing of XMM registers. Previously printed them as XMM8-15 but should have been XMM0-7. (Mostly in trace files.)
-
- Jun 30, 2010
-
-
rtoy authored
-
rtoy authored
for octets-to-code and code-to-octets.
-
rtoy authored
o All external formats need an extra required argument for the error handler. o Add optional error parameter to OCTETS-TO-CODEPOINT, CODEPOINT-TO-OCTETS, OCTETS-TO-CHAR, and CHAR-TO-OCTETS.
-
rtoy authored
when converting octets to characters or characters to octets. These aren't currently being used, but will be. A basic cross-compile is needed. When CMUCL asks about incompatible structures, select the CLOBBER-IT restart in all cases.
-
- Jun 29, 2010
-
-
rtoy authored
-
- Jun 27, 2010
-
-
rswindells authored
when SIGSEGV_VERBOSE defined.
-
rtoy authored
-
rtoy authored
-
- Jun 22, 2010
-
-
rtoy authored
compiler/x86/vm.lisp: o Change *float-register-names* to be defparameter. o Setup float-regs and def-random-reg-tns appropriately for x87 and sse2. lisp/Darwin-os.c: lisp/Linux-os.c: o Conditionalize previous change for FEATURE_SSE2.
-
rtoy authored
Carl's suggestion and define new SC numbers for the xmm registers instead of overloading the x87 fpu registers and the xmm register SC's. bootfiles/20a/boot-2010-06-cross-x86.lisp: o New file needed for cross-compiling this change. code/x86-vm.lisp: o Revert previous change. compiler/x86/sse2-c-call.lisp: o Use xmm0-tn instead of fr0-tn. No functional change, but makes the code more readable. compiler/x86/vm.lisp: o Increase the number of float registers from 8 to 16 (8 more for SSE2 registers). o Define new xmm<n> registers o Update the locations with the new sse2 SC locations for single-reg, double-reg, double-double-reg, complex-single-reg, complex-double-reg, and complex-double-double-reg storage classes. lisp/Darwin-os.c: o Revert previous change. o Update os_sigcontext_fpu_reg to support the xmm registers. lisp/Linux-os.c: o Update os_sigcontext_fpu_reg to support the xmm registers.
-