- Jul 14, 2010
- Jul 13, 2010
-
-
rtoy authored
-
rtoy authored
features and causes the translated string to be included or removed from cmucl.pot. To help make this consistent, we put the system-dependent strings in the system-dependent pot files. bootfiles/20a/boot-2010-07-1.lisp: o Add a fake definition for with-textdomain so we can bootstrap the changes. o Removed a defstruct that was already commented out. code/exports.lisp: o Export WITH-TEXTDOMAIN. code/intl.lisp: o Add macro WITH-TEXTDOMAIN to temporarily bind the textdomain to the desired domain for the body, and restoring the original domain afterwards. code/signal.lisp: o Wrap the system-specific items in WITH-TEXTDOMAIN so they are placed in the system-dependent text domain.
-
rtoy authored
- Two minor bugs in error handling of compile-file* - Add optional arg to ensure-source-registry - Add clear-system - use /etc/common-lisp as documented o Add file-comment.
-
- Jul 12, 2010
-
-
rtoy authored
-
rtoy authored
-
rtoy authored
o Load all the external formats so we can save the strings to the pot file. external-formats/*.lisp: o Set the text domain to cmucl for all of the files.
-
rtoy authored
lisp/GNUmakefile: o Change "all" target to build just lisp.nm. Don't also build the translations target. tools/build.sh: o Only make translations for the last build.
-
rtoy authored
little information about the format. Provide a means to get a list of external formats and to display the documentation. bootfiles/20a/boot-2010-07-1.lisp: o Use this bootstrap file when doing a normal build. code/exports.lisp: o New functions: - Add LIST-ALL-EXTERNAL-FORMATS to list all available external formats and their corresponding aliases. - Add DESCRIBE-EXTERNAL-FORMAT to print some information about the given format. o Add docuemntation slot to defstruct EXTERNAL-FORMAT. o Change DEFINE-EXTERNAL-FORMAT macro. Adds :DOCUMENTATION keyword to specify the documentation. Add :BASE keyword indicate that the external format is based on another format. (Previously, this wasn't needed, but is somewhat incompatible with adding a documentation string.) o Change DEFINE-COMPOSING-EXTERNAL-FORMAT to include :documentation keyword to specify the documentation for the format. o Minor reindentation of some docstrings. o Make sure documentation strings for external format are marked for translation; wrap other strings with intl:gettext to explicitly mark them for translations. o Add docstring for VOID and ISO8859-1 external formats. code/exports.lisp: o Export the new symbols LIST-ALL-EXTERNAL-FORMATS and DESCRIBE-EXTERNAL-FORMAT. Import into EXTENSIONS package. docs/cmu-user/unicode.tex: o Update docs to include LIST-ALL-EXTERNAL-FORMATS and DESCRIBE-EXTERNAL-FORMAT. o Update docs for DEFINE-EXTERNAL-FORMAT and DEFINE-COMPOSING-EXTERNAL-FORMAT to match implementation. general-info/release-20b.txt: o Update external-formats/*.lisp: o Update with docstrings. o Add :BASE keyword where needed.
-
- Jul 10, 2010
-
-
rtoy authored
o Add a simple function it list all external formats. o Add some docstrings. o Correctly indent some s-exps. exports.lisp: o Update package definitions to export new LIST-ALL-EXTERNAL-FORMATS.
-
- Jul 07, 2010
-
-
rtoy authored
mac-roman.lisp: o Fix code so that the offending codepoint on output is actually passed to the error routine. (Previously, we returned the value from the table which was always nil because the code did not have a valid output.)
-
rtoy authored
too-large codepoint, swallow the whole sequence instead of putting back the characters like we did previously. (This new way is in line with how we handle other bad sequences.) o Pass the number of octets read to the error handler in these cases. o Update the message strings to include the number of octets.
-
rtoy authored
-
- Jul 06, 2010
- Jul 05, 2010
-
-
rtoy authored
-
rtoy authored
args. o Generate different error messages for surrogate code points and code points that are too large.
-
rtoy authored
for asdf and defsystem. make-extra-dist.sh: o Fix up the grep patterns to skip over what we wanted. (Use egrep instead of grep, and change \| to |.) This makes sure that the extras tarball doesn't have asdf or defsystem. make-main-dist.sh: o Don't need to touch the asdf/defsystem files anymore.
-
rtoy authored
-
rtoy authored
o Revert previous incompatible change to STRING-DECODE and STRING-ENCODE. Change the keyword parameters back to optional parameters, and make the error parameter the last one. fd-stream.lisp: o Update use of STRING-ENCODE.
-
rtoy authored
For utf-8, also print out the value of the invalid codepoint.
-
rtoy authored
stream the data correctly causing decoding errors. code/sysmacs.lisp: o Need to copy back the in-index that fast-read-char-string-refill updated. code/stream.lisp: o Fix buffering issue when refilling the in-buffer with new data. Code was confused about the difference between in-length and in-buffer-length.
-
rtoy authored
so update code.
-
- Jul 03, 2010
-
-
rtoy authored
-
rtoy authored
-
rtoy authored
o Update comments for the various slots in DEFINE-EXTERNAL-FORMAT. fd-stream.lisp: o Declare the types for the CHAR-TO-OCTETS-ERROR and OCTETS-TO-CHAR-ERROR slots in FD-STREAM. o Update docstrings for MAKE-FD-STREAM and OPEN for :DECODING-ERROR and :ENCODING-ERROR parameters.
-
rtoy authored
variable that was shadowing another.
-
rtoy authored
parameters.
-
rtoy authored
-
rtoy authored
where the external format does not have a flush-state method.
-
rtoy authored
to signal errors on bare surrogates at the end of the output.
-
rtoy authored
o SURROGATEP is not exported from LISP.
-
rtoy authored
o Add error parameter to flush-state in external format definition so we can handle errors when flushing the state to a stream. o Add optional error parameter to flush-state macro. code/fd-stream.lisp: o For the case where an external format has flush method, EF-FLUSH was not calling it correctly. Update so the output function actuall works. o Add error handler to call to flush-state. o For the case where an external format does not have a flush method, output the state value instead of a replacement character so the external format can handle any errors.
-
- Jul 02, 2010
-
-
rtoy authored
o Forgot to add error parameter for code-to-octets and octets-to-code. o Call error handler for output errors. iso8859-2.lisp: mac-roman.lisp: o If defined, call error handler for output errors. utf-16.lisp: utf-16-be.lisp: utf-16-le.lisp: o If defined, call error handler for input and output errors. utf-32.lisp: utf-32-be.lisp: utf-32-le.lisp: o If defined, call error handler for input and output errors. (Previously, we didn't signal any output errors, but large codepoints and surrogate characters are not allowed in UTF-32 output streams.) utf-8.lisp: o Use lisp:codepoint-limit instead of #x10ffff.
-
rtoy authored
o Pass the error handler on for composed external formats. code/fd-stream.lisp: o Forgot to pass the error-handler to char-to-octets in EF-COUT. o In MAKE-FD-STREAM slightly change handling of encoding-error and decoding-error: - If :encoding-error is a character, then the external format will use that character whenever an encoding error happens instead of the default (internally specified by the external format). - If :decoding-error is a character, then the external format will use that character whenever an encoding error happens instead of the default (internally specified by the external format). If :decoding-error is T, then a cerror is signaled; if continued, the Unicode replacement character (#\U+FFFD) is used. o Fix bug in OPEN: The :decoding-error and :encoding-error keyword parameter was placed in the &aux section by mistake.
-
rtoy authored
desired replacement code. o Generate different messages for the possible caes of invalid codepoint, overlong sequence, and surrogate characters in UTF8 stream.
-
rtoy authored
o The optional error parameter doesn't need to be optional in DEFINE-EXTERNAL-FORMAT, EF-STRING-TO-OCTETS, EF-OCTETS-TO-STRING, EF-ENCODE and EF-DECODE. code/fd-stream.lisp: o Update comments for char-to-octets-error and octets-to-char-error. o Forgot to pass the error handler to char-to-octets in EF-SOUT and EF-STRLEN.
-
rtoy authored
-
rtoy authored
code/extfmts.lisp o Call the error handler for iso8859-1 output. o In OCTETS-TO-CODEPOINT and CODEPOINT-TO-OCTETS, call the external format with the error argument. o In OCTETS-TO-CHAR - Call OCTETS-TO-CODEPOINT with the error handler. - For all of the error conditions, call the error handler if defined. o Add error parameter to EF-STRING-TO-OCTETS and EF-ENCODE so we can handle errors. Call CHAR-TO-OCTETS with the error handler. o Add error parameter to STRING-TO-OCTETS and use it. o Add error parameter to EF-OCTETS-TO-STRING and EF-DECODE so we can handle errors. Call OCTETS-TO-CHAR with the error handler. o Add error parameter to OCTETS-TO-STRING and use it. o In STRING-ENCODE and STRING-DECODE, call the ef function with the error handler. o Change STRING-ENCODE to use keyword args instead of optional args. Add error parameter and use it. code/fd-stream-extfmt.lisp: o Tell OCTETS-TO-STRING about the error handler stored in the fd-stream. code/fd-stream.lisp: o OPEN, MAKE-FD-STREAM, and OPEN-FD-STREAM get DECODING-ERROR and ENCODING-ERROR keyword arguments for specifying how to handle decoding and encoding errors in external formats. code/stream.lisp: o Make sure the error handler is called in FAST-READ-CHAR-STRING-REFILL. pcl/simple-streams/external-formats/utf-8.lisp: o Initial cut at calling the error handler for the various possible invalid octet streams for a utf-8 encoding.
-