Cangjie input method

The Cangjie input method (Tsang-chieh input method, sometimes also Changjie, Cang Jie or ChongKit) is a system by which Chinese characters may be entered into a computer using a standard keyboard. Invented in 1976 by Chu Bong-Foo, the method is named after Cangjie (Tsang-chieh), the mythological inventor of the Chinese writing system; the name was suggested by Chiang Wei-kuo, then Defence Minister of Taiwan. Although the input method was initially based upon traditional Chinese characters, it has since been revamped so that Cangjie and the simplified Chinese character set can interact.

In filenames and elsewhere, the name Cangjie is sometimes abbreviated as cj.

Unlike pinyin, Cangjie is based on the graphological aspect of the characters: each basic, graphical unit is represented by a basic character component, 24 in all, each mapped to a particular letter key on a standard QWERTY keyboard. An additional, "difficult character" function is mapped to the X key. Within the keystroke-to-character representations, there are four subsections of characters: the Philosophical Set (corresponding to the letters 'A' to 'G' and representing the sun, the moon and the five elements), the Strokes Set (corresponding to the letters 'H' to 'N' and representing the brief and subtle strokes), the Body-Related Set (corresponding to the letters 'O' to 'R' and representing various parts of human anatomy), and the Shapes Set (corresponding to the letters 'S' to 'Y' and representing complex and encompassing character forms).

The basic character components in Cangjie are usually called "radicals"; nevertheless, Cangjie decomposition is not based on traditional Kangxi radicals, nor is it based on standard stroke order; it is in fact a simple geometric decomposition.

Overview of the input method

The keys and "radicals"

The basic character components in Cangjie are called "radicals" (字根) or "letters" (字母). There are 24 radicals but 26 keys; the 24 radicals (the basic shapes 基本字形) are associated with roughly 76 auxiliary shapes (輔助字形), which in many cases are either rotated or transposed versions of components of the basic shapes. For instance, the letter A (日) can represent either itself, the slightly wider 曰, or a 90° rotation of itself. (For a more complete account of the 76-odd transpositions and rotations than the one listed below, see the article on Cangjie entry in Chinese Wikibooks.)

The auxiliary shapes of each Cangjie radical have changed slightly between different versions of the Cangjie method; this is one reason that different versions of the Cangjie method are not completely compatible.

Keyboard layout

The basic rules

The typist must be familiar with several decomposition rules 拆字規則 that define how to analyse a character to arrive at a Cangjie code.

• Direction of decomposition: left to right, top to bottom, and outside to inside
• Geometrically connected forms: take 4 Cangjie codes, namely the first, second, third, and last codes
• Geometrically unconnected forms that can be broken into two subforms (i.e., 你): identify the two geometrically connected subforms according to the direction of decomposition rules (i.e., 人 and 尔), then take the first and last codes of the first subform and the first, second, and last code of the second subform.
• Geometrically unconnected forms that can be broken into multiple subforms (i.e., 謝): identify the first geometrically connected subform according to the direction of decomposition rules (i.e., 言) and take the first and last codes of that form. Next, break the remainder (i.e., 射) into subforms (i.e., 身 and 寸) and take the first and last codes of the first subform and the last code of the last subform.

The rules are subject to various principles:

• Conciseness (精簡) — if two decompositions are possible, the shorter decomposition is correct
• Completeness (完整) — if two decompositions of the same length are possible, the one that identifies a more complex form first is the correct decomposition
• Reflection of the form of the radical (字型特徵) — the decomposition should reflect the shape of the radical, meaning (a) using the same code twice or more should be avoided if possible, and (b) the shape of the character should not be "cut" at a corner in the form
• Omission of codes (省略)
  • Partial omission (部分省略) — when the number of codes in a complete decomposition would exceed the permitted number of codes, the extra codes are ignored
  • Omission in enclosed forms (包含省略) — when part of the character to be decomposed and the form is an enclosed form, only the shape of the enclosure is decomposed; the enclosed forms are omitted

Examples

Typing Chinese with Cangjie input method version 5

• 車 (chē, vehicle)
  • This character is geometrically connected, consisting of one part with a vertical structure, so we take the first, second, and last Cangjie codes from top to bottom.
  • The Cangjie code is thus 十 田 十 (JWJ), corresponding to the basic shapes of the codes in this example.
• 謝 (xiè; to thank, to wither)
  • This character consists of geometrically unconnected parts arranged horizontally. For the initial decomposition, we treat it as two parts, 言 and 射.
  • The first part, 言, is geometrically unconnected from top to bottom; we take the first (亠, auxiliary shape of 卜 Y) and last parts (口, basic shape of 口 R) and arrive at 卜 口 (YR).
  • The second part is again geometrically unconnected, arranged horizontally. The two parts are 身 and 寸.
    • For the first part of this second part, 身, we take the first and last codes. Both are slants and therefore H; the first and last codes are thus 竹 竹 (HH).
    • For the second part of the original second part, 寸, we take only the last part. Because this is geometrically unconnected and consists of two parts, the first part is the outer form while the second part is the dot in the middle. The dot is I, and therefore the last code is 戈 (I).
  • The Cangjie code is thus 卜 口 (YR) 竹 竹 (HH) 戈 (I), or 卜 口 竹 竹 戈 (YRHHI).
• 谢 (simplified version of 謝)
  • This example is identical to the above, except that the first part is 讠; the first and last codes are 戈 (I) and 女 (V)
  • Repeating the same steps as in the above example, we get 戈 女 (IV) 竹 竹 (HH) 戈 (I), or 戈 女 竹 竹 戈 (IVHHI).

The short list of exceptions

Some forms are always decomposed in the same way, whether the rules say they should be decomposed this way or not. The number of such exceptions is small:

Some forms cannot be decomposed. They are represented by an X. (Which appears as the 難 key on a Cangjie keyboard.)^[1]

Early Cangjie system

In the beginning, the Cangjie input method was not a way to produce a character in any character set. It was, instead, an integrated system consisting of the Cangjie input rules and a Cangjie controller board. The controller board contains character generator firmware, which dynamically generates Chinese characters from Cangjie codes when characters are output, using the hi-res graphics mode of an Apple II computer. In the preface of the Cangjie user's manual, Chu Bong-Foo wrote in 1982:

[in translation]
In terms of output: The output and input, in fact, [form] an integrated whole; there is no reason that [they should be] dogmatically separated into two different facilities.… This is in fact necessary.…

In this early system, when the user types "yk " (for example) to get the Chinese character 文, the Cangjie codes do not get converted to any character encoding; the actual string "yk " is stored. In a very real sense, the Cangjie code of each character (string of 1 to 5 lowercase letters plus a space) was the encoding of that particular character.

A particular "feature" of this early system is that if you send random lowercase words to the character generator, it will attempt to construct Chinese characters according to the Cangjie decomposition rules, sometimes causing strange, unknown characters to appear. This unusual feature, "automatic generation of characters", is actually described in the manual and is responsible for producing more than 10,000 of the about 15,000 characters that the system can handle. The name Cangjie, evocative of creation of new characters, was actually very apt for this early version of Cangjie.

The presence of the integrated character generator also explains the historical necessity for the existence of the "X" key used for disambiguation of decomposition collisions: because characters are "chosen" when the codes are output, every character that can be displayed must in fact have a unique Cangjie decomposition. It would not make sense—nor would it be practical—for the system to provide a choice of candidate characters when some random text file is displayed; the user would not know which of the candidates are correct.

Issues

Cangjie was designed to be an easy-to-use system to help promote the use of Chinese computing; nevertheless, many users find Cangjie to be a difficult method. Many of the perceived difficulties arise from poor instruction.

Perceived difficulties

• In order to input using Cangjie, one must know not only the names of the radicals, but also all their auxiliary shapes (which might not appear to make sense, though Chu had intended all the auxiliary shapes to be related to the basic shapes and "easy to remember"). It is common to find tables of the Cangjie radicals with their auxiliary shapes taped onto the monitors of casual computer users.
• One must also be familiar with the decomposition rules; a lot of casual computer users are not even aware of the existence of decomposition rules but rather type by guessing. This makes Cangjie difficult for them.

Enough practice, however, can overcome the above problems. A typist with sufficient practice in Cangjie touch-types, much like one typing English. It is entirely possible for a touch-typist to type at 25 Chinese characters per minute (cpm) or better in Cangjie, yet have difficulty remembering the list of auxiliary shapes or even the decomposition rules. Experienced Cangjie typists can reportedly attain a typing speed between 60 cpm and over 200 cpm.

Actual difficulties

Cangjie, however, also has some fundamental problems:

• Cangjie is error-intolerant (不容錯): The decomposition of a character depends on a predefined set of "standard shapes" (標準字形); however, because Cangjie is used in many different countries, the standard shape of a certain character in Cangjie is not always the standard shape the user has learnt for that character. Learning Cangjie then entails learning not only Cangjie itself, but also unfamiliar standard shapes for some characters. The Cangjie IME does not handle mistakes in decomposition except by telling the user (usually by beeping) that there is a mistake.
• Punctuation marks are not geometrically decomposed, but rather given random-looking codes that begin with ZX followed by a string of three letters related to the ordering of the characters in the Big5 code. Typing punctuation marks in Cangjie thus becomes a frustrating exercise in either memorization or pick-and-peck. However, this is solved on modern system through accessing a virtual keyboard on screen (On Windows, this is activated by pressing Ctrl + Alt + comma key)
• The user cannot type a character which he or she has forgotten how to write. This, of course, is not a specific problem with Cangjie but rather a problem universal to all non-phonetic input methods.

In some situations it cannot be used at all. Cangjie uses all 26 keys in an QWERTY keyboard; it cannot be used to input Chinese on feature phones. For cell phones, zhuyin, 5-stroke (or 9-stroke by Motorola) and the Q9 input method are the current norm because they are designed specifically for use on numeric keypads. Of course, smartphones can and do support Cangjie input by using the touchscreen virtual keyboard.

Versions of Cangjie

The Cangjie input method is commonly said to have gone through five generations (commonly referred to as “versions” in English), each of which is slightly incompatible with the others. Currently, version 3 (第三代倉頡) is the most common; it is the version of Cangjie supported natively by Microsoft Windows. Version 5 (第五代倉頡), supported by the Free Cangjie IME and previously the only Cangjie supported by SCIM, represents a significant minority method and supported by iOS.

The early Cangjie system supported by the Zero One card on the Apple II was Version 2; Version 1 was never released.

The Cangjie input method supported on the classic Mac OS is somewhat like Version 3 and somewhat like Version 5.

Version 5, like the original Cangjie input method, was created directly by Chu, the inventor. Chu had hoped that the release of Version 5, originally slated to be Version 6, would bring an end to the “more than ten versions of Cangjie input method” (slightly incompatible versions created by different vendors).

Version 6 was developed by Chu's longtime assistant Shen Honglian (沈紅蓮). It was created as the encoding for a character set of about 100,000 characters extracted from Chinese literature. This character set was developed independently from Unicode, which Chu heavily criticized as inferior in design. Version 6 has not yet been released to the public, but is being used to create a database which can accurately store every historical Chinese text.

Variants of Cangjie

Most modern implementations of Cangjie IMEs provide various convenient features:

• Some IMEs list all characters beginning with the code you have typed; for example, if you type A, the system gives you all characters whose Cangjie code begins with A so that you can select the correct character if it is on the screen; if you type another A, the list is shortened to give all characters whose code begins with AA. Examples of such implementations include the IME in Mac OS X, and SCIM.
• Some IMEs provide one or more wildcard keys, usually but not always * and/or ?, that allows the user to omit part(s) of the Cangjie code; the system will display a list of matching characters for the user to choose. Examples include xcin, SCIM, and the IME in the Founder (University of Peking) typesetting systems. Microsoft Windows's "standard" Changjie IME allows * to substitute for in-between characters (effectively reducing it to Simplified Cangjie entries), while New Changjie IME allows * as a wildcard anywhere except for the first character.
• Some IMEs provide an "abbreviation" feature, where impossible Cangjie codes are interpreted as abbreviations for the Cangjie codes of more than one character. This allows more characters to be input with fewer keys. An example is SCIM.
• Some IMEs provide an "association" (聯想 lianxiang) feature, where the system anticipates what you are going to type next, and provides you with a list of characters or even phrases associated with what the user has typed. An example is the Microsoft Changjie IME.
• Some IMEs present the list of candidate characters differently depending on the frequency of character use (how often that character has been typed by the user). An example is the Cangjie IME in NJStar.

Besides the wildcard key, many of these features are very convenient for casual users but unsuitable for touch-typists because they make the Cangjie IME unpredictable.

There have also been various attempts to "simplify" Cangjie one way or another:

• Simplified Cangjie ( also known as Quick, (簡易 jiǎnyì) or (速成 sùchéng) ) has the same radicals, auxiliary shapes, decomposition rules, and short list of exceptions as Cangjie, but only the first and last codes are used if more than two codes are required in Cangjie.

Applications

Many researchers have discussed ways to decompose Chinese characters into their major components, and have tried to build applications based on the decomposition system. The idea can be referred to as the study of The Genes of Chinese Characters.^[2] Cangjie codes certainly offer a basis for such an endeavour. Academia Sinica in Taiwan^[3] and Jiaotong University in Shanghai^[4] have similar projects as well.

One direct application of the use of decomposed characters is the possibility of computing the similarities in writing Chinese characters, e.g.^[5] the Cangjie input method offers a good starting point for this kind of application. By relaxing the limit of five codes for each Chinese character and adopting more detailed Cangjie codes for each character, we can compute visually similar characters. Integrating this with pronunciation information enables computer-assisted learning of Chinese characters.^[6]

See also

• Chinese input methods for computers
• Keyboard layout
• More complete table of input shapes at Chinese Wikibooks
• OpenVanilla - A framework that provides facilities to use Cangjie on Mac OS X.

References

• Taipei: Chwa! Taiwan Inc. (全華科技圖書公司). 倉頡中文資訊碼 : 倉頡字母、部首、注音三用檢字對照 [The Cangjie Chinese information code : with indexes keyed by Cangjie radicals, Kangxi radicals, and zhuyin]. Publication number 023479. — This is the user manual of an early Cangjie system with a Cangjie controller card.
  • The second-to-last paragraph on the first page in the section entitled "The Cangjie radical-based Chinese input method" (倉頡字母中文輸入法) states that

    [Translation]
    This is no problem; there are also auxiliary forms to complement the deficiencies of the radicals. The auxiliary forms are variations of the shape of the radicals, [and therefore] easy to remember.

  • The last paragraph on the fifth page in the same section states

    [Translation]
    The dictionary appended [to this book] is based on the 4800 standard, commonly used characters as proclaimed by the Ministry of Education. Adding to this the characters that are automatically generated, the number of characters is about 15,000 (using the Kangxi dictionary as a basis).

• Part of the information from this article comes from the equivalent Chinese-language Wikipedia article
• The decomposition rules come from the "Friend of Cangjie — Malaysia" web site at http://www.chinesecj.com/ The site also gives the typing speed of experienced typists and provides software for version 5 of the Cangjie method for Microsoft Windows.
• It might be difficult to find specific references to the "not error-forgiving" property of Cangjie. The table at http://www.array.com.tw/keytool/compete.htm is one external reference that states this fact.
• Input.foruto.com has a brief history of the Cangjie input method as seen by that article‘s author. Versions 1 and 2 are clearly identified in the article.
• Cbflabs.com contains a number of articles written by Mr Chu Bong-Foo, with references not only to the Cangjie input method, but also Chinese language computing in general. Versions 5 and 6 (now referred to as 5) of the Cangjie input method are clearly identified.

External links

Wikimedia Commons has media related to Cangjie input method.

Wikibooks has a book on the topic of: Cangjie_input_method

• Online Cangjie Input Method 網上倉頡輸入法
• The Chinese University of Hong Kong Research Centre for Humanities Computing: Chinese Character Database: With Word-formations Phonologically Disambiguated According to the Cantonese Dialect: A Chinese character database covering the entire set of Big-5 Chinese characters (5401 Level 1 and 7652 Level 2 Hanzi) as well as 7 additional ETen Hanzi. Cangjie input codes are shown for each character in the database. Note: The Hong Kong Supplementary Character Set (HKSCS - 2001) is not included in this database.
• Mingzhu generator(Taiwanese Mandarin): Chu Bong Foo's page. Includes the executable, sourcecode and instructions. Mingzhu is a Canjie character generator that runs on MS Windows ' "DOS PROMPT". It requires Microsoft Macro Assembler and Link.
• Friend of the Cangjie: a Cangjie reference and a place where it is possible to download the Cangjie 5 for various operating systems, and Cangjie's supplementary input code lists for inputting the Simplified characters
• CjExplorer: a tool for learning Cangjie. The Cangjie code for a highlighted Chinese character will be displayed when the tool is running.
• Overview of the Cang-Jie Method: a great resource for English speakers to learn the rules and method of Cangjie.
• Online Cangjie Input Method Editor (IME) 網上倉頡輸入法
• 倉頡之友。馬來西亞