Organize and Share your Electronics the way you want. Sign-Up for a free account now. It takes only 30 seconds!

How I added 6 characters to Unicode (and you can too)

How I added 6 characters to Unicode (and you can too)


Star characters
(☆★)
have long been part of the Unicode standard, which means they can appear as characters in web pages, text, and email.
But half-stars were missing, so they required special images or custom fonts.
I recently co-wrote a proposal to add half-star characters to Unicode, and it was just
accepted.
In the next Unicode release,
half-stars will be usable like any other text character.
In this article, I discuss how I got the half-star characters and two others added to Unicode.


Usage of the four different half-stars to express 3.5 of 5.

Unicode is the computer standard that defines the characters that are used by almost every computer—this standard allows different computers to easily display text in almost every language, and with almost every symbol you might need. (Before Unicode, dealing with non-English text on computers was a mess.)
But Unicode doesn’t include everything. Last June, a comment on Hacker News complained that Unicode lacked the half-star character used in ratings and movie reviews:

Until Unicode has a half-star character, it won’t even be able to encode the average newspaper.

I suggested that someone should propose the half-star to Unicode, but quickly realized that “someone” would be me.
Since I had successfully proposed two symbols to Unicode earlier, I knew the process necessary to get the half-star added.

A few years ago, a detailed article described how a couple people got power symbols added to Unicode.
Adding a new character to Unicode is easier than most people think. You don’t need to pay money, be part of a major company or join a committee. All you need to do is write a proposal explaining why the character is needed. If the Unicode Committee agrees, they’ll approve your character for addition to Unicode.

In 2015, I started programming the 1960s-era IBM 1401 mainframe
at the Computer History Museum.
But when I wrote about the IBM 1401 system, I ran into a problem.
This computer uses a 6-bit character set (the precursor to EBCDIC) with some strange characters.
All these characters appeared in Unicode, with the exception of one: the Group Mark.
I was a bit shocked that Unicode, with its 128,172 characters, lacked a character I needed. Having read about the power symbol team’s success in adding characters, I figured it would be interesting to see if I could get the group mark character added to Unicode.
I wrote a proposal, submitted it to Unicode, and at the next meeting it was approved.

An explanation of the group mark character from an IBM 705 computer manual (1959).

The group mark character, from an IBM 705 computer manual (1959). Since Unicode lacked this character, you couldn’t write this text on a modern computer.

A few months later, I learned that the Bitcoin symbol was missing from Unicode. This was a surprising omission, since the Bitcoin symbol is widely used in the real world.
The symbol had been rejected before, so I made a more thorough proposal in October 2015 with the enthusiastic support of /r/bitcoin and other Bitcoin groups.
The Bitcoin symbol proposal was accepted by the Unicode Committee in November 2015.

The Bitcoin symbol on an IBM punched card.

The Bitcoin symbol on an IBM punched card. Mining Bitcoins on a punched card mainframe isn’t practical, but was an interesting experiment.

So when I saw the comment about half-stars on Hacker News, I figured it would be straightforward to get it accepted to Unicode. I wrote a proposal after discussion on HN and on the Unicode mailing list.
The Unicode committee considered the proposal in August 2016, but to my surprise they had also received another half star proposal, so they decided to wait on a single proposal.
It turned out that Andrew West had also written a proposal for half-stars, and we had both submitted proposals, unaware of the other.
So Andrew and I joined forces and made a combined proposal, which was accepted by the committee Sept 30, 2016.

Why did we propose four different half-stars? We included both the outline half-star and solid half-star because both forms are commonly used.
(I wasn’t sure if the committee would consider these characters distinct enough to include both, but they did.)
Right-to-left languages such as Hebrew do their star ratings right-to-left too (which was a bit of a surprise to me), so we included mirrored versions for RTL languages. Thus, the four different half-stars cover the range of uses.

Half-stars in Hebrew are written right-to-left. From Haaretz 2 November 2012, provided by Simon Montagu.

Half-stars in Hebrew are written right-to-left. From Haaretz 2 November 2012, provided by Simon Montagu.

If there’s a character that you want to add to Unicode and it meets the requirements, you should submit a proposal, since its a very interesting process and not too difficult.
Make sure your character meets the criteria.
In particular, you’ll need to find a bunch of examples of the character used in text.
The Unicode Committee isn’t going to add a character just because you think it’s cool, so you need examples to prove the character is in use.
Creating a font to demonstrate your new character is probably the most challenging part; I used FontForge.
The power symbol team has lots of helpful advice on making a successful proposal.
I’m also happy to offer advice if you’re writing a proposal.

I should mention that emojis have a totally different process, so don’t argue that “since the poop emoji exists, my character should too”.
(The
poop emoji
💩
was added for backwards compatibility
with Japanese mobile phones.)
For emoji, expected popularity of the symbol is a major factor in acceptance.
Regular Unicode, on the other hand, isn’t concerned with popularity—historical scripts such as Tangut won’t get a millionth the usage of a new emoji—but with existing usage in text.
(Reading between the lines, I think a lot of the Unicode committee
wishes they weren’t in the emoji business at all.)

Once a character is accepted, there’s still a long road for it to appear in fonts and be usable. A new version of Unicode is released typically every June, so the half stars will probably appear in Unicode 11.0 mid-2018. The Bitcoin community in particular has had to wait patiently since the Bitcoin symbol just missed the cutoff for Unicode 9.0, so it will probably appear in Unicode 10.0, mid-2017.
So if you’re patient, eventually you’ll be able to use the group mark, Bitcoin symbol and half stars in web pages and text just like any other symbol.

Read more Here







 

More Articles to Read

Peeqo is a desktop bot that communicates through GIFs
Peeqo is a desktop bot that communicates through GIFs
Using a Programmable Input Multiplier to Minimize Integer Boundary Spurs
Using a Programmable Input Multiplier to Minimize Integer Boundary Spurs
Serial seven segment LED display shield
Serial seven segment LED display shield
G-code controlled drawing plotter
G-code controlled drawing plotter
An Arduino round word clock
An Arduino round word clock
The Sandwich-o-Matic will make your lunch automatically
The Sandwich-o-Matic will make your lunch automatically
Scalar Network Analyser Jr
Scalar Network Analyser Jr
An Arduino-controlled automated whiskey distillery
An Arduino-controlled automated whiskey distillery
The Rex800 looks like a dinosaur Terminator
The Rex800 looks like a dinosaur Terminator
Home Environment Monitor
Home Environment Monitor
Understanding the Operation of the Frequency Synthesizer in Maxim’s RF Transceivers
Understanding the Operation of the Frequency Synthesizer in Maxim’s RF Transceivers
App note: EPIC: Electro-Pyrotechnic Initiator Chip Resistor
App note: EPIC: Electro-Pyrotechnic Initiator Chip Resistor
Noisy ESP8266
Noisy ESP8266
App note: Noise analysis for high-speed op amps
App note: Noise analysis for high-speed op amps
Skill Sunday: Arrays
Skill Sunday: Arrays
App note: Infrared remote control implementation with MSP430FR4xx
App note: Infrared remote control implementation with MSP430FR4xx
Gesture Controlled Smart Home
Gesture Controlled Smart Home
Design for a Wideband, Differential Transimpedance DAC Output
Design for a Wideband, Differential Transimpedance DAC Output
Wrist thrusters let you fly through the water effortlessly
Wrist thrusters let you fly through the water effortlessly
Bertan/Spellman 225-20R HV power supply teardown
Bertan/Spellman 225-20R HV power supply teardown

Top


Shares