Showing posts with label Claude Shannon. Show all posts
Showing posts with label Claude Shannon. Show all posts

Saturday, June 4, 2016

Claude Shannon Centenary and the 1-bit Maze (A-Maze-ing Dash Challenge)


The Claude Shannon Centenary 2016 in Hong Kong is a series of events held in Hong Kong to mark the life and legacy of Claude Shannon, an American mathematician and engineer, who was a visionary pioneer in the fields of computing, communications and artificial intelligence.  I chaired a seminar on quantum information theory given by the 2016 Shannon Award Lecturer Alexander Holevo on May 6th.  A Claude Shannon Centenary workshop was also organised on May 19th by Professor Raymond Yeung at the CUHK Institute of Network Coding, where I gave a talk titled "To prove or to disprove: information inequalities and sparse optimization". 

I also delivered this as an invited talk at Tsinghua University in Beijing on May 14th ("纪念Shannon诞辰一百周年学术论坛"). My talk was on the automated generation of mathematical proof to Shannon-type inequalities in information theory using linear programming and cloud computing.  Fancy that! A topic that would be impossible without Shannon's Master thesis that engendered the birth of digital logic in 1938 and his seminal work on information theory in 1948, and these two seemingly-disparate subjects converge!




A local outreach activity Computer Science Challenge was held on 21 May at the City University of Hong Kong for 180 middle school children (62 upper primary and 118 secondary school students) who formed teams to compete in three digital game challenges. The CS Challenge is part of the Claude Shannon Centenary, 2016 Hong KongDuring the CS Challenge, educational exhibits of Claude Shannon and replicates of his fun and thought-provoking robotic machines Rubik-cube manipulators using Lego — were also on display



One of the CS Challenge's tasks was to program a robot to solve a maze. This was inspired by Shannon's Maze-solving Theseus Mouse, which was the world's first digitally-programmed maze-solver in 1951. Shannon's Theseus Mouse ushered in the age of machine intelligence when a computer (using telephone relays) is capable of searching for a solution by trial and error and then remembering the solution. It was also Shannon's Theseus Mouse that inspired Paul Baran, the Internet pioneer to come up with the packet switching principle and dynamic routing underlying our Internet technologies.

The maze in the CS Challenge for secondary school students was designed with Shannon's entropy  a coin flip decides one of two possible maze entrances, i.e., the robot starts from the left entrance with a Head or otherwise from the right entrance with a Tail. The left and right entrances entail a left and right corner respectively, and the two passages meet at the intersection of a corridor to the exit. Now, a fair coin flip generates one bit of informationIn this way, as the coin is flipped only after the robot has been programmed, this 1-bit uncertainty prevents the participants from hard-coding the robot's movement (i.e., no dead reckoning); The robot has to hit an obstacle (i.e., the corner wall) and navigate its way by trial and error. We hope that students know about Claude Shannon and his marvellous creations as they bravely enter the Maze as Theseus did. Check out more pictures and the video below on the 1-bit maze. What a memorable and a-maze-ingly fun 2016 CS Challenge we had!



Friday, June 26, 2015

Claude Shannon: Centennial and Machines

Claude Shannon and his electromechanical mouse Theseus. Retrieved from http://www.kerryr.net/pioneers/gallery/ns_shannon5.htm

Claude Elwood Shannon (April 30, 1916 – February 24, 2001) was a distinguished American electrical engineer and mathematician who founded the field of Information Theory when he published his landmark paper "A Mathematical Theory of Communication" in 1948. He worked on anti-aircraft and cryptography systems during World War II, and later on had a career at the AT&T Bell Labs and as a Professor at MIT. The MIT Technology Review Magazine ran an article on this Reluntant Father of the Digital Age shortly after his death.


In fact, while Shannon was still a student at MIT, he wrote what has been touted as the Most Important Master's Thesis of the Twentieth Century (putting forward the idea that Boolean algebra can be used for computing). Many technological fields that we know of now (such as the digital revolution, secrecy and cryptography, artificial intelligence, wearable computing) can all be traced back to Shannon's pioneering ideas and work.


Despite all these achievements, Shannon is surprisingly little known. Next year 2016 is Shannon's centenary. To get the public know more about Shannon, the Information Theory Society is on a drive to make a movie about this scientific genius of the twentieth century. Incidentally, Shannon did appear in a movie once - back in 1961 - in a MIT Centennial Film called The Thinking Machine. At 50:09 mins of the film, he shared his vision of a future machine capable of learning by experience. The Information Theory Society also aims to organize events worldwide to celebrate the Shannon's centenary. 


I wonder: What little bits of things can we do to celebrate Shannon's centenary?

Worth noting is Shannon's fun-loving and unconventional side: To amuse himself, Shannon created very clever mechanical and electrical toys -- a juggling robot, a flame-throwing trumpet, a maze-solving mouse, a chess-playing machine, a mind-reading machine, a manipulator to solve the Rubik's cube game etc. The Ultimate Machine is another such curiously uncanny toy -- we have one built from a small motor, off-the-shelf electronics and recyclable. See video below.




In a 1987 interview, the Omni Magazine asked Shannon: Do you find it depressing that chess computers are getting so strong? 


Shannon replied: I am not depressed by it. I am rooting for the machines! I have always been on the machines' side. Ha-ha!