Project Diversita: When Machine Learning Meets User Experience

 

In this two-quarter grad school project, I explored how to unleash the power of Machine Learning to fulfill requirements that were tricky for the previous generation of technologies, with the consideration of Human-Centered Design and Engineering.

Background

Project Diversita was a Microsoft sponsored “Launch Project” at the University of Washington GIX in 2018 under the AI for Earth initiative. It aimed to empower biodiversity research by utilizing Machine Learning (ML) on Edge technology. The ML model had been trained by Microsoft Research based on the iNaturalist dataset.

I received training in Machine Learning and sensors, however for this project my role was mainly on product design. The challenge was to explore the potential market space and find a niche that fits our technology backbone best.

Time Span

Jun. 27, 2018–Dec. 07, 2018

About the Team

A ten-people team consists of UW GIX students (Phelps Xia, Hal Zhang, Ben Keller, and I) and Microsoft researchers (Dan Morris, Lucas Joppa)/engineers (Wee-Hyong Tok, Siyu Yang, Erika Menezes, Xiaoyong Zhu)

Role in the Project

Product Designer (UX, ID), Product Manager, User Researcher

General Objectives
  • Study the market to identify a niche camera trap scenario to disrupt with Microsoft’s ability in AI.
  • Ideate concepts that are desirable for the customers, viable for the business and feasible for engineering.
  • Develop working prototypes to prove the concept.
Keywords

Machine Learning, Edge Computing, Raspberry Pi, IoT, computer vision

Continue reading “Project Diversita: When Machine Learning Meets User Experience”

Niu Listed on Nasdaq

Niu Technologies listed on Nasdaq
Image credit: Niu Technologies

EDT 9:30am today in New York City, former colleagues of my previous company—Niu Technologies—started the IPO at Nasdaq.

This is another milestone my fellows have achieved. As once a part of the team for a long ride, I do know how hard they have worked to make it happen. Congratulations to all Niu fellows and early investors.

Some friends have asked if I regret to give up my stakes at Niu to come to study in the US. My answer was, “a thirst for knowledge is the desire among all desires.”

Recently, I started job searching. I’m especially good at cold-starting a new product. I can do a full set of product creation works—from business strategy analysis, product positioning, user research, ideation, concept design to detailed product experience design (both SW & HW), product development management and product launch with marketing fellows. Thanks to the education I received at the University of Washington, I have also touched the US IP and corporate laws. I’m an ideal candidate for a product designer or product manager for a new product line. Please feel free to leave me a message if you are interested to have a talk.

Quick Thoughts On Assistive Technology


Just watched an independent documentary film called Between Sound and Silence on New York Times’ website. Before watching the film, I had never paid attention to the cochlear implant and never knew hearing impaired people could hear clearly with assistive technology. I come from a less-developed region in China. If people in my hometown were born with hearing disability, they might end up hearing nothing for life.

According to the documentary film and the post, I have identified following aspects that I would like to comment:

  1. Technology has significantly powered the improvement of human life quality. More than technologies that have surrounded our normal life like automobiles, smartphones, or microwave ovens, the integration of engineering capability and physiology research have given birth to medical solutions like the cochlear implant, radiofrequency ablation, 3D printed joints and so on that solve incurable diseases just decades ago.
  2. There are no absolute criteria to judge a product. This might be counter-intuitive for most of us to know not every hearing disabled person would like to hear again. An engineering solution usually has an impact on both functionality and social influence. The social significance is hard to predict until the solution being deployed. Similar phenomena can be seen in the P2P protocol being criticized for copyright infringement and Le Corbusier’s design of Unité d’Habitation being criticized in the 1950s for being “inhumane.”
  3. The product design can be more empathetic. The current design of cochlear implant is generally neutral and humble; this makes it easier for users to hide the device from being noticed. However, the stealthy design ignored the fact that some users would like their situation to be aware of by nearby people. In a paper on assistive technology’s social impact, by Kristen Shinohara and Jacob O. Wobbrock from the Information School at University of Washington, revealed the fact that some research participants purposefully used their devices to raise awareness of their situation for safety reasons—this echoes with some of the interviewees’ embarrassing moments shared in the documentary—people forgot they were deaf [1]. When designing a product, it’s usage scenario shall be considered thoroughly—not only the user and the product but also the physical and social/psychological environments—should be taken into account. The problem demonstrated by the paper and the documentary also makes me think what is missing to push the assistive technology product firms to consider beyond the current scope in the R&D process.

Reference

  1. Kristen S., Jacob W. (2011). In the Shadow of Misperception: Assistive Technology Use and Social Interactions. CHI 2011, May 7–12, 2011, Vancouver, BC, Canada.

dynaTac: A Device Improves Fishing Performance

dynaTac - Fishing sensorBackground

dynaTac is a novel consumer-facing technology which improves fishing performance. It was developed as the Hardware/Software Lab-II course project at the University of Washington, instructed by Gabe Cohn and Sidhant Gupta from Microsoft Research. A team of three students worked for ten weeks to develop this device.

General Objectives

  • Scope a real-world problem that could be solved/improved with sensing technology within ten weeks.
  • Study the case and experiment solutions to solve the problem.
  • Develop iterations to implement the solution and study from this experience.

Time Span

Mar. 28, 2018 – Jun. 04, 2018

People in the Project

Ryan Wu, Maksim Surguy, Tyson Chen

Role in the Project

Product/Project Manager, Mechanic Engineer

Keywords

Sensor, microcontroller, Arduino, fishing, lab
Continue reading “dynaTac: A Device Improves Fishing Performance”

Alexa, Who Are You — A Brief History of Amazon’s Voice Assistant and Beyond

In the 2nd Quarter of the MSTI program at Global Innovation Exchange, University of Washington, we had a course called the History and Future of Technology. The course aims to give us an understanding and appreciation of past trends in technology to understand the trajectories of technology and how they change over time. This paper was the piece of work for the final assignment. In the article, I explored the path of Amazon Echo/Alexa’s development, and its impact on the society.


Photo credit: Amazon PR
Photo credit: Amazon PR

Abstract

In 2015, the Seattle-based company Amazon released Amazon Echo, a voice command device that connects to the company’s voice-controlled virtual assistant service Alexa. This research paper will introduce the development path of Amazon Echo/Alexa—how was it conceived, what were the critical decisions made. As the voice-based-command product relatively belongs to a new category, its optimal research and development approach has not been well defined; Amazon initiated the Alexa Prize for university talents to challenge specific topics, we can have a glimpse into the crucial technical challenge in a conversation AI product through this competition. This paper will also cover the ecosystem of the voice-command service industry, its impact on the society, debates, and controversies around such services.

Keywords:  Amazon Alexa, conversational AI, natural language processing, machine learning, virtual assistant
Continue reading “Alexa, Who Are You — A Brief History of Amazon’s Voice Assistant and Beyond”