A prototype augmented reality device in development at Carnegie Mellon University projects apps onto your desk and runs from a standard-size lightbulb socket. It lets you convert any surface into a screen that’s as interactive as your smartphone.
The project, detailed in the MIT Technology Review, is being developed by the Future Interfaces Group at Carnegie Mellon. Called Desktopography, the idea lets you use the empty space on your desk to display convenience apps like a calculator, clock or maps.
Because the system uses augmented reality, the apps can automatically position themselves when you put a real object on the desk. If you need to put a pen, sheet of paper or mug down, any apps in the area will be moved away to a clear space on the desk.
Unlike most other augmented reality devices, Desktopography doesn’t require you to wear a headset. It’s a simpler, “no-wires” approach to future interfaces that’s meant to help you interact with your computer. This means it shouldn’t impede you by placing artificial limitations on how you work.
The researchers hope the projection technology will allow the system to circumvent most of the annoyances of conventional augmented reality, making Desktopopgraphy more appealing and useful in everyday life. By cutting away the boundaries and literally overlaying the digital world on the real, the project’s creators are aiming to create the first seamless blend of the two.
“It’s about trying to break interaction out from our screens and our devices, where they’re separated from reality, and a separate world, really … and try to merge those onto our environment,” Robert Xiao, the graduate student behind Desktopography, said to the MIT Technology Review.
The device uses a small projector, a camera and a single depth sensor to work out the location of objects on your desk and display its apps. Since the camera can identify where you’re tapping, the hardware provides everything needed to turn any surface into a “touchscreen” panel. The system can also track real objects, letting you use a pen to “scroll” through content or slide a book to rearrange apps. The entire device is powered by the standard lightbulb socket it’s mounted in.
Desktopography is currently a functioning prototype but a lot of work remains before it’ll be ready for commercial use. The most significant hurdle to be overcome is the mounting of the camera used to track where you’re tapping.
Multi-touch tracking with a camera is always difficult but the sensor’s placement vertically above your finger makes the issues worse. It cannot accurately identify when the bottom of your finger touches your table, leading to misplaced inputs.
Xiao is optimistic that Desktopography will one day be put on sale. He thinks it could be available within the next five years, letting you put apps and shortcuts on your physical desktop in the year 2022. The technology is described as being “imminently feasible.” Unlike augmented reality headsets, its ease of use could eventually make it popular with consumers.
In a global survey of over 1,700 line of business employees in organizations with at least 250 employees, MuleSoft found that just 37% of organizations have the skills and technology to keep up with digital projects.
The resulting report — The State of Business and IT Innovation — reveals four key ideas that IT leaders need to know in order to drive digital innovation forward.
The @MuleSoft 2020 global survey of 1,739 line-of-business (LoB) employees in organizations with at least 250 employees revealed only 37% of companies have the skills and technology to keep pace with digital projects during the COVID-19 pandemic. https://t.co/yZBlJsdc08pic.twitter.com/OM54WZ6QqA
68% of respondents believe IT and LoB users should jointly drive digital innovation.
Keep up the pace
51% expressed frustration with the speed at which IT can deliver projects.
Integration challenge
37% cite security and compliance as the biggest challenge to delivering new digital services, followed by integration (i.e. connecting systems, data, and apps) at 37%.
Data access
80% say that in order to deliver on project goals faster, employees need easy access to data and IT capabilities.
“This research shows data is one of the most critical assets that businesses need to move fast and thrive into the future,” said MuleSoft CEO Brent Hayward.
“Organizations need to empower every employee to unlock and integrate data — no matter where it resides — to deliver critical, time-sensitive projects and innovation at scale, while making products and services more connected than ever.”
Despite the proliferation of the technology and increased investment, according to the report, just 10% of organizations are achieving significant financial benefits with AI. The secret ingredient in these success stories? “Multiple types of interaction and feedback between humans and AI,” which translated into a six-times better chance of amplifying the organization’s success with AI.
“The single most critical driver of value from AI is not algorithms, nor technology — it is the human in the equation,” affirms report co-author Shervin Khodabandeh.
From a survey of over 3,000 managers from 29 industries based in 112 countries — plus in-depth interviews with experts — the report outlined three investments organizations can make to maximize value:
The likelihood of achieving benefits increases by 19% with investment in AI infrastructure, talent, and strategy.
Scalability. When organizations think beyond automation as a use case, the likelihood of financial benefit increases by 18%.
“Achieving organizational learning with AI (drawing on multiple interaction modes between humans and machines) and building feedback loops between human and AI increases that likelihood by another 34%.”
According to report co-author Sam Ransbotham, at the core of successfully creating value from AI is continuous learning between human and machine:
“Isolated AI applications can be powerful. But we find that organizations leading with AI haven’t changed processes to use AI. Instead, they’ve learned with AI how to change processes. The key isn’t teaching the machines. Or even learning from the machines. The key is learning with the machines — systematically and continuously.”
Continued growth
While just 1 in 10 organizations finds financial benefits with AI, 70% of respondents understand how it can generate value — up from 57% in 2017.
BCG research finds that only 10% of companies report financial benefits from implementing AI. Companies that find success do so by thinking of AI as an integral, strategic component of their business and engaging in four key categories of activities: https://t.co/QTO68XLya2pic.twitter.com/RZUJRCdlL6
Additionally, 59% of respondents have an AI strategy, compared to 39% in 2017, the survey found. Finally, 57% of respondents say their organizations are “piloting or deploying” AI — not a huge increase from 2017 (46%).
One of the biggest takeaways? According to co-author David Kiron, “companies need to calibrate their investments in technology, people, and learning processes.”
“Financial investments in technology and people are important, but investing social capital in learning is critical to creating significant value with AI.”
There’s little doubt that COVID-19 had a profound effect on the food supply chain.
As one example, just think back to roughly March of this year, when virus transmission was rapidly picking up speed. Remember the reports of food and beverage companies only producing their most popular or essential products? Or how it would take slightly longer than usual to restock certain products? What about the rush to integrate — or quickly improve the efficiency of — digital and e-commerce.
Panning out a bit, think about food safety and quality professionals. The need to stay safe — and in many cases, stay at home — meant performing the very hands-on job of monitoring, auditing, inspecting at a distance, i.e. digitally.
When the food supply chain was hit by storages, delays, breakdowns, and lockdowns, the end result was — like in so many sectors — a rapid digital transformation.
As The Food Safety Market — an SME-powered industrial data platform dedicated to boosting the competitiveness of European food certification — elaborates in a new discussion paper, “technology has played an important role in enabling business continuity in the new reality.”
Agroknow (Coordinator of the TheFSM project) and 13 distinguished leaders from a variety of supply chain stakeholders discussed the changes we should expect regarding the Digital Transformation of Food Quality and Safety.#foodsafety#foodquality
👉https://t.co/VSdqwWP2LT
John Carter, Area Europe Quality Director for Ferrero put the issue of food access into perspective at the start of his interview:
“The production of food defines our world. The effects of agriculture on our daily lives are so omnipresent that they can be easy to overlook; landscapes and societies are profoundly influenced by the need to feed our growing population. But much has been taken for granted. Only occasionally are we forced to consider: ‘where does our food come from?'”
Ellen de Brabander, Senior Vice President of R&D for PepsiCo provided insight on the cost benefits of digital transformation:
“The need for customization is a big driver for accelerating digital transformation and moving away from a ‘one size fits all’ approach. This means that the cost to develop and produce a product must be lower and digital technologies provide a clear opportunity here.”
Clare Menezes, Director of Global Food Integrity for McCormick & Company brought up one area where digital tools need to go:
“There aren’t any areas where digital tools “fail”, but there is a need for tools that ‘prove out’ predictions around where the next integrity event will play out and how it could lead to quality or food safety failure. These tools are an obvious candidate for AI given the number of PESTLE factors that might come into play.”
Want to read all of the interviews? Check out the paper here.
