A new artificial intelligence tool can create realistic videos from audio files alone.
The technology, developed at the University of Washington is based on new algorithms designed to turn audio clips into realistic, lip-synced videos of the person who is speaking the words by searching for and learning from existing videos on the Internet or elsewhere.
How was this tech created?
Creating the tech involved first training a neural network to view videos of an individual and then to translate different audio sounds into basic mouth shapes. Then, researchers used a new mouth synthesis technique to realistically superimpose mouth shapes and textures onto an existing reference video of a given person.
To test out the technology, the research group generated a realistic video of Barack Obama discussing such diverse subjects as terrorism, fatherhood and employment. The video was created using audio clips alone together with a separate video image of the former president. The video overcomes a major problem with adding audio to video, where the mouth of the speaker appears unrealistic.
The video below shows the outcome of the study:
Discussing the outcome, lead researcher Professor Ira Kemelmacher-Shlizerman enthused: “These type of results have never been shown before.”
The white paper based on the research is called “Synthesizing Obama: Learning Lip Sync from Audio”.
Betting on yourself with entrepreneur Tanya Gough
Armed with a passion for narrative literacy and a knack for content architecture, creative-industry entrepreneur Tanya Gough is driven to help make the writing process more interactive, collaborative and social with StoryBilder.
“Whatever you do will be wrong…until it isn’t,” says creative-industry entrepreneur Tanya Gough, about navigating other people’s feedback while building a tech platform.
Armed with a passion for narrative literacy and a knack for content architecture, Gough has created StoryBilder. It is an adaptive story-generating platform that transforms the way writing happens. The platform is aimed at helping storytellers build out their plots, characters and entire worlds to make the writing process more interactive, collaborative and social.
Gough is one of 50 women across Canada selected for the first cohort of the BANFF Spark Accelerator for Women in the Business of Media. With support from Western Economic Diversification Canada, this new program offers training, mentorship and market access to women entrepreneurs ready to grow or launch their own businesses in screen-based industries.
Leigh Doyle: You’re a big believer in narrative literacy. Can you tell me a bit about what is narrative literacy, and why do all of us need to sort of relearn it?
Tanya Gough: Narrative literacy is the ability to recognize and understand narrative structure in the stories around us. It matters because we’re surrounded by story, and it’s an incredibly persuasive format for transmitting information. When we understand story, not only are we better able to express our own stories and be heard, but it also gets easier to recognize when we’re being manipulated or lied to. And that gives us better defenses against fake news and makes it easier to differentiate between fact and fiction.
Doyle: How did the idea of StoryBilder come to you?
Gough: I was hanging out with a friend of mine who is a game designer, and we were brainstorming for an app we were working together on. At that moment, StoryBilder just happened for me. I knew exactly what it had to be.
I wanted to create an environment where people could not only write their stories, but that could also help them organize their thoughts and ideas. And, if they were new to writing or didn’t know what to do next, there would be support and tools to help them improve their craft. I also wanted to ensure the platform would foster creativity, which I think is missing in the market.
Here’s what it is and how it works:
Doyle: Who is StoryBilder for?
Gough: StoryBilder is currently designed to support creative writing, particularly for fiction novels. But the technology is adaptable. I’ve already got screenwriters who want to use it as a planning tool for their scripts. I have game developers who want to use it for world building. I even had a D&D master ask me if he could use it to build campaigns — and the answer to this is yes. StoryBilder is built around a narrative construction model that can be applied to any storytelling format. It can be used for a lot of different things.
Doyle: What author would you be thrilled to see using StoryBilder?
Gough: It’s so hard to pick! The obvious answer is George RR Martin. The idea of this huge epic world, with tons of characters spanning multiple books and managing all of the interconnected pieces, is a long-term ambition of StoryBilder. But, personally, from more of a literary geek perspective, I would say Michael Chabon who wrote The Amazing Adventures of Kavalier & Clay. It’s probably my favorite book of all time. Chabon writes these incredibly dense, complexly structured storylines with interconnecting plots and massively detailed backgrounds. This is the type of narrative I’m keeping back of my mind as I develop StoryBilder.
Doyle: When will StoryBilder be available to the public?
Gough: Right now, we’ve got beta testers helping me find the last of the bugs, and I’m doing some extra design work. Then we’re launching this summer. I’m looking forward to getting it into the market and getting the word out.
Doyle: You’ve owned a boutique CD and video store, the world’s largest Shakespeare video catalogue and created content for companies like BlackBerry, Shoppers Drug Mart and more. How have you seen the entrepreneurial landscape change for women over the course of your career?
Gough: If five years ago, you asked me if there would be any substantial change for women in business in my lifetime, I would have said no. And clearly I won’t see parity in my lifetime — just look at the numbers. But what I have seen — especially in the last few years — is a rising opportunity for entrepreneurial women to connect with each other. This is thanks to social media and groups on large networks like Facebook.
The women in these groups are not only talking about their challenges in a really honest way, but they are incredibly generous about helping each other and supporting each other through not only the bad stuff, but making sure that we’re all succeeding together. Change is happening now. It’s not going to happen as fast as people hope, but it will happen as long as we continue to support each other and continue to speak openly. Support and solidarity are incredibly empowering.
One of my big drivers for creating StoryBilder is this knowledge that more women need to have businesses to create a path for the next generation to follow. Someone needs to be out in front. And that’s where I need to be, with the rest of the women taking the hits and leading the way.
Doyle: What lessons do you have for entrepreneurs building tech platforms like Story Bilder?
Gough: The first is to forget about funding. Sure, there are stories about people getting funded at the idea stage, but it’s rare, and you’re new and inexperienced. Find another way and don’t waste all of your time chasing the money until you have something solid in hand.
The second is whatever you do will be wrong…until it isn’t. Take the time to experiment and try new approaches to make sure you’re solving the right problem in the right way. Likewise, if you are looking for funding, be prepared to hear you’re not ready — a lot.
Finally, do it because you love it. Starting a business is way too much work to do if you don’t wake up every morning excited to be working on it. Which isn’t to say you’re going to love it every day, but if you’re waking up every morning not knowing if you’re building the right thing, go do some market research or get out.
Connect with Tanya and StoryBilder on social media:
DX Journal covers the impact of digital transformation (DX) initiatives worldwide across multiple industries.
Digital transformation for a more sustainable world
Sure, they’re confronted with business challenges every day, but the world’s top business leaders have a significant part to play in solving the world’s challenges — economic, technological, societal and educational.
As Christian Klein, Co-Chief Executive Officer of enterprise application software company SAP succinctly puts it in a blog post for the World Economic Forum, “Companies today don’t just prosper based on their financial performance, but on how they make a positive contribution to society.”
Ahead of the World Economic Forum’s 2020 meeting — taking place Jan. 21-24 — Klein outlined how digital transformation can be a force for good in the world, and be a way to create a more sustainable world.
Critical minds, he starts, might wonder why companies would take the time, considering their primary goal of making money. “These critics should not underestimate the power of the consumer,” he argues, explaining that while customers do consider their decisions based on products or price, but the company’s values. Employees act in a similar way, choosing to join companies “that embrace their responsibility towards humankind and the planet.”
Almost every person on the planet knows that technology plays a profound effect on just about every facet of our lives, from jobs to wages to health to security. Meanwhile the need for business to undergo digital transformation, simply to stay relevant and alive, is hardly big news anymore.
“But transformation is also about a change of culture, which requires a radical rethinking of people, processes and technologies,” Klein writes. Included in this are “tectonic changes” that go into a company, and how employees interact within the whole system.
“And just like a business cannot digitally transform unless – or until – its people transform, I believe that, while they come with their own environmental costs, technology and digitalization can play a crucial role in developing solutions for a better tomorrow.”
Some examples? Blockchain’s potential to add traceability (and by extension, trust) to food supply chains. The empowerment of people with disabilities through AI, which, when properly applied, can reduce bias in the hiring process. Smart cities, powered by everything from sensors to open data to better supply services and protect resources.
[Related reading: How 5G and the Internet of Things can create a winning business]
“There is no doubt that technology and digital transformation break down silos and create transparent and unified data for objective decision-making,” Klein writes. “But even more so: they change how companies manage their relationships with the wider world.”
Creating a sustainable world requires us to look beyond corporate borders, toward the communities around us, creating an ecosystem of trust “that allows us to exchange ideas to create a safety net for the most marginalized.”
DX Journal covers the impact of digital transformation (DX) initiatives worldwide across multiple industries.
DX survey reveals high levels of enterprise-consumer disconnect
A new survey looks at the global investment and effectiveness of businesses’ digital transformation efforts. The survey shows a disconnect between enterprise investments and consumer experiences.
The survey is titled “The Kony Digital Experience Index (KDXi) Survey”, and the main takeaway is that while businesses have invested nearly $5 trillion on digital transformation initiatives, only 19 percent of customers have reported any significant improvement in the experiences offered to them.
The Kony Inc., survey included 1,600 responses from business leaders and customers across the U.S., Europe and Asia. The responses were used to gauge the target digital project implementation efficiencies in banking, retail, utilities and healthcare. The research showed a disconnect on both sides and a potential misalignment around investment priorities, and highlighted the impact this could potentially have for businesses.
Among other things, the study found that consumers are underestimating the number of businesses that are investing heavily in every customer experience outcome by at least 50 percent. This means that while business are spending money on digital transformation projects, consumers are not necessarily noticing a difference.
The survey also reported that 62 percent of consumers say that they spend more with companies that offer effortless digital experiences, while 56 percent of consumers indicate that they will switch if a retailer does not deliver the digital experience they want. This signals the necessity for businesses to continue to invest in the digital experience for the customer. However, in doing so they need to start making an impact.
As the report states: “It is critical for businesses to have a greater focus on understanding and aligning with customer needs and priorities to ensure that they are driving the agenda for the digital technology they create and fund.”
In terms of what businesses should be doing, the basis of a strategy includes:
- Embracing innovative thinking, ambition and a commitment to improvement
- Prioritizing investment in digital outcomes, not digital initiatives
- Getting their foundations right before evolving
- Building for now, but investing in a roadmap that leads to the future
- Saying no to silos and yes to integrated digital strategy
- Setting a customer-centered digital transformation agenda
This means companies should work to provide web experiences that make it easier for users to navigate, and for websites to be more engaging and intuitive to use. There also needs to be comprehensive online and mobile facilities so that users can do everything online or via their mobile device. Furthermore, to truly step forwards, businesses need to begin offering digital experiences such as AI, chatbots and augmented reality.
Summing this up, Thomas E. Hogan, chairman and CEO, Kony, Inc. states: “Improvements in costs and efficiencies are always welcomed and clearly important to project funding, but the real returns and real impact of digital starts and stops with its impact on the customer experience.”
Business2 weeks ago
Shanghai eases Covid curbs in step towards ending lockdown
Business2 weeks ago
Shanghai euphoria tempered by deep wound to China’s economy
Business3 weeks ago
Twitter shareholder lawsuit accuses Musk of ‘market manipulation’
Energy4 weeks ago
Industrial Edge: The Energy Opportunity
Business1 week ago
US suspends solar tariffs, boosts production in clean energy push