• Home
  • Latest
  • Fortune 500
  • Finance
  • Tech
  • Leadership
  • Lifestyle
  • Rankings
  • Multimedia

Trendingnow

1

Jensen Huang made his $172 billion fortune on AI chips. His family's $75 million gift to Vanderbilt argues art decides what technology is for

2

'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down

3

The $39 trillion U.S. national debt isn’t as high as Japan’s and Singapore’s relative to economy size—and yet it's still worse somehow

1

Jensen Huang made his $172 billion fortune on AI chips. His family's $75 million gift to Vanderbilt argues art decides what technology is for

2

'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down

3

The $39 trillion U.S. national debt isn’t as high as Japan’s and Singapore’s relative to economy size—and yet it's still worse somehow
TechGoogle

Facebook Is Building Some Fancy New 360 Video Technology

By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
By
Jonathan Vanian
Jonathan Vanian
Down Arrow Button Icon
August 31, 2016, 1:00 PM ET
Photograph by Bloomberg via Getty Images
Add Fortune on Google for similar content.

Last week, President Barack Obama dipped his toes into the world of virtual reality.

He starred in a short film during a recent trip to Yosemite National Park that was shot with high-end cameras that capture video in full 360 degrees. Viewers wearing virtual reality headsets could crane their necks to gawk at Yosemite’s majestic granite cliffs and tranquil meadows as if they had tagged along with the president.

It was the next best thing to being there.

President Obama’s trip was a showcase of what is possible by filming video in 360 degrees. But it’s also a reminder of how much work remains to be done before tourists are able to film their own vacations like that of President Obama by a professional VR studio for Facebook’s Oculus Rift virtual reality business.

Facebook (FB) has been a big proponent of 360-degree video (in addition to regular, old video in general), and over the past year has added several data center and video processing technologies so that it can more efficiently show 360 degree videos to users without annoying delays.

Get Data Sheet, Fortune’s technology newsletter.

By improving the technology for consumers to both watch and create videos in 360 degrees, the social network hopes to benefit by keeping its over 1 billion users more engaged and active. As of now, however, most amateur 360-degree video being shot is “super shaky and not so watchable,” said Johannes Kopf, a research scientist in Facebook’s computational photography research group.

Watching one of these shaky 360 videos using a headset can be disorienting and can even cause people with sensitive stomachs to feel queasy, Kopf explained. To deal with these wobbly videos, Facebook built a new algorithm that Kopf said can automatically improve amateur videos by removing some of the unwanted unsteadiness that is typical when non-professionals film using a camera in their untrained hands.

The algorithm is part of what’s known as electronic image stabilization, a type of video processing that can help smooth the jerkiness in videos even when filmed in an unsteady environment, like from a dirt bike cruising down a bumpy trail.

Currently, many different automatic video stabilization tools are available for standard, flat video, but there are not many designed for 360 video. Companies like VideoStitch and Mettle as well as academic researchers have all been working on ways to smooth bumpy 360 videos, but the technology is not yet widespread.

Unlike some video technology companies, Facebook does not want to sell video-processing software to consumers. Instead, it wants to bundle its homegrown 360-degree video smoothing technology into its social networking service so that when users upload videos, the stabilization technology works automatically behind the scenes to remove some of the jittery imagery, Kopf explained.

Facebook’s video stabilization tool involves slicing a video into chunks, or key frames. The engineers used an existing image tracking technology to pinpoint specific objects within a video, which allows them to keep track of those objects in the film over time.

So in the case of a 360-degree video of a yellow ball filmed with shaky hands, Kopf said, Facebook can lock onto that ball and keep track of its original position.

As the film progresses and the ball starts moving away from its center position of the image because of poor camera work, the algorithm can essentially rotate each key frame so that the ball magically appears in the same spot in every frame. Once the key frames are rotated, the algorithm can then re-orient all the other video frames in relation to the stabilized key frames, which helps if there happens to be multiple balls in the scene.

“It’s like a balance, you can’t smooth them out all at once,” said Kopf. “Different parts of the scene might be moving in slightly different ways, and by having more localized information you can smooth them out as well.”

The algorithm can also slightly deform each frame as well, so that in the case of an extreme wobbles the actual frame gets a little tweaked to conform to where the ball should be. Once stabilized, the film should appear less amateurish than before and less nauseating of an experience.

Kopf and his team started working on the technology in January and is still testing and improving it. Facebook hasn’t decided when to actually start rolling it out to all of its users.

For more about Facebook, watch:

Smoothing out 360-degree videos has a couple benefits to Facebook, Kopf said. For one, smoothing out the shaking makes it easier to shrink the video for storage and for streaming, which eases the burden on Facebook’s data centers and makes it faster for users to upload.

The smoother videos also makes it easier for people to create time-lapse scenes. For example, someone filming themselves on a scenic 15 minute car ride can speed up the clip so it’s shorter and easier to follow, he explained.

“The 360 and VR space is really developing and we are seeing now more consumer content,” said Kopf. “There’s some interesting work to be done to make the creation of this content easier and able to share a moment, which is really powerful.”

About the Author
By Jonathan Vanian
LinkedIn iconTwitter icon

Jonathan Vanian is a former Fortune reporter. He covered business technology, cybersecurity, artificial intelligence, data privacy, and other topics.

See full bioRight Arrow Button Icon
Add Fortune on Google for similar content.

Latest in Tech

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025

Most Popular

Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Finance
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam
By Fortune Editors
October 20, 2025
Fortune Secondary Logo
Rankings
  • 100 Best Companies
  • Fortune 500
  • Global 500
  • Fortune 500 Europe
  • Most Powerful Women
  • World's Most Admired Companies
  • See All Rankings
  • Lists Calendar
Sections
  • Finance
  • Fortune Crypto
  • Features
  • Leadership
  • Health
  • Commentary
  • Success
  • Retail
  • Mpw
  • Tech
  • Lifestyle
  • CEO Initiative
  • Asia
  • Politics
  • Conferences
  • Europe
  • Newsletters
  • Personal Finance
  • Environment
  • Magazine
  • Education
Customer Support
  • Frequently Asked Questions
  • Customer Service Portal
  • Privacy Policy
  • Terms Of Use
  • Single Issues For Purchase
  • International Print
Commercial Services
  • Advertising
  • Fortune Brand Studio
  • Fortune Analytics
  • Fortune Conferences
  • Business Development
  • Group Subscriptions
About Us
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • About Us
  • Press Center
  • Work At Fortune
  • Terms And Conditions
  • Site Map
  • Facebook icon
  • Twitter icon
  • LinkedIn icon
  • Instagram icon
  • TikTok icon
  • YouTube icon

Latest in Tech

Google logo is displayed on a smartphone in front of the EU Flag.
CybersecurityGoogle
EU strikes Google with $1 billion fine in major crackdown on antitrust regulations even as Trump threatens retaliation
By The Associated Press and Sam McNeilJuly 24, 2026
19 minutes ago
AI executives demand OpenAI release more details about how the Hugging Face hack happened
AIOpenAI
AI executives demand OpenAI release more details about how the Hugging Face hack happened
By Emily ForliniJuly 24, 2026
58 minutes ago
woman yellow shirt standing in front of ring light
SuccessSocial Media
Influencer marketing isn’t an experiment anymore as companies expand their creator advertising budgets
By Tatiana SatauaJuly 24, 2026
1 hour ago
dario
AIEconomics
Anthropic’s head of economics just explained why Anthropic’s CEO was wrong about a white-collar bloodbath
By Nick LichtenbergJuly 24, 2026
2 hours ago
jh
AINvidia
Jensen Huang just used his first ever X post to warn the AI industry not to make the mistake that software narrowly avoided in the 1980s
By Nick LichtenbergJuly 24, 2026
3 hours ago
pjm
EnergyData centers
The AI boom’s hidden electricity bill — and why you’re paying it
By Nick LichtenbergJuly 24, 2026
3 hours ago

Most Popular

Jensen Huang made his $172 billion fortune on AI chips. His family's $75 million gift to Vanderbilt argues art decides what technology is for
Big Tech
Jensen Huang made his $172 billion fortune on AI chips. His family's $75 million gift to Vanderbilt argues art decides what technology is for
By Sydney LakeJuly 23, 2026
2 days ago
'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down
Economy
'The demographic dividend of the last 40 years is ending': J.P. Morgan says the world is running out of the two things that kept interest rates down
By Eleanor PringleJuly 24, 2026
13 hours ago
The $39 trillion U.S. national debt isn’t as high as Japan’s and Singapore’s relative to economy size—and yet it's still worse somehow
Economy
The $39 trillion U.S. national debt isn’t as high as Japan’s and Singapore’s relative to economy size—and yet it's still worse somehow
By Sasha RogelbergJuly 23, 2026
1 day ago
The millennial generation has split, new Fed research shows: Those over 35 are edging toward boomer-style wealth, while everyone else falls behind
Real Estate
The millennial generation has split, new Fed research shows: Those over 35 are edging toward boomer-style wealth, while everyone else falls behind
By Nick LichtenbergJuly 22, 2026
2 days ago
Spain lifted the World Cup, but the IRS still gets a cut of its $50 million pay day as players, coaches and refs all face complex U.S. “jock taxes”
Personal Finance
Spain lifted the World Cup, but the IRS still gets a cut of its $50 million pay day as players, coaches and refs all face complex U.S. “jock taxes”
By Joshua HongJuly 23, 2026
2 days ago
Current price of oil as of July 24, 2026
Personal Finance
Current price of oil as of July 24, 2026
By Joseph HostetlerJuly 24, 2026
11 hours ago

© 2026 Fortune Media IP Limited. All Rights Reserved. Use of this site constitutes acceptance of our Terms of Use and Privacy Policy | CA Notice at Collection and Privacy Notice | Do Not Sell/Share My Personal Information
FORTUNE is a trademark of Fortune Media IP Limited, registered in the U.S. and other countries. FORTUNE may receive compensation for some links to products and services on this website. Offers may be subject to change without notice.