Facebook builds 'Rosetta' AI to understand text in images and videos

14/09/2018

Facebook says that Rosetta has already been widely adopted within various teams at the company and with Instagram, and noted that the text extracted from images is also being used in various machine learning models, such as those to improve its photo searching features. As a large number of posts are being posted on the social media, Facebook's moderators aren't able to review the content of the memes while they are being posted, creating a lot of fuss related to offensive posts. First, it detects rectangular regions that potentially contain text, and then performs text recognition.

By its own admission, Facebook has been struggling to suppress the spread of inappropriate content - from hate speech and threats of violence to disinformation and "fake news" across its vast platform.

The technology is rooted in optical character recognition (OCR), only here it's been goal built to process images that get uploaded to Facebook on a daily basis.

Fb says text extraction and machine learning are being set up to exercise to "robotically identify squawk that violates our hate-speech coverage" and that it's doing so in just a few languages. To handle the task, the company has now designed a very sophisticated artificial intelligence which is known as Rosetta.

"Taking into account the sheer volume of photos shared each day on Facebook and Instagram, the number of languages supported on our global platform, and the variations of the text, the problem of understanding text in images is quite different from those solved by traditional optical character recognition (OCR) systems, which recognize the characters but don't understand the context of the associated image", Facebook said in a blog post. The AI tool will be effective enough to understand multiple languages.

For what its worth, Facebook and Twitter have constantly updated their policies, and put in place mechanisms to curb the spread of offensive content on their platforms. Rosetta is the most recent advancement.

For over a year now, Facebook has been under the scanner for the role its played in providing a platform for fake news and hate speech.

Related News:

Apple CEO Tim Cook speaks at the company's event in Cupertino , at which updated iPhones and a new smartwatch were unveiled. It is also running on the new 7nm A12 Bionic Chip and it retains the same 12MP f/1.8 main camera that's assisted with OIS.

AC Milan have again been linked with the Blues midfielder, having been linked with him during successive transfer windows. But this could be too early to discuss as Fabregas has a very very large chunk of the season to turn the fortunes.

The court heard police in an unmarked auto spotted Lloris' Porsche Panamera driving at 15mph (24kph) in a 30mph (48kph) zone. Lloris apologised to his manager and team-mates after the incident. "I made a mistake and now I need to pay".

People in the Carolinas had the daytime hours Thursday to complete their final preparations to ride out or escape the storm. Although the storm has weakened to a Category 2, it's still expected to bring some bad weather to the area this weekend.

Ultimate, some more info about that new Yoshi game, and if you're feeling really lucky, an Animal Crossing Switch announcement. No word yet on what Luigi's Mansion 3 will be like, but I for one am excited to protect this poor plumber from further harm.

It's not that my hunger for it went away or my motivation. "Even when she broke her nose she just never gave up", said Andrews. And we did that. "The talent has definitely improved", said Monique Currie, a 13-year veteran.

US crude inventories fell by 5.3 million barrels in the last week, the US Energy Information Administration said on Wednesday. Russian energy minister Alexander Novak on Wednesday warned of the impact of U.S. sanctions against Iran.

When SquareEnix's Hajime Tabata joked that Final Fantasy XV might come to Nintendo's hybrid portable, fans bought into the hype. And so is World of Final Fantasy , as a new version called World of Final Fantasy Maxima (also coming to PC, PS4 and Xbox One).

The 3 touchdown passes each went to newly added receivers for the team, Michael Crabtree , John Brown , and Willie Snead. Green climbed the ladder and ripped the ball out of Austin's hands, shrugged off his tackle and was gone for 32 yards .

Most liked

'I'm not racist' - Aussie cartoonist on Serena Williams
The anger came thick and fast, and it quickly became less about Knight's cartoon and more about perceived racism in Australia. Knight, who deleted his own account after being inundated with complaints from around the world, has not commented on it.

Joyce Drifting Southwestward With No Change in Strength
Currently, tropical-storm-force winds have been recorded extending outward up to 160 miles (260 km) from the centre of the storm. However, Isaac is still predicted to trigger tropical-storm-force winds and life-threatening flash flooding.

Norwegian Dawn docks in Sydney for the day
As of 1:00 PM ET Monday, Florence was about 575 miles south-southeast of Bermuda and moving to the west at 13 miles per hour. The infographic below, provided by Statista, demonstrates the comparative cost of damage caused by recent hurricanes.

Pokémon's Game Freak Announces New 'Town' RPG
The game takes place entirely in the village and it'll be up to you to help the villagers take on various monsters. The game is tentatively titled " Town ", and it is slated for 2019 on Nintendo Switch.