Skip to main content

Google Street View rival Mapillary collaborates with Amazon to read text in its 350M image database

Mapillary, the Swedish startup that wants to take on Google and others in mapping the world by way of a crowdsourced database of street-level imagery, is taking an interesting step in the development of its platform. The company is now working with Amazon, and specifically its Rekognition API, to detect and read text in Mapillary’s database of 350 million images.

The first application resulting from the new feature will come from a large US city (that Mapillary will not name right now), which plans to use the information that will now be “readable” from parking signs to build a parking app.

“Parking is a super hot space and [parking information] is one of the most asked-for pieces of data that people want to use Mapillary for,” said Jan Erik Solem, CEO and co-founder of the Malmo, Sweden-based startup. He said that while parking will be the first application and one that he expects other cities to use as well, there will be other applications coming out from matching up text in Mapillary’s images, and subsequently being able to pinpoint exact latitude and longitude for specific locations. “We’re starting with parking signs in the US because parking is one of the biggest issues in towns today, but text recognition will apply to many different types of objects and images, such as building facades.”

While it might sound odd that a city might not have a grip on the state of its on-street parking, this is apparently the case: cities, Solem said, have general analogue maps indicating parking regulations, but many of them lack digitised versions, which means that when they want to build new services (and in particular services that help them raise revenues either from parking fees, or parking fines), or consider whether they need to build more parking, they lack the datasets to be able to either.

Mapillary cites research that says that parking problems collectively cost $73 billion in the US — presumably that includes not just the fines that people pay for overstaying, but the lost revenues in areas where they overstay, but no one knows.

Notably, Mapillary is referring to its use of the Rekognition API as a “collaboration” with Amazon, although when I asked about the wording, he was a little less willing to collaborate with me.

“I can’t comment on what Amazon is doing or why,” he said. “It would be nice to have that part of the announcement, but it ended up not working out this time.” It seems that the two have been working together for a while now, although that is all under NDA.

Amazon has been doing a lot in the world of mapping, however, both as a provider of data to third parties, and for its own services. For starters, the company is a logistics powerhouse, and part of the reason for that is because of its intelligent routing around areas to figure out how best to collect and deliver and distribute goods bought and sold on its marketplace.

But that is just one part of how mapping and location are used at Amazon. The company uses maps from Here, and had at one point been rumored to be one of the parties interested in buying the mapping firm. Meanwhile, it also has built (and acquired other mapping IP and talent in the process) a mapping API, similar to Google’s, for developers that want to build apps that use location services in any way for any Amazon device.

For now, that has mainly meant building apps for its Fire tablet and Amazon’s burgeoning range of Echo devices, but Amazon is also very focused on also having a role to play in other kinds of hardware, such as connected vehicles.

In January, Toyota announced that it would be working with Amazon to integrate Alexa into its cars, and separately, Amazon has also been racking up patents in the area of autonomous vehicles.

In other words, there is a clear opportunity for a company like Mapillary, providing a viable alternative to Google Maps in terms of street-level imagery, to work as a strong partner to Amazon in these services, specifically in indexing and providing information about what is around you, and how to route you most efficiently from A to B.

And as a side note, as with other artificial intelligence platforms, Rekognition is also learning from each time that it’s used in an application, so through its collaboration with Mapillary, it too is picking up more detailed data about street signs and what they say, and where they are used.

Mapillary itself is an interesting startup that I’ve long thought is one to watch. Solem is a computer vision specialist who sold his previous company, the facial recognition startup Polar Rose, to Apple; and his latest venture has raised $24.5 million so far from the likes of Sequoia, Atomico, Navinfo, BMW and Samsung — leading the way to building some interesting inroads with potential customers.

One of these happens to include Here, Amazon’s mapping provider. Others are under NDA. Together, they are now also feeding Mapillary images to contribute to its wider database, although Solem said about 80 percent of its content of 350 million images still comes from individuals, much like Waze. “Everyone either seems to have a need to solve some kind of problem, or a desire to fix maps around the world,” he said.

While text recognition and reading is one problem Mapillary is tackling today, the next will be helping people capture more images, more automatically. “The next iteration of our product will help people fill out coverage,” Solem said without elaborating more on the details. “We are building out tools to deploy capture tasking.”

from TechCrunch


Popular posts from this blog

Android blatantly copies the iPhone X navigation gestures

Google unveiled some of the new features in the next version of Android at its developer conference. One feature looked particularly familiar. Android P will get new navigation gestures to switch between apps. And it works just like the iPhone X.“As part of Android P, we’re introducing a new system navigation that we’ve been working on for more than a year now,” VP of Android Engineering Dave Burke said. “And the new design makes Android multitasking more approachable and easier to understand.”While Google has probably been working on a new multitasking screen for a year, it’s hard to believe that the company didn’t copy Apple. The iPhone X was unveiled in September 2017.On Android P, the traditional home, back and multitasking buttons are gone. There’s a single pill-shaped button at the center of the screen. If you swipe up from this button, you get a new multitasking view with your most recent apps. You can swipe left and right and select the app you’re looking for.If you swipe up o…

Square launches restaurant point-of-sale platform

Square, which has already made its way into retail stores and service-based businesses (think hair salons, massage therapists, etc), is officially getting into the restaurant business with the launch of Square for Restaurants. Square for Restaurants is a point-of-sale system that handles everything from menu updates, floor layouts, employee scheduling, performance tracking to tip splitting.Usually, restaurants have “some old legacy thing or something else,” Square Seller Lead Alyssa Henry told me.“Historically, we’ve not served this customer segment very well,” Henry said. “With Square for Restaurants, we’re excited to finally be able to serve this customer segment and deliver on a couple of key things that are core to Square but also highly valued by sellers of all types.”This new product is designed to be fast, self-serve, elegant and cohesive, Henry said. It also integrates seamlessly into Square’s existing ecosystem that includes Payroll, Capital and more. Given Square’s ownership…

State Farm sponsors popular Fortnite streamer DrLupo

DrLupo, one of the biggest names and most recognizable voices in Fortnite streaming, has closed a sponsorship deal with State Farm.Bejanmin “DrLupo” Lupo has nearly 3 million Twitch followers and often plays with the world’s most popular streamer, Tyler “Ninja” Blevins. Beloved for his talent and his personality alike, Lupo has also worked as a caster for various Fortnite tournaments and events. Last year, DrLupo held a charity stream for St. Jude’s Research Hospital and raised $1.3 million.State Farm Marketing Director Ed Gold had this to say:DrLupo is one of the world’s most followed Fortnite streamers. His philanthropic efforts and massive fanbase make him an ideal partner as we continue to amplify our esports programming and efforts with the gaming community.This marks State Farm’s first sponsorship of an esports athlete. The sponsorship will include support of the stream through branded replays, live in-stream stunts and product integration (here’s me trying to imagine integratin…