The New Frontier: Physical AI

We are living through a period where the boundary between science fiction and reality is thinning daily. While much of the recent noise has been around “Digital AI”—the chatbots and art generators—the most significant shift for our physical world is the rise of Physical AI.

Physical AI is intelligence with a body. It is the motor grader capable of autonomously maintaining a township road, the plow truck clearing snow after a blizzard, and the self-driving sensor suite that identifies downed trees or debris before a human ever has to drive out there. For these machines to function, they don’t just need code; they need a “Ground Truth” digital twin of the world—a level of sensory detail that satellites simply cannot provide.

The Rural Reality: From Stagnation to Survival

In major urban centers, high-quality street-level imagery is often a “want”—a convenience for checking traffic or finding a shop. But in rural areas, like my home region in Northern Minnesota, this data is becoming a fundamental need.

For decades, rural communities have faced a steady decline. The bustling towns of the mid-20th century have seen jobs and younger generations migrate toward urban hubs. This leaves us with a grim economic reality: we have massive, aging infrastructure built by the Boomer generation, but we no longer have the labor pool or the tax base to maintain it.

In Minnesota alone, there are thousands of miles of county and township roads rapidly deteriorating. We simply do not have enough people or money to do the work manually anymore. Physical AI isn’t just a high-tech luxury here; it is the only viable path to keeping these regions habitable and connected in the decades to come.

The Project Manager’s Perspective: The Invisible Crisis

As a Highway Heavy/Civil Project Manager, I see the lack of accurate physical data every single day on the job. It’s not just a rural problem; it’s an infrastructure problem.

Take roadway reconstruction: one of our biggest hurdles is existing underground utility infrastructure—sanitary sewers, water mains, fiber optics, and power lines. On paper, these are “marked” during the design phase. In reality, the information is often outdated, inaccurate, or missing. This leads to massive delays, safety risks, and billions of dollars in “surprises” during excavation.

While Mapillary currently focuses on surface-level data like signs and overhead lines, the mission of building a complete Digital Twin of our world is the key to solving these systemic inefficiencies. If we can’t accurately map the world we can see, we have no hope of organizing the world we can’t see. Combining ground-level imagery with centralized utility data into a functional digital twin would be worth billions if not trillions of dollars to our economy.

The Data Gap: Breaking the Urban Bias

There are two major hurdles preventing this “Physical AI” revolution from reaching the places that need it most:

  1. The Adoption Lag: Rural areas and the construction industry are traditionally the last to receive new tech. They are often “stuck in their ways,” and the capital required for adoption is scarce.

  2. The Training Bias: Tech companies build for their biggest markets—cities. Because they lack comprehensive rural data, their AI models are “urban-smart” but “rural-blind.”

This creates a self-perpetuating cycle: rural areas and builders don’t buy the tech because it isn’t suited for their environment, and companies don’t build for those environments because no one is buying. Mapillary has the unique opportunity to break this cycle by providing the open-source, ground-level data required to train AI on the specific physical factors of rural life and civil construction.

The Pinch Point: Time, Money, and the “Hobbyist” Limit

This is where we have to be honest about the current state of crowdsourcing. Right now, mapping large rural tracts is largely a labor of love. People like myself spend significant time and personal funds to map our local regions because we want to help build a future for our communities.

But “passion” doesn’t scale to the level required to map the entire physical world.

Mapping massive areas is a significant time and money sink. If we are serious about building the data infrastructure for Physical AI, we have to address the compensation gap. We are asking individuals to build the foundation for a multi-billion dollar industry, often with no personal gain and at a personal loss.

A Call for a Sustainable Future

The most important task of the next decade is fully mapping our physical world into a digital twin. This is the only way we overcome the labor and fund shortages that threaten our standard of living.

We need the tech industry and the Mapillary community to recognize that digital infrastructure is infrastructure. Just as the previous generations invested in physical roads, we must find a way to fund the digital ones. We need a model that compensates the mappers who are out there in the heat and the snow, capturing the data that will eventually allow a robotic grader to keep a township road open or a utility crew to dig without hitting a fiber line.

Without a way to support the people building this future, the promise of Physical AI will remain a “city-only” privilege, and our infrastructure will continue its slow, quiet decline.

2 Likes

I agree. I was actually just wondering about the feasibility trying to get contract work to capture imagery through self-employment. I’m in rural Australia, and all too familiar with the ageing infrastructure you refer to.

It’s a long read, but this is very true.

You present deep deliberations, which is indeed far more than critical thinking people can usually expect from others (these days). So, it is great that you can and have shared your thoughts. :+1: And, I also fully understand your frustration about how many things are currently progressing. However, if you really want things to change or your words to have any meaningful impact then you must be more precise and concise about what exactly you want. Try to condense your cause and conclusions reasoning as well as your suggestions about what needs to be done into simple compact sentences.

The Pinch Point: Time, Money, and the “Hobbyist” Limit

It is true that the current crowdsourced mapping model is not for everybody because it depends on time, available equipment, technical skill, and of course money of individuals (sometimes also organizations). However, it is not true that this model is unsustainable per se or ineffective. Just look at OpenStreetMap, Wikipedia, or the Linux kernel projects. These projects are well alive and evidently contribute massively to society. So, just because a project is volunteer driven and sponsor funded does not mean that it is unsustainable. Keep in mind that wherever there is a need there is also usually somebody who is willing (and capable) to satisfy that need, no matter whether against payment or not. This is how open societies generally operate. People not only vote at the ballot box but also with their feet and money.

This is not true either. Capture coverage progress may look slow from your perspective but “Rome has not been built over night” either. The same is true for OpenStreetMap, Wikipedia, or the Linux kernel. These projects are decades old and took thousands upon thousands of man hours of volunteer and lots of sponsor funds to mature. Eventually, these projects progressed to where they are today. Often these projects are almost irreplaceable in many situations. So, the question is: Why are they where they are today? The answer is simple: persistence. Persistence is far more important in life than people usually think in our day and age. Just be persistent in your mapping and encouragement of others to map in your area too.

What is true though is that a working compensation model for Mapillary (or other open data repositories) contributors could indeed potentially accelerate mapping growth and people’s engagement. I have called for such a model too because among other reasons start-ups already exist that experiment with compensating their contributors. If you have a working model on your mind then I am sure the Mapillary community would be very happy to read about it. :wink:

This is something you rather have to address with governments and local community leaders than to the Mapillary community because building any kind of infrastructure is always one of key government duties. The Mapillary community is already doing its best to build that digital twin or digital infrastructure you aspire. You do not have to convince us. You have to convince your government(s) and local leaders.
You do not have to convince Big Tech either. They already invest heavily where it is potentially most lucrative to invest, so that they can gather data now and sell it later to governments and the private sector. You have to convince your government(s) and local leaders that it is better to build public infrastructure that serves everybody for free than corporate owned pay-by-use infrastructure.