> informatique > security > links-to-afraid-people > human-pose-estimation-through-walls-using-wifi-reflections-and-ai

This AI Senses Humans Through Walls 👀

Two Minute Papers - 2018-10-12

Pick up cool perks on our Patreon page:
› https://www.patreon.com/TwoMinutePapers

Crypto and PayPal links are available below. Thank you very much for your generous support!
› PayPal: https://www.paypal.me/TwoMinutePapers
› Bitcoin: 13hhmJnLEzwXgmgJN7RB6bWVdT7WkrFAHh
› Ethereum: 0x002BB163DfE89B7aD0712846F1a1E53ba6136b5A
› LTC: LM8AUh5bGcNgzq6HaV1jeaJrFvmKxxgiXg

The paper "Through-Wall Human Pose Estimation Using Radio Signals " is available here:
http://rfpose.csail.mit.edu/

We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
313V, Andrew Melnychuk, Angelos Evripiotis, Anthony Vdovitchenko, Brian Gilman, Christian Ahlin, Christoph Jadanowski, Dennis Abts, Emmanuel, Eric Haddad, Eric Martel, Evan Breznyik, Geronimo Moralez, John De Witt, Kjartan Olason, Lorin Atzberger, Marten Rauschenberg, Michael Albrecht, Michael Jensen, Milan Lajtoš, Morten Punnerud Engelstad, Nader Shakerin, Owen Skarpness, Raul Araújo da Silva, Rob Rowe, Robin Graham, Ryan Monsurate, Shawn Azman, Steef, Steve Messina, Sunil Kim, Thomas Krcmar, Torsten Reil, Zach Boldyga.
https://www.patreon.com/TwoMinutePapers

Thumbnail background image credit: https://pixabay.com/en/texture-wall-gray-wall-texture-1033755/
Splash screen/thumbnail design: Felícia Fehér - http://felicia.hu

Károly Zsolnai-Fehér's links:
Facebook: https://www.facebook.com/TwoMinutePapers/
Twitter: https://twitter.com/karoly_zsolnai
Web: https://cg.tuwien.ac.at/~zsolnai/

Aberrate - 2018-10-12

So the inevitable hunter killer AI robots will be able to find us anywhere.

Terruf Tube - 2019-10-25

Hide in your fridge

EasyBreadToast - 2019-10-25

@Jonny Nik oh no not the metalhead from that netflix show Iwatched.

Art Vein - 2020-05-13

Aberrate 5G

Aberrate - 2020-05-13

@Art Vein here we go!

Narblo - 2020-05-19

Now lead paints are legal again to avoid this hahahah I wish

helifalic - 2019-04-20

The machine burst through the wall, tracking its target with its wifi sonar. As it crushed the man's throat, it extrapolated his last thought by analyzing micro-details in his expression:

"What a time to be alive".

1000 subs with no content - 2019-10-27

WW2 veterans: "Ah sh*t here we go again"

Stephane Nouafo - 2019-12-22

lol nice one. took me a second

James H - 2020-05-12

Lmao

Retalak - 2019-10-23

Definitely can't see any possible way this could be abused.

Boyfinn - 2020-01-27

@Mi Canal lol. The scene where the T800 tracks and shoots a cop through the wall in the original movie comes to mind...

husk - 2020-03-10

@Boyfinn just wait til 5g is implemented worldwide this is how the government will start spying on us

Boyfinn - 2020-03-10

@husk Now i feel violated...

Nikita Drovinskiy - 2020-04-07

husk provide scientific evidence that 5g is deadly

husk - 2020-04-07

@Nikita Drovinskiy i never said 5g was deadly lmao i meant imagine if you had 5g everywhere, you could implement a system using AI to track where every one is at all times

サム - Sam - 2019-10-18

No one:
American: This can be reformed to a weapon.

JT-Kawaii Matthew - 2019-10-26

d19mc just strap a WiFi to it... ey??
Edit: Thisious already said dis ri her

James H - 2020-05-12

@i_ffy You're pretty dumb.

i_ffy - 2020-05-12

Thanks for explaining how everything works and where I was wrong.

サム - Sam - 2020-05-12

@i_ffy it's been 6 months, you don't have to reply.

i_ffy - 2020-05-12

サム - Sam I thought it’d be nice to acknowledge everyone and @James H’s reply reminded me that this thread exists

dxxPacmanxxb - 2018-10-12

Wall hacks for future military incoming.
The future is scary

Deric Huynh - 2019-10-27

Literally Bone Esp

Alex Dollar - 2019-10-29

Manuel Camelo but u can hide for sometime

creamsykle - 2019-10-29

The US military is 20-40 years ahead of any technologies available and sometimes even known to the rest of the population.

Rektonator - 2019-11-19

Just use heatcam

windows_x_seven - 2020-02-19

nah the future is fucking awesome

Trader Of Goods - 2019-10-19

0:53 "Why yes, my legs are connected to my neck. Why do you ask?"

That_ Dude - 2019-10-21

I lost my body in the Hiroshima nuke, so the doctors decided I didn’t need a body.

KnightSky - 2019-10-24

do those legs go all the way up....Why yes they do

SugarBooty - 2019-10-25

@KnightSky Ahhhhhh

Quazar _omega - 2019-10-25

Mike Wazowski, is that you?

7X HARDER - 2019-10-26

Best thread 2020

Pristo - 2018-10-12

I can think of several military applications.

I wanna die - 2019-10-20

wall

Blackstorm - 2019-10-22

@Dukan Jackflash Then you train network to be able to train itself in new environment. Easy.

Akshat Agrawal - 2019-10-23

Christopher Nolan did it 11 years ago in his trilogy.

viiru6 - 2019-10-24

So can america

V1Gibby - 2019-10-27

Unfortunately

Aayush Poudel - 2018-10-12

Black mirror, here we come

Aayush Poudel - 2018-10-13

Robin Mathew it's fun to watch

Anonymous user - 2018-10-13

Aayush Poudel Yea, they truly are awesome mistakes XD. Too bad they can turn our futures into dystopian nightmares.

Something something - 2019-10-14

Black Mirror, sci-fi for people who have never read a book.

Grammar Nazi Party - 2019-10-28

@Something something
Which books would you recommend?

m ・ ́ω・ - 2019-12-19

Here we are.

tamenga88 - 2018-10-12

Bye Bye Privacy.

NortheastGamer - 2019-10-16

@Joking Limit Reached Yes, because secret government agencies totally abide by the laws which respect the rights of the people. ;)

SHOX - 2019-10-19

@Joking Limit Reached poeple will surely pay tons of money just to spy you, no wonder 😂😂

Joking Limit Reached - 2019-10-19

@SHOX The technology won't be expensive forever. At the end it reaches consumer level pocket money. Consider you could spy anyone for $5. Yup. That's the scary part

Midnattsol - 2019-10-24

@Neurotic Knight Was privacy is destroyed by you getting observed, not by you knowing you're being observed. Exchanging a recording in visual light with a recording of your movement doesn't change anything here.

HUEHEEUUEHUEUHEUHEU HUEHEEUHUEUHEHUEHUEUHEUHEU - 2019-10-28

IM FAAPPPPIIINNGGG SOOOOO GOOOOOOOODDDDDD RIGGGHJT NOWWWWW MMMMMM YUEEEEEEEDSSSSSDS

kaushal suvarna - 2019-10-24

"We know that WiFi signals go through walls"
Meanwhile my phone sobs inconsolably in the bedroom

Pacdev - 2019-10-25

i feel you

Erik S - 2018-10-12

Well that's not at all disturbing... Next thing you know, tin foil is actually the only thing that can stop their mind reading equipment and all those crazy people in the 20th century will prove to have been just ahead of their time

Dykam - 2018-10-15

So far it seems it can only work for static camera's and teaching material for said pose. So it's far away from just working for any random location.

Erik S - 2018-10-16

@Dykam not saying that this particular paper presents anything scary, but more the direction of research it shows that will likely be very fruitful, and is also one of those research paths we may be better off not taking, but that we're definitely going to be taking anyways.

Katniss - 2019-10-25

@Erik S That's precisely because people should not research that that people are doing it 🤣

Dixiklo9000 - 2018-10-12

Unsubscribed, you're supposed to talk about scientific papers, not about literally just magic!
I'm completely overwhelmed by this, so crazy!

Tool Jockey - 2019-10-22

@KiemPlant you've got to be joking

Poetry & Prose. - 2019-10-22

@Tool Jockey You'll seem like a joke to this A.I.

Jaron Loar - 2019-10-22

@KiemPlant Im not sure if you're joking about not being sure that ThreeBee HD189733b is joking about Dixillo9000 joking. I'm assuming you're joking because it was quite clear that he was joking about him joking but if you arent joking about him joking about a joke then I should stop joking around about you joking about him joking about a joke because that probably means you don't get what sarcasm is.

Hansel D'silva - 2019-10-23

@Jaron LoarI'm not sure if my life is real or it's the universe playing an extremely elaborate joke. Can you please clarify it's a joke @universe

Alexander Büchler - 2020-05-23

@ThreeBee HD189733b maybe train a convolutional network to detect if someone is joking?

Commentur The Great - 2019-10-18

Real-life xray aimbots here we come

magna Pony - 2019-10-26

@Hansel D'silva In the wars of 1914-1918 and 1939-1945 alone 120 million people died, not to mention infrastructure, ecology, resources and economic losses. This is equal to the population of the USA at the moment of 1928.
Now imagine if the population of the whole usa would not perish, if so much development potential would not be lost.
These wars were the largest error of humanity, and the only thing we can do now - is do not forget this error, and do not allow it again.

A snek - 2019-10-26

@Hansel D'silva yeah, maybe, but really we wouldn't know. Anything could have happened though. We're lucky a nuclear war didn't happen lol

J7 - 2019-10-26

@Hansel D'silva regular bullets already penetrate walls, unless they are armored walls. They're not bulletproof.

TheCreaterKeygen - 2019-10-31

Fucking wall-hackers.

Pyramid Head - 2019-11-14

@Hansel D'silva No need to shoot through, just keep aiming at the target as you rush in or they rush out

Greedy Crustacean - 2019-10-24

Me: oh look there's wifi in this totally remote desert

ai drone lurking in the distance

got zee - 2019-10-25

N A N I

Milo Estobar - 2019-10-22

AI detect humans stacking on top each other
= human are exchanging data.

Faustin Gashakamba - 2019-10-27

Man, this is so funny!
The data is fluid....so advanced

Zelenov - 2018-10-12

"What kind of researchery is that!" 10/10

lgab - 2018-10-12

He said wizardry...

Zelenov - 2018-10-12

Oh my Hearing Neural Network did a bad prediction, ty for your input! I'll now retrain!

mateogon - 2018-10-13

your version is better

Tinfoilpain - 2018-10-12

I dropped all my papers

[Some guy] - 2019-10-23

Oh

S - 2018-10-12

What a time for "surveillance", more like.

QuincyIsCrispy - 2019-10-25

Can't wait for the Government to spy on stickfigure me!

Fyloeu - 2018-10-12

It almost bothers me to just hear a bright side presented.

Kram1032 - 2018-10-12

That's quite amazing.
I'm not sure if it's ever going to be computationally feasible, but in principle it ought to one day be possible to just, like, "read" the entire planet (at some useful resolution) at once, just from various subtle signals like these radio waves or the aperture edge effects you showed recently.

And mind you, this here is a single signal source. Why not "just" combine signals? It seems that incorporating multiple signals tends to boost performance.

Shorter-term, I'm sure this will be immensely useful for, say, autonomous driving. Presumably a simpler version of this is already happening in some autonomous systems that can use radio waves to detect cars before the car before you.

Oh and I guess there are like a billion nefarious applications as well. But, you know, which of these recent AI techniques doesn't have those?

Pol Xhaferi - 2019-10-12

Yeah man. I have seen some whistleblowers that are put into "conspiracy theory" category that talked about such things being already avaiable. And quite recently I heard some high ranking military people talking about a supercomputer called "The Beast" that collects data through our tech equipment and social media to build an virtual avatar.

Gary - 2019-10-21

Put 2 and 2 together on that last sentence man. Where research money goes, the military follows. There are almost certainly plenty of harmless ai improvements we could make, but those don't oil up the gears of war.

Hansel D'silva - 2019-10-23

@Gary war: the unexpected catalyst of scientific advancement

Cam P - 2020-05-03

Imagine the NSA having an application like in The Dark Knight

Tori Ko - 2018-10-12

Uh oh

psychic_hedgehog - 2019-10-24

Everyone’s saying “oh no this could be used for so many evil things” and you’re right but have you considered the VR applications

Neoshaman Fulgurant - 2018-10-12

Surveillance tech skills perk +10

Vijayabhaskar J - 2018-10-12

Combining this Skeleton output with the Everybody can dance technique, you can recreate the entire scene without even a camera? Mind=Blown.

Миша Шевченко - 2018-10-12

You can know where the hostages and the terrorists are and shoot through a wall.

DerFailer - 2018-10-13

Or shoot anybody else in a house

Миша Шевченко - 2018-10-13

A neural network can be trained to analyze peoples behavior and accurately predict who is the criminal and who is the hostage. A scenario where the terrorists make hostages to act like criminals to try and fool the system is of course possible

TheKejjo3 - 2018-10-15

Yes!
That's actually an awesome and pretty effective way this could be used.

DerFailer - 2018-10-18

@Миша Шевченко Yes but that is not what I meant. I meant everybody can be defined as a criminal or terrorist.

Trillionage - 2018-10-29

Could you use Wifi jammers?

Paul Tremblay - 2018-10-12

That's not good. When you think you can hide behind the wall, they got you

Kram1032 - 2018-10-12

If it actually is "just" the dirty jobs no human wants to do, then good riddance?
What point is a job if it costs more in live quality than the income it provides gives back?

Paul Tremblay - 2018-10-12

@Kram1032
Yes but the question is, would you prefer that a lifeless machine kill you or a human being.

Personally I think I would prefer a human because if he miss me I could make him pay, broking his Jaw and teeth.

But if it's a Robot, not only you may have no chance to survive but you can't make the robot pay, they will mask it as a glitch. And you can't read the face of a robot, it's unpredictable, cold and without remorse, you can't tell him wait or try to bribe him, it's a perfect killing machine.

eteppo - 2018-10-13

To add to my comment: if a machine has superhuman sensors, actuators, data storage, computing speed, energy, and so, it can be like a thousand times dumber algorithmically and still win 100-0.

Kram1032 - 2018-10-13

Paul other than overtly ironic or humiliating deaths, I don't really care about how I die. Mostly I care about dying later than presently.
And in terms of irony and humiliation, if accidental a human can do this just as well as a machine or a natural cause. And if deliberate, a human will be far better at it than anything else.

Furthermore, I'm less worried by humans using robots as killing machines than by humans using robots to abusively exploit other humans in more or less arbitrary ways while keeping them alive. (For instance, bots already work way better than anybody wants to admit, to instill flame wars and, through them, shape opinions which might lead to problematic shifts in a country's power. It's not even necessary to sustain such opinions. You just need to sell them at the right time and for long enough to make those shifts happen. After, the damage is already done)

Jiink - 2018-10-13

Time for thick lead walls 😎

SPYFF - 2018-10-12

The authors brought their demo setup to Budapest for the ACM SIGCOMM a few months ago, it was cool, I tried out (indeed works :-) )

Georgios Tsirtsidis - 2018-10-12

cool!

Benjamin Miller - 2018-10-12

Do you happen to know how much training it needs on a new environment?

Patrick Ngobiro - 2018-10-13

Our privacy even behind walls is gone with the wind(AI)

Harry - 2018-10-13

How quickly could it adapt to a new environment?

SPYFF - 2018-10-13

Almost immediately, but they did not modified the walls too much (they built some walls from empty boxes)

Phlimy - 2018-10-12

That's insane.

Lepus Lunaris - 2018-10-12

Welcome to the world of AI.

Phlimy - 2018-10-12

I follow the progress of AI pretty closely, and yet with every new paper I'm still blown away. It's an amazing time we live in

Lepus Lunaris - 2018-10-12

@Phlimy That's exactly how I feel as well. It's just incredible.

The GamerzX Channel - 2019-10-22

@Phlimy Well, its just a paper, describing the abstract usage how one would achieve it, though I doubt you would be able to recreate it on your own after reading their paper. Those study cases are many times wrote from people to people with same wavelengths. So this technology will be recognised by the government for the government... What an amazing time to be alive indeed...

Mr Esteban - 2018-10-12

This is amazing!!!!!!! imagine the posibilities for virtual reality or security cameras!!!

Cole Park - 2018-10-12

Im not sure you'd want this on a consumer VR headset, walls exist for a reason :P
We certainly could build perceptual super powers in to a headset that also had pass-through AR though.

Thomas Norwood - 2018-10-13

i was thinking about what a sniper could do with this.

obligatory username - 2019-10-24

Mr esteban, I, too, would like to be constantly monitored within my own house, even more than we already are. Fuck privacy. VR, here we come!

Owen Skarpness - 2018-10-12

Does this technique utilize existing WiFi networks? What (if any) additional hardware is necessary?

SPYFF - 2018-10-12

Yes, special radio equipment required for the best result but the approach could works with existing Wi-Fi hardware (just more noisy)

Owen Skarpness - 2018-10-12

From the paper it looks like they used a custom multi-plane array of antennas which analyse reflections those antenna outputs. I'm certain that something similar could be achieved with other hardware, but additional limitations also exist like the need for training from a static position. If this technology could be made portable, it's no stretch to think of how powerful it could be in combat situations.

S.Y.N. - 2018-10-13

I'm imagining robocop taking out perps through walls with his wifi vision now

Riley Courtier - 2018-10-12

WHAT
A
TIME
TO
BE
ALIVE

Ja Broski - 2019-10-11

Imagine just messing around with that at your house alone and it picks up someone in the other room

Beacon of Wierd - 2018-10-13

”Master Bruce, I’m picking up several signatures on the BatFiNet.”

Kerron - 2018-10-12

"what a time to be alive" - it's the only time my friend

Yuuup - 2019-10-24

They haven't taken over yet and we're teaching them how to find us in a dark room and through walls. Not terrifying at all...

DSXG Plays - 2019-10-20

Since when did the US Government get those ESP hacks?

Maui0895 - 2019-10-22

Wall hacks IRL!

Donaldo - 2018-10-13

"Welcome to a world without rules."

Youtube Account#:457 - 2018-10-13

Scientists are slowly handing the government the Keyes to successful, invincible fascism.

MZ - 2019-10-09

While very cool, the big limitation is that it seems to be trained on one specific room.
for any other space, it would require retraining with cameras and enough data
Edit: *After actually reading the paper...I was wrong, the method is not limited to one room, I assumed it learned the RF reflections off walls to learn the pose, but apparently, the walls are transparent to that RF range. overall, really cool tech!

Jonathan alis - 2018-10-13

We have to train it for each room? And the WiFi source have to be still, right?
The reflexions would be totally different even with a chair in a different position or a open door, right?
So, for instance, in autonomous car, it would have to train on the fly with images it takes, so still needs the classified images...

Tomas - 2019-10-22

CIA/NSA/FBI Wants to know your location...

eerereps - 2018-10-12

This was Icredible!
... ended up in an Asylum 🤣🤣🤣

Crow - 2019-10-25

2:47
Not sure it was a problem that this didn't exist

Tyler Durden - 2019-10-21

This along with self replicating AI and self learning AI, humans will become extinct

lolindirlink - 2019-10-24

Altered Carbon Season 1 Episode 1 <3

Otakutaru - 2018-10-13

holy Ct! Hold onto your rifles fellow scholars!!! They're here!

Stepwise Urchin - 2019-10-22

this wil be so good for clearing rooms in the military.

thevoiceofcake - 2019-10-24

After watching Joe Rogans interview with Edward Snowden this is actually kinda terrifying.

Felixcesar15 - 2019-11-04

finally xray hack on reality!

i hope it wont be patched in next update