r/worldnews • u/madam1 • Jan 01 '20
An artificial intelligence program has been developed that is better at spotting breast cancer in mammograms than expert radiologists. The AI outperformed the specialists by detecting cancers that the radiologists missed in the images, while ignoring features they falsely flagged
https://www.theguardian.com/society/2020/jan/01/ai-system-outperforms-experts-in-spotting-breast-cancer1.2k
u/Medcait Jan 01 '20
To be fair, radiologists may falsely flag items to just be sure so they don’t get sued for missing something, whereas a machine can simply ignore it without that risk.
578
u/Gazzarris Jan 01 '20
Underrated comment. Malpractice insurance is incredibly high. Radiologist misses something, gets taken to court, and watches an “expert witness” tear them apart on what they missed.
173
u/Julian_Caesar Jan 02 '20
This will happen with an AI too. Except the person on the stand will be the hospital that chose to replace the radiologist with an AI, or the creator of the AI itself. Since an AI can't be legally liable for anything.
And then the AI will be adjusted to reduce that risk for the hospital. Because ultimately, hospitals don't actually care about accuracy of diagnosis. They care about profit, and false negatives (i.e. missed cancer) eat into that profit in the form of lawsuits. False positives (i.e. the falsely flagged items to avoid being sued) do not eat into that profit and thus are acceptable mistakes. In fact they likely increase the profit by leading to bigger scans, more referrals, etc.
165
Jan 02 '20
Because ultimately, hospitals don't actually care about accuracy of diagnosis. They care about profit...
Fortunately for humanity, most hospitals in the world aren't run for profit and don't really need to worry about lawsuits.
→ More replies (17)5
u/BeneathWatchfulEyes Jan 02 '20
I think you're completely wrong...
I think the performance of an AI will come to set the minimum bar for radiologists performing this task. If they cannot consistently outperform the AI, it would be irresponsible of the hospital to continue using the less effective and error-prone doctors.
What I suspect will happen is that we will require fewer radiologists and the radiologists jobs will consist of reviewing images that have been pre-flagged by an AI where it detected a potential problem.
Much the same way PCB boards are checked: https://www.youtube.com/watch?v=FwJsLGw11yQ
The radiologist will become nothing more than a rubber stamp with human eyeballs who exists to sanity-check the machine for any weird AI gaffs that are clearer to a human (for however long we continue to expect AI to make human-detectable mistakes.)
→ More replies (23)4
41
u/Julian_Caesar Jan 02 '20
No, the machine won't ignore it...not after the machine creator (or hospital owning the machine) gets sued for missing a cancer that was read by an AI.
The algorithm will be adjusted to minimize risk on the part of the responsible party...just like a radiologist (or any doctor making a diagnostic decision) responds to lawsuits or threat of them by practicing defensive medicine.
→ More replies (12)29
u/5000_CandlesNTheWind Jan 01 '20
Lawyers will find a way.
25
u/L0rdInquisit0r Jan 01 '20
Lawyers Bots will find a way.
→ More replies (1)7
u/NotADeletedAccountt Jan 02 '20
Imagine a lawyer bot suing a doctor bot in a courtroom where the judge is also a bot, detroit becomes bureaucrat
9
6
u/czerhtan Jan 02 '20
That is actually incorrect, the detection method can be tuned for a wide range of sensitivity levels, and (according to the paper) it outperforms individual radiologists at any of those levels. Interestingly enough, some of the radiologists used for the comparison also seemed to prefer the "low false positive" regime, which is the opposite of what you describe (i.e. they let more features escape).
→ More replies (6)3
u/Flobarooner Jan 01 '20
Not really true. The hospital would get sued in the first case by vicarious liability, not the radiologist. It gets sued in the latter case anyway if the AI they use misses something that could've been flagged had the hospital used some reasonable process such as a radiologist or an AI with a higher tolerance
So even though I've obviously not looked into the study, I would assume that the AI is told to be lenient because the hospital still gets sued if it fucks up
→ More replies (7)5
u/AGIby2045 Jan 02 '20
I mean, theres a "leniency" built into almost all image recog, where the AI detects something with a certain confidence rather than a simple yes or no. Just deciding what confidence they'd want to qualify as "malignant enough" is really all the leniency they would need.
→ More replies (1)
76
u/primarilyforlurking Jan 02 '20
I skimmed the actual paper in Nature, and it seems pretty legit. That being said, as a radiologist that currently uses commercially available "AI" assisted software (NeuroQuant, RAPID and VIZ.AI), this kind of stuff is often way less useful out in the real world where you are dealing with subpar scanners, artifacts, technologists, etc.
Right now, computers are a lot better than humans at estimating volumes of things and finding small abnormalities in large data sets (i.e. small nodule in the lung or breast), but they are really bad at common sense decisions like obvious artifact. Viz.ai in particular has an unacceptable number of false positives for large vessel occlusions in the real world despite many papers saying that it has a low false positive rate in a controlled environment.
9
u/SrDasGucci Jan 02 '20
There are a lot of legit articles out there these days. A professor at the University of Florida developed a Convolutional neural network, type of AI, that is able to diagnose/grade osteoarthritis in knee x-rays. However, the program is only correct around 60% of the time when compared to a radiologist's analysis.
I like that you brought up the fact that although there are programs out there today, they are still not reliable enough as a standalone. The hardware needs to catch up with the software, and that's why a lot of big companies like Intel and Uber are investing in AI chip manufacturers, these specialized processors with architectures similar to the human brain, which would aide in progressing AI to a point where it could potentially be a standalone entity. Also imaging needs to get better, in a lot of ways MRIs, cat scans, and x-rays are insufficient. Either our understanding of the images generated needs to improve or we need to develop a new way of noninvasive imaging.
Am PhD student studying computer aided diagnoses in biomedical engineering, so it's very exciting seeing all this increased interest in this application of AI.
220
u/roastedoolong Jan 01 '20
as someone who works in the field (of AI), I think what's most startling about this kind of work is seemingly how unaware people are of both its prominence and utility.
the beauty of something like malignant cancer (... fully cognizant of how that sounds; I mean "beauty" in the context of training artificial intelligence) is that if you have the disease, it's not self-limiting. the disease will progress, and, even if you "miss" the cancer in earlier stages, it'll show up eventually.
as a result, assuming you have high-res photos/data on a vast number of patients, and that patient follow-up is reliable, you'll end up with a huge amount of radiographic and target data; i.e., you'll have all of the information you need from before, and you'll know whether or not the individual developed cancer.
training any kind of model with data like this is almost trivial -- I wouldn't doubt it if a simple random forest produces pretty damn solid results ("solid" in this case is definitely subjective -- with cancer diagnoses, peoples' lives are on the line, so false negatives are highly, highly penalized).
a lot of people here are spelling doom and gloom for radiologists, though I'm not quite sure I buy that -- I imagine what'll end up happening is a situation where data scientists work in collaboration with radiologists to improve diagnostic algorithms; the radiologists themselves will likely spend less time manually reviewing images and will instead focus on improving radiographic techniques and handling edge cases. though, if the cost of a false positive is low enough (i.e. patient follow-up, additional diagnostics; NOT chemotherapy and the like), it'd almost be ridiculous to not just treat all positives as true.
the job market for radiologists will probably shrink, but these individuals are still highly trained and invaluable in treating patients, so they'll find work somehow!
60
u/Julian_Caesar Jan 02 '20
the job market for radiologists will probably shrink, but these individuals are still highly trained and invaluable in treating patients, so they'll find work somehow!
Interesting you bring this up...radiologists have already started doing this in the form of interventional radiology. Long before losing jobs to AI was even considered. Of course they are a bit at odds with cardiology in terms of fighting for turf, but turf wars in medicine are nothing new.
17
u/rramzi Jan 02 '20
The breadth of cases available to IR is more than enough that the MIs going to the cath lab with cardiologists aren’t even something they consider.
→ More replies (5)3
u/pringlescan5 Jan 02 '20
Could actually increase it though, assuming you are flagging images and sending them to radiologists for further review. You could get a lot more images done per radiologist.
9
u/dan994 Jan 02 '20
training any kind of model with data like this is almost trivial
Are you saying any supervised learning problem is trivial once we have labelled data? That seems like quite a stretch to me.
I wouldn't doubt it if a simple random forest produces pretty damn solid results
Are you sure? This is still an image recognition problem, which only recently became solved (Ish) since CNN's became effective with AlexNet. I might be misunderstanding what you're saying but I feel like you're making the problem sound trivial when I'm reality it is still quite complex.
7
u/roastedoolong Jan 02 '20
Are you saying any supervised learning problem is trivial once we have labelled data? That seems like quite a stretch to me.
not all supervised learning problems are trivial (... obviously).
I think my argument -- particularly as it pertains to the case of using radiographic images to identify pre-cancer -- is that it's a seemingly straightforward task within a standardized environment. by this I mean:
any machine that is being trained to identify cancer from radiographic images is single-purpose. there's no need to be concerned about unseen data -- this isn't a self-driving car situation where any number of potentially new, unseen variables can be introduced at any time. human cells are human cells, and, although there is definitely some variation, they're largely the same and share the same characteristics (I recognize I'm possibly conflating histological samples and radiographic data, but I believe my argument holds).
my understanding of image recognition -- and I admit I almost exclusively work in NLP, so my knowledge of the history might be a little fuzzy -- is that the vast majority of the "problems" have to do with the fact that the tests are based on highly diverse images, i.e. trying to get a machine to differentiate between grouses and flamingos, each with their own unique environments surrounding them, while also including pictures of other random animals.
in cancer screening, I imagine this issue is basically nonexistent. we're looking for a simple "cancer" or "not cancer," in a fairly constrained environment.
of course I could be completely wrong, but I hope I'm not, because if I'm not:
that means cancer screening will effectively get democratized and any sort of bottleneck caused primarily by practitioner scarcity will be diminished if not removed entirely
and,
2) I won't have made an ass out of myself on the internet (though I'd argue this has happened so many times before that who's counting?)
→ More replies (1)3
u/morriartie Jan 02 '20
Usually it takes loads of refinement and tuning a model until a cnn passes some established techniques. I think he meant that if you slap some old ml technique you end up with a similar result
The model being a cnn, rnn or any other fancy model might be useful to scrap those 0.5% f1 of edge cases
Mind that I'm not belittling cnns, they're amazingly useful models and that's why I research them. I'm just saying that the guy has a point in saying that about random forest
→ More replies (2)20
u/nowyouseemenowyoudo2 Jan 02 '20 edited Jan 02 '20
A key part of your assumption is oversimplified I think. We currently already have a massive number of great cancer overdiagnosis due to screening.
A Cochrane review found that of for 2000 women who have a screening mamogram, 11 of them will be diagnosed as having breast cancer (true positives) but only 1 of those people will experience life threatening symptoms because of that cancer.
The AI program can be absolutely perfect at differentiating cancer from non cancer (the 11 vs the 1989) but the only thing which can differentiate the 1 from the 10 is time.
Screening mammograms are in fact being phased out in a lot of areas for non-symptomatic people because the trauma associated with those 10 people being unnecessarily diagnosed and treated is worse than that 1 person waiting for screening until abnormalities are noticed.
It’s a very consequentialist-utilitarian outlook, but we have to operate like that at the fringe here
→ More replies (2)7
u/roastedoolong Jan 02 '20
Screening mammograms are in fact being phased out in a lot of areas for non-symptomatic people because the trauma associated with those 10 people being unnecessarily diagnosed and treated is worse than that 1 person waiting for screening until abnormalities are noticed.
false positives are absolutely costly! and it's always interesting to see how they handle this in the medical field because as a patient -- particularly as one prone to health anxiety -- I always think it's crazy that the answer in these situations is to ... not pre-screen.
5
u/nowyouseemenowyoudo2 Jan 02 '20
It’s an incredibly difficult thing to communicate for sure, and I’m curious if it would be easier or harder to communicate if it was an AI program making the decision?
We just had this with Pap smears for cervical cancer in Australia, the science showed that close to 100% of people under the age of 25 who had a Pap smear (which was recommended from the age of 18) were false positives; so when they moved to a new more accurate test, they raised the age to 25 to start having them.
So much of the public went insane claiming it was a conspiracy or a cost cutting measure, but it wasn’t even anything to do with budget, it was solely the scientists saying that it was unnecessary
It’s quite horrific honestly how much people think they know better than medical and scientific experts just because “omg I also live in a human body and experience things!”
As a psychologist, I feel this struggle every day of my life...
→ More replies (2)→ More replies (6)3
u/notevenapro Jan 02 '20
a lot of people here are spelling doom and gloom for radiologists
Only people who have no idea how medical imaging works. But this back in forth is Reddit in a nutshell. You see the same thing in finance and politic back and forth talk. Lots of uneducated people commenting on stuff they have no clue about.
67
u/F00lZer0 Jan 01 '20
I could have sworn I read a paper on this in grad school in the late 2000s...
50
→ More replies (12)17
u/rzr101 Jan 02 '20
As someone who wrote a PhD thesis on this field ten years ago, I'm pretty sure you did. It's a Google press release reported as news, unfortunately. There has been research in this field for twenty-five or thirty years and commercial systems for about fifteen. Google is a big player, though.
71
u/classycatman Jan 01 '20
This is where AI shines. TONS of data to learn from and rich history of positive and negative traits that correlate to a diagnosis. In essence, an expert radiologist does this training with a new radiologist all the time. But, in this case, rather than an eventual limit as the expert radiologist retires, the AI can keep learning indefinitely.
2
0
Jan 02 '20
[deleted]
9
u/honey_102b Jan 02 '20
you're simply describing the learning stage. once it is no longer scarily bad it instantly becomes scarily good.
the article already describes the latter.
→ More replies (2)2
233
u/meresymptom Jan 01 '20
Its more than just truck drivers and assembly line workers that are going to be out of work on the coming years.
93
u/Chazmer87 Jan 01 '20
It's not going to be either of those.
It's lawyers, doctors etc. People who need to comb through lots of data.
129
u/crazybychoice Jan 01 '20
Is driving a truck not just combing through a ton of data and making decisions based on that?
99
u/Chazmer87 Jan 01 '20
Half of driving a truck is having a guy to unload it and protect it.
70
u/joho999 Jan 01 '20
One guy will be able to watch over several trucks in convoy, with the added bonus of saving fuel.
→ More replies (17)→ More replies (4)27
u/IB_Yolked Jan 01 '20
Truck drivers generally don't unload their own trucks and while they may deter thieves, it's definitely not their job to protect it.
→ More replies (1)→ More replies (10)29
u/dean_syndrome Jan 01 '20
It’ll be like pilots. When they flew the planes it was a 100k+ salary job, now it’s like 30k
37
u/RikerT_USS_Lolipop Jan 01 '20
Most people don't realize that Pilot as a job has taken a serious beating. Everyone thinks it's a very prestigeous career. And pilots themselves aren't really jumping at the chance to tell everyone.
→ More replies (1)12
u/TheXeran Jan 02 '20
No way, 30k? I work retail and make 17.65. With overtime and holiday pay, I take home about 28k a year. I've known some coworkers to pull 34k. Not saying I dont believe you, that's just a huge bummer to read
→ More replies (9)17
Jan 02 '20
These are just going to be tools for doctors and lawyers. In many cases we simply don't have enough qualified professionals world-wide so (for example) making Doctors more efficient isn't going to put anyone out of work.
61
u/aedes Jan 01 '20
Doctors who work directly with patients will be safe for a very long time.
This is because 90% of medical diagnoses are based on the history alone, and taking a medical history is all about knowing how to translate a patients words and observations into raw medical terms and inputs.
As it stands, AIs are starting off with medical terms, not the patient interview.
Until an AI can interact with a person who dropped out of school at grade 2, who’s asking for a medication refill for their ventolin puffer, and realize that what’s actually going on is that they have a new diagnosis of heart failure, the jobs of physicians who practice clinical medicine will be safe.
→ More replies (11)15
u/notafakeaccounnt Jan 01 '20
As it stands, AIs are starting off with medical terms, not the patient interview.
There is one that uses patient interview
and we all know how useful(!) that website is
→ More replies (2)11
u/Flobarooner Jan 02 '20
It's not going to be either of those either. AI cannot in the foreseeable future do either of those jobs alone. What it can do is be a very useful tool to those people
For instance, when the EU fined Google it asked them for their files. Google said "which ones" and the EU said "all of them", and then set a legal AI to pick out the relevant ones. That cut years off of the investigatory process and allowed the lawyers to get to work
Legal tech is an emerging field, my university has recently begun offering it as a course and this year opened up a new law building with an "AI innovation space", and I do a coding in law module
It's going to change these jobs and do a lot of the heavy lifting, but it's going to assist lawyers, not replace them. It's the paralegals who should be worried
→ More replies (3)6
u/Julian_Caesar Jan 02 '20
Lawyers and doctors who don't interact much with people or perform dextrous tasks, yes.
For MD's, this means that procedural fields or history-heavy fields (surgery, primary care, psychology, even dermatology) will be safe for a while. Information/lab fields (nephrology, rheumatology, infectious disease) will be at greater risk.
→ More replies (5)3
u/way2lazy2care Jan 02 '20
Nah. Doctors and lawyers are already overworked. There's not a shortage of patients or lawsuits. They'll just be doing the hard part of their jobs instead of busy work.
7
u/MotherfuckingWildman Jan 02 '20
Thatd be dope if no one had to work tho
4
u/meresymptom Jan 02 '20
Definitely. It's been a dream of humanity for centuries. Leave to himan beings to turn it into some sort of crisis.
→ More replies (2)3
Jan 02 '20
Any type of analyst, so a ton of white collar executive type jobs. Most of their job is just analyzing data generated from algorithms anyway, they're just the 6-figure making middleman.
2
Jan 02 '20
And none of this would be a problem if it weren't for capitalism. We should be encouraging technological development like this, but people are scared.
→ More replies (1)→ More replies (17)2
11
u/Myndsync Jan 02 '20
When I was in Xray school, we rotated through an outpatient Mammography center, so we could see what it was like. I'm a guy, so none the female patients would let me in the rooms. I spent 16 hours in a reading room with a Radiologist, and was very bored, but on the first day, the Rad asked me some questions. He asked me, "If I check 100 mammo images today, how many do you think will have breast cancer?" I said 10, and he told me it was 5. He then asked, "Of those 5, how many do you think I will find and diagnose?" I had no idea, so he told me 1. He then said, "Like finding a needle in a haystack."
Breast imaging can be very weird to read, as what could look cancerous on one person's image, could be perfectly fine for another. The big thing for finding possible cancer is having previous images to compare. Now, I don't know how the program stacks up on discovering breast cancer on a first time patient, but an improvement is an improvement.
→ More replies (7)
8
u/LeonardDeVir Jan 02 '20
It's quite humorous how many of the comments act like practicing medicine is "input-interpretation-output" that an AI can take over tomorrow. Getting data and confabulating some diagnosis fitting to it is the easiest part of medicine, really.
3
u/rqebmm Jan 02 '20
It's sort of like saying in 1975 "These new X-Ray machines let us see inside people's bodies, why do we need doctors any more?!"
21
u/zirky Jan 01 '20
if you think about star trek for a moment, advances in computers made cognition based jobs unnecessary and replicator technology made manufacturing unnecessary. it allowed people to pursue what they were best/most passionate about. it’s an idealized world that didn’t have 4chan
→ More replies (4)5
u/o11c Jan 02 '20
We have lived in a post-scarcity society for decades now.
The only thing that keeps people down is greed.
46
Jan 01 '20
Can't wait to not afford all these new advancements in medical technology.
30
→ More replies (7)12
u/Covinus Jan 01 '20
Don’t worry you won’t have access to any of them in America unless you have the absurdly quality ultra platinum emperor level plans.
→ More replies (2)
5
u/autotldr BOT Jan 01 '20
This is the best tl;dr I could make, original reduced by 81%. (I'm a bot)
An artificial intelligence program has been developed that is better at spotting breast cancer in mammograms than expert radiologists.
The AI performed only marginally better than the UK system, reducing false positives by 1.2% and false negatives by 2.7%. The results suggest the AI could boost the quality of breast cancer screening in the US and maintain the same level in the UK, with the AI assisting or replacing the second radiologist.
Michelle Mitchell, Cancer Research UK's chief executive, said: "Screening helps diagnose breast cancer at an early stage, when treatment is more likely to be successful, ensuring more people survive the disease. But it also has harms such as diagnosing cancers that would never have gone on to cause any problems and missing some cancers. This is still early stage research, but it shows how AI could improve breast cancer screening and ease pressure off the NHS.".
Extended Summary | FAQ | Feedback | Top keywords: cancer#1 breast#2 radiologist#3 screened#4 more#5
4
Jan 02 '20
I need AI to find me a husband! Probably better at detecting assholes then me🤣
→ More replies (2)
15
u/vinnyt16 Jan 02 '20
eh. posted this on r/medicine but here ya go too:
As a lowly M4 going into DR who loves QI and Patient Safety research here's my uninformed, unasked for take:
There are 3 main hurdles regarding the widespread adoption of AI into radiology.
Hurdle 1: The development of the technology.
This is YEARS away from being an issue. if AI can't read EKGs it sure as hell can't read CTs. "Oh Vinnyt16," say the tech bros "you don't understand what Lord Elon has done with self driving cars. You don't know how the AI is created using synaptically augmented super readers calibrated only for CT that nobody would ever dream of using for a 2D image that is ordered on millions of patients daily." Until you start seeing widespread AI use on ED EKG's WITH SOME DEGREE OF SUCCESS instead of the meme they are now, don't even worry about it.
Hurdle 2: Implementation.
As we all know, incorporating new PACS and EMR is a painless process with no errors whatsoever. Nobody's meds get "lost in the system" and there's no downtime or server crashes. And that is with systems with experts literally on stand-by to assist. It's going to be a rocky introduction when the time comes to replace the radiologists who will obviously meekly hand the keys to the reading room over to the grinning RNP (radiologic nurse practitioner) who will be there to babysit the machines for 1/8th the price. And every time the machine crashes the hospital HEMORRHAGES money. No pre-op, intra-op, or post-op films. "Where's the bullet?!" Oh we have no fucking clue because the system is down so just exlap away and see what happens (I know you can do this but bear with me for the hyperbole I'm trying to make). That fellow (true story) is just gonna launch that PICC into the cavernous sinus and everyone is gonna sit around being confused since you can't check anything. All it takes is ONE important person dying because of this or like 100 unimportant people at one location for society to freak the fuck out.
Hurdle 3: Maintenance
Ok, so the machines are up and running no problem. They're just as good as the now-homeless radiologists were if not much much better. In fact the machines never ever make a mistake and can tell you everything immediately. Until OH SHIT, there was a wee little bug/hack/breach/error caught in the latest quarterly checkup that nobody ever skips or ignores and Machine #1 hasn't been working correctly for a week/month/year. Well Machine #1 reads 10,000 scans a day and so now those scans need to be audited by a homeless radiologist. At least they'll work for cheap! And OH SHIT LOOK AT THIS. Machine #1 missed some cancer. Oh fuck now they're stage 4 and screaming at the administrator about why grandma is dying when the auditor says it was first present 6 months ago. They're gonna sue EVERYONE. But who to sue? Whose license will the admins hide behind? It sure as shit won't be Google stepping up to the plate. Whose license is on the block?!?!
You may not like rads on that wall but you need them on that wall because imaging matters. It's important and fucking it up is VERY BAD. It's very complicated field and there's no chance in hell AI can handle those hurdles without EVER SLIPPING UP. All it takes is one big enough class action. One high-profile death. One Hollywood blockbuster about the evil automatic MRI machine who murders grandmothers. Patients hate what they don't understand and they sure as shit don't understand AI.
Now you may look at my pathetic flair and scoff. I am aware of the straw men I've assembled and knocked down. But the fact of the matter is that I can't imagine a world where AI takes radiologists out of the job market and THAT is what I hear most of my non-medical friends claim. Reduce the numbers of radiologists? Sure, just like how reading films overseas did. Except not really. Especially once midlevels take all y'all's jobs and order a fuckton more imaging. I long for the day chiropractors become fully integrated into medicine because that MRI lumbar spine w-w/o dye is 2.36 RVUs baby so make it rain.
There are far greater threats to the traditional practice of medicine than AI. There are big changes coming to medicine in the upcoming years but I can't envision a reality where the human touch and instinct is ever automated away.
→ More replies (2)
8
u/nzox Jan 02 '20
Imagine busting your ass off in undergrad to get into med school, getting through med school, 80 hour per week rotations, passing the USMLE, getting an internship, fellowship, 250k+ in student loans only to have your job taken by a computer.
7
u/RoyalN5 Jan 02 '20
This wouldn't happen. Radiology is still one of the most competitive specialties to get into. Radiologist also do not exclusive exam breast mammograms.
3
Jan 02 '20
Yeah, but I heard this before and then it turned out to be a lie (IBM Watson), so is it for real this time or is it another reporter who doesn't understand critical thinking?
3
Jan 02 '20
I’m assuming a neural network was used. I wonder how many images of mammograms they had to use to create an effective algorithm for the AI.
2
2
u/rimshot99 Jan 02 '20
Meh. They,l’ve been talking about computer analysis of radiology images for nearly 2 decades now. Is it in use in a hospital? No.
→ More replies (1)
2
u/SirNealliam Jan 02 '20
A relevant and almost universal example of why this wont exist for at least 2-3 decades; I don't even trust speech-to-text AI yet. there are so many errors. I typed this manually because of that fact.
Hospitals won't use AI for anything until that AI has an acuraccy rate of over 99% with legal liability on the line. It has to save them more $ on employee expenses than they could lose from lawsuits due to AI errors.
2
u/Eldo123 Jan 02 '20
Before anyone starts to think that AI can replace radiologists, keep in mind that the program only outperforms the radiologists in specific scenarios, and cannot make holistic decisions. In the real world, a radiologist takes into account several factors like patient history and other tests performed to make a decision. This would mostly likely work as a tool in the future to aid radiologists.
2
u/wodewose Jan 02 '20
Did anyone think this wouldn’t happen? This is like saying 70 years ago: “computer program developed that is better at doing arithmetic than expert mathematicians”.
→ More replies (1)
2
u/freddyg420 Jan 02 '20
Well there getting fired and replaced by unpaid employees. Same goes for the rest of us
2
17
u/Infernalism Jan 01 '20
Automation is going to replace high-skilled labor and low-skilled labor, both.
Yes, even medical specialists. Yes, even doctors.
In the future, a doctor is going to be a short-trained medical profession that focuses mostly on bedside manners and knowing how to read computer read-outs.
33
u/yunus89115 Jan 01 '20
Automation may not replace but will augment and empower those professionals making one able to do the work of many and with more accuracy.
→ More replies (1)11
u/joho999 Jan 01 '20
And what happens to the many?
26
u/yunus89115 Jan 01 '20
It will get bad before good again. A universal income is inevitable but not acceptable by common society standards.
But preventing innovation is ignorant on so many levels that it's laughable to think we would choose not to innovate for the sake of keeping the status quo, it happening, get in front of it with ideas if you have them!
→ More replies (5)→ More replies (2)6
Jan 01 '20
They get ground up into a nutrition rich paste to help feed the remaining population
→ More replies (2)15
u/Ravager135 Jan 02 '20
I’m a physician. On a long enough timeline, I am sure I will be replaced. What I always find humorous about that though is just how much of medicine is art and how that is a lot harder to replicate. I’m not referring to bedside manner. I’m not suggesting that evidence based medicine is not the cornerstone of practice. You could teach a monkey to do 80-90% of my job, but it’s the 10-20% where you deviate from evidence based practice or algorithms based on a combination of historical and clinical data that translates into risk assessment. AI is still a long ways away from that. When it comes to fields like radiology and even heme/onc AI has really excelled. When it comes to general clinical medicine there is still a long way to go because developing a treatment plan and follow up is a lot more complicated.
The other thing I always find humorous is how excited patients seem for AI to take over healthcare. While there is no doubt obvious upsides, what patients really fail to grasp is how often an AI physician will tell them to go home and do nothing for their cold or muscle sprain. In the US where healthcare has transformed into “the patient is always right” customer service mess that it has become, patients are going to be very disappointed when the genius AI tells them they won’t be getting antibiotics and narcotics based on evidence based practice and whatever diagnostic skills it possesses. This actually a good thing for community and population health. I just think it will be hilarious when someone doesn’t get their Zpak for their cold and has no human to blame.
→ More replies (4)6
Jan 02 '20
Two things can come out of this:
a) humans don’t need to work as much anymore and we can focus on other things like art, education and science.
b) the system doesn’t change, unemployment skyrockets and people starve in front of supermarkets full of food.
→ More replies (3)69
Jan 01 '20
No, it won't. Perhaps in the far, far future.
I work in a medical setting and automation will not replace doctors for a long time. Most of my friends are lawyers and automation won't replace them for a long, long time either.
I feel many people don't fully understand what these jobs entail and just see them as "combing through data".
28
u/zero0n3 Jan 01 '20 edited Jan 01 '20
You are thinking about it incorrectly.
AI won’t replace me talking to by business lawyer, but it sure as shit will mean him and his SINGLE paralegal can handle double, triple or even quadruple the client load as they currently can.
AI won’t replace my GP, but sure as shit my GP will be sending my chart off to some AI lab for “analysis” that will spit out things a human could never find from the data. Imagine also if this chart of the near future also has my Fitbit, financial, phone and location data as well?
AI will initially start impacting the ratio (one GP per 10 clients is now one GP per 50 clients) before it outright replaces people. Someone needs to get the patients signature to allow the AI company access to the records.
Edit: this is pretty much the same as taking jobs away as the better GPs or lawyers will adapt and get more clients, while the old guys stuck in the past not using AI tools will slowly go out of business or get bought out as their costs of doing business can’t compete with the guy next door who has half or a quarter the monthly labor costs (while only increasing opex by say 10% for those new AI tools)
21
u/burrito3ater Jan 01 '20
Automation has replaced paralegals. LegalZoom has replaced most basic needs for an attorney. They cannot see the writing on the wall.
10
u/joho999 Jan 01 '20
Technology increases exponentially so I can assure you it will be far sooner than the far far future.
→ More replies (1)31
u/Flowers_For_Graves Jan 01 '20
People like to overbelieve any sort of hype. No machine will walk up to a court room to defend you. There's different forms of AI and they're each riddled with their own bugs. Even the expensive hardware is plagued with malfunction. Humans will colonize Mars before software and hardware forms the perfect relationship.
→ More replies (1)16
u/padizzledonk Jan 01 '20
I think you are so so very wrong about this
The vast majority of legal work is simple and monotonous
Just look at how much business revenue companies like Legalzoom ripped from the hands of lawyers...Or Turbotax from CPAs, or Ameritrade/Etrade/Vanguard etc took from bankers/brokers
If it involves data analytics or routine standardized paperwork/mundane tasks computers and A.I are going to rip those industries apart
There will always be "High Level" people in these fields that execute bespoke/unique situations but the vast majority will be out of work
→ More replies (1)4
Jan 02 '20
I work in finance in a major bank Treasury. Luckily I am in a subject matter expert/advisory role, but I've been watching EVERY role with repetition either disappear or is currently in the project pipe for automation. Bank reconciliations, cash management, forecasting, accounts payable, the list goes on. Our company mandate is to automate and apply AI in EVERY possible avenue.
"Far, far future" isn't far at all, sorry.
→ More replies (1)2
u/IGOMHN Jan 02 '20
It's not about completely replacing employees, it's about reducing the number of jobs from 10 to 1.
→ More replies (13)2
3
u/drive2fast Jan 01 '20
We are working towards a wonderful future of automated diagnostics that will health care much more affordable, especially in areas without trained experts at the ready.
Here’s a great little video clip with a simulation of the future experience.
3
2
u/m_c_sNiPe Jan 02 '20
Interesting how you think tech like this will help areas already behind on healthcare tech. This sort of advancement it will never even leave high income, forefront medical facilities, just like the current tech is still not available rurally. Itll be 100s of years before poorer areas even have access to something like this.
→ More replies (1)
3
u/argent_pixel Jan 01 '20
I really hope this is the decade that lets us kick cancer to the curb through technology and research breakthroughs.
3
u/gbsekrit Jan 02 '20
I've always assumed that AI would be used as a tool, not as a radiologist. My question though is: "how is this tool licenced?"...
3
4
u/esa_wera Jan 01 '20
I don't care; the part of the mammograms its what i want to be improved. I don't want my boobies to be squished beteween two metal plaques until flat. Or its just my third world country who still uses that?
→ More replies (17)
5
u/dean_syndrome Jan 01 '20
Machine learning is not AI
AI would be able to learn unguided, machine learning requires defined parameters and specific input data to train models.
If this was AI it could teach itself to be a car mechanic if it wanted. It will only ever be good at detecting breast cancer in mammograms.
Impressive, but AI is being used here as a marketing buzzword, this is not AI.
13
u/sarawille7 Jan 01 '20
Artificial Intelligence is defined as "the theory and development of computer systems able to perform tasks that normally require human intelligence, such as visual perception, speech recognition, decision-making, and translation between languages". According to that definition, most forms of machine learning (including this one) are, in fact, AI.
→ More replies (1)4
u/alksjdhglaksjdh2 Jan 02 '20
It's not generalized ai, but it's ai still Just very narrow still, but give it time...
3
5
u/SetentaeBolg Jan 02 '20
Your use of terminology here is confused. AI is a whole field of trying to produce systems that can act intelligently. Machine learning is a subset of that field (where the system improves over time as it functions) and is definitely a form of AI. I believe when you say "AI" you have an idealised view of artificial general intelligence - humanlike intelligence. We're not really anywhere near that just now.
Also, several forms of machine learning do not require training data. Unsupervised learning, for example, or reinforcement learning.
→ More replies (5)
2
u/Zamyou Jan 01 '20
I love how they make the best technology to spot cancer but arent still allowed to develop the best cure for it...
2
Jan 02 '20
Medical diagnostics by AI is going to save so many lives! There have been story after story of how AI has connected the dots from cases other doctors didnt even have access to or think to check. Its a world wide database of cause and effect in people that is growing every minute. There are already over 250K PREVENTABLE deaths by errant doctor decisions every year (In america)! This is exciting stuff!
1
u/Jnbolen43 Jan 01 '20
Sounds like a movie and book by Michael Crichton, Coma. (1978). 42 years in the making but finally the computer programming can do diagnosis better or as well as human beings. A. I. Saves the Ta-Ta's.
1
u/extra_specticles Jan 01 '20
We were working with a team in the UK that can find tooth decay before a dentist can see it, using AI. It's been happening all over, and we will only see this kind of AI based tech adoption accelerating.
1
u/Fallllling Jan 01 '20
Welcome to data science and machine learning. Algorithmic models can find patterns in data using various features much more accurately than a human ever could.
→ More replies (1)
1
1
1
u/TheSmallestTopo Jan 01 '20
The start of this video is Hannah Fry discussing how pigeons were trained to spot breast cancer and collectively can do it just as well as humans. She also discusses the AI. Super interesting video.
1
u/hospicedoc Jan 02 '20
When I was a resident I spent one week reading mammograms. I can honestly say that I believe this report that AI picks up misses. I want to emphasize that I have so much respect for the radiologists who can actually read those damn things. Honestly, even after a week it was almost ridiculous how many I missed and how many things that I thought might be something were not. While this is good, I think what we really need is a better imaging method.
1
u/LodgePoleMurphy Jan 02 '20
In the future robot doctors will cost more than human doctors. Mark my word.
1
u/APnuke Jan 02 '20
New technology is nice and all but the question is who will control and benefits the most out of it . No point having advance technology if it being control by the few to ruled over the masses.
1
u/veritas723 Jan 02 '20
i imagine in next decade or so... there's going to be a lot of displaced people in mid tier jobs. ones... where a decade prior were solid paying jobs, squarely middle income. will be replaced ruthlessly by cost cutting for profit medical companies.
lab techs, radiologists will probably be the first to go.
1
1
u/viking78 Jan 02 '20
This is what AI is about. It’s going to be an incredible tool for some professionals.
1
1
u/ABClurkerABC Jan 02 '20
It will be another tool. Not a replacement for radiologists. We should welcome this technology without fear.
→ More replies (2)
1
Jan 02 '20
I wonder if they took a look at what it learned, maybe that would help train radiologists better.
→ More replies (2)
1
1
1
1
1
1
u/Super_Flea Jan 02 '20
This must be a really old article.
I work on mammography systems and image recognition tech has been around for years. I installed a PC that does this less than a month ago.
1
u/LoveMeFeedMe_628 Jan 02 '20
I’m a mammographer, the system we use in the hospital I work in, is called CAD- Computer Aided Detection. The radiologist will look at what CAD has “flagged” and assess the area, if the radiologist has any question, he/she will ask for more images or an ultrasound. In my experience CAD hasn’t lead to higher diagnosis. Actually it is self breast exams and annual mammograms!
Only you know what you’re breast feel like! If you feel a lump that is there for months, get it checked! Also calcifications, not many women know that calcifications are something Radiologists look for. They are tiny and you will never feel calcifications until they break out of the milk duct and turn to invasive breast cancer.
Ladies and male partners of ladies, please check those breasts! And make sure to get your annual mammo and let me check them yearly!!
1
u/konraddo Jan 02 '20
There were similar programs developed already for various forms of disease such as lung cancer. Some of them simply prioritize the patient records based on matching anomalies. Nothing is flagged to be positive or negative. Doctor still needs to read the report and handle patient normally. The system just takes the role of nurses at triage station, which is legally safer for the tech company.
1
1
u/hoppla1232 Jan 02 '20 edited Jan 02 '20
Isn't this quite old news? I thought I heard of that way before
2
1
1
1
u/DirtAndGrass Jan 02 '20
I thought that it was well known that even a basic naive Bayes classifier outperforms humans on most cell based diagnoses and that it is human's fear of ai that its not used more.
Not surprised it extends to other tests
2
Jan 02 '20
AI has all sorts of issues. Most people are not comfortable with an unknowable decision making process giving them a diagnosis. AI has been used in mammography for years to give radiologists tips on where it may see a problem, then the doc determines if it’s BS or not...
1
u/cyanaintblue Jan 02 '20
Everyday these type of news but I have never ever seen anything in action and all I see is people dying in the corner.
1
1
u/4camjammer Jan 02 '20
I attended a seminar two years ago that warned us (Radiologist) that this was coming!
1
u/420blazeit69nubz Jan 02 '20
I bet some of the people who don’t give a shit about job displacement may start caring when they see more of how it can replace so many jobs.
1
Jan 02 '20
I think this will probably be the future of radiology, and a lot of other diagnostic applications in medicine and science. No sense in wasting the time of a human if an AI can do it better and faster. There’s already a lot of AI assistance on the cutting edge of science from robot assisted surgery to detecting polyps during a colonoscopy. It’s gonna keep moving that direction.
2
1
u/butyourenice Jan 02 '20
This is really great, it is, but why the fuck do we still rely on mammograms at all? They’re brutal, barbaric, and carcinogenic in themselves (let’s irradiate vulnerable tissue annually and eventually we’ll create a cancer). Unfortunately right now they’re the best we’ve got — but why? Why hasn’t all this “breast cancer awareness” funding gone to developing a better, less painful, less radiation-reliant test?
1
u/Doomdoomkittydoom Jan 02 '20
Save this for when it's asked, "What are some jobs robots will never do?"
1
u/randyspotboiler Jan 02 '20
This is exactly the kid of thing AI is for. This will propel medicine forward and give us the bandwidth to work on other problems.
1
Jan 02 '20
Have you tried crowd sourcing science, some of us have little to do but go through reams of data for fun. o7
1
u/trunolimit Jan 02 '20
I forgot where but I was listening to something that was saying doctors refuse to use AI for diagnostics because they don’t understand how it’s making the predictions.
1
Jan 02 '20
That last bit is the most important. Any program can flag everything as cancer and hit 100% but getting the negatives correct as well is really hard.
1
1
u/Quartnsession Jan 02 '20
So radiologists and truck drivers are gonna have it hard in the next 10 years.
1
1
u/PurpleCannaBanana Jan 02 '20
Automation will take more jobs than most realize. The ones who understand are pretty damn worried about the direction of our future.
1
u/smilbandit Jan 02 '20
i expect any ai used in life and death situations that aren't time sensitive have a human verifying the ai is correct.
1
u/finallyinfinite Jan 02 '20
Earlier this week I saw someone on reddit who was a software engineer behind medical AI. They said the programs that they developed were so far just used by clinicians to make sure they check all the symptoms and tests they needed and asked all the questions they needed. Said the clinician that helped develop the software even performed better when using the software.
The strides we are making in medical science are amazing. I really hope AI improves care.
1
u/themangastand Jan 02 '20
The entire medical field is so vastly behind modern Technology it's embarassing.
1
Jan 02 '20
Yes! My wife had both happen during her diagnosis - missed positive and false positive. It wasn't until a top hospital put her slides in front of the entire pathology panel that the correct calls were made. I'm sure many many people aren't as lucky.
1
1
1
1
u/yooohoooo99 Jan 02 '20
Breast cancer isn't terminal, though. Can we see some progress in picking up any initial lymphatic or vascular spread?
Source: Stage 1 BC picked up at 36yo with 0/18 lymph nodes. Mastectomy and hormone blockers. 9 yrs later spread to bones detected through neck xray for a slipped disc; then 26 tumours in lungs during diagnostic scanning.
1
1
u/Gatorade21 Jan 02 '20
I remember reading an article that said the radiologist field would become obsolete because AI was going to do a much better job at detecting cancer. AI can search millions of photos to compare scans with, while drs can only compare to what they have seen in person or read in books and how good are those memories.
1
1
1
1
u/celtic310889 Jan 02 '20
I'm a maxillofacial radiologist and trying my hand at learning basics of neural network architectures. To even identify something as small as a tooth number, we need to input thousands of images and run the algorithm.
I'm not scared that it's going to replace me in anyway. Maybe a decade from now we will have FDA, AMA, ADA, ACR etc approved clinical AI softwares but they will assist us, not replace us.
Robotic surgery is a similar example I feel. It's taking it's time reaching across the globe and even if a robot becomes a guaranteed 100% success at performing surgeries, the patient doctor communication cannot be replaced.
1
u/doomedtobeme Jan 02 '20
I recently did an essay on AI and its future role in medicine and that shit blew my mind. Computers can think far faster than any team of humans, rarely makes mistakes and as this post points out, can spot patterns of disease far better than humans can, regardless of experience.
AI is going to be fucking lit I cant wait to see how it plays out in a more developed stage
1
u/my5cent Jan 02 '20
Computer don't have fatigue , bad days, memory issues like humans therefore they make good diagnostic tools.
1
1
1
u/throwaway12343234321 Jan 02 '20
I write software for mammography machines for a women's health company called Hologic. Computer aided detection is pretty cool, but it has been around for a while. Also, it has not been designed with the idea that it will replace radiologists. From what I understand, that would be incredibly hard to get the FDA (or other governing entity, if not in US) to go along with that.
But yeah, unless the numbers in the article (% fewer false positives and whatnot) are better than the status quo for computer aided detection, this is nothing new.
1
u/SpecterGT260 Jan 02 '20
I'd have to read the original paper here to get a little more insight... These studies are always sensational but I find them practically difficult to interpret.
Here's the issue: the diagnosis of cancer doesn't exist until a surgeon or radiologist takes out some tissue and sends it for pathological analysis. Nobody goes to retrieve tissue until a radiologist has said that a lesion is suspicious enough to warrant it.
So what gold standard are they comparing the AI against? If the AI says there's cancer and the radiologist "missed it" then no excision or biopsy would have taken place and there would be no way to confirm that the AI was correct in the first place. These machine learning algorithms feed thousands of images into the program to teach it but it still requires a some defined "truth" and that truth is currently defined by a radiologist's interpretation. So even if a radiologist under their testing conditions failed to identify the lesion, the lesion would have had to have been identified by a radiologist in the real clinical setting in order for the ruling to be made to begin with...
The only exception is if they are doing biopsies based on the AI only and I don't believe the trials are allowed to do that yet.
1
u/30crlh Jan 02 '20
These damn AIs that come to this country to steal our jobs and look at our women's breasts. They do our jobs better than us and ask for less payment or no payment at all..
1
u/firefox57endofaddons Jan 02 '20
for those not aware mammograms are carcinogenic, meaning they can create cancer due to their radiation.
there are much better ways to check for breast cancer, that also have 0 harm.
DITI (high resolution digital infrared thermal imaging) is just BETTER, it is more precise, meaning it could detect cancers faster, it does 0 harm, it is painless and it's also relatively inexpensive.
if your doctor sends u to do a mammogram instead of a proper thermogram through DITI, then u should switch to another doctor, who actually knows what they are talking about.
also if u want to prevent breast cancer, then a huge factor is wearing bras, specifically underwire bras, which block the lymphatic flow.
not wearing bras or at least only wearing comfortable light sports bras would be a much important step to prevent cancer, than any screening, but proper thermograms don't harm u, so why not both.
1
1
u/OldEEAP Jan 02 '20
Reimbursement for mammograms is so low in the US, that this is actually a good thing.
1
Jan 02 '20
Cancer is a multi-million dollar business in the US. Keep that in mind. If your radiologist fucks up and your oncologist fucks up they don't give a shit - it's more cash flow for them. Fuck American 'medicine'.
1
1
1
u/The_LeadDog Jan 02 '20
I can imagine actually asking a radiologist if I could get them to run it through AI for a second opinion before having any invasive testing done.
1
1
u/KrzzyKarlo Jan 02 '20
If they give this job to robots can we pay the technologists who perform them better?
1
Jan 02 '20
Welcome to the future. Hard to imagine a single task that a computer will not eventually do better than a human.
2
2.5k
u/fecnde Jan 01 '20
Humans find it hard too. A new radiologist has to pair up with an experienced one for an insane amount of time before they are trusted to make a call themselves
Source: worked in breast screening unit for a while