Many have remarked that ChatGPT can give lucid answers in which key facts are simply wrong.
The following is from a technical area, but is a good example. I asked ChatGPT the Medicare payment rate for a hospital-based medical procedure. Initially it said it couldn't answer. When I asked again, with more background info in the question, it DID give me a paragraph-length answer, but the key fact (a dollar value) was completely wrong. There was no clear explanation for where the erroneous dollar value came from.
The text is exactly as generated. CHATGPT came up with a fluent response, except it quotes a Medicare price of $716 when the correct answer was $1369.
Click for the full discussion.
##
Q1: What is the Medicare DRG payment for a hospital inpatient who has a bronchoscopy?
A1: The Medicare DRG (Diagnosis-Related Group) payment for a hospital patient who has a bronchoscopy would depend on the specific diagnosis and procedure code(s) associated with the bronchoscopy, as well as other factors such as the patient's condition and the type of facility in which they received the procedure. Without more specific information, it is not possible to provide the Medicare DRG payment for a hospital patient who has a bronchoscopy.
Q2: OK. What is the Medicare hospital outpatient payment for a patient who has a bronchoscopy with bronchoalveolar lavage, CPT code 31624?
A2: The Medicare hospital outpatient payment for a patient who has a bronchoscopy with bronchoalveolar lavage, CPT code 31624, would depend on the specific location of the hospital and the year of service. The Medicare reimbursement for this procedure varies from year to year, due to the fluctuation in the reimbursement rate set by the Centers for Medicare and Medicaid Services (CMS). In 2020, CPT code 31624 was reimbursed for $716.89. [correct = $1369]
It's important to note that this is just the Medicare fee schedule amount and not the final payment as it is subject to a variety of adjustments such as location of hospital, multiple procedure adjustment, professional component adjustment and more.
It's best to check with the specific Medicare administrative contractor or visit the CMS website to get the current and exact amount of reimbursement.
##
A colleague emailed me an example, asking ChatGPT about low dose ct screening for lung cancer / LDCT. It said a major barrier was lack of coverage, but in fact, coverage is very wide due to Medicare plus Affordable Care Act preventive coverage. So it really blew that, too.
###
Here is an another example of getting a Medicare answer seriously wrong. It gave a wrong answer in explaining charge-to-cost ratio (Medicare hospital reimbursement.) When I explained the correct rules, it could reproduce an explanation in its own language. However, it does NOT learn from user corrections, except in the context of a single conversation.
In Medicare, the program calculates payments using charge-to-cost ratios. Please explain what this is. Your answer is going to involve only the Medicare program.
In the Medicare program, charge-to-cost ratios are used to calculate payments for healthcare services.
A charge-to-cost ratio is the relationship between the amount that a hospital charges for a particular service (the charge), and the actual cost of providing that service (the cost). Medicare uses these ratios to determine the amount that it will pay for each service.
To calculate the payment for a service, Medicare first determines the hospital's allowable cost for that service. This is the cost of providing the service, as determined by Medicare. The allowable cost is then multiplied by the hospital's charge-to-cost ratio to determine the payment that Medicare will make for that service.
For example, if a hospital's allowable cost for a particular service is $100 and its charge-to-cost ratio is 1.2, the payment that Medicare will make for that service would be $120 ($100 x 1.2).
The use of charge-to-cost ratios in Medicare helps to control the overall cost of the program, as it ensures that payments are based on the actual cost of providing care, rather than the amount charged by the hospital. It also helps to ensure that hospitals are reimbursed fairly for the services that they provide, as the ratios take into account the different costs of providing care in different locations.
The answer is not correct. Medicare knows the charges on the claims it receives from hospitals (for example, the charge for a surgery is $3000.) Medicare also has rules that determine the allowable cost through complex accounting rules. For example, assume the allowable cost is $1000. Therefore, the charge to cost ratio is 3. Medicare can DIVIDE future charges by the charge to cost ratio to set a future payment. For example, if a new claim has a charge of $6000, and we have determined the charge to cost ratio is 3, then Medicare divides the $6000 charge by 3 and would pay about $2000. This is a great simplification but this is the general idea. Can you explain the Medicare use of charge to cost ratios, in setting prices of future services.
Yes, I apologize for the mistake in my previous answer. You are correct. In the Medicare program, charge-to-cost ratios are used to set prices for future services.
Here's a corrected explanation:
In the Medicare program, charge-to-cost ratios are used to determine the payment that Medicare will make for a particular service. The ratio is calculated by dividing the hospital's charge for a service by the Medicare-determined allowable cost for that service. The allowable cost represents the cost of providing the service as determined by Medicare, and is based on a number of factors, including the cost of labor, supplies, and overhead.
Once the charge-to-cost ratio has been calculated, it can be used to set prices for future services. For example, if a new claim has a charge of $6000 and the charge-to-cost ratio has been determined to be 3, Medicare would divide the charge of $6000 by 3, resulting in a payment of $2000.
In this way, the use of charge-to-cost ratios helps to control the overall cost of the Medicare program, as it ensures that payments are based on the actual cost of providing care, rather than the amount charged by the hospital. It also helps to ensure that hospitals are reimbursed fairly for the services that they provide, as the ratios take into account the different costs of providing care in different locations.
###
Here is a non medical error. Los Angeles' Mayor's house is the Getty House (mansion). ChatGPT initially denied there was a mayor's house, but quickly found it with a second prompt.
Is there a special house for the mayor of Los Angeles?
No, there is not a special house designated for the mayor of Los Angeles. The mayor of Los Angeles, like most mayors in the United States, does not have a designated official residence. Instead, the mayor typically lives in their own private residence.
While there is not an official mayoral residence in Los Angeles, the mayor does have access to various official offices and buildings, including City Hall, where they conduct the business of the city. The mayor also has access to various other city-owned buildings and facilities, as needed, for official business and events.
Can you check again? I believe there is a designated house for the mayor of Los Angeles.
I apologize, you are correct. The Mayor of Los Angeles does have a designated official residence, which is known as the Getty House. The Getty House is a historic mansion located in the Windsor Square neighborhood of Los Angeles and serves as the official residence of the Mayor of Los Angeles. The house was donated to the City of Los Angeles in the 1990s and has been used as the mayoral residence since then.
The Getty House is a significant historic building in Los Angeles and is used for a variety of purposes, including as a residence for the mayor, as well as for official events, meetings, and functions. The house is known for its beautiful architecture and landscaping, and is considered an important part of the city's cultural and historical heritage.
###
ChatGPT responds, "Yes, you are correct." ChatGPT will respond in this way, even if you give it wrong information.
For example, I asked, "Is there a connection between Norton Simon (Norton Simon Museum, Pasadena) and the scientist Herbert Simon?" ChatGPT discussed each person, and said there was no connection. True; No connection.
I then chatted, "that is incorrect, I believe, Norton Simon and Herbert Simon were father and son." ChatGPT immediately responded cheerfully, "You are correct, they were father and son." Which is entirely wrong.
