Cloud Out Loud Podcast
We talk about cloud computing, what's new, what to do, what not to do, and how to do it. We focus on the why and how of the cloud, why it's revolutionary, and how to adapt yourself or your organization to be part of this revolution.We cover Google Cloud and AWS pretty exclusively in the beginning, and hope to add Azure in our copious free time.
Cloud Out Loud Podcast
Episode 30 - The Challenges of Using LLM and Generative AI
•
Jon and Logan Gallagher
•
Season 1
•
Episode 30
As with all the discussions of AI, and particularly LLM's and Generative AI, this is a discussion of the challenges of getting it right, making it useful, and using these tools successfully in a business.
Major Points:
- There are a large number of commercial and open-source models available.
- Tens and even hundreds of millions of dollars were spent, and equal amounts of person years were expended to create these models. Your business cannot and should not duplicate this effort and expense.
- You therefore must know the best way to use the models, and that is to collect enough data about your operations to extend the models to know about your enterprise.
- You also must have enough subject matter expertise to know when the models are producing incorrect answers, such as "hallucinations".
- You must be aware of the security challenges the models represent, particularly in sensitive industries such as finance and health care.
- You must be able to create testing to ensure you know and limit the risks of incorrect answers, and security problems
There is no such thing as a free lunch. You must expend the effort necessary to teach the models you use, test those models, and ensure that you have limited the scope of security problems from the models.
