No Free LL-unch
This video covers some of the emerging tools and platforms for tuning and comparative testing of Large Language Models, including Vellum.ai, Gradio, Lambda Labs and Paperspace. “No Free Lunch” is […]
Jeffrey Spyropoulos: Making Analytics Count at JCP Jim Griffin
Tapan Khopkar: A ‘MasterClass’ in Marketing Mix Jim Griffin
Aida Farahani: From 2D to 3D in Seconds Jim Griffin
Nikhil Patel: Inside Sally Beauty’s Data Strategy Jim Griffin
Victor Perrine: From Bananas to $Billions Jim Griffin
Ray Pettit: New Models for AI Literacy? Jim Griffin
Ivan Pinto: A Year of AI Testing in Software Dev Jim Griffin
Sam Marks: Big Data, Big Bad Bruins Jim Griffin
A review of six months’ worth of developer posts on the OpenAI Developer Community page shows a range of markups from a low(!!) of 100% to a high of 100x cost.
After exploring how those markups get determined, this video moves on to an even harder problem. As one developer wrote:
“Not trying to limit users tokens, but not trying to be on the hook for tokens used, but not trying to confuse the end user, but trying to explain the relationship between queries, tokens and costs… Man, that’s hard!”
Yes, it is!
This video explores two competing schools of thought about how to handle this: (1) What we’ll call the “cell phone company” approach vs. (2) the “pay-as-you-go” approach. In doing that, we’ll unpack four different trade-offs between those choices.
It turns out that the best way to balance risk and reward between these options might depend, to a very large extent, on the target market itself. In this video, we’ll see why.
But . . . Why is there dance music at the end of the video??
Stay tuned to the end to find out!
This video covers some of the emerging tools and platforms for tuning and comparative testing of Large Language Models, including Vellum.ai, Gradio, Lambda Labs and Paperspace. “No Free Lunch” is […]
Copyright AI Master Group 2023-24