Well, no, I’m just saying the text generation stuff did not change anything about that process.
It can try to generate the right text for the requests to grab this data, but since there’s going to be practically no documentation for that out there, it will struggle to do so from just its training data alone.
So, what you do instead is that you have a human figure out the API of each store that needs to be integrated + ideally a transformation of the returned data into a shared, documented format. And then you tell the text generation a trivial way for it to generate the text to make use of that.
So, basically you preface the whole user conversation with “If I ask for prices of Todd’s Tater Tots, run ./prices_todds_tater_tots.sh for that and use the result according to the JSON schema in prices_store.schema.json.”.
And then you repeat that for all the other stores, for some math API and some navigation API and then you’ve got a chance that the text generation figures out the right semantics of how these things should be called.
Semantics is what it’s good at. But the rest is still the same process as ten years ago.
I think you’re under selling what chat gpt is capable of. It is able to take outside data in and use it with the rest of the model. Bing does it with its web index data. I was able to ask what the cheapest gas station near me is and bing gave me a list, likely coming from gas buddy.
Well, no, I’m just saying the text generation stuff did not change anything about that process.
It can try to generate the right text for the requests to grab this data, but since there’s going to be practically no documentation for that out there, it will struggle to do so from just its training data alone.
So, what you do instead is that you have a human figure out the API of each store that needs to be integrated + ideally a transformation of the returned data into a shared, documented format. And then you tell the text generation a trivial way for it to generate the text to make use of that.
So, basically you preface the whole user conversation with “If I ask for prices of Todd’s Tater Tots, run
./prices_todds_tater_tots.shfor that and use the result according to the JSON schema inprices_store.schema.json.”.And then you repeat that for all the other stores, for some math API and some navigation API and then you’ve got a chance that the text generation figures out the right semantics of how these things should be called.
Semantics is what it’s good at. But the rest is still the same process as ten years ago.
I think you’re under selling what chat gpt is capable of. It is able to take outside data in and use it with the rest of the model. Bing does it with its web index data. I was able to ask what the cheapest gas station near me is and bing gave me a list, likely coming from gas buddy.