The value that they can add is the ability to bootstrap.
If in my day-to-day I'm building a transformation model, I first have to create a project structure, then some base models and then get some data for testing purposes. This takes time and takes me away from the problem I actually want to solve.
An LLM, with the right prompt, can create the entire project, with the right structure, and some base models within a couple of minutes. I can have the entire thing, end-to-end, done in 5-10 minutes and then start on the problem I need to solve.
Then there’s the document summarisation capabilities. It’s having something that can take a long document and help you work out the gist of what’s being said. It’s either an end-point or it’s a great way to set up a bunch of biases before you read the document to confirm or dismiss them.
Using LLMs frees us up to think more, exercise our imaginations, be more creative and do exciting things. We get time back to solve the problems we want to solve.
Let's assume that if you're building new features with AI you’ll also be able to build them faster. Ultimately, you’re going to be throwing users a stream of new features and functionality. It’s going to become a bit of a burden on them, in that they’re going to need to learn these features to do their jobs efficiently. How much time do new analysts need to become productive? 3 months, 6 months, 12 months? That would be suboptimal, right?
LLMs are a great fit here. Take your documentation and feed it to the LLMs and then search it easily using natural language. If you can integrate LLMs into your product and provide context about the user, alongside the search you can help steer users of your new features in the right direction.
If you have a very complicated set of tools that you typically expect someone to take 6 to 12 months to get up to speed with, an intelligent Microsoft Clippy clone saying, “I think you're trying to do a report on this. Have you seen the documentation on this particular set of functions that I currently have?” can help accelerate the learning process.