|
|
| | LLMs and SQL | |
3 points by zephodb 17 days ago | hide | past | favorite | 9 comments
|
|
| Why is there no opensource or closed source solution as on today for a LLMs performing Data Analysis on Large databases. I mean complex schemas and with more than 100 tables. Essentially to replace data analysts.Is it really that difficult. While everyone in interested in finetuning, RAG and Agents, no one is serious about using LLMs for data analysis on a large scale. For starters, one can try using the Microsoft Contoso BI demo Dataset. Even GPT4 fails miserably to answer the simplest Analysis questions. |
|
Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact
|
But like the "AI lawyer", the "AI doctor", the "AI coder", it doesn't replace the analyst, it just improves the quality and output of their work.
It might replace analyst interns, or some entry-level positions that were mostly low-level tasks and data entry, but a data analyst at a company who knows how to put data into a LlamaIndex for querying is a very useful analyst - think of what can be built on top of that domain-specific LLM for the company, for the analyst. It makes non-technical analysts who don't use AI seem incredibly passe and useless in comparison.
Same with auto mechanics, lawyers, doctors, HVAC techs, construction workers - AI tooling will even make its way into police work (even in the field, running on their little computer in-car) as well as dispatching.
Doesn't replace anyone, but has the ability to drastically improve our quality of work. Turns the expert into a super-expert.