{"id":72510,"date":"2024-04-12T08:48:56","date_gmt":"2024-04-12T06:48:56","guid":{"rendered":"https:\/\/intellias.com\/?post_type=blog&#038;p=72510"},"modified":"2024-07-29T12:28:24","modified_gmt":"2024-07-29T10:28:24","slug":"the-rise-of-domain-specific-llms-for-data-analytics","status":"publish","type":"blog","link":"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/","title":{"rendered":"The Rise of Domain-Specific LLMs for Data Analytics"},"content":{"rendered":"<p>Ironically, businesses aren\u2019t getting better at making decisions even though they have more access to data and analytics tools than ever. Sixty-four percent of chief financial officers surveyed by <a href=\"https:\/\/www2.deloitte.com\/us\/en\/pages\/finance\/articles\/cfo-signals-1q-2023.html\" target=\"_blank\" rel=\"noopener\">Deloitte<\/a> name inadequate technologies\/systems as one of the three greatest challenges in turning data into insights.<\/p>\n<p>You might ask: <em>Aren\u2019t data analytics budgets growing year over year?<\/em> They are. But so is the volume, variety, and complexity of data.<\/p>\n<p>Businesses are paying a lot for data infrastructure and business intelligence (BI) tools, but they often see a small return on investment (ROI) and a big list of complaints from end-users about the tools\u2019 complexity, lengthy setup cycles, etc.<\/p>\n<p>What if your team could write text-based questions instead of complex SQL queries? The combination of large language models (LLMs) and data analytics promises to commoditize access to analytics.<\/p>\n<h2>How LLMs and data analytics enable data-driven workflows<\/h2>\n<p>Traditional data analytics tools work with structured and numerical data. Large language models (LLMs), in turn, can interpret human language and extract sentiments, speech patterns, and specific topics from unstructured textual data.<\/p>\n<p>By fusing LLMs with data analytics,<strong> businesses can use more data points, plus create a conversational interface to explore them<\/strong>.<\/p>\n<div><a href=\"https:\/\/intellias.com\/data-science-and-big-data\/\" class=\"cta-wrap bg_3 column\">\n                    <div class=\"left-col\">\n                        <p class=\"cta-title\">Data Analytics<\/p>\n                        <div class=\"cta-block__content\">\n                            <div class=\"description\">Make smart business choices and transform your strategy with Intellias data analytics services<\/div>\n                        <\/div>\n                    <\/div>\n                     <span class=\"btn-filled\">Learn more<\/span>\n\t\t        <\/a><\/div>\n<h3>How LLMs enhance data analytics<\/h3>\n<ul style=\"list-style-type: circle;\">\n<li><strong>Identify<\/strong> the most relevant information your teams need to do their job.<\/li>\n<li><strong>Query<\/strong> extensive knowledge bases and analytical databases with natural language.<\/li>\n<li><strong>Generate<\/strong> summarized answers, trend predictions, and next-best action recommendations.<\/li>\n<li><strong>Explain<\/strong> complex concepts, trends, and outliers in data.<\/li>\n<\/ul>\n<p>It\u2019s quite possible that you have already asked ChatGPT to perform some analytics tasks in your industry and had mixed results.<\/p>\n<p>General-purpose LLMs like Bidirectional Encoder Representations from Transformers (BERT) and Generative Pre-trained Transformer (GPT) weren\u2019t explicitly trained to <a href=\"https:\/\/intellias.com\/effective-ev-route-planning\/\">run route optimization scenarios<\/a> for different types of electric vehicles (EVs), for example. But thanks to various model fine-tuning techniques, you can teach general-purpose models to:<\/p>\n<ul style=\"list-style-type: circle;\">\n<li>Better understand the jargon in your industry (e.g., financial or legal terms) to analyze complex documents<\/li>\n<li>Fetch knowledge from a specific dataset (e.g., anonymized CRM data) to provide relevant, data-backed answers<\/li>\n<li>Generate answers in different formats \u2014 text, video, images \u2014 based on the user prompt<\/li>\n<\/ul>\n<p>Effectively, fine-tuned LLMs help accomplish <strong>two things for data analytics<\/strong>: Improve access to different data assets through a conversational interface and help deliver more comprehensive, contextually relevant insights.<\/p>\n<p>That\u2019s exactly how many data-driven companies already use LLMs. Colgate-Palmolive, for example, <a href=\"https:\/\/d1.awsstatic.com\/psc-digital\/2023\/gc-600\/cdo-agenda-2024\/cdo-agenda-2024.pdf\" target=\"_blank\" rel=\"noopener\">uses generative AI<\/a> to synthesize consumer and shopper insights and better capture consumer sentiment. Morgan Stanley has <a href=\"https:\/\/fortune.com\/2023\/09\/20\/morgan-stanley-ai-assistant-answer-investing-personal-finance-queries\/\" target=\"_blank\" rel=\"noopener\">launched an AI workforce assistant<\/a>, which can handle a range of research inquiries (<em>What\u2019s the projected interest rate increase in April 2024?<\/em>) and general admin queries (<em>How can I open a new IRA account?<\/em>).<\/p>\n<p>According to a 2023 global study by Amazon Web Services, <a href=\"https:\/\/d1.awsstatic.com\/psc-digital\/2023\/gc-600\/cdo-agenda-2024\/cdo-agenda-2024.pdf\" target=\"_blank\" rel=\"noopener\">80% of chief data officers<\/a> expect that generative AI will positively transform their organization\u2019s business environment \u2014 and for some good reasons.<br \/>\n<div><a href=\"https:\/\/intellias.com\/ebooks\/ai-engineering-productivity-cookbook\/\" class=\"whitepaper-banner wow fadeInUp\">\n\t\t\t<div class=\"whitepaper-banner__icon\"><img loading=\"lazy\" decoding=\"async\" src=\"https:\/\/intellias.com\/wp-content\/uploads\/2024\/06\/AI-Engineering-Productivity-Cookbook-image-2.jpg\" alt=\"AI Engineering Productivity Cookbook image 2\" width=\"345\" height=\"442\" ><\/div>\n\t\t\t<div class=\"whitepaper-banner__info\">\n\t\t\t\t<div class=\"whitepaper-banner__info-text\">\n\t\t\t\t\t<div class=\"whitepaper-title\">AI Engineering Productivity Cookbook<\/div>\n\t\t\t\t\t<div class=\"whitepaper-description\">Unleash the potential of AI in software engineering for higher productivity and reduced time-to-market<\/div>\n\t\t\t\t<\/div>\n\t\t\t\t<span class=\"whitepaper-btn btn-filled\"> Download now <\/span>\n\t\t\t<\/div>\n\t\t<\/a><\/div><\/p>\n<h2>Benefits of combining LLMs and data analytics<\/h2>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-72520\" src=\"https:\/\/d17ocfn2f5o4rl.cloudfront.net\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-02.jpg\" alt=\"Benefits of combining LLMs and data analytics \" width=\"1604\" height=\"798\" srcset=\"https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-02.jpg 1604w, https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-02-300x149.jpg 300w, https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-02-1024x509.jpg 1024w, https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-02-768x382.jpg 768w, https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-02-450x225.jpg 450w\" sizes=\"(max-width: 1604px) 100vw, 1604px\" \/><\/p>\n<p>By augmenting existing business analytics processes with LLMs, teams across functions can get answers to questions that previously required at least one business analyst or data scientist. Advantages of using LLMs for data analytics include:<\/p>\n<ul style=\"list-style-type: circle;\">\n<li><strong>Reduced learning curve<\/strong>. With LLMs, there\u2019s no need for SQL queries or half-day training for junior staff. Teams can run an analytics command with a simple text prompt.<\/li>\n<li><strong>Personalized reports<\/strong>. LLMs can slice and dice available data to create short summaries, provide segmented insights, or recommend next steps.<\/li>\n<li><strong>Innovative insights<\/strong>. Combined with machine learning methods for processing structured data, LLMs can discover hidden patterns, nascent trends, and subtle correlations in data.<\/li>\n<li><strong>Cost efficiency<\/strong>. Operationalize more datasets without spending extra on expensive software licenses or specialists to set up yet another analytics dashboard.<\/li>\n<li><strong>Scalability<\/strong>. Embedding extra functions into pre-trained LLMs allows them to support a broader range of use cases and is simpler than implementing another business analytics (BI) tool.<\/li>\n<li><strong>Content generation<\/strong>. Custom reports based on text-based user queries or ad-hoc data visualizations are also great tasks for LLMs in data analytics.<\/li>\n<\/ul>\n<p>Unlike regular data analytics and <a href=\"https:\/\/intellias.com\/5-use-cases-of-machine-learning-in-fintech-and-banking\/\">machine learning models<\/a>, LLMs can perform semantic search, taking into account the meaning and intention behind a user\u2019s query to provide a more relevant answer. For that, the models employ <em>embeddings<\/em>: vector-based representations of relationships between words, phrases, and data points. Thanks to embeddings, LLMs can locate data points that closely relate to the user\u2019s intent and return nuanced and context-aware answers. Effectively, LLMs can transform vast amounts of textual data into precise insights, plus combine this information with numerical data to provide more comprehensive information to users.<\/p>\n<div><a href=\"https:\/\/intellias.com\/intelligent-automation-services\/\" class=\"cta-wrap bg_1 column\">\n                    <div class=\"left-col\">\n                        <p class=\"cta-title\">Intelligent Automation<\/p>\n                        <div class=\"cta-block__content\">\n                            <div class=\"description\">Deploy intelligent virtual assistants and chatbots with rich functionality across multiple platforms<\/div>\n                        <\/div>\n                    <\/div>\n                     <span class=\"btn-filled\">Learn more<\/span>\n\t\t        <\/a><\/div>\n<h2>6 viable combinations of LLMs with data analytics<\/h2>\n<p>So, what exactly can LLMs do for data analysis? Let\u2019s take a look at several labor-intensive knowledge tasks companies can streamline:<\/p>\n<ul style=\"list-style-type: circle;\">\n<li><strong>Customer sentiment analysis<\/strong>: LLMs can detect nuances in textual data and interpret the semantics of written content at a massive scale.<\/li>\n<li><strong>Sales analytics<\/strong>. Instead of relying on dashboards and SQL queries, business analysts can interact with CRM, ERP, and other data sources via a conversational interface.<\/li>\n<li><strong>Market intelligence<\/strong>. By combining textual and numerical data, business analysts can identify nascent trends, patterns, and potential growth opportunities.<\/li>\n<li><strong>Sustainability reporting<\/strong>. LLMs can facilitate data extraction and management and can be configured for automatic document generation and\/or validation.<\/li>\n<li><strong>Due diligence<\/strong>. LLMs help better identify risks, inconsistencies, and critical insights that leaders need to know to make better deals.<\/li>\n<li><strong>Fraud investigation<\/strong>. With LLMs, analysts get high-precision anomaly detection capabilities and conversational assistance in investigation efforts.<\/li>\n<\/ul>\n<h3>Customer sentiment analysis<\/h3>\n<p>LLMs like GPT and BERT can perform <strong>semantic searches<\/strong>. This can make a huge difference in sentiment analysis, revealing whether a customer thinks your product is \u201cterrible\u201d versus \u201cterribly awesome!\u201d<\/p>\n<p>Open-source large language models are already rather good at scanning for context but they can further improve information extraction by using vector databases.<\/p>\n<p><strong>Vector databases<\/strong> convert unstructured data (such as texts) into mathematical vectors that indicate word meanings and semantic relationships between them (known as word embeddings). This helps the model better distinguish the intent behind a user\u2019s query and generate more accurate results. For example, a vector database can help to ensure that your customer is talking about Java the programming language and not Java the Indonesian island.<\/p>\n<p><img loading=\"lazy\" decoding=\"async\" class=\"alignnone size-full wp-image-72523\" src=\"https:\/\/d17ocfn2f5o4rl.cloudfront.net\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-01.jpg\" alt=\"example, a vector database \" width=\"1604\" height=\"798\" srcset=\"https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-01.jpg 1604w, https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-01-300x149.jpg 300w, https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-01-1024x509.jpg 1024w, https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-01-768x382.jpg 768w, https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-Body-01-450x225.jpg 450w\" sizes=\"(max-width: 1604px) 100vw, 1604px\" \/><\/p>\n<p><em>Source: <a href=\"https:\/\/www.semanticscholar.org\/paper\/Efficient-3-D-modelling-of-punching-shear-failure-Setiawan-Vollum\/3b61bce3cfb8ea8a40965b862be3682ef2c82b81\" target=\"_blank\" rel=\"noopener\">Semantic Scholar<\/a><\/em><\/p>\n<p>A pair of words that possess similar meanings or occur frequently in similar contexts will share a vector relationship.<\/p>\n<p>To improve LLM performance, you can create custom embeddings for your domain or use a pre-trained open-source model like <a href=\"https:\/\/www.tensorflow.org\/text\/tutorials\/word2vec\" target=\"_blank\" rel=\"noopener\">Word2Vec<\/a>, <a href=\"https:\/\/huggingface.co\/thenlper\/gte-base\" target=\"_blank\" rel=\"noopener\">GTE-Base<\/a>, <a href=\"https:\/\/huggingface.co\/olm\/olm-roberta-base-dec-2022\" target=\"_blank\" rel=\"noopener\">RoBERTa<\/a>, or <a href=\"https:\/\/huggingface.co\/sentence-transformers\/all-mpnet-base-v2\" target=\"_blank\" rel=\"noopener\">MPNet V2<\/a>. By fusing LLMs and business analytics tools, you can get 360-degree insights based on structured data points (NPS scores) and unstructured data points (text complaints). For example, Intellias recently helped a client <a href=\"https:\/\/intellias.com\/chatgpt-powered-solution-for-evaluating-brand-performance\/\">deploy a brand performance tracker<\/a> that combines NLP, generative AI, and traditional data analytics methods.<\/p>\n<p>The business solution can collect data from external sources \u2014 social media, blog posts, reviews, etc. \u2014 and transform it into accurate reputational indices. As a result, the brand marketing team no longer needs to manually review media coverage to assess the impact of recent promotional campaigns. Instead, they can get condensed and prioritized data from a GPT model, along with accurate assessments of recent brand mentions from all around the web.<\/p>\n<p>What\u2019s more, you can program an LLM to collect sentiment from mediums like images, audio, or video. <a href=\"https:\/\/www.sonnetai.com\/\" target=\"_blank\" rel=\"noopener\">Sonnet<\/a>, for example, is fine-tuning the GPT-4 model to pick up important insights from voice and video conversations related to sales deals, customer demos, user interviews, or even morning standups. The ultimate goal is to create a <a href=\"https:\/\/intellias.com\/7-conversational-ai-trends\/\">conversational<\/a> assistant that can deliver insights on what customers resonate with, or complain about.<\/p>\n<h3>Sales analytics<\/h3>\n<p>Almost unanimously, business leaders agree that data drives better decisions, and yet a recent <a href=\"https:\/\/www.salesforce.com\/news\/stories\/data-skills-research\/\" target=\"_blank\" rel=\"noopener\">Salesforce survey<\/a> has found that only 33% use data to decide on pricing in line with economic conditions. And no, it\u2019s not that teams lack business intelligence tools in the first place. What they lack is the ability to interpret available data.<\/p>\n<section class=\"testimonial-wrap testimonial-wrap--simple\">\n\t\t\t<blockquote class=\"testimonial-block\">\n\t\t\t\t<div class=\"testimonial-block__content\">\n\t\t\t\t<svg class=\"quote-icon\" width=\"75\" height=\"65\" viewBox=\"0 0 75 65\" fill=\"none\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\"><path opacity=\".3\" fill-rule=\"evenodd\" clip-rule=\"evenodd\" d=\"M16 29.7h10c2.4 0 4.4.8 6.1 2.5a8.5 8.5 0 0 1 2.5 6.2v17.4c0 2.5-.8 4.5-2.5 6.2a8.2 8.2 0 0 1-6 2.6H8.7c-2.4 0-4.4-.9-6-2.6a8.5 8.5 0 0 1-2.6-6.2v-32A23 23 0 0 1 7 7.4 23.1 23.1 0 0 1 23.2.6H26a2.8 2.8 0 0 1 2.9 3v5.7c0 .8-.3 1.5-.9 2-.5.6-1.2 1-2 1h-2.8a11 11 0 0 0-8.2 3.3c-2.2 2.3-3.3 5-3.3 8.2v1.5c0 1.2.4 2.2 1.2 3 .9 1 1.9 1.4 3 1.4Zm49.9 0c2.4 0 4.4.8 6 2.5a8.5 8.5 0 0 1 2.6 6.2v17.4c0 2.5-.9 4.5-2.5 6.2a8.2 8.2 0 0 1-6.1 2.6H48.7c-2.4 0-4.5-.9-6.1-2.6a8.5 8.5 0 0 1-2.5-6.2v-32a23 23 0 0 1 6.7-16.4A23.1 23.1 0 0 1 63 .6h2.9c.7 0 1.4.3 2 .8.6.6.8 1.3.8 2v5.9c0 .8-.2 1.5-.8 2-.6.6-1.3 1-2 1H63a11 11 0 0 0-8.1 3.3c-2.2 2.3-3.4 5-3.4 8.2v1.5c0 1.2.4 2.2 1.3 3 .8 1 1.8 1.4 3 1.4h10Z\" fill=\"url(#a)\"\/><defs><linearGradient id=\"a\" x1=\".2\" y1=\"32.6\" x2=\"74.5\" y2=\"32.6\" gradientUnits=\"userSpaceOnUse\"><stop stop-color=\"#45D6AD\"\/><stop offset=\".5\" stop-color=\"#5DB6E1\"\/><stop offset=\"1\" stop-color=\"#BC84CA\"\/><\/linearGradient><\/defs><\/svg>\n\t\t\t\t\t<p>Lack of understanding of data because it is too complex or not accessible enough and the lack of ability to generate insights from data are the two main barriers to unlocking more value from data.<\/p>\n\t\t\t\t<\/div>\n\t\t\t\t<small class=\"testimonial-block__footer\">\n\t\t\t\t\n\t\t\t\t\t<span class=\"testimonial-block__author\"><span class=\"author\"> <\/span> <span class=\"testimonial-block__position\">2023 Untapped Data Research by Salesforce <\/span><\/span>\n\t\t\t\t<\/small>\n\t\t\t<\/blockquote>\n\t\t<\/section>\n<p>Unlike humans, LLMs are great at transforming mathematical formulas and endless rows of numbers into easily digestible text summaries. Instead of staring at yet another bar chart, comparing numbers in Excel, or writing complex SQL queries to analyze data from an ERP system, your sales team can just ask an <a href=\"https:\/\/intellias.com\/deploy-llm-chatbot-with-rag\/\">LLM chatbot with RAG<\/a> to generate a report for sales product X or calculate the average customer <em>lifetime value for all users acquired since January 2020<\/em>.<\/p>\n<p>And that\u2019s exactly what many companies already do. <a href=\"https:\/\/www.findly.ai\/\" target=\"_blank\" rel=\"noopener\">Findly<\/a> has created a GenAI assistant for interpreting Google 4 analytics data. Instead of fiddling with filters, users can write a quick message in Slack and Findly will look at anything from the latest traffic stats to the most important user acquisition metrics, broken down by language. <a href=\"https:\/\/www.salesforce.com\/products\/einstein\/overview\/?d=cta-body-promo-8\" target=\"_blank\" rel=\"noopener\">Einstein GPT<\/a> from Salesforce lets users interact with CRM data using natural language.<\/p>\n<p>Effectively, a fine-tuned LLM for data analytics tasks can act as a tireless on-demand business analyst for your sales team, supplying them with insights on new trends in customer spending, average order values, sales volumes for different product groups, active discount policies, and anything else that can be gleaned from the available data.<\/p>\n<h3>Market intelligence<\/h3>\n<p>Apart from delivering hyper-granular insights, LLMs also help companies make better sense of wider market trends. For example, they can help with tasks such as identifying trends, detecting regulatory changes, analyzing product portfolios, and benchmarking competitors. For such broad analysis, <a href=\"https:\/\/intellias.com\/machine-learning-artificial-intelligence-development-services\/\">AI teams<\/a> often rely on graph databases.<\/p>\n<p><strong>Graph databases<\/strong> record data as a spoke network of relationships (sets of interconnected data points, or ordered pairs). An ordered pair has two parts: vertices (nodes) and edges (links). A graph can contain any number of such ordered pairs to represent complex semantic relationships in data.<\/p>\n<p>Graph databases help organize information in a refined format, allowing for more relevant and granular search results, similar to vector databases. Using word embeddings in vector databases may result in precise answers, but the model may lose global context.<\/p>\n<p>In a graph database, nodes represent word concepts, and edges represent the relationships between them.<\/p>\n<p>For example, when asked about the top business competitors, an LLM could give solid data on each competitor individually but fail to benchmark competitors against each other. Because graph structures capture relationships in data, they help models generate more nuanced answers that factor in different variables. Graph databases also support faster data querying, as it is easier for computing systems to traverse relationship graphs and operationalize different vector combinations.<\/p>\n<p>Knowledge graphs also help algorithms discover new relationships in data, which enables advanced predictive analytics scenarios. Take it from the <a href=\"https:\/\/www.lseg.com\/en\/\" target=\"_blank\" rel=\"noopener\">London Stock Exchange Group (LSEG)<\/a>, a global provider of financial market intelligence. The company boasts a host of advanced products for quantitative analytics, financial modeling, yield analysis, and mutual performance data analytics.<\/p>\n<p>One of their key products, the <strong>StarMine Mergers and Acquisition Target Model (M&amp;A Target)<\/strong>, predicts the likelihood of public company acquisitions using a combination of machine learning techniques and natural language processing (NLP). <a href=\"https:\/\/www.risk.net\/insight\/technology-and-data\/7958507\/leading-edge-llm-approaches-predictive-analytics-for-ma-targets\" target=\"_blank\" rel=\"noopener\">LSEG\u2019s data science team<\/a> fine-tuned a BERT model using historical M&amp;A records from the Reuters News Archive (RNA) service to enable deeper market analysis.<\/p>\n<p>To ensure high accuracy, the team used techniques like named entity replacement to remove sensitive information from the training data (such as company names and locations). Doing so prevents the model from associating an offhand mention of a company with previous M&amp;A events, resulting in more accurate predictions. The team also applied other data pre-processing steps to properly map the relationships between data points and ensure high model accuracy in predicting M&amp;A targets.<\/p>\n<p>Effectively, StarMine\u2019s model can process both structured information (financial statements, corporate actions, deal information) and unstructured insights (news coverage). Then, it can synthesize the obtained data to make accurate financial predictions. LSEG believes this is a more advantageous approach than solely using fundamental data. Unstructured insights provide richer context and expanded coverage of data. Users can query LLM with text on M&amp;A targets for over 38,000 public companies globally and ask it to resurface specific data for analysis.<\/p>\n<h3>Sustainability reporting<\/h3>\n<p>Business leaders have a laudable commitment to <a href=\"https:\/\/intellias.com\/corporate-responsibility\/\">environmental, social, and governance (ESG) targets<\/a>. Almost every investor report these days bears a mention of planned carbon footprint reduction or a greater degree of inclusion in the workplace. <a href=\"https:\/\/finance.ec.europa.eu\/capital-markets-union-and-financial-markets\/company-reporting-and-auditing\/company-reporting\/corporate-sustainability-reporting_en\" target=\"_blank\" rel=\"noopener\">Regulations in the EU<\/a>, the <a href=\"https:\/\/www.gov.uk\/guidance\/uk-sustainability-disclosure-standards\" target=\"_blank\" rel=\"noopener\">UK<\/a>, and a <a href=\"https:\/\/blog.worldfavor.com\/countries-affected-by-mandatory-esg-reporting-here-is-the-list\" target=\"_blank\" rel=\"noopener\">number of other countries and regions<\/a> have made ESG disclosure mandatory for many publicly traded companies.<\/p>\n<p>However, the regulatory landscape is highly fragmented, with multiple reporting frameworks. Unsurprisingly, <a href=\"https:\/\/www.finchandbeak.com\/1748\/state-esg-2023-where-play-and-how-win.htm\" target=\"_blank\" rel=\"noopener\">75% of ESG teams name data collection as the key challenge<\/a> for implementing their sustainability strategy. The absence of standardization in ESG reporting forces teams to spend more time on compliance instead of advancing with planned initiatives.<\/p>\n<p>A lot of ESG insights are buried in unstructured data sources, and that\u2019s yet another great use case for combining LLMs and business analytics tools. <a href=\"https:\/\/www.briink.com\/\" target=\"_blank\" rel=\"noopener\">Briink<\/a> has created a product to facilitate data extraction with LLMs. Fine-tuned on a proprietary dataset, Briink&#8217;s generative AI assistant can auto-fill ESG questionnaire data using information obtained from company documents. It also provides source references for human workers to cross-check automatically reported information. Additionally, the model can analyze submitted documents (such as current vendor agreements) for gaps in compliance. For example, it can ensure that the current corporate policy aligns with the <a href=\"https:\/\/intellias.com\/pay-transparency\/\">EU Pay Transparency Directive<\/a>.<\/p>\n<p>A <a href=\"https:\/\/arxiv.org\/abs\/2312.17264\" target=\"_blank\" rel=\"noopener\">group of Chinese researchers<\/a> has proposed an effective framework for extracting ESG data from corporate reports using retrieval augmented generation (RAG) techniques. The team tested the fine-tuned version of the GPT-4 model on a dataset of ESG reports from 166 companies listed on the Hong Kong Stock Exchange, achieving an accuracy rate of 76.9% in data extraction and 83.7% in disclosure analysis, which was above that of previous reference models.<\/p>\n<div><a href=\"https:\/\/intellias.com\/deploy-llm-chatbot-with-rag\/\" class=\"cta-wrap \">\n                    <div class=\"left-col\">\n                        <p class=\"cta-title\">For more on the advantages of using RAG for business data processing with LLMs, read our previous post<\/p>\n                        <div class=\"cta-block__content\">\n                            <div class=\"description\"><\/div>\n                        <\/div>\n                    <\/div>\n                     <span class=\"btn-filled\">Learn more<\/span>\n\t\t        <\/a><\/div>\n<h3>Due diligence<\/h3>\n<p>Similar to ESG disclosures, due diligence requires multi-dimensional analysis of textual, visual, and numerical data. Traditionally, M&amp;A teams need to go through many (sometimes physical) folders of documents, containing all sorts of financial reports and statements. But given current economic uncertainty, relying on historical financial insights isn\u2019t enough. Increased scrutiny from regulators, governments, and investors has led to a <a href=\"https:\/\/www.gartner.com\/en\/newsroom\/press-releases\/2018-10-15-gartner-says-the-average-time-to-close-an-manda-deal-has-risen-more-than-30-percent-in-the-last-decade\" target=\"_blank\" rel=\"noopener\">30% increase<\/a> in the average time for closing an M&amp;A lead over the past decade.<\/p>\n<p><a href=\"https:\/\/www2.deloitte.com\/us\/en\/pages\/mergers-and-acquisitions\/articles\/m-a-trends-report.html\" target=\"_blank\" rel=\"noopener\">According to Deloitte<\/a>, in 2024, 79% of corporate leaders and 86% of private equity leaders expect an increase in deal volume over the next 12 months, which means even more work for supporting teams. These teams are also increasingly focused on accurate deal valuation, and that\u2019s a great task for LLMs.<\/p>\n<p><a href=\"https:\/\/www.deepsearchlabs.com\/\" target=\"_blank\" rel=\"noopener\">DeepSearch Labs<\/a> specializes in custom LLMs for business insights. The company has developed proprietary search engine technology, powered by knowledge graphs, that can be fine-tuned for different use cases including asset valuations. Through a conversational interface, users can obtain data on major market trends, sub-trends, and outliers in the analyzed dataset. One current user claims that DeepSearch Lab delivered the same level of due diligence insights on a recent valuation target as hired consultants, but for a fraction of the cost.<\/p>\n<p>Thomson Reuters recently launched an AI-powered <a href=\"https:\/\/legal.thomsonreuters.com\/en\/products\/document-intelligence\/features\" target=\"_blank\" rel=\"noopener\">Document Intelligence<\/a> platform, which can come in handy at later deal stages. The company says its legal staff spent over 15,000 hours providing feedback and fine-tuning the model to ensure its top performance. The platform enables legal teams to automatically locate important contractual information (indemnities, special clauses, etc.) and analyze their meaning, intent, and context to ensure that nothing important gets overlooked.<\/p>\n<h3>Fraud investigation<\/h3>\n<p><a href=\"https:\/\/www.ukfinance.org.uk\/news-and-insight\/press-release\/over-ps12-billion-stolen-through-fraud-in-2022-nearly-80-cent-app\" target=\"_blank\" rel=\"noopener\">In the UK alone, over \u00a31.2 billion was lost to fraud in 2023<\/a>, with 80% of fraud cases beginning online. Although process digitization eliminated a good degree of simple financial fraud cases, cyber criminals have gotten better at covering their tracks and engineering more elaborate attacks.<\/p>\n<p>Anti-fraud and cybersecurity teams, in turn, feel pressured by the mounting volume of work while also being severely understaffed. <a href=\"https:\/\/www.gartner.com\/en\/newsroom\/press-releases\/2023-02-22-gartner-predicts-nearly-half-of-cybersecurity-leaders-will-change-jobs-by-2025\" target=\"_blank\" rel=\"noopener\">Gartner<\/a> expects that by 2025, half of significant cyber incidents will happen because of talent shortages.<\/p>\n<p>Although AI cannot fully replace human analysts, it can make teams more productive by removing menial tasks. Lucinity has created an <a href=\"https:\/\/lucinity.com\/luci\" target=\"_blank\" rel=\"noopener\">AI copilot<\/a> called Luci for fraud case investigation. Using transnational data from connected sources, Luci helps analysts investigate suspected fraud by providing a quick summary of a detected incident. Instead of opening multiple tabs, an analyst can get all the data they need to run a check right in Luci. Apart from analyzing transactional data and security signals, Luci can also scan corporate reports and multimedia files to discover extra insights for the team (for example, recent trading activity with a sanctioned entity).<\/p>\n<p>SymphonyAI has a similar <a href=\"https:\/\/www.symphonyai.com\/financial-services\/sensa-copilot\/\" target=\"_blank\" rel=\"noopener\">GenAI assistant<\/a> that can be used for a broader range of tasks, from KYC and CDD to AML investigations. Powered by Microsoft Azure OpenAI Service, the assistant can collect, collate, and summarize different data signals associated with fraudulent behavior. Users can slice and dice available data using a natural language interface to confirm their suspicions, request a summary of key risk factors for any monitored business, and automatically generate suspicious activity reports (SARs). SymphonyAI expects that the integration of LLMs into fraud investigation workflows will result in <a href=\"https:\/\/customers.microsoft.com\/en-us\/story\/6caaa857-9890-474f-b216-f9120361ba4b?preview=1\" target=\"_blank\" rel=\"noopener\">60% less time and 70% less effort<\/a> on the part of human investigators.<\/p>\n<h2>Looking ahead at the potential of LLMs and data analytics<\/h2>\n<p>While 2023 was the year of large foundation models, 2024 will be the year of smaller domain-specific LLMs, fine-tuned to address specific business problems. These fine-tuned LLMs might perform highly contextual sentiment analysis or provide data-driven instructions for fraud analysis. When asked in September 2023, 62% of machine learning teams said they <a href=\"https:\/\/arize.com\/blog\/llm-survey\/\" target=\"_blank\" rel=\"noopener\">plan to have an LLM-based application in production within a year<\/a>.<\/p>\n<p>While general-purpose LLMs have proven to be a security and privacy nuisance, custom fine-tuned models can be trained in a more isolated environment. They can operationalize a large volume of proprietary, non-public, and regulated data using different privacy-preserving techniques. In other words, they are paving the way for obtaining more business insights with LLMs.<\/p>\n<p>At the same time, fine-tuned domain-specific models can become a separate product line for your business. In the same way that banks and FinTech companies started to rent out core banking systems as a service, we are already seeing larger companies (Amazon, Microsoft, IBM) distributing API-based access to open-source foundation models. More players with domain-specific offerings are already in the market, and more are likely to emerge in the next several years. The potential of combining LLMs and data analytics is still largely untapped, and the field is ripe for innovation.<\/p>\n<h4>Your AI journey starts with Intellias<\/h4>\n<p>As a leading consultancy firm with AI at its core, Intellias invites businesses to embark on their AI transformation journey. Our end-to-end solutions, tailored to meet the unique needs of each partner, guarantee not just technological advancement but also a strategic edge in the marketplace. <a href=\"https:\/\/intellias.com\/contact\/\">Contact us<\/a> today to unlock the full potential of AI and data analytics for your business.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>Learn how domain-specific LLMs help build a data-driven culture  <\/p>\n","protected":false},"author":18,"featured_media":72517,"template":"","class_list":["post-72510","blog","type-blog","status-publish","has-post-thumbnail","hentry","blog-category-machine-learning-ai","blog-category-data-analytics","blog-category-technology"],"acf":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO Premium plugin v22.4 (Yoast SEO v23.2) - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\n<title>LLMs with Data Analytics: Uncover Hidden Business Value - Intellias<\/title>\n<meta name=\"description\" content=\"By combining fine-tuned LLMs and business data, leaders can reduce the speed, cost, and complexity of obtaining insights for operational decision-making.\" \/>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"The Rise of Domain-Specific LLMs for Data Analytics\" \/>\n<meta property=\"og:description\" content=\"By combining fine-tuned LLMs and business data, leaders can reduce the speed, cost, and complexity of obtaining insights for operational decision-making.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/\" \/>\n<meta property=\"og:site_name\" content=\"Intellias\" \/>\n<meta property=\"article:modified_time\" content=\"2024-07-29T10:28:24+00:00\" \/>\n<meta property=\"og:image\" content=\"https:\/\/d17ocfn2f5o4rl.cloudfront.net\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-fb_lin_tw.jpg\" \/>\n\t<meta property=\"og:image:width\" content=\"1200\" \/>\n\t<meta property=\"og:image:height\" content=\"628\" \/>\n\t<meta property=\"og:image:type\" content=\"image\/jpeg\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data1\" content=\"15 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/\",\"url\":\"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/\",\"name\":\"LLMs with Data Analytics: Uncover Hidden Business Value - Intellias\",\"isPartOf\":{\"@id\":\"https:\/\/intellias.com\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/#primaryimage\"},\"image\":{\"@id\":\"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/#primaryimage\"},\"thumbnailUrl\":\"https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-wesite-header.jpg\",\"datePublished\":\"2024-04-12T06:48:56+00:00\",\"dateModified\":\"2024-07-29T10:28:24+00:00\",\"description\":\"By combining fine-tuned LLMs and business data, leaders can reduce the speed, cost, and complexity of obtaining insights for operational decision-making.\",\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/#primaryimage\",\"url\":\"https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-wesite-header.jpg\",\"contentUrl\":\"https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-wesite-header.jpg\",\"width\":1920,\"height\":600},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/intellias.com\/#website\",\"url\":\"https:\/\/intellias.com\/\",\"name\":\"Intellias\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/intellias.com\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/intellias.com\/#\/schema\/person\/49393ae6c76450b944348af909348651\",\"name\":\"Pavlyna-Mariana Ruzhytska\"}]}<\/script>\n<!-- \/ Yoast SEO Premium plugin. -->","yoast_head_json":{"title":"LLMs with Data Analytics: Uncover Hidden Business Value - Intellias","description":"By combining fine-tuned LLMs and business data, leaders can reduce the speed, cost, and complexity of obtaining insights for operational decision-making.","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/","og_locale":"en_US","og_type":"article","og_title":"The Rise of Domain-Specific LLMs for Data Analytics","og_description":"By combining fine-tuned LLMs and business data, leaders can reduce the speed, cost, and complexity of obtaining insights for operational decision-making.","og_url":"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/","og_site_name":"Intellias","article_modified_time":"2024-07-29T10:28:24+00:00","og_image":[{"width":1200,"height":628,"url":"https:\/\/d17ocfn2f5o4rl.cloudfront.net\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-fb_lin_tw.jpg","type":"image\/jpeg"}],"twitter_card":"summary_large_image","twitter_misc":{"Est. reading time":"15 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/","url":"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/","name":"LLMs with Data Analytics: Uncover Hidden Business Value - Intellias","isPartOf":{"@id":"https:\/\/intellias.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/#primaryimage"},"image":{"@id":"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/#primaryimage"},"thumbnailUrl":"https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-wesite-header.jpg","datePublished":"2024-04-12T06:48:56+00:00","dateModified":"2024-07-29T10:28:24+00:00","description":"By combining fine-tuned LLMs and business data, leaders can reduce the speed, cost, and complexity of obtaining insights for operational decision-making.","inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/intellias.com\/domain-specific-llms-for-data-analytics\/#primaryimage","url":"https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-wesite-header.jpg","contentUrl":"https:\/\/intellias.com\/wp-content\/uploads\/2024\/04\/BP-LLM-Chatbots-wesite-header.jpg","width":1920,"height":600},{"@type":"WebSite","@id":"https:\/\/intellias.com\/#website","url":"https:\/\/intellias.com\/","name":"Intellias","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/intellias.com\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/intellias.com\/#\/schema\/person\/49393ae6c76450b944348af909348651","name":"Pavlyna-Mariana Ruzhytska"}]}},"_links":{"self":[{"href":"https:\/\/intellias.com\/wp-json\/wp\/v2\/blog\/72510"}],"collection":[{"href":"https:\/\/intellias.com\/wp-json\/wp\/v2\/blog"}],"about":[{"href":"https:\/\/intellias.com\/wp-json\/wp\/v2\/types\/blog"}],"author":[{"embeddable":true,"href":"https:\/\/intellias.com\/wp-json\/wp\/v2\/users\/18"}],"version-history":[{"count":10,"href":"https:\/\/intellias.com\/wp-json\/wp\/v2\/blog\/72510\/revisions"}],"predecessor-version":[{"id":77627,"href":"https:\/\/intellias.com\/wp-json\/wp\/v2\/blog\/72510\/revisions\/77627"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/intellias.com\/wp-json\/wp\/v2\/media\/72517"}],"wp:attachment":[{"href":"https:\/\/intellias.com\/wp-json\/wp\/v2\/media?parent=72510"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}