There are additional security issue arise due to GenAI e.g.
GenAI/LLMs can learn from prompts. It store prompts and use it for training dataset.
With that data in the system, it is possible that if someone enters the right prompt, the LLM could potentially use your company’s data in response to a query.
And if the information you entered contains sensitive files or data such as intellectual property or know-how, financial reports, confidential internal documents, or sales numbers, it could become part of the third-party AI model and potentially available to others, creating privacy, intellectual property, and security risks if the appropriate guardrails are not in place.
Each companny have policies. There need to be set of tools and solution to detect GenAI activity that deviate from policies or best practices.
One should be able to detect anomalies