• Time: 16:28
• Type: Technical Presentation and Demo
• Speakers:
  • Lucy Park, Upstage
  • Siddharth Ghatti, Marsh McLennan
• Session Goal: Showcase Upstage's Solar LLMs and Document Parts technology in enterprise solutions

Solar LLM Family:

• Designed for workspace tasks and human-AI collaboration
• Optimized for finance, legal, and healthcare domains
• Two variants:
  • Solar Mini: Optimized for fine-tuning
  • Solar Pro: Single-GPU deployment focus

Document Parts Technology:

• Complex document conversion to structured formats
• Advanced table structure recognition
• Fast processing for lengthy documents
• Fact-checking module for hallucination reduction
• HTML/markdown output for LLM processing

System Components:

• Solar LLM models
• Document Parts processor
• Fact-checking module
• Tool routing system

Use Cases:

• Workspace intelligence
• Insurance claims processing
• Enterprise search
• Document analysis

Marsh McLennan Implementation:

• LaniI personal assistant
• Tool routing system
• 500,000 requests/week
• High accuracy in tool selection
• Integration with Predibase serverless

Performance Focus:

• Processing speed optimization
• Accuracy prioritization
• Hallucination reduction
• Document structure preservation

Technology Adoption:

• Workspace AI integration
• Task-specific fine-tuning
• Enhanced document processing
• Automated workflows

Business Benefits:

• Increased productivity
• Task automation
• Improved decision-making
• Enhanced document handling

The session demonstrated how combining Small Language Models with specialized document processing technology can create effective enterprise solutions, particularly highlighting the successful implementation at Marsh McLennan through the integration of Solar LLMs with Predibase's infrastructure.