Large Language Model

Oracle Cloud Infrastructure (OCI) Data Science is a fully managed, serverless platform that empowers data science teams to build, train, and manage machine learning models on Oracle Cloud Infrastructure.

The platform features AI Quick Actions, which enable you to deploy, evaluate, and fine-tune foundation models directly within OCI Data Science. Designed for users eager to quickly harness AI capabilities, these actions provide a streamlined, code-free, and efficient environment for working with foundation models. You can access AI Quick Actions directly from the Data Science Notebook.

Detailed documentation on deploying LLM models in OCI Data Science using AI Quick Actions is available here and here.

This section provides comprehensive information on integrating OCI with LangChain, Autogen, LlamaIndex, and other third-party LLM frameworks.

• AI Quick Actions HTTP Client
  • Authentication
  • Usage
  • HTTPX Client Integration with OCI Authentication
  • Aqua OpenAI Client
• Training Large Language Model
  • Access the Pre-Trained Model
  • Fine-Tuning the Model
• LangChain Integration
  • Authentication
  • Completion Models
  • Chat Models
  • Embedding Models
  • Tool Calling
• AutoGen Integration
  • Custom Client Registration
  • LLM Config
  • Logging And Reporting
• LlamaIndex Integration
  • Authentication
  • Basic Usage
  • Streaming
  • Async
  • Async Streaming
  • Configure Model
  • Function Calling
• Deploy LLM Applications and Agents
  • Prepare Model Artifacts
  • Register the Model Artifact
  • Build Container Image
  • Deploy as Model Deployment
  • Invoking the Deployment
• Integration with OCI Generative AI and OpenSearch
  • OCI Generative Embedding
  • Retrieval QA with OpenSearch
  • Retrieval QA with FAISS
  • Deployment of Retrieval QA
• Guardrails
  • HuggingFace Measurement as Guardrail
  • Using Guardrail with LangChain
  • Guardrail Sequence