Large Language Model

Oracle Cloud Infrastructure (OCI) provides fully managed infrastructure to work with Large Language Model (LLM).

Train and Deploy LLM

You can train LLM at scale with multi-node and multi-GPU using Data Science Jobs (Jobs), and deploy it with Data Science Model Deployment (Model Deployments). The following blog posts show examples training and deploying Llama2 models:

Integration with LangChain

ADS is designed to work with LangChain, enabling developers to incorporate various LangChain components and models deployed on OCI seamlessly into their applications. Additionally, ADS can package LangChain applications and deploy it as a REST API endpoint using OCI Data Science Model Deployment.

Installation

Install ADS and other dependencies for LLM integrations.

$ python3 -m pip install "oracle-ads[llm]"