.. _large_language_model: #################### Large Language Model #################### Oracle Cloud Infrastructure (OCI) provides fully managed infrastructure to work with Large Language Model (LLM). Train and Deploy LLM ******************** You can train LLM at scale with multi-node and multi-GPU using `Data Science Jobs (Jobs) `_, and deploy it with `Data Science Model Deployment (Model Deployments) `_. The following blog posts show examples training and deploying Llama2 models: * `Multi-GPU multinode fine-tuning Llama2 on OCI Data Science `_ * `Deploy Llama 2 in OCI Data Science `_ * `Quantize and deploy Llama 2 70B on cost-effective NVIDIA A10 Tensor Core GPUs in OCI Data Science `_ Integration with LangChain ************************** ADS is designed to work with LangChain, enabling developers to incorporate various LangChain components and models deployed on OCI seamlessly into their applications. Additionally, ADS can package LangChain applications and deploy it as a REST API endpoint using OCI Data Science Model Deployment. * `Bridging cloud and conversational AI: LangChain and OCI Data Science platform `_ * `Deploy LangChain applications as OCI model deployments `_ .. admonition:: Installation :class: note Install ADS and other dependencies for LLM integrations. .. code-block:: bash $ python3 -m pip install "oracle-ads[llm]" .. toctree:: :maxdepth: 2 training_llm langchain_models autogen_integration deploy_langchain_application retrieval guardrails