OSS Connector for AI/ML contains some high-performance Python libraries specifically designed for AI and ML scenariosis, tailored to work with Alibaba Cloud OSS (Object Storage Service).
Currently, the OSS connector is composed of two libraries: OSS Model Connector and OSS Torch Connector.
-
OSS Torch Connector is dedicated to AI training scenarios, including loading datasets from OSS and loading/saving checkpoints from/to OSS.
-
OSS Model Connector focuses on AI inference scenarios, loading large model files from OSS into local AI inference frameworks.
The core component of the OSS Connector for AI/ML is implemented in C++ using PhotonLibOS and is provided as dynamic link libraries within wheel packages. This repository only contains the code of Python.
For details, please refer to ossconnector.github.io or aliyun.github.io/oss-connector-for-ai-ml.
This project is licensed under the terms of the MIT License.