Is solar Pro A good GPU?

Solar Pro provides a substantial leap in performance while maintaining the best performance among single-GPU models. Key highlights include: On the IFEval benchmark, a trusted measure of instruction-following capabilities, Solar Pro outperformed all the models designed for single GPUs across all three target languages.

Does solar Pro Preview perform better on a single GPU?

Our experimental findings indicate that among models that can be deployed on a single GPU, Solar Pro Preview shows superior performance in intelligence and instruction-following capabilities, as measured by MMLU-Pro and IFEval scores respectively.

Should I use a quantized version of solar pro?

To save costs, consider using the quantized version of Solar Pro which shows a performance degradation of less than 0.5%. The quantized Solar Pro requires two NVIDIA A10G GPUs, so an AWS ml.g5.12xlarge instance, which includes four A10G GPUs, can support two Solar Pro deployments simultaneously.

How many GPUs do I need for solar pro?

The quantized Solar Pro requires two NVIDIA A10G GPUs, so an AWS ml.g5.12xlarge instance, which includes four A10G GPUs, can support two Solar Pro deployments simultaneously. API from Upstage Console: If setting up your own infrastructure isn't preferable, access Solar Pro through the Upstage Console.

How do I access solar pro?

API from Upstage Console: If setting up your own infrastructure isn't preferable, access Solar Pro through the Upstage Console. This platform provides a user-friendly interface to interact with Solar Pro's capabilities, offering a pay-as-you-go model for flexibility.

How do I deploy solar pro?

Integrating Solar Pro into your operations is straightforward, with multiple deployment options to suit your needs: VPC deployment with AWS: Deploy Solar Pro on your AWS infrastructure via the newly released AWS Bedrock Marketplace or AWS Marketplace.