GenAI
In a rapidly evolving digital era, businesses are under increasing pressure to innovate and adapt quickly. Pegasystems, a recognized business in low-code platforms, is at the forefront of this transformation, empowering clients to build applications with greater speed and efficiency. By seamlessly integrating generative AI into its platform, Pegasystems has taken the development experience to the next level, making application creation not just simpler but also smarter.
- Categories:
6 Views
The benchmarking dataset, GenAI on the Edge, contains performance metrics from evaluating Large Language Models (LLMs) on edge devices, utilizing a distributed testbed of Raspberry Pi devices orchestrated by Kubernetes (K3s). It includes performance data collected from multiple runs of prompt-based evaluations with various LLMs, leveraging Prometheus and the Llama.cpp framework. The dataset captures key metrics such as resource utilization, token generation rates/throughput, and detailed inference timing for stages such as Sample, Prefill, and Decode.
- Categories:
182 Views