Aviary - Revision history

BPeat: Text replacement - "* Conversational AI ... ChatGPT | OpenAI ... Bing | Microsoft ... Bard | Google ... Claude | Anthropic ... Perplexity ... You ... Ernie | Baidu" to "* Conversational AI ... [[C...

2024-03-16T15:56:47Z

BPeat at 13:47, 3 March 2024

2024-03-03T13:47:39Z

BPeat at 02:04, 3 September 2023

2023-09-03T02:04:25Z

BPeat at 01:23, 17 August 2023

2023-08-17T01:23:35Z

BPeat at 12:08, 5 July 2023

2023-07-05T12:08:57Z

BPeat at 09:52, 15 June 2023

2023-06-15T09:52:47Z

BPeat at 09:49, 15 June 2023

2023-06-15T09:49:25Z

BPeat at 02:31, 15 June 2023

2023-06-15T02:31:41Z

BPeat at 02:30, 15 June 2023

2023-06-15T02:30:47Z

BPeat at 02:25, 15 June 2023

2023-06-15T02:25:49Z

@@ Line 24: / Line 24: @@
 * [https://www.anyscale.com/blog/announcing-aviary-open-source-multi-llm-serving-solution Announcing Aviary: Open Source Multi-LLM Serving |] [https://www.anyscale.com/ Anyscale]
 * [[Large Language Model (LLM)]] ... [[Natural Language Processing (NLP)]] ... [[Natural Language Generation (NLG)|Generation]] ... [[Natural Language Classification (NLC)|Classification]] ... [[Natural Language Processing (NLP)#Natural Language Understanding (NLU)|Understanding]] ... [[Language Translation|Translation]] ... [[Natural Language Tools & Services|Tools & Services]]
-* [[Conversational AI]] ... [[ChatGPT]] | [[OpenAI]] ... [[Bing]] | [[Microsoft]] ... [[Bard]] | [[Google]] ... [[Claude]] | [[Anthropic]] ... [[Perplexity]] ... [[You]] ... [[Ernie]] | [[Baidu]]
+* [[Conversational AI]] ... [[ChatGPT]] | [[OpenAI]] ... [[Bing/Copilot]] | [[Microsoft]] ... [[Gemini]] | [[Google]] ... [[Claude]] | [[Anthropic]] ... [[Perplexity]] ... [[You]] ... [[phind]] ... [[Ernie]] | [[Baidu]]
 * [https://thenewstack.io/a-new-tool-for-the-open-source-llm-developer-stack-aviary/ A New Tool for the Open Source LLM Developer Stack: Aviary | Richard MacManus - The New Stack] ... An open source LLM stack is emerging, says Anyscale’s head of engineering. Along with Ray, LangChain and Hugging Face, we can now add Aviary.
 * [https://www.marketwatch.com/press-release/anyscale-launches-aviary-open-source-infrastructure-to-simplify-large-language-model-deployment-2023-05-31 Anyscale Launches Aviary: Open Source Infrastructure to ... - MarketWatch]

@@ Line 58: / Line 58: @@
 *Many Model Training: Many model training is common in ML use cases such as time series forecasting, which require fitting of models on multiple data batches corresponding to locations, products, etc. The focus is on training many models on subsets of a dataset. This is in contrast to training a single model on the entire dataset. When any given model you want to train can fit on a single GPU, Ray can assign each training run to a separate Ray Task.
-Ray provides a higher-level API for parallel and pipelined data processing, while internally handling data batching, task parallelism and pipelining, and memory management. Ray takes functions and classes and translates them to the distributed setting as tasks and actors. This allows developers to easily parallelize their workloads and take advantage of the distributed computing capabilities of Ray.
+Ray provides a higher-level API for parallel and pipelined data processing, while internally handling data batching, task parallelism and pipelining, and [[memory]] management. Ray takes functions and classes and translates them to the distributed setting as tasks and actors. This allows developers to easily parallelize their workloads and take advantage of the distributed computing capabilities of Ray.
 In Ray, an actor is a stateful worker that can be used to encapsulate state and methods. An actor is also a “Ray worker” but is instantiated at runtime (upon `actor_cls.remote()`). All of its methods will run on the same process, using the same resources (designated when defining the Actor). This allows developers to create distributed objects with methods that can be invoked remotely. Actors are useful for implementing distributed systems, such as parameter servers, simulators, and databases.

@@ Line 24: / Line 24: @@
 * [https://www.anyscale.com/blog/announcing-aviary-open-source-multi-llm-serving-solution Announcing Aviary: Open Source Multi-LLM Serving |] [https://www.anyscale.com/ Anyscale]
 * [[Large Language Model (LLM)]] ... [[Natural Language Processing (NLP)]] ... [[Natural Language Generation (NLG)|Generation]] ... [[Natural Language Classification (NLC)|Classification]] ... [[Natural Language Processing (NLP)#Natural Language Understanding (NLU)|Understanding]] ... [[Language Translation|Translation]] ... [[Natural Language Tools & Services|Tools & Services]]
 * [https://thenewstack.io/a-new-tool-for-the-open-source-llm-developer-stack-aviary/ A New Tool for the Open Source LLM Developer Stack: Aviary | Richard MacManus - The New Stack] ... An open source LLM stack is emerging, says Anyscale’s head of engineering. Along with Ray, LangChain and Hugging Face, we can now add Aviary.
 * [https://www.marketwatch.com/press-release/anyscale-launches-aviary-open-source-infrastructure-to-simplify-large-language-model-deployment-2023-05-31 Anyscale Launches Aviary: Open Source Infrastructure to ... - MarketWatch]

@@ Line 53: / Line 53: @@
 Ray has a wide range of use cases for scaling machine learning and Python workloads. Some common use cases include:
-*Large language models (LLMs) and generative AI: Ray provides a distributed compute framework for scaling these models, allowing developers to train and deploy models faster and more efficiently. With specialized libraries for data streaming, training, fine-tuning, hyperparameter tuning, and serving, Ray simplifies the process of developing and deploying large-scale AI models.
+*Large language models (LLMs) and generative AI: Ray provides a distributed compute framework for scaling these models, allowing developers to train and deploy models faster and more efficiently. With specialized libraries for data streaming, training, [[fine-tuning]], hyperparameter tuning, and serving, Ray simplifies the process of developing and deploying large-scale AI models.
 *Batch Inference: Ray can be used for batch inference, which is the process of generating model predictions on a large “batch” of input data. Ray for batch inference works with any cloud provider and ML framework, and is fast and cheap for modern deep learning applications. It scales from single machines to large clusters with minimal code changes.
 *Many Model Training: Many model training is common in ML use cases such as time series forecasting, which require fitting of models on multiple data batches corresponding to locations, products, etc. The focus is on training many models on subsets of a dataset. This is in contrast to training a single model on the entire dataset. When any given model you want to train can fit on a single GPU, Ray can assign each training run to a separate Ray Task.

@@ Line 2: / Line 2: @@
 |title=PRIMO.ai
 |titlemode=append
-|keywords=artificial, intelligence, machine, learning, models, algorithms, data, singularity, moonshot, TensorFlow, Facebook, Google, Nvidia, Microsoft, Azure, Amazon, AWS
+|keywords=ChatGPT, artificial, intelligence, machine, learning, GPT-4, GPT-5, NLP, NLG, NLC, NLU, models, data, singularity, moonshot, Sentience, AGI, Emergence, Moonshot, Explainable, TensorFlow, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Hugging Face, OpenAI, Tensorflow, OpenAI, Google, Nvidia, Microsoft, Azure, Amazon, AWS, Meta, LLM, metaverse, assistants, agents, digital twin, IoT, Transhumanism, Immersive Reality, Generative AI, Conversational AI, Perplexity, Bing, You, Bard, Ernie, prompt Engineering LangChain, Video/Image, Vision, End-to-End Speech, Synthesize Speech, Speech Recognition, Stanford, MIT |description=Helpful resources for your journey with artificial intelligence; videos, articles, techniques, courses, profiles, and tools
-|description=Helpful resources for your journey with artificial intelligence; Attention, GPT, chat, videos, articles, techniques, courses, profiles, and tools
 }}
 [https://www.youtube.com/results?search_query=Aviary+Anyscale+Large+Language+Model+LLM YouTube]

@@ Line 16: / Line 16: @@
 * [[Large Language Model (LLM)]] ... [[Natural Language Processing (NLP)]] ... [[Natural Language Generation (NLG)|Generation]] ... [[Natural Language Classification (NLC)|Classification]] ... [[Natural Language Processing (NLP)#Natural Language Understanding (NLU)|Understanding]] ... [[Language Translation|Translation]] ... [[Natural Language Tools & Services|Tools & Services]]
 * [https://thenewstack.io/a-new-tool-for-the-open-source-llm-developer-stack-aviary/ A New Tool for the Open Source LLM Developer Stack: Aviary | Richard MacManus - The New Stack] ... An open source LLM stack is emerging, says Anyscale’s head of engineering. Along with Ray, LangChain and Hugging Face, we can now add Aviary.
-Aviary is a new open-source project launched by Anyscale, the AI infrastructure company built by the creators of Ray. It is designed to help developers simplify the process of choosing and integrating the best open-source large language models (LLMs) into their applications. Aviary is the first fully free, cloud-based infrastructure designed to help developers choose and deploy the right technologies and approach for their LLM-based applications. It includes libraries, tooling, examples, documentation, and sample code—all available in open source and readily adaptable for small experiments or large evaluations. Aviary provides an extensive suite of pre-configured open-source LLMs, with reasonable defaults that work out of the box. It includes libraries, tooling, examples, documentation, and sample code—all available in open source and readily adaptable for small experiments or large evaluations. Aviary is a new open-source project launched by Anyscale, the AI infrastructure company built by the creators of Ray. It is designed to help developers simplify the process of choosing and integrating the best open-source large language models (LLMs) into their applications. Aviary is built on top of Ray Serve, Anyscale’s popular open-source offering for serving and scaling AI applications, including LLMs. Aviary provides an extensive suite of pre-configured open-source LLMs, with reasonable defaults that work out of the box. It also aims to help solve the challenge of model selection. With the growing number of models, it’s not easy for anyone to know the best model for a specific use case. By making it easier to deploy open-source LLMs, Aviary is also making it easier for organizations to compare different LLMs. The comparisons enabled via Aviary include accuracy, latency and cost. The goal of Aviary is to enable developers to identify the best open source platform to fine-tune and scale an LLM application. Developers can submit test prompts to a pre-selected set of LLMs, including Llama, CarperAI, Dolly 2.0, Vicuna, StabilityAI, and Amazon’s LightGPT.
+Aviary is a new open-source project launched by Anyscale, the AI infrastructure company built by the creators of Ray. It is designed to help developers simplify the process of choosing and integrating the best open-source large language models (LLMs) into their applications. Aviary is built on top of Ray Serve, Anyscale’s popular open-source offering for serving and scaling AI applications, including LLMs. Aviary provides an extensive suite of pre-configured open-source LLMs, with reasonable defaults that work out of the box. It also aims to help solve the challenge of model selection. With the growing number of models, it’s not easy for anyone to know the best model for a specific use case. By making it easier to deploy open-source LLMs, Aviary is also making it easier for organizations to compare different LLMs. The comparisons enabled via Aviary include accuracy, latency and cost. The goal of Aviary is to enable developers to identify the best open source platform to fine-tune and scale an LLM application. Developers can submit test prompts to a pre-selected set of LLMs, including Llama, CarperAI, Dolly 2.0, Vicuna, StabilityAI, and Amazon’s LightGPT.
 <youtube>WmqPfQOXJ-4</youtube>

@@ Line 11: / Line 11: @@
 [https://www.bing.com/news/search?q=Aviary+Anyscale+Large+Language+Model+LLM&qft=interval%3d%228%22 ...Bing News]
 * [[Large Language Model (LLM)]] ... [[Natural Language Processing (NLP)]] ... [[Natural Language Generation (NLG)|Generation]] ... [[Natural Language Classification (NLC)|Classification]] ... [[Natural Language Processing (NLP)#Natural Language Understanding (NLU)|Understanding]] ... [[Language Translation|Translation]] ... [[Natural Language Tools & Services|Tools & Services]]
 * [https://thenewstack.io/a-new-tool-for-the-open-source-llm-developer-stack-aviary/ A New Tool for the Open Source LLM Developer Stack: Aviary | Richard MacManus - The New Stack] ... An open source LLM stack is emerging, says Anyscale’s head of engineering. Along with Ray, LangChain and Hugging Face, we can now add Aviary.
-* [https://www.anyscale.com/ Anyscale]
-* [https://www.anyscale.com/large-language-models Develop and Deploy Large Language Models | Aviary from Anyscale]
 * [https://www.marketwatch.com/press-release/anyscale-launches-aviary-open-source-infrastructure-to-simplify-large-language-model-deployment-2023-05-31 Anyscale Launches Aviary: Open Source Infrastructure to ... - MarketWatch]

@@ Line 21: / Line 21: @@
 The goal of Aviary is to enable developers to identify the best open source platform to fine-tune and scale an LLM application. Developers can submit test prompts to a pre-selected set of LLMs, including Llama, CarperAI, Dolly 2.0, Vicuna, StabilityAI, and Amazon’s LightGPT.
 = Aviary Explorer =
 * [https://aviary.anyscale.com Aviary Explorer | Anyscale]
-Aviary Explorer is a tool provided by Anyscale that allows developers to submit one prompt to multiple LLMs and evaluate the quality of responses¹. It is an interactive front-end that helps developers review and assess the performance and compute costs of different LLMs². Aviary Explorer is built on Ray Serve, Anyscale's popular open-source offering for serving and scaling AI applications, including LLMs³.
+Aviary Explorer is a tool provided by Anyscale that allows developers to submit one prompt to multiple LLMs and evaluate the quality of responses. It is an interactive front-end that helps developers review and assess the performance and compute costs of different LLMs. Aviary Explorer is built on Ray Serve, Anyscale's popular open-source offering for serving and scaling AI applications, including LLMs.
 = Ray =
@@ Line 44: / Line 46: @@
 Placement groups allow users to atomically reserve groups of resources across multiple nodes (i.e., gang scheduling). They can be then used to schedule Ray tasks and actors packed as close as possible for locality (PACK), or spread apart (SPREAD). Placement groups are generally used for gang-scheduling actors, but also support tasks.

← Older revision		Revision as of 02:25, 15 June 2023
Line 26:		Line 26:
	Aviary Explorer is a tool provided by Anyscale that allows developers to submit one prompt to multiple LLMs and evaluate the quality of responses¹. It is an interactive front-end that helps developers review and assess the performance and compute costs of different LLMs². Aviary Explorer is built on Ray Serve, Anyscale's popular open-source offering for serving and scaling AI applications, including LLMs³.		Aviary Explorer is a tool provided by Anyscale that allows developers to submit one prompt to multiple LLMs and evaluate the quality of responses¹. It is an interactive front-end that helps developers review and assess the performance and compute costs of different LLMs². Aviary Explorer is built on Ray Serve, Anyscale's popular open-source offering for serving and scaling AI applications, including LLMs³.

		+	<youtube>WmqPfQOXJ-4</youtube>
	<youtube>tSj0Z2Bo1JA</youtube>		<youtube>tSj0Z2Bo1JA</youtube>