agiresearch / aios Goto Github PK

This document outlines the steps in the AIOS roadmap for refactoring the LLM structure. Feel free to discuss any of the following topics, and add any other topics you'd like to talk about in this issue.

Kernel

• Set up base LLM router with customizable features
• Create task-specific routers
  • Cost Router
  • Complexity Router
  • Efficiency Router

Agents

• Connect agent workflow to router to allow for automatic agent creation

Hi everyone. I am having an issue with GPU memory on a Windows machine when I try to run the code from the terminal of vscode. Tried directly copying the command, and also tried other values, seems nothing is working. What might be the problem?

Currently, main.py does not allow users to interact with agents to perform tasks. The task list is outlined below:

Phase 0: author quick documentation on current agents so that users know what each agent can do. have all agents and descriptions displayed with a ls command

Phase 1: add the ability for the user to send a query to a specific agent using "@" like in a chat app

Phase 2: add an "agent recommender" that a user can "@" with a task, then return the best agent for the job

Phase 3: fully automate the workflow. A user will type their instruction into a box and the recommender will talk to the best agent for the job to finish the task without user intervention

The far future: GUI (Qt??)

TODO:

• code base review with @BRama10
• start writing agent descriptions and ls
• start prototyping phase 1
• read further into recommendation engines

Hi,

I tried to run the demo in the README file but got an exception.

The command and output are:

python main.py --llm_name gemma-2b-it --max_gpu_memory '{"0": "24GB"}' --eval_device "cuda:0" --max_new_tokens 256
Traceback (most recent call last):
File "/root/autodl-tmp/AIOS/main.py", line 21, in
from src.agents.agent_factory import AgentFactory
File "/root/autodl-tmp/AIOS/src/agents/agent_factory.py", line 14, in
from pympler import asizeof
ModuleNotFoundError: No module named 'pympler'

Does it mean the file pympler.py is not included in the released code now?

Hi,
Very interesting work, I do like the idea a lot and see a huge potential in this becoming defacto way of dealing with LLM agents.

I would like to know how would you compare yourself with other opensource frameworks for multi agent collaboration like LangGraph, Autogen, CrewAI etc. Do you see a path forward where you would have them integrated into your kernel or even the app layer? And specifically how do you see LangGraph's finite state machines approach being integrated into this OS?

论文里面有一个表列出了sdk几个接口，但是没有在代码仓里面看到？后续是否有开源计划？

This document outlines the features in the AIOS roadmap for Q2 2024. Please feel free to discuss and contribute to the specific features through related Issues or PRs, and add any other topics you'd like to talk about in this issue.

Device Support & LLM inference acceleration integration

• ollama support: #108
• vllm support on GPU

Agent configuration

• move agent creation logic from AIOS to OpenAGI
• enable tool callings
  • chatgpt-based tool calling
    agiresearch/OpenAGI#50
    #116
  • open-sourced llm tool calling
• add an agent (travel agent) with more tool callings
• add a RAG agent
  • add a RAG agent from scratch, @scottyaohk
  • add a llamaindex -based RAG agent, @zzfoo
  • add a langchain -based RAG agent, @BRama10
  • add a langgraph -based RAG agent
• add a ReAct agent
• add an agent with self planning and code interpretation for action execution

More & better documentation

• add evaluation script and add agent-level and request-level evaluation metrics
  • #93
  • #96
  • #100
• improve documentation and environment set up
  • #97
  • #98
  • #99
• add more benchmarks
• update the architecture diagram of AIOS

Better demo

• restructure demo output
• add visualize.py script to visualize agent task execution

Streaming output

• change to streaming output
• enable the context switch and interrupt for closed-source llm

Testing

• modify unit test
  • agiresearch/OpenAGI#48
  • #113
• add integration test
• add github workflow

Package & Documentation

• release OpenAGI and AIOS Python packages
• add documentation for OpenAGI and AIOS
• add video tutorials for developers

Integration of the LLM Kernel into the OS Kernel (Om Raheja)

• using the OpenBSD kernel or FreeBSD kernel as the OS kernel
• create new abstraction in OS kernel for integrating LLMs
• translation to C/C++ or Mojo language of LLM kernel implementation

when run

python main.py --llm_name gemma-2b-it

the ERROR occurs

ImportError: cannot import name 'thread_pool' from 'src.utils.global_param'

I love the idea!!!

But... how could an LLM-based OS become reality in the light of non-determinism & hallucination?

Dear authors,

After reading the code, I had a question that I did not undersatnd clearly.

I note that you used the concurrent.futures module to implement the FIFO schedule. Then, each thread is the execution of agent.run function. Since you define all the necessary actions to finish an agent's task in the run function (e.g., the travel agent

I would greatly appreciate it if you could help me.
Thanks in advance.

Initialize AIOS powered by LLM: mixtral-8x7b-it
2024-03-29 18:52:03,062 - DEBUG - Starting new HTTPS connection (1): huggingface.co:443
2024-03-29 18:52:03,205 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json HTTP/1.1" 200 0
2024-03-29 18:52:03,206 - DEBUG - Attempting to acquire lock 5751387536 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock
2024-03-29 18:52:03,206 - DEBUG - Lock 5751387536 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock
2024-03-29 18:52:03,300 - DEBUG - https://huggingface.co:443 "GET /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/config.json HTTP/1.1" 200 720
config.json: 100%|████████████████████████████████████████████████████████████████████████| 720/720 [00:00<00:00, 676kB/s]
2024-03-29 18:52:03,327 - DEBUG - Attempting to release lock 5751387536 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock
2024-03-29 18:52:03,327 - DEBUG - Lock 5751387536 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/de132a80b25c9d12c674dbd84cedc1d6f35fb756.lock
2024-03-29 18:52:03,935 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model.safetensors HTTP/1.1" 404 0
2024-03-29 18:52:04,021 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model.safetensors.index.json HTTP/1.1" 200 0
2024-03-29 18:52:04,024 - DEBUG - Attempting to acquire lock 6052548688 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock
2024-03-29 18:52:04,025 - DEBUG - Lock 6052548688 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock
2024-03-29 18:52:04,124 - DEBUG - https://huggingface.co:443 "GET /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model.safetensors.index.json HTTP/1.1" 200 92658
model.safetensors.index.json: 100%|██████████████████████████████████████████████████| 92.7k/92.7k [00:00<00:00, 2.68MB/s]
2024-03-29 18:52:04,164 - DEBUG - Attempting to release lock 6052548688 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock
2024-03-29 18:52:04,165 - DEBUG - Lock 6052548688 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/fc6de58e070254aaf6fe4a23c825f87fd16aa816.lock
Downloading shards: 0%| | 0/19 [00:00<?, ?it/s]2024-03-29 18:52:04,250 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00001-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:52:04,300 - DEBUG - Attempting to acquire lock 6067941136 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock
2024-03-29 18:52:04,300 - DEBUG - Lock 6067941136 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock
2024-03-29 18:52:04,303 - DEBUG - Starting new HTTPS connection (1): cdn-lfs-us-1.huggingface.co:443
2024-03-29 18:52:04,451 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00001-of-00019.safetensors%3B+filename%3D%22model-00001-of-00019.safetensors%22%3B&Expires=1712015524&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTUyNH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNTQ2NjljNWFlYzI5ZmU1ZTRlZGQ4MDk4ZjdiNTY0YTEzN2JhMzZiZTIyYWQyNWExOTRjZDkzZjJiYjU0Yzk0MD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=WcDC8tmz2MnThexhaZ9FQqzk-h06B99T9UbFZeyfER1l1rSH45s9O2Rwd6jKtLZGCjYbHMAA2NPppI3NY8ystRgY9kowAsexpvtaWgik4Zxb-3hF4ql8XX0kZVjmIA-7whzWaTGHezooLge1UHF0Dnfy-A6CGPoIi69VoYrWfu2Ez5TYUJMy8BqZ7pP9zsTPoEzKmxGg6EYVml9oHM60qEtezYdj6kxLckHlMFVl0YUuJcJZHcnHt9u3IVf7jML4PLg2yepoypoiaOJ8o~~9d08rGsvlD9fCYaS5VVniV6utththC8UmjC9aXZhttuNmFiD3NJJ1OojzP6YTtg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4892809584
model-00001-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.89G/4.89G [00:53<00:00, 90.7MB/s]
2024-03-29 18:52:58,387 - DEBUG - Attempting to release lock 6067941136 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock
2024-03-29 18:52:58,387 - DEBUG - Lock 6067941136 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/54669c5aec29fe5e4edd8098f7b564a137ba36be22ad25a194cd93f2bb54c940.lock
Downloading shards: 5%|███▍ | 1/19 [00:54<16:15, 54.22s/it]2024-03-29 18:52:58,502 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00002-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:52:58,507 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock
2024-03-29 18:52:58,507 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock
2024-03-29 18:52:58,614 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00002-of-00019.safetensors%3B+filename%3D%22model-00002-of-00019.safetensors%22%3B&Expires=1712014184&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDE4NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvMjllMTUzNjRkOGFiMWQ2ZWUyMjkyMzMzODFmMjk1ZTlmZjk2MjM3ZWZlZDA0NzUwNTkxZjdkYTUyYWI2Y2MwZT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=FZyz2TlKFTHzZ00vTEGByk3hlVmeGTb2DYypdSPUXRnUtB2WgV2PgihRfzC5s2IP8JlUCJqtGthMsnEFFpEEXf565-vY1TVkdCU92gF-m-nVhct8oCAV16MeyZh81k5qaj-0GmjFiTufxTbM-3vx7QE0B3lJr7BHKn5TsrQTrUJmulSasajOTAwi9tj5oJn-kDoCjx8BHqCzftLDUYf9Go4C5AqqTmVIJAMhRX996Yh8EkWtPP4A6whXV0rCU34agrYsHLoR941VazyMzhqJ99lIvCCZsZEOymiJpZjKeFQsMAZJRxLmJRH7i1fpIy8QNhnQtVMwLCBF2DvCoQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016
model-00002-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:53<00:00, 92.7MB/s]
2024-03-29 18:53:52,392 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock
2024-03-29 18:53:52,392 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/29e15364d8ab1d6ee229233381f295e9ff96237efed04750591f7da52ab6cc0e.lock
Downloading shards: 11%|██████▉ | 2/19 [01:48<15:19, 54.09s/it]2024-03-29 18:53:52,470 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00003-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:53:52,507 - DEBUG - Attempting to acquire lock 6060966672 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock
2024-03-29 18:53:52,508 - DEBUG - Lock 6060966672 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock
2024-03-29 18:53:52,628 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00003-of-00019.safetensors%3B+filename%3D%22model-00003-of-00019.safetensors%22%3B&Expires=1712015382&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTM4Mn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZDBiNjNmY2E3OTNjYzI5NDIxY2M1YTQ2ODUxOTkyOTc1Y2JlMDgzYWFkZWQxYjJmMzExMTNhNDVhMGM5MDk1ND9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=hYc9-vF0tEJU9SXrGUS6OqC7GIXmsE73VRYVLRu3lh7XmK8HwG0n7zfScS6e9dXe0u1tKad0nsg6tuvs9Qo5KnhzKE4HWLbPcunQZAHJjix9oASZhwzIHZjKJU5VxoqQ1vWVL6N6VJvlQz1kJUPmjly2MjboJ8Lyev7LEY90HvhwYH0lIcixk5X4rHxMnpIDMrWglmziJQX2OBkizYkjuvMJnkIlzC9NIR8Kcy6AbD0wIFRDiGMpzFGICT5dFyHFcq01biBpt5iVDDDK1Rg-yGs6NheD85y3Y1w98h32jv4osRPAU4IMCOgyhaVIk-uFLNvxtMwIgs44njhXCg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016
model-00003-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 94.1MB/s]
2024-03-29 18:54:45,572 - DEBUG - Attempting to release lock 6060966672 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock
2024-03-29 18:54:45,572 - DEBUG - Lock 6060966672 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/d0b63fca793cc29421cc5a46851992975cbe083aaded1b2f31113a45a0c90954.lock
Downloading shards: 16%|██████████▍ | 3/19 [02:41<14:18, 53.68s/it]2024-03-29 18:54:45,684 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00004-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:54:45,690 - DEBUG - Attempting to acquire lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock
2024-03-29 18:54:45,691 - DEBUG - Lock 6052456528 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock
2024-03-29 18:54:45,815 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00004-of-00019.safetensors%3B+filename%3D%22model-00004-of-00019.safetensors%22%3B&Expires=1712014450&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDQ1MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNjdlMDU5NjkyMGZlNTQzNDE1YzAxOTFlODY3YTlhN2RlOTQyYTI5MjRkNjI3N2NkOThjOGM1YjM0ZTExZTQzNj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=j1slpxTVfiiZlkfXvqe6Dt7SVlcMMI8SL83N2yhYhbG21pH8CMh59U34-qRlqsTzsGsqz66WbR8WFK0BHf2xXHg46GbiTfivFs5CWe6jV43N9zqDuUg7PX9LCfldIDP94GTLzbLXqJibGMb-YPLABw8rbignbpkVS5X5WM1eLVg7g9Vz0bwLEFMvoA7oEZleuv3Tb4ZCdhWR4oDkgAdXeQ6FtltndNCOl4mMDuNfE98FblEiJ1uxxIFzZd2hpU0w3NzsZ9sJnIfURIEspwGnBM4pMyV0NsPOVGXJZUEkNhy6llra85jGmVuw4HfMtYcwmzWSRzbqsxaxhu2B8NQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035200
model-00004-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:54<00:00, 89.7MB/s]
2024-03-29 18:55:40,417 - DEBUG - Attempting to release lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock
2024-03-29 18:55:40,417 - DEBUG - Lock 6052456528 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/67e0596920fe543415c0191e867a9a7de942a2924d6277cd98c8c5b34e11e436.lock
Downloading shards: 21%|█████████████▉ | 4/19 [03:36<13:32, 54.14s/it]2024-03-29 18:55:40,526 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00005-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:55:40,581 - DEBUG - Attempting to acquire lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock
2024-03-29 18:55:40,582 - DEBUG - Lock 6078577360 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock
2024-03-29 18:55:40,674 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00005-of-00019.safetensors%3B+filename%3D%22model-00005-of-00019.safetensors%22%3B&Expires=1712014360&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDM2MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZTMzMGVhYmQ3MGI0NjdkZGNiZDhkM2Q2YjJiOWMzZWJhNjY2NTViMGVkOWY4NGUxOWYyNzBkYTM2MjNkYzQ1NT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Uxyk5K9RelY2V9NY-0I9p5tBw4HBLLcri8bz9PNUe4YwVTBf6FRsfra5LFXWlmx2CqXTthJDfZQc7XIyY-dm6W-nj5suVOVGOiZQeitPDpLcQlgANHc-oQ8Rn8ttYDFbJnpkGHPoYerxe48IVHDW43Jeb1vKdGt-PCVmXrV8blfpMkCdA5aCsxU2St5lKJ3y7xE0XRADvvNbf0jp3TMPvf4lDnSRNynYWCqKyQ4-f6gx8CqcPyO7iTBpLt93DiN0yXOGeWhnh2g1a36FH6mDhj31gCq8yvqlnk3ijt9LGi5xEWL212G25xyawHcoSL1zq7fyXJs4IpxBdfJA__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016
model-00005-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:54<00:00, 91.4MB/s]
2024-03-29 18:56:35,213 - DEBUG - Attempting to release lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock
2024-03-29 18:56:35,213 - DEBUG - Lock 6078577360 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e330eabd70b467ddcbd8d3d6b2b9c3eba66655b0ed9f84e19f270da3623dc455.lock
Downloading shards: 26%|█████████████████▎ | 5/19 [04:31<12:41, 54.37s/it]2024-03-29 18:56:35,331 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00006-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:56:35,339 - DEBUG - Attempting to acquire lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock
2024-03-29 18:56:35,340 - DEBUG - Lock 6068402512 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock
2024-03-29 18:56:35,417 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00006-of-00019.safetensors%3B+filename%3D%22model-00006-of-00019.safetensors%22%3B&Expires=1712015795&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTc5NX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvMDQ4ZmE1MzQ3ODc3YjZkMDRlY2NmNjk3NjVkMjNlNTU2MWNjOTgyMGRkNGQwZTViYTJkZjAxMDAyMDRkZmIwND9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=a7xea92d53X-M1T8Q06nnpdfE-7O4EA23Rmpcxgvd5q1cq2Vku-AueCOvA2kIUw0ZlAW5V5xurQWEZ-WaTci3XVcYxLjHAg4uM4TLHJ8zjDHTGbUEpcTMKNcSy1QNMpyp0h3Se9OJmijT91ejEMFIRCAVjNqg7cGX37aOEm47VXgfLlkM7x8s84a6vlG29eyfxbLfZYyk2P52S3ObwiURxkQFlguxzsmWdZ8068KvgrAcyPwqluUkd-r4QFKFY1yN4FvFTYzqqkbSbJZVE1HV0q7YcRB0dHWgSseKwQSYyfzHS56sba746K9ot3-uKdtop-QhsxPl4JntVLcQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004016
model-00006-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:51<00:00, 96.7MB/s]
2024-03-29 18:57:26,957 - DEBUG - Attempting to release lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock
2024-03-29 18:57:26,957 - DEBUG - Lock 6068402512 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/048fa5347877b6d04eccf69765d23e5561cc9820dd4d0e5ba2df0100204dfb04.lock
Downloading shards: 32%|████████████████████▊ | 6/19 [05:22<11:35, 53.48s/it]2024-03-29 18:57:27,069 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00007-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:57:27,108 - DEBUG - Attempting to acquire lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock
2024-03-29 18:57:27,109 - DEBUG - Lock 6068402512 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock
2024-03-29 18:57:27,187 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00007-of-00019.safetensors%3B+filename%3D%22model-00007-of-00019.safetensors%22%3B&Expires=1712015847&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTg0N319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvODNiZmVkNjE2OWMxZjViMGFlODU0ZmIzMzExYjU3NmQwNjIwOWVlNWFmNDVkN2Q0NmJjYmMyNTA5OGE0ZDAyYj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=XKritaLSbL6x3tpodntZXDMrfBLwFkDel394Ze6rttSPk-SP4EOFssYVDcgAH1ePoht-HNcA5FYp9iUQIfLxnykyq4AijSsXRqS20-ugtvaELPJra2NWNp0HGP6mhvYwmi5jqN35f8CWmWiWSh5-AYASO-ZMNobedmp1l0zu4vTrAUuoDoYBdrGvKDxebI1YOBWH75GeQVAyLUlGbKbj4LHB78BrTdTLeW9BtYmRJH1xMNznbSLQo4VI3RRZAkfUxGewnG48R4qKrBuD85e0j99nMGVlCZdTH8Qx3-XLbv7rkksyRoDVPqn3re5qETPP1CBwkTUy3FXNho6g__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248
model-00007-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:50<00:00, 97.5MB/s]
2024-03-29 18:58:17,419 - DEBUG - Attempting to release lock 6068402512 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock
2024-03-29 18:58:17,419 - DEBUG - Lock 6068402512 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/83bfed6169c1f5b0ae854fb3311b576d06209ee5af45d7d46bcbc25098a4d02b.lock
Downloading shards: 37%|████████████████████████▎ | 7/19 [06:13<10:29, 52.49s/it]2024-03-29 18:58:17,533 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00008-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:58:17,540 - DEBUG - Attempting to acquire lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock
2024-03-29 18:58:17,540 - DEBUG - Lock 6078577360 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock
2024-03-29 18:58:17,601 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00008-of-00019.safetensors%3B+filename%3D%22model-00008-of-00019.safetensors%22%3B&Expires=1712014682&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDY4Mn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvYWYzMTZhZDc4NDAyN2VkYmE0N2JmMDk1OWM4MjE2ODJjOTMxYzljOTAxZDNkNzU1MDM4YjM1OGQ5YzdhMjhjMD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=nJ3OFuXG03HdxwtmfcWDTihEsBHvrhWckfMI5G57RBetjkq2onR0qOGb3TDU7vJfLSTho6PRHguic5y3zlTOHUR3iCCwGvB42WKBx2PgJkOYw0cnW9MTF15k95Q7mwNcSQrGLLwZUqlnKwgpMJ-CfdKNQfgocytAbKouzvuSPjsGgmAECODX49uuw7rEYaJBFFat0L57HJGYlvj08Ba9wJz54hWEDg2HOxZRrJZ8WzRlFCaZo36JccAnsfvqKbdR1JNcsqyTbk5JWhOZhnpLaXtJlK8Duf37qp2SqxuHSEtK9aOC0jqZj7GY1JPsEutf9znTyeHqsVbyitsQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00008-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 95.0MB/s]
2024-03-29 18:59:10,084 - DEBUG - Attempting to release lock 6078577360 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock
2024-03-29 18:59:10,084 - DEBUG - Lock 6078577360 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/af316ad784027edba47bf0959c821682c931c9c901d3d755038b358d9c7a28c0.lock
Downloading shards: 42%|███████████████████████████▊ | 8/19 [07:05<09:38, 52.55s/it]2024-03-29 18:59:10,160 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00009-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 18:59:10,225 - DEBUG - Attempting to acquire lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock
2024-03-29 18:59:10,226 - DEBUG - Lock 6067363792 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock
2024-03-29 18:59:10,319 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00009-of-00019.safetensors%3B+filename%3D%22model-00009-of-00019.safetensors%22%3B&Expires=1712015584&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTU4NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNTg4MmU0MzY2YzYzMDQ4YTBhZDM2ZWY2ZDkwMTk0YTJmYWJkYjQyYTIxNDBiZTc5YzhlMGVjMmU4YWMyY2NjNT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Rw7BZRkOpESlfXyXAP776cJ-7QH3muQxj3sfC0CtqMXnf55ieEkhH5oFWmz1dnH9EUapxBzWssiifXeP7CwhtkzqHdHNghTictCfuygiLQHlWQWQr5z8bG2mx3FAT7tdMV3yK362XpU5vUnpM5tsBvefuQAR6cnYK5IzQecYdy9Fm3HXI6JzfHyOSzk7L3ZkJeidZVaraDcMh9alSJjFqajHiE8jopDknMH2aQ0iCNR26Iu5CRUVc9VJfR016t1NCjP-8DWsjyBDZL80NZ7btkpWTz7A6Z1g1otcrMP1Guv945NSLfBUu3jsIuZJ399kQPxjnTTqWOwQQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00009-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 94.2MB/s]
2024-03-29 19:00:03,210 - DEBUG - Attempting to release lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock
2024-03-29 19:00:03,210 - DEBUG - Lock 6067363792 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/5882e4366c63048a0ad36ef6d90194a2fabdb42a2140be79c8e0ec2e8ac2ccc5.lock
Downloading shards: 47%|███████████████████████████████▎ | 9/19 [07:59<08:47, 52.73s/it]2024-03-29 19:00:03,314 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00010-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:00:03,320 - DEBUG - Attempting to acquire lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock
2024-03-29 19:00:03,321 - DEBUG - Lock 6059235664 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock
2024-03-29 19:00:03,380 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00010-of-00019.safetensors%3B+filename%3D%22model-00010-of-00019.safetensors%22%3B&Expires=1712015547&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTU0N319LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNzc4MTNkMWRiZWU2MzQxOTIyNmFjMTVlNGI4ZjI4ZDA3NWMzZjc5MjFjYzY2NDA5MDIzNmM0OTE2NjdlYWYyOT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=EOc-RybVXjM7CGdRkv6LY8bVO1iumqpzkbOuU39AKSb0imjpTwDGqfMuh6dqBjqDp3olaZnzVm475wsXpusN3DkXScGaTy68F6WBpRkHugR--2ukZDKSiV1beyId85vhE8q1PoJGS6q5s8TDz4fMSaRzaq4r3K9YZkbz41qfJuCGLGjVpvrqFafffcsJgkRexODHOG9dIa1ntQhTZXskWNLTgmwBXRMPrzwZjXZoYSBpBn6XUFu5UUDyuhiuxhVtP1t5gHMj-VN-jyvQf0gb7gGZ4qiamvbZOnLYsPUpNAr8v-FWMlU9Z9y76AP7mIHWUVkdF2yCJn8xadg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248
model-00010-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:53<00:00, 92.0MB/s]
2024-03-29 19:00:56,642 - DEBUG - Attempting to release lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock
2024-03-29 19:00:56,642 - DEBUG - Lock 6059235664 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/77813d1dbee63419226ac15e4b8f28d075c3f7921cc664090236c491667eaf29.lock
Downloading shards: 53%|██████████████████████████████████▏ | 10/19 [08:52<07:56, 52.95s/it]2024-03-29 19:00:56,740 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00011-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:00:56,783 - DEBUG - Attempting to acquire lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock
2024-03-29 19:00:56,784 - DEBUG - Lock 5761146192 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock
2024-03-29 19:00:56,839 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00011-of-00019.safetensors%3B+filename%3D%22model-00011-of-00019.safetensors%22%3B&Expires=1712016056&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjA1Nn19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZmYyNDU0MGQ5OTY3ZmU0M2MwYzE3Y2FkYWVhN2YyYTM0ZDA4MGEyZjllNThiOTEzMDM4YjliZmQwYmY4Y2E0OT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=c9VFpGafImO5QY6cqmNPMXcTi8KJTP7Ryx585frL321dQmlOxMeqYHy2MCgYCZ--g9yx105YDwOR0GzlrZteaApVJeBBDENoF3WCXOZADH0GnPzy5cGyYRLqm7FCaT4vrPGK-qERM9D5AWfsuiIvpRUXBmykIQLVqTlWG1vPxgfmEuJOMGObLgpQrYvfQcHq6APOgxx8ojm80i9h1NNkN5iV-xTf8jV6noLRlG8Jyhg5afZqI1lGO4VZA7xa6Ilnn2cX1LKkF68XVNMc-3kOuiLeC6Iwk6qjdNhelaoSgeE7FpP6FcZen8ZJEHb6V4DUsyGn86gTy4tvFyA__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00011-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 95.6MB/s]
2024-03-29 19:01:48,989 - DEBUG - Attempting to release lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock
2024-03-29 19:01:48,989 - DEBUG - Lock 5761146192 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/ff24540d9967fe43c0c17cadaea7f2a34d080a2f9e58b913038b9bfd0bf8ca49.lock
Downloading shards: 58%|█████████████████████████████████████▋ | 11/19 [09:44<07:02, 52.76s/it]2024-03-29 19:01:49,122 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00012-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:01:49,132 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock
2024-03-29 19:01:49,133 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock
2024-03-29 19:01:49,182 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00012-of-00019.safetensors%3B+filename%3D%22model-00012-of-00019.safetensors%22%3B&Expires=1712016109&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjEwOX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNDhiYzEyODQ1Njc2ZWFiMWFkYjNjZmNlNzAzN2E3ZWNkNjY0YTBkNWY1ZGVhZjkzYzczNjJhNWJiNTE3MzI5OD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=AGLeuapEY86P-Gyfd9QQlEbKSBlfgjPSyhnMh6cuDZFKqGu2Dpq2N9zKZpC4Q2RdM3oZ5jmCjFYjxCNTCSUH7SsL-cWCo4ZQrpjAoZN1DpCzthlpyGjgqcBuZGfQhcSwUrv2Ci6BUr62uE46BFmDxNGYtzLst210StfNIyNXp5enr63En5fETNjBjE1q9ES2Ik0XGplPncRN5UInZexUV-gQqauSIQcGQxiOf4FQ8zJAQGGsnaMAHMJJ4JqVOerBZmq1NXpnWoSPkFXKwWeCYfs2iKSj1gJtaoIY3yPNTtawDgMOgLQjb4IaO9Ci6y-1s6mec-bDWmghtdRTw__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00012-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:55<00:00, 90.2MB/s]
2024-03-29 19:02:44,427 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock
2024-03-29 19:02:44,427 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/48bc12845676eab1adb3cfce7037a7ecd664a0d5f5deaf93c7362a5bb5173298.lock
Downloading shards: 63%|█████████████████████████████████████████ | 12/19 [10:40<06:15, 53.58s/it]2024-03-29 19:02:44,507 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00013-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:02:44,549 - DEBUG - Attempting to acquire lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock
2024-03-29 19:02:44,550 - DEBUG - Lock 6052456528 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock
2024-03-29 19:02:44,647 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00013-of-00019.safetensors%3B+filename%3D%22model-00013-of-00019.safetensors%22%3B&Expires=1712016164&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjE2NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZTU2YTJlN2VkYTY5OWJmNGVjMTQzM2JkMDdkN2NiODY0ODg0MjA4MTNlNjY0NjNkMmUyMjk2ZDdhY2NlYmM1Yz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=RD8KjzaojJfJdyz-qUByQwISMtxKQao-b34iW8-9rqE0iMzghE2qm7mr-HhqbeYOZdp0yXJUyAeujshFRGrW7L0ndZjBoM7n5sXxnlktNFsxEy2KwEE31oDnqIDZqso0d5LMBo7Marl999HkDYvpFyNp0TA3H1WbCeNXdIcBpoaabjKi93T9J05nQUINmVRMVfCkfcmnZ-erdM9Q7V3V4dKSptEUIqm6IM8zWIydAxPFe4ibsrV4YXq6e9oDVW3BAn7Dcu7GJIEKL3vfPdljICifRfBPbCHyY9FVJ-KO-rMLxhR9H4csPH4WfoqCJWjHtMwyS0uRmyK15j6AQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00013-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:53<00:00, 92.6MB/s]
2024-03-29 19:03:38,472 - DEBUG - Attempting to release lock 6052456528 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock
2024-03-29 19:03:38,472 - DEBUG - Lock 6052456528 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/e56a2e7eda699bf4ec1433bd07d7cb86488420813e66463d2e2296d7accebc5c.lock
Downloading shards: 68%|████████████████████████████████████████████▍ | 13/19 [11:34<05:22, 53.72s/it]2024-03-29 19:03:38,592 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00014-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:03:38,601 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock
2024-03-29 19:03:38,601 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock
2024-03-29 19:03:38,655 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00014-of-00019.safetensors%3B+filename%3D%22model-00014-of-00019.safetensors%22%3B&Expires=1712016218&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjIxOH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvZGE2MjdmNmEzYzhmZGM2ZTM1Yjk5MThkMmFhNTM3MDRkNDA0NDE5MWZjYzg2YzdjMGIxYWM1N2YwMGU3MDdmNz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Et7Qgh6fwqvHjpWoq58bmA26296xMVU-GSZlPF4bhGzyd5XFH2EdNaMK4pPcnGkg-kA5zCCkxbToJXkWNTjE0sq1wHqtz7fOCOHbO4ZVFgEd5gWdodd5dcmcAvKMb6RzwsFFipSEWJFZ8un1cK6Q72-1gQ8QnPSqJxaQ0TrT6asaRLc6dH6s74TcvfsAZnmVq9n8OQqnqrFlSoPJjrkCzE2s10oInSCQVGDiGISxSIiFaGnS4j9VtWtHUa70kwiDQiYeaJjvvwf6TCDLyCSolPK0ZYeJGLMBtcWpIFo7JaYhK702HdFAXYYroyM3LmaGjm6ZFc6qJnMORbA__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248
model-00014-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:51<00:00, 95.7MB/s]
2024-03-29 19:04:29,876 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock
2024-03-29 19:04:29,876 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/da627f6a3c8fdc6e35b9918d2aa53704d4044191fcc86c7c0b1ac57f00e707f7.lock
Downloading shards: 74%|███████████████████████████████████████████████▉ | 14/19 [12:25<04:25, 53.02s/it]2024-03-29 19:04:29,960 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00015-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:04:30,002 - DEBUG - Attempting to acquire lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock
2024-03-29 19:04:30,002 - DEBUG - Lock 5755306960 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock
2024-03-29 19:04:30,060 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00015-of-00019.safetensors%3B+filename%3D%22model-00015-of-00019.safetensors%22%3B&Expires=1712016270&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjI3MH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNjFlMGYyMmJmZjkzYTY4ZTExNGRiYzNkNzVjMWRkMWU2Njg3ZDU1NGRiYTBjZmRmMTc0Mzk1MGFhMDRmZjFjZj9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=dqk2EkzCLl1BFXFZ34XuKJsTNqvoMUZPbKtggNgUKFanJzjgotVrBnRl8Z0zSbv71YP-PtGAZGUEzoWwBtqOZvXg1FZPJFxnMAtgD2KiPwoZduRRHk7taI3nETayWiTjzw2qLfCYAUGyhVXW2tHYx4WhMomCpNx2TXcatx1Om1ugAdSiX28-2pME-aGI2PlRqCLEq8iF64MI3KFNdQbxMh221jylIdpRCYkIC5LtAWv0BLGoNWT6tZ5ME6fU96lwuKRaK1g0Yz5qvNAXDK4OBI35xByEYJvy7XLCMSk6DeYUSuEA-qgl7BCRXZXMLJACa-fwVIq4akQo5BZw__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00015-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:53<00:00, 93.7MB/s]
2024-03-29 19:05:23,228 - DEBUG - Attempting to release lock 5755306960 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock
2024-03-29 19:05:23,228 - DEBUG - Lock 5755306960 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/61e0f22bff93a68e114dbc3d75c1dd1e6687d554dba0cfdf1743950aa04ff1cf.lock
Downloading shards: 79%|███████████████████████████████████████████████████▎ | 15/19 [13:19<03:32, 53.12s/it]2024-03-29 19:05:23,329 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00016-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:05:23,338 - DEBUG - Attempting to acquire lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock
2024-03-29 19:05:23,339 - DEBUG - Lock 6067363792 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock
2024-03-29 19:05:23,437 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00016-of-00019.safetensors%3B+filename%3D%22model-00016-of-00019.safetensors%22%3B&Expires=1712015384&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNTM4NH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNzY0NjZiZmMyMzEyZjExNTU5NDgwOTgxZjIxMmU0Y2NhNmU5ODA5NmJmOGRmMGZkOTBjY2UxZjBmNDcwOWE5Yz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=Vkz68TR-4Mh8XvS9gijXnE1zOfaR4M4f5ETHhgrB95bjXCrGrzQtbtzmd1uZ2Z4BiJWjXalGcazRqWGBJObSY3EwGpvdhUqWVIsfZ6inwHn7bRk7nvjhvcXXtf8aPErAd3UYIr6maB982usg6CG2WgDzL9EaLWCUpQaPv-SNabLuBaEKtwNuhN74F8G08du9s2zG30cNb3kkgRuFSWWPHoBe3cQvoeVUFxOB97djdIaqwCRrkNrblzwfUhaiMT5Eu1pjYY7iQGWqsnvCLtZfaZbI3QlDKhudsIMeVd3NnPC9wtzQxToelmY4B47BSiEErkglGm0OOQqefqeqrQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00016-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:56<00:00, 88.6MB/s]
2024-03-29 19:06:19,707 - DEBUG - Attempting to release lock 6067363792 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock
2024-03-29 19:06:19,707 - DEBUG - Lock 6067363792 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/76466bfc2312f11559480981f212e4cca6e98096bf8df0fd90cce1f0f4709a9c.lock
Downloading shards: 84%|██████████████████████████████████████████████████████▋ | 16/19 [14:15<02:42, 54.13s/it]2024-03-29 19:06:19,780 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00017-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:06:19,824 - DEBUG - Attempting to acquire lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock
2024-03-29 19:06:19,825 - DEBUG - Lock 6059235664 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock
2024-03-29 19:06:19,877 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00017-of-00019.safetensors%3B+filename%3D%22model-00017-of-00019.safetensors%22%3B&Expires=1712016379&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjM3OX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNTcwYWYzYjgwMmJlZGMwZDU0ZDA0ODFkMTI0ZjYzZDQ0OWRkYTQwYTQyOTRhODJhMzlmOGRjMzcwNDA1N2E1Yz9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=jqgkdjkjlKDEQH8xHyw53TbZgJz6avUdZkLQVCWFkE9TDtNncnxFj9m0D8PRhB-Jd3fDfvgGTVBz55nvPThWwVV2KcFJgHseggVcleFGc7OQAAwKiad9F9jyrKmgd4ErXkqaGp8GEPqk6mOaU79pp5egpuVaO6wZIKsdIqs8WH-AY9aydNC2rs3UON3NivSaNAD1XQBeEYgvtGYW2T2f8-yByzB-n4p55QTVLN4IPIp5xfdN4DXS0xFlJwXzAjmM2k-mGkhY4iVEmt8sh90hcMPzsGkSX69WZ1qwhsWjWAlMIUjjUS-e-4bCsNeheynlvm8RRDnIpjC1w6wOQ__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4899035248
model-00017-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.90G/4.90G [00:56<00:00, 87.3MB/s]
2024-03-29 19:07:15,993 - DEBUG - Attempting to release lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock
2024-03-29 19:07:15,994 - DEBUG - Lock 6059235664 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/570af3b802bedc0d54d0481d124f63d449dda40a4294a82a39f8dc3704057a5c.lock
Downloading shards: 89%|██████████████████████████████████████████████████████████▏ | 17/19 [15:11<01:49, 54.78s/it]2024-03-29 19:07:16,097 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00018-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:07:16,107 - DEBUG - Attempting to acquire lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock
2024-03-29 19:07:16,108 - DEBUG - Lock 5761146192 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock
2024-03-29 19:07:16,168 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00018-of-00019.safetensors%3B+filename%3D%22model-00018-of-00019.safetensors%22%3B&Expires=1712014985&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNDk4NX19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvNGM2MDNiNjVjYmQ1ZGRhZGNkNWVjZThhZGQ2OGI5ZDQ3Zjk4ZjcyNjRkYmIwYTUzMTMxNzJjNzg0OTFlMDMyOT9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=ZcuF0TPS8vO9fqsPjRdeVKtyWYBG0i1Tg7W56bqLaSPBMrap2SvlHf6VbSllZi-0hVJkOtV7np6nWf9beWVmCZwSrt-94fcjooMiRFc-gColIpWUo-R5kiZfyn8uOlezSfmYuotqC1-uG3sIWLy2Rfc02c-9FNoMgdkYK8ZRDSYRA50FUEVxbQ8LAv2aVJ7tkQhNex3Rsu5U7PqZ1OFvvm83C66rnpOWsEXsKSgjz6N-ac4fBMjvEdVy4iJo4C9fNgJOScK0STjSP9T4ysRMCtT8OXn3IqHsURONVusnjY1zxAq-8MgXpye8rldkYY3KaQmNcHUfGdMMUtw__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4983004072
model-00018-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.98G/4.98G [00:52<00:00, 95.4MB/s]
2024-03-29 19:08:08,393 - DEBUG - Attempting to release lock 5761146192 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock
2024-03-29 19:08:08,393 - DEBUG - Lock 5761146192 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/4c603b65cbd5ddadcd5ece8add68b9d47f98f7264dbb0a5313172c78491e0329.lock
Downloading shards: 95%|█████████████████████████████████████████████████████████████▌ | 18/19 [16:04<00:54, 54.06s/it]2024-03-29 19:08:08,671 - DEBUG - https://huggingface.co:443 "HEAD /mistralai/Mixtral-8x7B-Instruct-v0.1/resolve/main/model-00019-of-00019.safetensors HTTP/1.1" 302 0
2024-03-29 19:08:08,714 - DEBUG - Attempting to acquire lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock
2024-03-29 19:08:08,715 - DEBUG - Lock 6059235664 acquired on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock
2024-03-29 19:08:08,788 - DEBUG - https://cdn-lfs-us-1.huggingface.co:443 "GET /repos/56/dd/56dddba94664e0d83f2b33a201ebd592ec49ebaefd116e268abfb7cc19cbdf5c/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0?response-content-disposition=attachment%3B+filename*%3DUTF-8%27%27model-00019-of-00019.safetensors%3B+filename%3D%22model-00019-of-00019.safetensors%22%3B&Expires=1712016488&Policy=eyJTdGF0ZW1lbnQiOlt7IkNvbmRpdGlvbiI6eyJEYXRlTGVzc1RoYW4iOnsiQVdTOkVwb2NoVGltZSI6MTcxMjAxNjQ4OH19LCJSZXNvdXJjZSI6Imh0dHBzOi8vY2RuLWxmcy11cy0xLmh1Z2dpbmdmYWNlLmNvL3JlcG9zLzU2L2RkLzU2ZGRkYmE5NDY2NGUwZDgzZjJiMzNhMjAxZWJkNTkyZWM0OWViYWVmZDExNmUyNjhhYmZiN2NjMTljYmRmNWMvMjcyZjMzYzc2YmNhY2Y2Y2ZjZWQ0OTdkYzA1NzllMTA3ZGUzODc0YjlmOTMxMjZmNWU2OWI1YjFhZTdlNzJhMD9yZXNwb25zZS1jb250ZW50LWRpc3Bvc2l0aW9uPSoifV19&Signature=MPwahSoVY8iLQNailKD1C53T6XbyddehZFgzKUQYlOfvQSUJFtVenc8B0p8viQqxv8pTnYu140uFG-Egip-S1uUqMYz2z0iKZi6y7wGSjbT1FOht1dW6iMelzSvpi0IHbvL3moT7UGhUIm05cBKWG6a35ly6Nm2wmprE8uFvTEHVXPAj9OPNqyAD2tpHnpkGRtCEInkcEWr8he09cvtGs7JsAZRKY4wUBDhIlCqZBsxzKlMhWseStRMWoCkzaRocElZXFlEuwwW1J8eixoOt6rFPMGzHC7pW7p~mVoKu6mtDnAG9vN7pgP5msrKLuIKNLx14XAiF5LnAlg__&Key-Pair-Id=KCD77M1F0VK2B HTTP/1.1" 200 4221679088
model-00019-of-00019.safetensors: 100%|██████████████████████████████████████████████| 4.22G/4.22G [00:48<00:00, 86.5MB/s]
2024-03-29 19:08:57,625 - DEBUG - Attempting to release lock 6059235664 on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock
2024-03-29 19:08:57,625 - DEBUG - Lock 6059235664 released on /Users/toddcurry/AIOS/cache/hub/.locks/models--mistralai--Mixtral-8x7B-Instruct-v0.1/272f33c76bcacf6cfced497dc0579e107de3874b9f93126f5e69b5b1ae7e72a0.lock
Downloading shards: 100%|█████████████████████████████████████████████████████████████████| 19/19 [16:53<00:00, 53.34s/it]
2024-03-29 19:08:58,055 - WARNING - Device 0 is not available, available devices are []
2024-03-29 19:08:58,055 - WARNING - Device 1 is not available, available devices are []
2024-03-29 19:08:58,055 - WARNING - Device 2 is not available, available devices are []
2024-03-29 19:08:58,679 - WARNING - Device 0 is not available, available devices are []
2024-03-29 19:08:58,679 - WARNING - Device 1 is not available, available devices are []
2024-03-29 19:08:58,679 - WARNING - Device 2 is not available, available devices are []
Loading checkpoint shards: 0%| | 0/19 [00:00<?, ?it/s]
Traceback (most recent call last):
File "/Users/toddcurry/AIOS/main.py", line 87, in
main()
File "/Users/toddcurry/AIOS/main.py", line 44, in main
llm = llms.LLMKernel(llm_name, max_gpu_memory, max_new_tokens)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/Users/toddcurry/AIOS/src/llms/llms.py", line 31, in init
self.load_llm_and_tokenizer()
File "/Users/toddcurry/AIOS/src/llms/llms.py", line 56, in load_llm_and_tokenizer
self.model = model_class[self.model_type].from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/transformers/models/auto/auto_factory.py", line 561, in from_pretrained
return model_class.from_pretrained(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3502, in from_pretrained
) = cls._load_pretrained_model(
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/transformers/modeling_utils.py", line 3926, in _load_pretrained_model
new_error_msgs, offload_index, state_dict_index = _load_state_dict_into_meta_model(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/transformers/modeling_utils.py", line 805, in _load_state_dict_into_meta_model
set_module_tensor_to_device(model, param_name, param_device, **set_module_kwargs)
File "/opt/anaconda3/lib/python3.11/site-packages/accelerate/utils/modeling.py", line 387, in set_module_tensor_to_device
new_value = value.to(device)
^^^^^^^^^^^^^^^^
File "/opt/anaconda3/lib/python3.11/site-packages/torch/cuda/init.py", line 293, in _lazy_init
raise AssertionError("Torch not compiled with CUDA enabled")
AssertionError: Torch not compiled with CUDA enabled

很不错的工作，看给的例子都是简单的单Agent例子，请问有多Agent的示例吗？最好是关于RAG的，谢谢！

python main.py --llm_name gemma-2b-it --max_gpu_memory '{"0": "24GB"}' --eval_device "cuda:0" --max_new_tokens 256

Traceback (most recent call last):
File "/Users/doudou/project/AIOS/main.py", line 31, in
from src.agents.travel_agent.travel_agent import TravelAgent
File "/Users/doudou/project/AIOS/src/agents/travel_agent/travel_agent.py", line 21, in
from src.tools.bing_search import BingSearch
ModuleNotFoundError: No module named 'src.tools.bing_search'

I'm interested about your idea to integrate LLM agent into operating system, but I came across several problems when running your project.

1. Incorrect imported module path in travel_agents.py. You may change

   from src.tools.bing_search import BingSearch
   from src.tools.google_search import GoogleSearch
   from src.tools.arxiv import Arxiv

   to

   from src.tools.online.bing_search import BingSearch
   from src.tools.online.google_search import GoogleSearch
   from src.tools.online.arxiv import Arxiv

2. I didn't find the SDKs and syscalls mentioned in the paper, so I don't know how to test applications on your project. Have you thought about make these modules open-source later?

Thank you for your hard work on this project, and I look forward to your response and guidance on these matters.

LLM内核的实现不是基于OS内核完成的么，比如长短期记忆控制的实现、发起外部网络请求等等

Both papers delve into the collaborative interaction possibilities. I was curious about maintainer's opinion on the idea of establishing a more general Resource abstraction at the AIOS level, that enables the necessary concurrency control for accessing and manipulating shared resources on an AIOS interactive session.

It seems to me that the problem is twofold, depending on the resource at question

• only utilized by agents
  • for this particular scenario a Resource object during runtime could act as a proxy for the resource in question, and hold a threading.Lock or threading.Semaphore, attributes that are enough to cover current implementations of concurrency actions of tasks using the aforementioned resource.
  • in this scenario inputs for agents should admit arbitrary input that cannot be predicted at the agent level.
• resource utilized both by agents and host OS-APP as well
  • in this case, there is no escape for using OS based lock mechanism

I am unaware of the existence of solutions to this type of problems, so forgive the ignorance. To me it seems like this is one of the most essential problems of the host OS - AIOS interaction. If not solved, it seems like the agents are deemed to live in LLM space only :F

This document outlines the long-term features in the AIOS roadmap for Q3 2024. Feel free to discuss any of the following topics, and add any other topics you'd like to talk about in this issue.

AIOS Documentation (@throwie72)

• manual pages and documentation
• OpenBSD style as an example: https://man.openbsd.org/style

Agent interaction UI (@mannanshukla)

Build a UI demo #133, users can @ a particular agent to indicate that the request needs to be executed by that agent running on AIOS, just like @ somebody on twitter.

• add multiple commands (following linux commands)
• add command parser for agent-related operation
• add output formatter
• dynamic agent loader
• request user clarification by agent

Tree/Graph agent workflow support

Support the design of different workflows with different data structures.

• add tree-structured workflow
• add graph-structured (without cycle) workflow
• add graph-structured (with cycle) workflow

Natural-language agent workflow support (@BRama10)

Support non-expert agent developers to use natural language to design and describe their agent workflows.

• reference paper: https://arxiv.org/abs/2405.06907
• integrate natural language workflow programming syntax
• integrate llm interpreter to interpret and execute natural language programmed agents

Automated agent workflow (@itsthemoon)

An extension of Natural-language agent workflow, llm automatically create agent workflow

• add workflow that can be generated by LLM and can be updated

Batchfy agent requests

• batchfy multiple agent requests sent to open-sourced LLM
• batchfy multiple agent requests sent to close-sourced LLM

Support multi-level queues

• add multiple queues for LLM requests
• separate tool calling request and LLM request into different queues

Multi-core AIOS and LLM router

Multi-LLM-Core with LLM router which can direct agent request to the most cost-efficient/time-efficient LLM
#129