Downloads: 0
62 lines (61 with data), 9.8 kB
o
ÔPÑdø6 ã
@ sR d dl Z d dlmZmZ d dlmZmZ G dd deZe jG dd dZ e dd d
d ej
d d
Z e dd dd ej
d d
Z e ddddd ej
dddZe dddd ej
dddZe dd dd ej
d d
Ze dd dd ej
d d
Ze dd dd ej
d d
Ze dd d d ej
d d
Ze d dddd ej
dddZe Ze eeeee eed Zed kr§ee ¡ dS dS ) é N)ÚautoÚEnum)ÚListÚTuplec @ s e Zd ZdZe Ze ZdS )ÚSeparatorStylezDifferent separator style.N)Ú__name__Ú
__module__Ú __qualname__Ú__doc__r ÚSINGLEÚTWO© r
r
úN/data/chunyl/research/project/2023/llava_biomed/LLaVA_v1/llava/conversation.pyr s
r c @ s® e Zd ZU dZeed< ee ed< eee ed< eed< ej Z
eed< dZ eed< d Z eed
< d Z
eed < d
Zeed< dd Zdd ZdddZdd Zdd Zdd Zd S ) Ú Conversationz,A class that keeps all conversation history.ÚsystemÚrolesÚmessagesÚoffsetÚ sep_styleú###ÚsepNÚsep2ÚUnknownÚversionFÚ skip_nextc C s | j tjkr5| j| j }| jD ]#\}}|r,t|tu r |\}}}||d | | j 7 }q||d 7 }q|S | j tjkrx| j| j g}| j|d }t
| jD ](\}\}}|rot|tu r`|\}}}||d | ||d 7 }qM||d 7 }qM|S t d| j )Nz: ú:r é zInvalid style: ) r r r r r r ÚtypeÚtupler r Ú enumerateÚ
ValueError)ÚselfÚretÚroleÚmessageÚ_ÚsepsÚir
r
r Ú
get_prompt s(
zConversation.get_promptc C s | j ||g¡ d S )N)r Úappend)r! r# r$ r
r
r Úappend_message3 s zConversation.append_messagec st g }t | j| jd
D ]«\}\}}|d dkr·t|tu r·dd l}ddlm} ddlm |\}}} | dkrCd fdd }
|
|}n| d krHn| d
krR|
d ¡}nt d | t |j
t|j
} } | | }
d
\}}tt||
|| }t||
}|j
\}}||kr||}}n||}}|
||f¡}|r| |¡ q | }|j|dd | | ¡ ¡ ¡ }| |¡ q |S )Nr r ©ÚBytesIO©ÚImageÚPad©éz ét éh c s~ | j \}}||kr | S ||kr' | j||f|¡}| | d|| d f¡ |S | j||f|¡}| | || d df¡ |S )Nr r )ÚsizeÚnewÚmodeÚpaste)Úpil_imgÚbackground_colorÚwidthÚheightÚresultr- r
r Ú
expand2square@ s
z.Conversation.get_images.<locals>.expand2squareZCropÚResize)éà r? z Invalid image_process_mode: ©i i ÚJPEG©Úformat)r0 )r r r r r Úbase64Úior, ÚPILr. Úresizer Úmaxr4 ÚminÚintr) ÚsaveÚ b64encodeÚgetvalueÚdecode)r! Z
return_pilÚimagesr' r# ÚmsgrD r, ÚimageÚimage_process_moder= Úmax_hwÚmin_hwÚ aspect_ratioÚmax_lenÚmin_lenÚ
shortest_edgeÚ longest_edgeÚWÚHÚbufferedÚ img_b64_strr
r- r Ú
get_images6 sD
zConversation.get_imagesc C s6 g }t | j| jd
D ]\}\}}|d dkrt|tu rdd l}ddlm} |\}}}t|j t
|j } }
| |
} d\} }
t t
| | |
|
}t || }|j \}}||kr_||}}n||}}| ||f¡}| }|j
|dd | | ¡ ¡ ¡ }d| d}| d |¡}| |d g¡ q ||d
d
< q |S ) Nr r r+ r@ rA rB z <img src="data:image/png;base64,z " alt="user upload image" />z<image>éÿÿÿÿ)r r r r r rD rE r, rH r4 rI rJ rG rK rL rM rN Úreplacer) )r! r" r' r# rP rD r, rQ rR rS rT rU rV rW rX rY rZ r[ r\ r] Zimg_strr
r
r Úto_gradio_chatbotg s2
z Conversation.to_gradio_chatbotc C s. t | j| jdd | jD | j| j| j| jdS )Nc S s g | ]\}}||gqS r
r
©Ú.0ÚxÚyr
r
r Ú
<listcomp> s z%Conversation.copy.<locals>.<listcomp>©r r r r r r r )r r r r r r r r ©r! r
r
r Úcopy
s ùzConversation.copyc C sV t | ¡ dkr | j| jdd | jD | j| j| jdS | j| j| j| j| j| jdS )Nr c S s, g | ]\}}|t |tu r|d n|gqS )r )r r rb r
r
r rf s , z%Conversation.dict.<locals>.<listcomp>)r r r r r r )Úlenr^ r r r r r r rh r
r
r Údict s ú úzConversation.dict)F)r r r r
ÚstrÚ__annotations__r rJ r r r r r r r Úboolr( r* r^ ra ri rk r
r
r
r r s"
1
r zA chat between a curious human and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the human's questions.)ÚHumanÚ Assistant))ro z$Give three tips for staying healthy.)rp a Sure, here are three tips for staying healthy:
1. Exercise regularly: Regular physical activity can help improve your overall health and wellbeing. It can also help reduce your risk of chronic conditions such as obesity, diabetes, heart disease, and certain cancers. Aim for at least 150 minutes of moderate-intensity aerobic exercise or 75 minutes of vigorous-intensity aerobic exercise per week, along with muscle-strengthening activities at least two days per week.
2. Eat a balanced diet: Eating a balanced diet that is rich in fruits, vegetables, whole grains, lean proteins, and healthy fats can help support your overall health. Try to limit your intake of processed and high-sugar foods, and aim to drink plenty of water throughout the day.
3. Get enough sleep: Getting enough quality sleep is essential for your physical and mental health. Adults should aim for seven to nine hours of sleep per night. Establish a regular sleep schedule and try to create a relaxing bedtime routine to help improve the quality of your sleep.r r )r r r r r r ))ro zPWhat are the key differences between renewable and non-renewable energy sources?)rp ag Renewable energy sources are those that can be replenished naturally in a relatively short amount of time, such as solar, wind, hydro, geothermal, and biomass. Non-renewable energy sources, on the other hand, are finite and will eventually be depleted, such as coal, oil, and natural gas. Here are some key differences between renewable and non-renewable energy sources:
1. Availability: Renewable energy sources are virtually inexhaustible, while non-renewable energy sources are finite and will eventually run out.
2. Environmental impact: Renewable energy sources have a much lower environmental impact than non-renewable sources, which can lead to air and water pollution, greenhouse gas emissions, and other negative effects.
3. Cost: Renewable energy sources can be more expensive to initially set up, but they typically have lower operational costs than non-renewable sources.
4. Reliability: Renewable energy sources are often more reliable and can be used in more remote locations than non-renewable sources.
5. Flexibility: Renewable energy sources are often more flexible and can be adapted to different situations and needs, while non-renewable sources are more rigid and inflexible.
6. Sustainability: Renewable energy sources are more sustainable over the long term, while non-renewable sources are not, and their depletion can lead to economic and social instability.
zA chat between a curious user and an artificial intelligence assistant. The assistant gives helpful, detailed, and polite answers to the user's questions.)ÚUSERZ ASSISTANTÚv1r
Ú z</s>)r r r r r r r r zBEGINNING OF CONVERSATION:)rq ZGPTrg a( You are LLaVA-Med, a large language and vision assistant trained by a group of researchers at Microsoft, based on the general domain LLaVA architecture.You are designed to assist human with a variety of medical and clinical research tasks using natural language.Follow the instructions carefully.))ro zHi!©rp z%Hi there! How can I help you today?
a{ You are LLaVA-Med, a large language and vision assistant trained by a group of researchers at Microsoft, based on the general domain LLaVA architecture.You are able to understand the visual content that the user provides, and assist the user with a variety of medical and clinical tasks using natural language.Follow the instructions carefully and explain your answers in detail.))ro zHi!
### Response:rt a You are LLaVA-Med, a large language and vision assistant trained by a group of researchers at Microsoft, based on the general domain LLaVA architecture.You are able to understand the visual content that the user provides, and assist the user with a variety of medical and clinical research tasks using natural language.Follow the instructions carefully and explain your answers in detail.)ÚdefaultÚsimpleZ
simple_legacyZ
multimodalZllava_v1rr Zbair_v1Ú vicuna_v1_1Ú__main__)Ú dataclassesÚenumr r Útypingr r r Ú dataclassr r Zconv_v1Z conv_v1_2r Zconv_vicuna_v1_1Z conv_bair_v1Zsimple_conv_medZ simple_convZsimple_conv_multimodalZsimple_conv_legacyZ
conv_llava_v1Údefault_conversationÚconv_templatesr Úprintr( r
r
r
r Ú<module> s èä ÷ ù
õö
õõö
öÿ