o ijI @spdZddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl m Z m Z ddl mZmZddlZddlZejejeZejejeddddd Zejejedddd Zejejedddd d Zejejedddd Zejejedddd Zejejedd dd dZejeddZ ejeddZ!ddZ"e"ejedgdZ#ej$%ddZ&ej$%ddZ'dZ(ddddd d!e#d"id gd#d$Z)e*Z+da,iZ-e*Z.d%d&Z/d'd(Z0d)d*Z1dEd,d-Z2d.d/Z3d0d1Z4d2d3Z5dFd5d6Z6dGd8d9Z7d:d;Z8dd?Z:Gd@dAdAe Z;dBdCZ conversation.html POST /api/session -> mint OpenAI Realtime ephemeral token (server key stays here) POST /api/warmup -> warm face + body once, before conversation starts POST /api/stream/start -> create stateful face/body stream POST /api/stream/chunk -> PCM16 chunk -> newest face/body frames POST /api/stream/end -> flush final short chunk and release stream POST /api/infer_turn {audio_b64, emotion, id?} -> render_turn(wav, emotion) -> {id, dir, meta}; rebuilds turns index GET /outputs/turns//* -> the produced face.json / body.vrma / audio.wav (viewer reads these) OPENAI_API_KEY=sk-... python server.py [--port 8318] Needs OPENAI_API_KEY only for /api/session; /api/infer_turn works without it (offline test). N)SimpleHTTPRequestHandlerThreadingHTTPServer)unquoteurlsplitz..shaderzpseudo-nilotoonz npm-packagesrcvendorjsmassetsz lipsync-wasmv2z idle01.vrmaoutputsturnsmiccCszGt|8}|D]+}|}|r|dsd|vrq|dd\}}tj||ddqWdWdS1s@wYWdStyQYdSw)uMinimal .env loader (no dependency): KEY=VALUE per line, # comments, optional quotes. Does NOT override vars already in the environment (real env wins). The .env holds the OpenAI secret and is git-ignored — never log its values.#="'N)openstrip startswithsplitosenviron setdefaultFileNotFoundError)pathflinekvr! server.py _load_dotenv6s $& r#z.env)neutraljoylaughter excitement agreement gratitudesadnesscryingsulkapologystruggleangerrefusalsurpriseflustershyREALTIME_MODELz gpt-realtimeREALTIME_VOICEmarinun당신은 친근한 한국어 아바타입니다. 답변은 짧고 대화체로. 매 사용자 발화에 대한 첫 응답에서는 음성을 생성하지 말고 set_emotion 도구를 정확히 한 번 호출해 다음 발화의 톤에 가장 맞는 감정 하나를 넘기세요. 도구 결과를 받은 뒤 이어지는 응답에서만 짧게 한 번 말하세요.function set_emotionzNBefore speaking, report the single emotion that best matches the coming reply.objectemotionstring)typeenum)r< propertiesrequired)r<name description parameterscCstdur ddl}|atS)Nr)_infer infer_turn)rDr!r!r"inference_modulefsrEcOstj|i|SN)rE render_turn)akwr!r!r"rGnsrGcCsP|s tjdtjdStj|dd}t|drtdtj|ddtjdS) Nr)dtypeT)validatez$PCM16 payload has an odd byte lengthzszHandler.__init__c stt|j}|dkr tSdtfdtfdtfdtfdtff}|D]F\}}| |s*q |t |d d}t j t j||}z t j||f|k}Wn tyWd }Ynw|r^|St j|d St|S) aExpose the canonical Pseudo NiloToon ESM sources without copying them. SimpleHTTPRequestHandler normally serves only HERE. The conversation viewer imports the shader from /pseudo-nilotoon/*, which maps to the sibling package's browser-ready npm source directory. Its one relaxed idle clip is exposed as an exact file route rather than mounting the surrounding lipsync package. z /idle01.vrmaz/pseudo-nilotoon-core/z/pseudo-nilotoon-jsm/z/pseudo-nilotoon-vendor/z/pseudo-nilotoon-assets/z/pseudo-nilotoon/N/F __not_found__)rrrIDLE_VRMA_PATHPSEUDO_NILOTOON_CORE_SRCPSEUDO_NILOTOON_JSMPSEUDO_NILOTOON_VENDORPSEUDO_NILOTOON_ASSETSPSEUDO_NILOTOON_SRCrrRlstriprrealpathr commonpathrSrtranslate_path) rr request_pathmountsrbrootrel candidate inside_rootrr!r"rAs6     zHandler.translate_pathcs*d|jpdvrtj|g|RdSdS)Nz/api/)rr log_message)rfmtargsrr!r"rcszHandler.log_messagecCsTtj|dd}|||dd|dtt|||j |dS)NF)rrzapplication/json; charset=utf-8Content-Length) rrencode send_response send_headerstrrR end_headerswfilewrite)rcodeobjbr!r!r"_jsongs   z Handler._jsonc Cs|jdd}zt|jdd}|rt|j|ni}Wnt y=}z| ddd|iWYd}~Sd}~ww|dkrz| dt WSt j yn}z| d dd |jjdd iWYd}~Sd}~wt y}z| d dt|iWYd}~Sd}~ww|d krz | ddtdWSt y}z| ddt|iWYd}~Sd}~ww|dkr|dd}|tvrd}t|d}z| dt||t|dddWSt y}z| ddt|iWYd}~Sd}~ww|dvrw|d}|s| dddiS|dd}|dr(|s(| dddiSzt|||d|dd }| d|WStyZ}z| d!dt|iWYd}~Sd}~wt yv}z| ddt|iWYd}~Sd}~ww|d"kr|d}|s| dddiSz | dt|WSt y}z| ddt|iWYd}~Sd}~ww|d#krf|dd}|tvrd}|d$} | s| ddd%iStjtdd&td'd(|dpd)ttd*dd+} tj t| d,} t!| d-} | "t#$| Wdn 1swYz*t%t&| || } Wdn 1s3wYt'| d| d.| | d/WSt ye}z| ddt|iWYd}~Sd}~ww| d!dd0iS)1N?rrierrorzbad request body: z /api/sessionizOpenAI token mint failed: riz /api/warmupT)oktimingiz/api/stream/startr:r$rryrq)ry)z/api/stream/chunkz/api/stream/endrjzmissing stream_idrrz/chunkzmissing pcm_b64z/end)r:riz/api/stream/cancelz/api/infer_turn audio_b64zmissing audio_b64exist_okz\W+rZturn_r0z.wavwbr)rrrzunknown endpoint)(rrrrrhrloadsrfilereadrnr rr HTTPErrorresponsetextrrerrcrfloatendswithrrrrmakedirsMIC_DIRr`rarrrr rPrQrdrGr)rrnreqer:rjrrb64out_idwav_pathrrr!r!r"do_POSTos".                 4  zHandler.do_POST) __name__ __module__ __qualname__rrrr r) __classcell__r!r!rr"r=s    "rcCst}|jdtdd|}tjtddttj dr"dnd}t d t d |j t d |j d t d tdtd|t dtj ddt dtd|j ftdS)Nz--porti~ )r<defaultTrrsetzNOT set (/api/session will 503)zserving z on http://127.0.0.1:z open http://127.0.0.1:z/conversation.htmlz model z voice z OPENAI_API_KEY z body AVATAR_BODY_PROFILEv4zD mode realtime v2 (24 frames / 0.8s per body chunk, 30fps output)z 127.0.0.1)argparseArgumentParser add_argumentr parse_argsrr!rrrrhprintrportr4r5rr serve_forever)aprHrr!r!r"mainsr:__main__)rY)rq)NF)>__doc__r2rPrrrr`rrr] http.serverrr urllib.parserrnumpyrMrrdirnameabspath__file__rrrrrrrrrrr"r#rrrhr4r5rrrrdrCrgrfrErGrXrcrerlrprrrrrrr:r*r!r!r!r"s                *C