<div dir="ltr"><div><div class="gmail_default" style="font-family:arial,sans-serif"><font face="arial, sans-serif">G<span class="gmail_default">ood evening</span></font><span style="font-family:Arial,Helvetica,sans-serif">,</span></div><div dir="auto"><br><div dir="auto">Please add the following event:</div><div dir="auto"><br></div><div dir="auto"> * name of the event: <span class="gmail_default" style="font-family:arial,sans-serif">Evaluating LLM based applications</span></div><div dir="auto"> * type of event: Workshop (<span class="gmail_default" style="font-family:arial,sans-serif"></span><span class="gmail_default" style="font-family:arial,sans-serif">Intermediate - Advanced</span> level)</div><div dir="auto"> * focus on Python:It is so easy to build a PoC using LLMs and it is so hard to turn it into a production-grade LLM application. To succeed you should have a robust evaluation framework during development and post-deployment, not to mention its automation<span class="gmail_default" style="font-family:arial,sans-serif">,</span> as manual reviews usually do not scale.This workshop focuses on the evaluation of LLM based applications powered by Python open-source libraries. We start with the exploration of different evaluation techniques. Further, we incorporate them into our test suite. At last, we lay the monitoring foundation.</div><div dir="auto">* approximate number of attendees: <span class="gmail_default" style="font-family:arial,sans-serif">100</span></div><div dir="auto">* location (incl. country): online</div><div dir="auto">* dates/times/recurrence (incl. time zone): <span class="gmail_default" style="font-family:arial,sans-serif"></span><span class="gmail_default" style="font-family:arial,sans-serif"></span><span class="gmail_default">Thursday</span>, J<span class="gmail_default" style="font-family:arial,sans-serif">anuary 16</span>, 202<span class="gmail_default" style="font-family:arial,sans-serif">5</span> <span class="gmail_default" style="font-family:arial,sans-serif">5</span>:<span class="gmail_default" style="font-family:arial,sans-serif">15</span> PM to <span class="gmail_default" style="font-family:arial,sans-serif">8</span>:<span class="gmail_default" style="font-family:arial,sans-serif">15</span> PM GMT+<span class="gmail_default" style="font-family:arial,sans-serif">1</span>.  </div><div dir="auto">* HTML link using the format <a href=" <a href="http://url/" target="_blank">http://url/</a>">name of the event<span class="gmail_default" style="font-family:arial,sans-serif"></span></a>: <a href="<a href="https://www.meetup.com/pyladiesams/events/304664913/" target="_blank"><span class="gmail_default" style="font-family:arial,sans-serif"></span></a><a href="https://www.meetup.com/pyladiesams/events/305032895/">https://www.meetup.com/pyladiesams/events/305032895/</a>"><span class="gmail_default" style="font-family:arial,sans-serif"></span><span class="gmail_default" style="font-family:arial,sans-serif"></span><span class="gmail_default" style="font-family:arial,sans-serif"></span>Evaluating LLM based applications</a></div></div><br clear="all"></div><div><br></div><div><br></div><div><div dir="ltr" class="gmail_signature" data-smartmail="gmail_signature"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><div dir="ltr"><p class="MsoNormal"><b><span style="font-family:Arial,sans-serif">Best Regards / </span></b><b><span style="font-family:Arial,sans-serif">Met vriendelijke groet,</span></b></p><p class="MsoNormal"><span style="font-family:Arial,sans-serif"><b>Giulia Caglia, </b></span><b style="font-family:Arial,sans-serif">Una</b><b style="font-family:Arial,sans-serif"> Galyeva </b></p><p class="MsoNormal"><span style="font-family:Arial,sans-serif"><a href="https://amsterdam.pyladies.com/" target="_blank">amsterdam.pyladies.com</a></span></p><p class="MsoNormal"><span style="font-family:Arial,sans-serif"><img src="https://secure.meetupstatic.com/photos/event/2/3/1/a/highres_483968986.jpeg" width="200" height="110"><br></span></p><p class="MsoNormal"><span style="font-family:Arial,sans-serif"><a href="https://www.meetup.com/PyLadiesAMS/" target="_blank">Meetup</a> | </span><a href="https://www.linkedin.com/company/pyladies-amsterdam" target="_blank">LinkedIn</a> | <a href="https://github.com/pyladiesams" target="_blank">GitHub</a> | <a href="https://twitter.com/PyLadiesAMS" target="_blank">X</a> | <a href="https://www.youtube.com/pyladiesamsterdam" target="_blank">YouTube<br></a></p></div></div></div></div></div></div></div></div></div></div></div></div>