東京都千代田区丸の内3-8-3
Join us for the eight instalment of TokyoDev Talks, where we have presentations that cut across the stack from engineers working at some of the most interesting tech companies in Japan.
Note that attendance for this event is limited to software developers, those aspiring to become one, or working in an adjacent position (e.g. Product Managers, UI/UX Designers, Security Engineers, etc). If you're unsure whether you're qualified to attend, please get in touch.
This event is being held at Tokyo Innovation Base (TiB). When attending it, you'll also need to complete the free registration process with TiB if you have not already done so. You are strongly encouraged to complete this in advance, as otherwise you'll need to complete it on site before you're allowed into the venue.
Enjoy talking with the other participants before the presentations begin. Drinks and a light meal will be provided by TokyoDev.
We'll kick things off by welcoming everyone and giving a short introduction of the event.
This presentation explores how we rewrote test automation with LLMs. Traditional native and Appium frameworks offered limited coverage and required high maintenance, so we turned to LLMs to determine how to perform user behaviors in testing.
Using this approach, our Test Automation Regression System (TARS) achieved 60% coverage in three months with almost no maintenance. Early versions faced hallucinations and automation errors, resulting in only a 45% accuracy. Through prompt tuning, experimentation, and the addition of an Auditor agent, we raised coverage to 95% and accuracy to 80%.
Marc Lihan graduated from Waseda University and started his career at NEC in Tokyo, where he witnessed the March 11 earthquake. He then relocated to Taiwan to work at HTC and LINE, and later returned to Tokyo as an Engineering Manager overseeing QA at SmartNews.
When deploying software for critical systems in fields like robotics or fintech, relying on a single staging environment for testing rarely provides sufficient reliability. This talk explores the unique QA lifecycle that supports such systems, emphasizing the layered safety nets that protect both users and infrastructure. From simulation environments to controlled staging setups and finally on-site validation, each phase is designed to catch issues before they escalate.
Equally important is the discipline of balancing thorough testing with development speed—a crucial requirement for any software project where delays can ripple across teams and impact delivery. The talk also covers how QA professionals navigate this tension, optimizing test coverage without compromising velocity.
I'm a QA engineer with experience in robotics and fintech systems, applying what I learned from
academic research in autonomous drones to real-world testing. With a background in embedded
systems and dual MSc degrees, I build testing frameworks to ensure reliability in complex, real-
time environments.
Discuss the presentation or anything else with the other attendees.
TokyoDev's job board is filled with software developer positions at Japanese companies whose engineering team’s primary language is English. From the big companies you’ve already heard of, to smaller up-and-coming startups, our positions offer you the chance to live in Japan but work in an international environment.
All attendees, speakers, sponsors and volunteers at our event are required to agree with the following code of conduct. Organisers will enforce this code throughout the event. We expect cooperation from all participants to help ensure a safe environment for everybody.
TokyoDev is dedicated to providing a harassment-free experience for everyone, regardless of gender, gender identity and expression, age, sexual orientation, disability, physical appearance, body size, race, ethnicity, religion (or lack thereof), or technology choices.
We do not tolerate harassment of event participants in any form. Sexual language and imagery is not appropriate for any venue, including at the event itself and other online media.
Participants violating these rules may be sanctioned or expelled from the event at the discretion of the organisers.
If you are being harassed, notice that someone else is being harassed, or have any other concerns, please contact a organizer immediately. Alternatively, you may contact us via our contact page.
Get-togethers for developers interested starting and growing a career in Japan. Organized by TokyoDev.
メンバーになる
