Introduction

As we venture further into the digital age, the significance of Generative AI, specifically the LLM, in a multitude of sectors cannot be overstated. This cutting-edge technology offers revolutionary solutions for businesses, challenging conventional methods and heralding a new era of efficiency and innovation. From deploying AI-driven customer service chatbots to facilitating advanced data analytics, the introduction of Generative AI underscores its expansive potential and adaptability across various industries.

The rising momentum in integrating AI solutions into business frameworks has spurred investigations into the optimal utilization of LLM's capabilities. By closely aligning with client needs, such explorations have illuminated promising avenues for the effective implementation of Generative AI in the business realm. Whether for content generation, data interpretation, or as this case study demonstrates, professional translation and summarization, the multifaceted nature of LLM is set to profoundly influence and reshape business operations and strategies.

Challenge

The client has been translating and summarizing the latest US industry news from Korea daily for years to share with their colleagues at a consistent time. Finding US news in Korea and translating it is arduous, not just because of the summarization but also because of the time difference.

Besides, for accurate and insightful delivery to executives, a professional translation and summary with knowledge about the industry and market is crucial. Moreover, given the need to share multiple news pieces daily, they wanted the summaries to be provided in a consistent format.

At TecAce, we possess numerous bilingual engineers familiar with the relevant industries and located in the US. This enables us to address many of the client's challenges. However, even experts proficient in both Korean and English found it time-consuming to find, translate, and summarize 5 to 6 news pieces daily.

Solution 1

We attempted translation using famous Generative AIs available in the market. We tried translating and summarizing the news into Korean using ChatGPT 4.0, Bard, Clova X, and DeepL. ChatGPT 4.0 yielded the most satisfactory results, using relatively accurate Korean words and maintaining context during translation and summarization.

However, the client's requirement wasn't just simple translation and summarization. They needed concise expression using industry-specific terms and a consistent format for each news summary. We decided to tackle this problem with prompt engineering on GPT 4.0.

We tested prompts that can translate, summarize, and shape the news on three services using GPT 4.0: ChatGPT 4.0, WRTN (strong in Korean), and Bing with web search capability.

Advantages and Disadvantages of GPT4.0 Generative AI tools

• High contextual understanding | - Tends to be overly verbose - Occurrences of hallucination | | Wrtn (GPT 4.0) | - Uses advanced Korean-specific words
• Offers multiple word choices in Korean | - Doesn’t fully grasp the overall context and produces sentences that don’t always fit | | Bing Chat (GPT 4.0) | - Convenient to use directly in a browser - Summarizes simply and clearly | - Occasional service malfunctions - Sometimes the summary is too simplistic to understand. |

Prompt engineering improved the results significantly, but they still didn't match the quality of translations done by experts. The appropriate use of professional terms was significantly lacking.