Generative drug design facilitates the creation of compounds effective against specific pathogenic target proteins. This opens up the potential to discover novel compounds within the vast chemical space and fosters the development of innovative therapeutic strategies. However, the practicality of generated molecules is often limited, as many designs focus on a narrow set of drug-related properties, failing to improve the success rate of the subsequent drug discovery process. To overcome these challenges, we develop TamGen, a method that employs a GPT-like chemical language model and enables targetaware molecule generation and compound refinement. We demonstrate that the compounds generated by TamGen have improved molecular quality and viability. Furthermore, we have integrated TamGen into a drug discovery pipeline and identified 7 compounds showing compelling inhibitory activity against the Tuberculosis ClpP protease, with the most effective compound exhibiting a half maximal inhibitory concentration (IC50) of1.9µM. Our findings underscore the practical potential and real-world applicability of generative drug design approaches, paving the way for future advancements in the field.