It is generally accepted that the appropriate boost of early immune response will control viral replications and limit the immune-mediated pathology in viral hepatitis. However, poor immunity results in viral persistence, chronic inflammation and finally liver cirrhosis and carcinoma. As a peripheral non-lymphoid organ of immune surveillance, the liver continually encounters hundreds of molecules from the blood, including nutrients, toxins and pathogens. In this way, the liver maintains immune tolerance under healthy conditions, but responds quickly to the hepatotropic pathogens during the early stages of an infection. Although our knowledge of liver cell compositions and functions has been improved significantly in recent years, the intrahepatic immune regulation of antiviral T cells at the initial stage is complex and not well elucidated. Here, we summarize the role of liver cell subpopulations in regulating antiviral T cell response at the initial stages of viral infection. A better understanding of early hepatic immune regulation will pave the way for the development of novel therapies and vaccine design for human viral hepatitis.