We present the first large-scale empirical application of reinforcement learning to the important problem of optimized trade execution in modern financial markets. Our experiments are based on 1.5 years of millisecond time-scale limit order data from NASDAQ, and demonstrate the promise of reinforcement learning methods to market microstructure problems. Our learning algorithm introduces and exploits a natural "low-impact" factorization of the state space.

We recently reported that NADH oxidase is one of the major enzymes responsible for superoxide (O(2)(-)*) production in the rat kidney. However, the functional significance of NADH oxidase-mediated O. production and the mechanisms regulating this enzyme activity are poorly understood. Using fluorescence microscopic imaging analysis, the present study demonstrated that thick ascending limbs of Henle's loop (TALHs) exhibited red fluorescence when incubated with dihydroethidium (DHE), suggesting that O(2)(-)* is produced in this tubular segment. Compared with other nephron segments, TALHs from both renal cortex and medulla showed the highest fluorescence intensity. By incubating cortical TALHs (cTALHs) with the substrates of NADH oxidase, xanthine oxidase, nitric oxide synthase, arachidonic acid-metabolizing enzymes, and intramitochondrial oxidases, NADH oxidase was found to be one of the most important enzymes for O(2)(-)* production in this tubular segment. The NADH oxidase inhibitor diphenyleneiodonium (DPI; 100 microM) completely blocked NADH-induced O(2)(-)* production in cTALHs. Exposure of cTALHs to low PO(2) (5-10 Torr) significantly increased O(2)(-)* production regardless of the absence or presence of NADH. Furthermore, angiotensin II (100 nM) increased NADH oxidase activity by 32%, which was completely blocked by DPI. These results suggest that NADH oxidase is a major enzyme responsible for O(2)(-)* production in the TALHs and that the production of O(2)(-)* via NADH oxidase may be regulated by renal tissue oxygenation and circulating hormones.

Endothelium-mediated vasodilation is specifically enhanced in uterine circulation during pregnancy, and production of nitric oxide (NO) is increased in response to a wide array of agonists. Uterine artery endothelial cells from nonpregnant (NP-UAECs) or pregnant (P-UAECs) ewes maintained in culture still show a pregnancy-enhanced difference in ATP-stimulated endothelial NO synthase (eNOS; official symbol NOS3) activation, even though NOS3 protein, purinergic receptors, and associated cell signaling proteins are expressed at equal levels. We have also shown that the pregnancy-enhanced endothelial cell NO response to ATP requires an enhanced and sustained capacitative entry phase that is likely mediated via canonical transient receptor potential protein/inositol 1,4,5-trisphosphate receptor type 2 interaction. In this study, we now show by simultaneous video imaging of individual Fura-2-loaded cells that the pregnancy-enhanced capacitative entry phase is not continuous and equal in all cells, but is in fact mediated as a series of periodic [Ca(2+)](i) bursts within individual cells. Not only does pregnancy increase the number of bursts over a longer time period in individual cells, but also a greater proportion of cells exhibit this burst activity, and at high cell density this occurs in a synchronous manner. The mediator of cell synchronization is connexin 43 (Cx43) gap junctions because 1) Cx43 is readily detectable by Western blot analysis in UAECs, whereas Cx40 and Cx37 are weakly detected or absent, and 2) pregnancy-specific enhancement of [Ca(2+)](i) bursts by ATP is blocked by inhibitory loop peptides selective to Cx43 ((43,37)GAP27) but not by a scrambled control peptide or (40)GAP27 or (40,37)GAP26 peptides, which are specific to Cx40 or Cx37. The relationship between Ca(2+) bursts and NOS3 activation is further established by the finding that (43,37)GAP27 inhibits ATP-stimulated NOS3 activation but has no effect on cell mitogenesis. We conclude that it is pregnancy-enhanced gap junction communication between cells that underlies pregnancy enhancement of capacitative entry via TRPC3 and, in turn, NOS3 activation. Such improved gap junction function allows greater and more sustained [Ca(2+)](i) responses to agents such as ATP within a single cell, as well as the additional recruitment of greater numbers of cells to the response in a coordinated and synchronous manner to support enhanced NO production.

Ceramide-activated NAD(P)H oxidase has been reported to participate in homocysteine (Hcys)-induced abnormal metabolism of the extracellular matrix (ECM) in rat glomerular mesangial cells. However, it remains unknown whether this ceramide-redox signaling pathway contributes to glomerular injury induced by hyperhomocysteinemia (hHcys) in vivo. The present study was designed to address this question, defining the role of ceramide and activated NAD(P)H oxidase in the development of hHcys-induced glomerular injury. Uninephrectomized Sprague-Dawley rats were fed a folate-free diet for 8 weeks to produce hHcys and the de novo ceramide synthesis inhibitor myriocin or the NAD(P)H oxidase inhibitor apocynin was administrated. Rats with folate-free diet significantly increased plasma Hcys levels, renal ceramide levels, and NAD(P)H oxidase activity accompanied by marked glomerular injury. Treatment of rats with myriocin significantly reduced ceramide levels and improved glomerular injury, as shown by decreased urinary albumin excretion and reduced glomerular damage index. ECM components changed towards to normal levels with decreased tissue inhibitor of metalloproteinase-1 and increased matrix metalloproteinase-1 activity. NAD(P)H oxidase activity and Rac GTPase activity were reduced by 69 and 66%, respectively. In rats treated with apocynin, similar beneficial effects in protecting glomeruli from hHcys-induced injury were observed. These results support the view that de novo ceramide production is involved in Hcys-induced NAD(P)H oxidase activity in the kidney of hHcys rats and indicate the important role of ceramide-mediated redox signaling in hHcys-induced glomerular injury in rats.

Recent studies have indicated that urotensin II (UII), a cyclic peptide, is vasoactive and may be involved in cardiovascular dysfunctions. It remains unknown, however, whether UII plays a role in the control of renal vascular tone and tubular function. In the present study, a continuous infusion of synthetic human UII (hUII) into the renal artery (RA) in anesthetized rats was found to increase renal blood flow (RBF) and urinary water and sodium excretion (UV and UNaV) in a dose-dependent manner. At a dose of 20 ng. kg-1. min-1, it increased RBF by 20% and UV and UNaV by 94 and 109%, respectively. Nitric oxide (NO) synthase inhibitor NG-nitro-l-arginine methyl ester (l-NAME) completely abolished hUII-induced increases in RBF and water/sodium excretion. In isolated, pressurized, and phenylephrine-precontracted small RA with internal diameter of approximately 200 microm, hUII produced a concentration-dependent vasodilation with a maximal response of 55% at 1.5 microM. l-NAME significantly blocked this hUII-induced vasodilation by 60%. In denuded RA, hUII had neither vasodilator nor vasoconstrictor effect. With the use of 4,5-diaminofluorescein diacetate-based fluorescence imaging analysis of NO levels, hUII (1 microM) was shown to double the NO levels within the endothelium of freshly dissected small RA, and l-NAME blocked this UII-induced production of endothelial NO. These results indicate that UII produces vasodilator and natriuretic effects in the kidney and that UII-induced vasodilation is associated with increased endothelial NO in the RA.