In collaboration with colleagues at UW, OGI, IBM, and SRI, we are developing technology to process spoken language from informal meetings. The work includes a substantial data collection and transcription effort, and has required a nontrivial degree of infrastructure development. We are undertaking this because the new task area provides a significant challenge to current HLT capabilities, while offering the promise of a wide range of potential applications. In this paper, we give our vision of the task, the challenges it represents, and the current state of our development, with particular attention to automatic transcription. D: There's a-there are-there's a whole bunch of tools J: Yes. / D: web page, where they have a listing. D: like 10 of them or something. J: Are you speaking about Mississippi State per se? or D: No no no, there's some .. I mean, there just-there arethere are a lot of / J: Yeah. J: Actually, I wanted to mention-/ D: (??) J: There are two projects, which are .. international .. huge projects focused on this kind of thing, actually .. one of them's MATE, one of them's EAGLES .. and um. D: Oh, EAGLES. D: (??) / J: And both of them have J: You know, I shou-, I know you know about the big book. E: Yeah. J: I think you got it as a prize or something. E: Yeah. / D: Mhm. J: Got a surprise. flaughg f J. thought "as a prize" sounded like "surprise"g Note that interruptions are quite frequent; this is, in our experience, quite common in informal meetings, as is acoustic overlap