William James Dally (born August 17, 1960) is an American computer scientist and educator.[1][2] He is the chief scientist and senior vice president at Nvidia and was previously a professor of Electrical Engineering and Computer Science at Stanford University and MIT. Since 2021, he has been a member of the President's Council of Advisors on Science and Technology (PCAST).[3][4]
Bill Dally | |
|---|---|
 Dally in 2021 | |
| Born | William James Dally August 17, 1960 |
| Alma mater | |
| Awards |
|
| Scientific career | |
| Institutions | |
| Thesis | A VLSI Architecture for Concurrent Data Structures (1986) |
| Doctoral advisor | Charles Seitz[1] |
| Doctoral students | |
Microelectronics
editHe developed a number of techniques used in modern interconnection networks including routing-based deadlock avoidance, wormhole routing, link-level retry, virtual channels, global adaptive routing, and high-radix routers.[jargon] He has developed efficient mechanisms for communication, synchronization, and naming in parallel computers including message-driven computing and fast capability-based addressing. He has developed a number of stream processors starting in 1995 including Imagine, for graphics, signal, and image processing, and Merrimac, for scientific computing.[citation needed]
He has published over 200 papers as well as the textbooks Digital Systems Engineering with John Poulton, and Principles and Practices of Interconnection Networks with Brian Towles. He was inventor or co-inventor on over 70 granted patents.
An author quoted him saying: "Locality is efficiency, Efficiency is power, Power is performance, Performance is king".[5]
Career
editBell Labs
editDally has received a bachelor's degree in electrical engineering from Virginia Tech.[6] While working for Bell Telephone Laboratories he contributed to the design of the Bellmac 32, an early 32-bit microprocessor,[citation needed] and earned an master's degree in electrical engineering from Stanford University in 1981. He then went to the California Institute of Technology (Caltech) from 1983 to 1986,[6] graduating with a Ph.D. degree in computer science in 1986. At Caltech he designed the MOSSIM simulation engine and an integrated circuit for routing. While at Caltech, he was part of the founding group of Stac Electronics in 1983.[7]
MIT
editFrom 1986 to 1997 he taught at MIT where he and his group built the J–Machine and the M–Machine,[8] parallel machines emphasizing low overhead synchronization and communication. During his MIT times he claims to have collaborated on developing design of Cray T3D and Cray T3E supercomputers. He became the Willard R. and Inez Kerr Bell Professor in the Stanford University School of Engineering and chairman of the computer science department at Stanford. He served as chairman for twelve years before moving on to Nvidia.[9]
Dally's corporate involvements include various collaborations at Cray Research since 1989. He did Internet router work at Avici Systems starting in 1997, was chief technical officer at Velio Communications from 1999 until its 2003 acquisition by LSI Logic, founder and chairman of Stream Processors, Inc until it folded.[7]
Nvidia and IEEE fellow
editDally was elected a Fellow of the Association for Computing Machinery in 2002, and a Fellow of the IEEE, also in 2002. In 2003 he became a consultant for NVIDIA for the first time and helped to develop GeForce 8800 GPUs series.[10] He received the ACM/SIGARCH Maurice Wilkes Award in 2000, the Seymour Cray Computer Science and Engineering Award in 2004, and the IEEE Computer Society Charles Babbage Award in 2006. In 2007 he was elected to the American Academy of Arts and Sciences.
In January 2009 he was appointed chief scientist of Nvidia.[11] He worked full-time at Nvidia, while supervising about 12 of his graduate students at Stanford.[12] He is currently chief scientist and SVP of Nvidia Research.[13]
Among many contributions to technology at Nvidia, Dally also kick-started optical interconnects for GPU[14] and computing systems[15] using micro ring modulators utilizing multiple wavelengths.[16][17] These systems can lead to the adoption of very high bandwidth, low energy per bit optical interconnects[18] in GPUs[19] and also lead to circuit switched GPU datacenters with significant boost to AI computing efficiency.
In 2009, he was elected to the National Academy of Engineering for contributions to the design of high-performance interconnect networks and parallel computer architectures.
He received the 2010 ACM/IEEE Eckert–Mauchly Award for "outstanding contributions to the architecture of interconnection networks and parallel computers."[20]
Personal life
editDally is married and has three children. He had a flight mishap in 1992 when the Cessna 210 he was flying from Hanscom Field, Massachusetts to Farmingdale, New York in bad weather conditions experienced an oil leak. He was forced to make a crash landing in the Long Island Sound and was retrieved by a rescue sailboat.[21]
Works
edit- Dally, William J.; Harting, Curtis (2012). Digital Design: A Systems Approach. Cambridge University Press. ISBN 978-0-521-19950-6.
- Dally, William J.; Towles, Brian (2004). Principles and Practices of Interconnection Networks. Elsevier. ISBN 978-0-12-200751-4.
- Dally, William J.; Poulton, John W. (1998). Digital Systems Engineering. Cambridge University Press. ISBN 978-0-521-59292-5.
References
edit- ^ a b Bill Dally at the Mathematics Genealogy Project
- ^ Date information sourced from Library of Congress Authorities data, via corresponding WorldCat Identities linked authority file (LAF).
- ^ "President Biden Announces Members of President's Council of Advisors on Science and Technology" (Press release). Washington: The White House. 2021-09-22.
- ^ "William Dally, PhD". PCAST. The White House. Retrieved 2023-06-11.
- ^ Johnson, Matt (2011). An Analysis of Linux Scalability to Many Cores. p. 4.
Locality is efficiency, Efficiency is power, Power is performance, Performance is king
- ^ a b "William Dally". Research. Nvidia. Retrieved 2023-06-11.
- ^ a b William Dally (November 4, 2011). "From Science to Technology, From Research to Product" (PDF). Slides from Norway Science Week. Stanford Engineering. Retrieved March 7, 2017.
- ^ "Practical AI #15: Artificial intelligence at NVIDIA with Chief Scientist Bill Dally". Changelog. 8 October 2018. Retrieved 2019-04-25.
I was on the faculty at MIT for 11 years, where I built a research group that built a number of pioneering supercomputers,
- ^ "Bill Dally". Stanford HAI. Retrieved 2023-06-11.
- ^ "Practical AI #15: Artificial intelligence at NVIDIA with Chief Scientist Bill Dally". Changelog. 8 October 2018. Retrieved 2019-04-25.
- ^ "Nvidia Names Stanford's Bill Dally Chief Scientist, VP Of Research". Press release. January 28, 2009. Archived from the original on February 3, 2009. Retrieved March 7, 2017.
- ^ Ashlee Vance (April 8, 2009). "Hello, Dally: Nvidia Scientist Breaks Silence, Criticizes Intel". The New York Times. Retrieved March 10, 2017.
- ^ MarketScreener. "William Dally - Biography". www.marketscreener.com. Retrieved 2023-06-11.
- ^ Dally, Bill (2023-08-27). "Hardware for Deep Learning". 2023 IEEE Hot Chips 35 Symposium (HCS). IEEE. pp. 1–58. doi:10.1109/hcs59251.2023.10254716. ISBN 979-8-3503-3907-9. S2CID 263180552.
- ^ HOTI 2023 - Day 1: Session 2 - Keynote by Bill Dally (NVIDIA): Accelerator Clusters, 17 September 2023, retrieved 2024-03-09
- ^ "Accelerator Clusters: the New Supercomputer | HotI30 (2023)". 2023-07-12. Retrieved 2024-03-09.
- ^ Manipatruni, Sasikanth; Chen, Long; Lipson, Michal (2010-07-23). "Ultra high bandwidth WDM using silicon microring modulators". Optics Express. 18 (16): 16858–16867. Bibcode:2010OExpr..1816858M. doi:10.1364/oe.18.016858. ISSN 1094-4087. PMID 20721078.
- ^ Manipatruni, Sasikanth; Lipson, Michal; Young, Ian A. (March 2013). "Device Scaling Considerations for Nanophotonic CMOS Global Interconnects". IEEE Journal of Selected Topics in Quantum Electronics. 19 (2): 8200109. arXiv:1207.6819. Bibcode:2013IJSTQ..1900109M. doi:10.1109/JSTQE.2013.2239262. ISSN 1558-4542. S2CID 6589733.
- ^ Chen, Long; Preston, Kyle; Manipatruni, Sasikanth; Lipson, Michal (2009). "Integrated GHZ silicon photonic interconnect with micrometer-scale modulators and detectors". Optics Express. 17 (17): 15248–15256. arXiv:0907.0022. Bibcode:2009OExpr..1715248C. doi:10.1364/oe.17.015248. PMID 19688003. Retrieved 2024-03-09.
- ^ "ACM Award Citation". Association for Computing Machinery. Archived from the original on 2 April 2012. Retrieved 25 October 2010.
- ^ Ball, Charles H. (September 30, 1992). "Dally Has Harrowing Flight Mishap". MIT News.