TPC

The Trillion Parameter Consortium

The Trillion Parameter Consortium (TPC) is an international alliance of experts from research, academia, and industry established to tackle the challenges of developing large-scale artificial intelligence (AI) systems and to promote trustworthy and reliable AI for scientific discovery. By creating a global network of expertise and resources TPC aims to enable the creation of generative AI models with trillions of parameters, and advance AI applications across various fields. 

Key objectives of the TPC include developing scalable model architectures and training strategies, organizing and curating scientific data for model training, optimizing AI libraries for current and future exascale computing platforms, and establishing comprehensive evaluation platforms to assess scientific task learning, reliability, and trustworthiness. The TPC aims to maximize the impact of AI in scientific research by building an open community for sharing methods, tools, and insights on the topic.

Training models with trillions of parameters requires exascale-class computing resources, such as the ones that CSC has to offer.