The last decade has witnessed massive progresses in the field of Artificial Intelligence (AI). With supervision from labelled data, machines have, to some extent, exceeded human-level perception on visual recognitions, while fed with feedback reward, single AI units (aka agents) defeat humans in various games including Atari video games, Go game, and card game. Yet, true human intelligence embraces social and collective wisdom and many real-world AI applications often require multiple AI agents to work in a collaborative effort. A next grand challenge is to answer how large-scale multiple AI agents could learn human-level collaborations, or competitions, from their experiences with the environment where both of their incentives and economic constraints co-exist. In this talk, I shall sample some of our recent research on what is called artificial collective intelligence, ranging from machine bidders competing against each other in an auction environment for buying advertising placements, to image/text/music generation with minimax adversarial games, to coordinating multiple AI agents as a team to defeat their enemies in StarCraft combat games. I will finally conclude the talk by pointing out the future direction on this exciting field.