When you send the code to the Arduino from your computer, the code is stored on the Arduino itself. You can upload and delete code from your Arduino as much as you like.

Arduino simplifies things by only using just one coding language. Here's what you need to get started with developing software for the tiny device.