Artificial intelligence (AI) algorithms for automated classification of skin diseases have shown promising results with a diagnostic accuracy that have performed equal to or even outperformed dermatologists. There is an abundance of AI applications on the consumer market. However, external validation with real life dermatological pictures from a mixed array of diagnosis, including not only melanocytic tumors but also inflammatory conditions, is missing. The main conclusion in this paper is that automated classification systems need further development to ensure appropriate accuracy. Consumers need to be vigilant with respect to the rapid development within this field, and the lack of scientifically unbiased validation.