Black box algorithmic systems make decisions that have a great impact in our lives. Thus, the need for their accountability and transparency is growing. Our team has created an evaluation model reflecting the state of practice in several organizations.This session presents the aspects this model covers and highlights the lessons learned from its application at a financial corporation.