In this talk I will present an historical view on the shape and topological derivative approach to damage and fracture problems in brittle materials. I will talk about my contributions on this topic achieved in the last 15 years in collaboration with G. Allaire, F. Jouve, A. Novotny, M. Xavier and S. Amstutz.