A combination of not wanting people to ever delete it and terrible design, as some windows components depend on the built in web browser to function. It's why they kept internet explorer around forever despite the new (well, now the old) edge being a thing.