If you no longer want to be a collaborator on someone else's repository, you can remove yourself.
In the top right corner of any page, click your profile photo, then click Settings.
In the left sidebar, click Repositories.
Next to the repository you want to leave, click Leave.
Read the warning carefully and then click "I understand, leave this repository"