adam/gitea-mirror
1
0 Fork 0
mirror of https://github.com/RayLabsHQ/gitea-mirror.git synced 2026-11-03 07:42:19 +01:00
Code Issues 4 Packages Projects Releases Wiki Activity

Large quantity of timestamped duplicate repos #57

New Issue
Closed
opened 2026-10-05 01:38:11 +02:00 by adam · 9 comments
adam commented 2026-10-05 01:38:11 +02:00
Owner
Copy link
Copy source

Not sure if I've configured something incorrectly, or if this behavior is documented but for some subset of repos I'm mirroring, I'm seeing a large number of duplicates being mirrored whose names end with what looks like a timestamp:

Image

Furthermore, many (all but the latest/highest) look like this, even after hours/days:

Image

Hope this is enough context - for the time being, I'm just running gitea-mirror periodically; otherwise, I'm getting hundreds more repos (almost 1k at this point) more repos being mirrored than intended.

But having said all that, this project is still awesome, thank you!

Not sure if I've configured something incorrectly, or if this behavior is documented but for some subset of repos I'm mirroring, I'm seeing a large number of duplicates being mirrored whose names end with what looks like a timestamp: <img width="360" height="582" alt="Image" src="https://github.com/user-attachments/assets/6caaf5ea-c420-4d68-b28b-d0b541a841ec" /> Furthermore, many (all but the latest/highest) look like this, even after hours/days: <img width="960" height="495" alt="Image" src="https://github.com/user-attachments/assets/54a438bc-e74b-4a61-bb30-96d0428442d7" /> Hope this is enough context - for the time being, I'm just running gitea-mirror periodically; otherwise, I'm getting hundreds more repos (almost 1k at this point) more repos being mirrored than intended. But having said all that, this project is still awesome, thank you! <!-- github-sync-id:3506509925 -->
adam closed this issue 2026-10-05 01:38:11 +02:00
adam commented 2026-10-05 01:38:12 +02:00
Author
Owner
Copy link
Copy source

@sunny-g this is weird and I have not seen this issue before is it with more than 1 repo or just this particular one ?

@sunny-g this is weird and I have not seen this issue before is it with more than 1 repo or just this particular one ? <!-- github-comment-id:3393916362 -->
adam commented 2026-10-05 01:38:13 +02:00
Author
Owner
Copy link
Copy source

I am also seeing this issue as well but typically it is 1 or 2 additional to the original.

I am also seeing this issue as well but typically it is 1 or 2 additional to the original. <!-- github-comment-id:3407269218 -->
adam commented 2026-10-05 01:38:14 +02:00
Author
Owner
Copy link
Copy source

@Arrmm can you add some related docker logs

@Arrmm can you add some related docker logs <!-- github-comment-id:3413826764 -->
adam commented 2026-10-05 01:38:14 +02:00
Author
Owner
Copy link
Copy source

Furthermore, many (all but the latest/highest) look like this, even after hours/days:

Image Hope this is enough context - for the time being, I'm just running gitea-mirror periodically; otherwise, I'm getting hundreds more repos (almost 1k at this point) more repos being mirrored than intended.

But having said all that, this project is still awesome, thank you!

From what I know, some of the repos takes a lot longer to mirror than others, and sometimes it gets stuck because of timeout. I don't think that's necessary gitea-mirror's problem but more like github or gitea problems.

I actually wrote a bash script to mirror the repos and it does exactly the same thing. Also to note that there are repos out there just can't be mirrored. Don't ask me why. For example, https://github.com/MicrosoftDocs/azure-docs can't be mirrored. I have tried it so many ways, even through gitea itself (using New Migration).

> Furthermore, many (all but the latest/highest) look like this, even after hours/days: > > <img alt="Image" width="960" height="495" src="https://private-user-images.githubusercontent.com/2055636/500214053-54a438bc-e74b-4a61-bb30-96d0428442d7.png?jwt=eyJ0eXAiOiJKV1QiLCJhbGciOiJIUzI1NiJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3NjA3MTQ2MzIsIm5iZiI6MTc2MDcxNDMzMiwicGF0aCI6Ii8yMDU1NjM2LzUwMDIxNDA1My01NGE0MzhiYy1lNzRiLTRhNjEtYmIzMC05NmQwNDI4NDQyZDcucG5nP1gtQW16LUFsZ29yaXRobT1BV1M0LUhNQUMtU0hBMjU2JlgtQW16LUNyZWRlbnRpYWw9QUtJQVZDT0RZTFNBNTNQUUs0WkElMkYyMDI1MTAxNyUyRnVzLWVhc3QtMSUyRnMzJTJGYXdzNF9yZXF1ZXN0JlgtQW16LURhdGU9MjAyNTEwMTdUMTUxODUyWiZYLUFtei1FeHBpcmVzPTMwMCZYLUFtei1TaWduYXR1cmU9MWQyM2M0Nzc3OGI4MGJmMDA4MWRiYWJkZjMwYmJkODEwZmMzNjlkZTlkZWZiZWE3YzY4YzYwNjhkOTBiYzEyYSZYLUFtei1TaWduZWRIZWFkZXJzPWhvc3QifQ.N5py6AjCNDHFMnnqstek8kb8x-3WF8JDWPb3UWfx96I"> > Hope this is enough context - for the time being, I'm just running gitea-mirror periodically; otherwise, I'm getting hundreds more repos (almost 1k at this point) more repos being mirrored than intended. > > But having said all that, this project is still awesome, thank you! From what I know, some of the repos takes a lot longer to mirror than others, and sometimes it gets stuck because of timeout. I don't think that's necessary gitea-mirror's problem but more like github or gitea problems. I actually wrote a bash script to mirror the repos and it does exactly the same thing. Also to note that there are repos out there just can't be mirrored. Don't ask me why. For example, https://github.com/MicrosoftDocs/azure-docs can't be mirrored. I have tried it so many ways, even through gitea itself (using New Migration). <!-- github-comment-id:3416035926 -->
adam commented 2026-10-05 01:38:15 +02:00
Author
Owner
Copy link
Copy source

@Arrmm thanks for investigating deeper into it. Need to figure out why this maybe happening cause I don't remember changing anything drastic recently

@Arrmm thanks for investigating deeper into it. Need to figure out why this maybe happening cause I don't remember changing anything drastic recently <!-- github-comment-id:3416435886 -->
adam commented 2026-10-05 01:38:16 +02:00
Author
Owner
Copy link
Copy source

I am still investigating. Give me another few days and I'll share the log so that we can all debug it together.

Can't say enough good things about this tool though. It is very pretty and easy to use.

I am still investigating. Give me another few days and I'll share the log so that we can all debug it together. Can't say enough good things about this tool though. It is very pretty and easy to use. <!-- github-comment-id:3416766266 -->
adam commented 2026-10-05 01:38:16 +02:00
Author
Owner
Copy link
Copy source

Can't say enough good things about this tool though. It is very pretty and easy to use.

@Arrmm Thank you. Next goal is to work towards ironing out all small annoying issues.

> Can't say enough good things about this tool though. It is very pretty and easy to use. @Arrmm Thank you. Next goal is to work towards ironing out all small annoying issues. <!-- github-comment-id:3417745621 -->
adam commented 2026-10-05 01:38:17 +02:00
Author
Owner
Copy link
Copy source

@sunny-g @Arrmm consider testing the image with the new PR for this #119 and see if it solves this issue. I would test it on a fresh gitea

@sunny-g @Arrmm consider testing the image with the new PR for this #119 and see if it solves this issue. I would test it on a fresh gitea <!-- github-comment-id:3430338616 -->
adam commented 2026-10-05 01:38:18 +02:00
Author
Owner
Copy link
Copy source

This should be solved now @sunny-g @Arrmm feel free to reopen this issue if it persists

This should be solved now @sunny-g @Arrmm feel free to reopen this issue if it persists <!-- github-comment-id:3431050349 -->
Sign in to join this conversation.
No Branch/Tag Specified
Labels
No items
No labels
Milestone
No items
No Milestone
Projects
Clear projects
No projects
Assignees
Clear assignees
adam (Adam Wojcieszonek)
No Assignees
1 Participants
Notifications
Due Date
No due date set.
Dependencies

No dependencies set.

Reference: adam/gitea-mirror#57