Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

inaccurate display of last sync after adding a new connection to an existing pipeline #525

Open
jakejh opened this issue Mar 28, 2024 · 3 comments
Labels
bug Something isn't working

Comments

@jakejh
Copy link

jakejh commented Mar 28, 2024

See attached. the gsheet connection was just created and added to the same pipeline as the other two connections, but it has not been run.
Screenshot 2024-03-28 at 21 59 11

@fatchat
Copy link
Contributor

fatchat commented Apr 1, 2024

Yes this is a bug, it thinks it was run because the pipeline it's now a part of was run

This is a design flaw, will need to figure out a solution

@fatchat fatchat added this to Dalgo Apr 1, 2024
@fatchat fatchat added the bug Something isn't working label Apr 1, 2024
@Ishankoradia Ishankoradia self-assigned this Apr 2, 2024
@jakejh
Copy link
Author

jakejh commented May 3, 2024

I just noticed a related behavior: the connection below was part of a pipeline that had been running daily for the last month, but I deleted the pipeline today. prior to deleting the pipeline, dalgo said the last sync was 20 hours ago. now, apparently because the pipeline no longer exists, it says the last sync was 10 days ago, which is probably when I last ran a manual sync.

Screenshot 2024-05-03 at 13 01 51

@fatchat
Copy link
Contributor

fatchat commented May 3, 2024

your guess is correct - dalgo looks through the list of manual syncs and pipeline runs for pipelines this connection is a part of (these lists are managed separately as distinct prefect deployments)

the change we need to implement is to look directly at the airbyte history rather than the prefect history

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
Status: No status
Development

No branches or pull requests

3 participants