Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Speed up test suite execution #31

Open
jphalip opened this issue Dec 29, 2022 · 0 comments
Open

Speed up test suite execution #31

jphalip opened this issue Dec 29, 2022 · 0 comments

Comments

@jphalip
Copy link
Collaborator

jphalip commented Dec 29, 2022

The overall test suite is currently a bit slow to run. Here are a few things to look into to speed things up:

  • Convert some integration tests into unit tests. We might not need to exercise the full stack for so many tests. Instead some integration tests could be modified to directly test specific classes or methods.
  • Reduce test matrix for some tests. We currently use CartesianTest to run a given test under multiple combination of configurations: execution engine (tez/mr), read format (avro/arrow), and write method (direct/indirect). This is to make sure we test all possible code paths. But it might be redundant to do that for all tests. We could reduce the test matrix for some tests after inspecting the test coverage and making sure that the various code paths are well covered.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant