Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enhance bigtable-beam-import project to import multiple hbase table snapshots into bigtable #4070

Open
prathapreddy123 opened this issue May 5, 2023 · 0 comments
Labels
api: bigtable Issues related to the googleapis/java-bigtable-hbase API.

Comments

@prathapreddy123
Copy link

Thanks for stopping by to let us know something could be better!

PLEASE READ: If you have a support contract with Google, please create an issue in the support console instead of filing on GitHub. This will ensure a timely response.

Is your feature request related to a problem? Please describe.
Current Dataflow Pipeline supports importing snapshot of only a single hbase table into BigTable.

Describe the solution you'd like
It would be helpful to enhance the pipeline to support following features:

  • Importing multiple snapshots in the same pipeline into corresponding BigTable tables
  • Handle parallelization of Skewed regions to enhance performance
  • Configuring additional BigTable configuration

Describe alternatives you've considered
Run multiple copies of the pipeline for each snapshot

Additional context
NA

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
api: bigtable Issues related to the googleapis/java-bigtable-hbase API.
Projects
None yet
Development

No branches or pull requests

1 participant