Support Apache Beam >= 2.44.0
Once we find out the root cause of:
- #5426 

we should revert the temporary pin on apache-beam introduced by:
- #5429
Some of the shard files now have 0 number of rows.

We have opened an issue in the Apache Beam repo:
- https://github.com/apache/beam/issues/25041