Change the RBD store to resize the image by up to 8GiB
at the time to not resize on every write.

Trim the image in Ceph after all data has been written
to the actual size in case we overshot the resize.

Partial-Bug: #1792710
Related-to: spec-lite-Ceph-Store-Optimization

Change-Id: I7f0bffda222b663d4316c5d6c03fdbd0d3337035
(cherry picked from commit c43f19e8)

It replaces legacy-tempest-dsvm-full-ceph-plugin-src-glance_store
which is defined inside openstack-zuul-jobs.
It is really a variant of the devstack-plugin-ceph-tempest job.

Remove .zuul.yaml from the ignored file list as in other jobs.

Change-Id: Id9bc9172560421e3ebcbb3842da367ffd9a6bfd4
(cherry picked from commit 1f50f31c)

With cinder configured as glance store and nfs as cinder backend,
if we create multiple images concurrently into the same share,
there might be race conditions.
This patch ensures a lock per export to avoid the race conditions.

This patch also introduces a reference counting mechamism for unmounting
which will unmount the share if no active thread/process is using it.

Closes-Bug: #1870289

Change-Id: I9197f64e29a0ae2e0a58186f1a70aa134f7f1db6
(cherry picked from commit f5d46996)

If user mis-configures one of the multiple stores defined in glance-api
configuratio file, then service returns 503 for all API requests.

Made provision to exclude faulty store and resume service normally
to function wiht other configured stores.

Closes-Bug: #1875281
Change-Id: I685a0ecbfba7cf7dbce3fd2eb84f97bd8ffbfcf3
(cherry picked from commit 98b90911)

Update the URL to the upper-constraints file to point to the redirect
rule on releases.openstack.org so that anyone working on this branch
will switch to the correct upper-constraints list automatically when
the requirements repository branches.

Until the requirements repository has as stable/ussuri branch, tests will
continue to use the upper-constraints list on master.

Change-Id: I1f2a1b8de81c5b8cd86881d591b76a7d6e62a5e5

Change-Id: If12ea4bf1c880a20a2c312d81c92f6feb79a6c1d

Change-Id: Id75209c172d881d90c85002bf6496cc1eef9c702

This patch adds a config option 'mount_point_base' by which we can
provide the mount point for *fs volumes.
The different types of FS drivers will have separate directory for
mounting their volumes,
Eg: <mount_point_base>/nfs, <mount_point_base>/xyzfs etc.
The default mount point for *fs volumes is /var/lib/glance/mnt/*fs.

Closes-Bug: #1866966

Change-Id: I10b5ea4943ad9388ce1962eae9204b905c8ff24a

Some of the methods in cinder store are only used by the Store class
methods and not used outside.
It makes sense to bound them to the class.
This refactoring will also help in handling the None imports inside
the class configure methods which will be done in a followup.

This patch also updates cinderclient version from v2(deprecated) to
v3(current).

Change-Id: I576b787012e73ebaf3274cfd8c31f79894284891

Revive the S3 driver that was supported up to Mitaka and add multiple
store support to correspond with the features added to glance_store from
Newton to U cycle. In addition, the use of the S3 SDK used by the Mitaka
S3 driver has been deprecated, so this implementation will be changed
to use the new version.

Change-Id: I203134837319080ead96da69048baf90086d2117
Implements: blueprint re-support-s3-driver

When the image is size larger than chunk size, swift store
uploads 0 bytes for swift_buffered_upload enabled.

Closes-Bug: #1863691

Change-Id: I272d380d8fc093e946ecd6bd5ba99b5bbe2409b2

Image upload is failing with NoFibreChannelVolumeDeviceFound error after
configuring cinder backend (HP3Par FC storage) for the glance service. The
issue here is that usually cinder calls os_brick with multipath information
but in this case cinder driver of glance is doing the call (without passing
any multipath information). with hard-coded' False to let os_brick library
know that multipath is not configured.

In order to fix this, added two new boolean config option for cinder
driver default to False;

'cinder_use_multipath'
'cinder_enforce_multipath'

Change-Id: I07064f3cb1a33ac4ac7e4b572f8e1b5c688bd9a3
Closes-Bug: #1863983

Even after dropping support for py2, tempest-full job is still running
using python2.

Removed this job from the set of templates.

Change-Id: I4dd93511567ba180d758628ccd0307340ba74fe2

ConfigParser does not remove quotes in Python3 that may break existing
configuration. This commit restores Python2 behavior and acts as
oslo.config StrOpt with quotes=True.

Closes-bug: #1839778
Related-bug: #1839772
Change-Id: I9e8e7e32b7abf1020081cc3b9fbdf7229403b7bf

OpenStack is dropping the py2.7 support in ussuri cycle.

glance_store is ready with python 3 and ok to drop the
python 2.7 support.

Complete discussion & schedule can be found in
- http://lists.openstack.org/pipermail/openstack-discuss/2019-October/010142.html
- https://etherpad.openstack.org/p/drop-python2-support

Ussuri Communtiy-wide goal - https://review.opendev.org/#/c/691178/

Change-Id: I6166a20610f77e0df7da75198e0c8273bb121d1f

pass configured cacert for Swift to the keystoneauth's Session
as well so that the swift endpoint can be resolved from the catalog
when a custom CA bundle is used.

Change-Id: I439f6b5af34c685f72c9b4933c7eb0c77cc92e14
Closes-Bug: #1820817

This is a counterpart of the glance doc patch [0].
This commit cleans up unexpected vertical lines at left side like [1].
For more detail context, see the commit mesasge of [0].

[0] https://review.opendev.org/682791
[1] https://docs.openstack.org/glance/latest/configuration/glance_cache.html#glance_store.swift_upload_buffer_dir

Change-Id: If1571631f4d24bc0550e2f42c49c9529451d74d2

For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: I0860a74f92ed97c2860c74f03cbc53ee4c34b90c

Change-Id: I0c202cedb1532b9fe44afbb6553e7353185f6238

Change-Id: I267224f734303e4e9791e5019a014814f6161956

For more information about this automatic import see:
https://docs.openstack.org/i18n/latest/reviewing-translation-import.html

Change-Id: If5ced94a41e593fc5ec3374626fec2b2e7ee7f21

Change-Id: Ib5a6891261be14ead6f358982d8181b075050188

Add file to the reno documentation build to show release notes for
stable/train.

Use pbr instruction to increment the minor version number
automatically so that master versions are higher than the versions on
stable/train.

Change-Id: I604685b7eab4f6bca06317b56ee0f8e854d0466a
Sem-Ver: feature

The config options for file stores will be registered
under correct group based on the dict "reserved_stores".

Change-Id: I636e7f8b625056d1c7ee1503ced4dd7628384bfb

Warning filter was enabled while fixing Launchpad bug #1516020 and later
when deprecation unused exceptions were removed, warning filter wasn't
removed due to which when glance_store is used by other projects, it
emits DeprecationWarning messages continuously.

This patch removes the unwanted warning filter.

Change-Id: Ibf227d509e567ccbcf77676277300511de2ad14d
Closes-Bug: #1844462

There is a bug where is_zero_size is set when the loop is exited,
regardless of whether any data was written in the while loop, making it
seems like 0 bytes were written.

We need to differentiate an exit with no data written and and exit with,
so we test if anything was actually written and only set is_zero_size
when nothing has been written.

Also, bytes_read gets resetted to 0 with the next line seek(0), so we
check before resetting the file position.

Change-Id: I547bdefe88816db85b5ff510e997980269eac1f7