Upload 95 files

.gitattributes

@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+SuperGluePretrainedNetwork/assets/freiburg_matches.gif filter=lfs diff=lfs merge=lfs -text

SuperGluePretrainedNetwork/.gitignore

@@ -0,0 +1,3 @@
+*.pyc
+*.DS_Store
+*.swp

SuperGluePretrainedNetwork/LICENSE

@@ -0,0 +1,48 @@
+SUPERGLUE: LEARNING FEATURE MATCHING WITH GRAPH NEURAL NETWORKS
+SOFTWARE LICENSE AGREEMENT
+ACADEMIC OR NON-PROFIT ORGANIZATION NONCOMMERCIAL RESEARCH USE ONLY
+
+BY USING OR DOWNLOADING THE SOFTWARE, YOU ARE AGREEING TO THE TERMS OF THIS LICENSE AGREEMENT.  IF YOU DO NOT AGREE WITH THESE TERMS, YOU MAY NOT USE OR DOWNLOAD THE SOFTWARE.
+
+This is a license agreement ("Agreement") between your academic institution or non-profit organization or self (called "Licensee" or "You" in this Agreement) and Magic Leap, Inc. (called "Licensor" in this Agreement).  All rights not specifically granted to you in this Agreement are reserved for Licensor. 
+
+RESERVATION OF OWNERSHIP AND GRANT OF LICENSE: 
+Licensor retains exclusive ownership of any copy of the Software (as defined below) licensed under this Agreement and hereby grants to Licensee a personal, non-exclusive, non-transferable license to use the Software for noncommercial research purposes, without the right to sublicense, pursuant to the terms and conditions of this Agreement.  As used in this Agreement, the term "Software" means (i) the actual copy of all or any portion of code for program routines made accessible to Licensee by Licensor pursuant to this Agreement, inclusive of backups, updates, and/or merged copies permitted hereunder or subsequently supplied by Licensor,  including all or any file structures, programming instructions, user interfaces and screen formats and sequences as well as any and all documentation and instructions related to it, and (ii) all or any derivatives and/or modifications created or made by You to any of the items specified in (i).
+
+CONFIDENTIALITY: Licensee acknowledges that the Software is proprietary to Licensor, and as such, Licensee agrees to receive all such materials in confidence and use the Software only in accordance with the terms of this Agreement.  Licensee agrees to use reasonable effort to protect the Software from unauthorized use, reproduction, distribution, or publication.
+
+COPYRIGHT: The Software is owned by Licensor and is protected by United  States copyright laws and applicable international treaties and/or conventions.
+
+PERMITTED USES:  The Software may be used for your own noncommercial internal research purposes. You understand and agree that Licensor is not obligated to implement any suggestions and/or feedback you might provide regarding the Software, but to the extent Licensor does so, you are not entitled to any compensation related thereto.
+
+DERIVATIVES: You may create derivatives of or make modifications to the Software, however, You agree that all and any such derivatives and modifications will be owned by Licensor and become a part of the Software licensed to You under this Agreement.  You may only use such derivatives and modifications for your own noncommercial internal research purposes, and you may not otherwise use, distribute or copy such derivatives and modifications in violation of this Agreement.
+
+BACKUPS:  If Licensee is an organization, it may make that number of copies of the Software necessary for internal noncommercial use at a single site within its organization provided that all information appearing in or on the original labels, including the copyright and trademark notices are copied onto the labels of the copies.
+
+USES NOT PERMITTED:  You may not distribute, copy or use the Software except as explicitly permitted herein. Licensee has not been granted any trademark license as part of this Agreement and may not use the name or mark "Magic Leap" or any renditions thereof without the prior written permission of Licensor.
+
+You may not sell, rent, lease, sublicense, lend, time-share or transfer, in whole or in part, or provide third parties access to prior or present versions (or any parts thereof) of the Software.
+
+ASSIGNMENT: You may not assign this Agreement or your rights hereunder without the prior written consent of Licensor. Any attempted assignment without such consent shall be null and void.
+
+TERM: The term of the license granted by this Agreement is from Licensee's acceptance of this Agreement by downloading the Software or by using the Software until terminated as provided below.
+
+The Agreement automatically terminates without notice if you fail to comply with any provision of this Agreement.  Licensee may terminate this Agreement by ceasing using the Software.  Upon any termination of this Agreement, Licensee will delete any and all copies of the Software. You agree that all provisions which operate to protect the proprietary rights of Licensor shall remain in force should breach occur and that the obligation of confidentiality described in this Agreement is binding in perpetuity and, as such, survives the term of the Agreement.
+
+FEE: Provided Licensee abides completely by the terms and conditions of this Agreement, there is no fee due to Licensor for Licensee's use of the Software in accordance with this Agreement.
+
+DISCLAIMER OF WARRANTIES:  THE SOFTWARE IS PROVIDED "AS-IS" WITHOUT WARRANTY OF ANY KIND INCLUDING ANY WARRANTIES OF PERFORMANCE OR MERCHANTABILITY OR FITNESS FOR A PARTICULAR USE OR PURPOSE OR OF NON-INFRINGEMENT.  LICENSEE BEARS ALL RISK RELATING TO QUALITY AND PERFORMANCE OF THE SOFTWARE AND RELATED MATERIALS.
+
+SUPPORT AND MAINTENANCE: No Software support or training by the Licensor is provided as part of this Agreement.  
+
+EXCLUSIVE REMEDY AND LIMITATION OF LIABILITY: To the maximum extent permitted under applicable law, Licensor shall not be liable for direct, indirect, special, incidental, or consequential damages or lost profits related to Licensee's use of and/or inability to use the Software, even if Licensor is advised of the possibility of such damage.
+
+EXPORT REGULATION: Licensee agrees to comply with any and all applicable U.S. export control laws, regulations, and/or other laws related to embargoes and sanction programs administered by the Office of Foreign Assets Control.
+
+SEVERABILITY: If any provision(s) of this Agreement shall be held to be invalid, illegal, or unenforceable by a court or other tribunal of competent jurisdiction, the validity, legality and enforceability of the remaining provisions shall not in any way be affected or impaired thereby.
+
+NO IMPLIED WAIVERS: No failure or delay by Licensor in enforcing any right or remedy under this Agreement shall be construed as a waiver of any future or other exercise of such right or remedy by Licensor.
+
+GOVERNING LAW: This Agreement shall be construed and enforced in accordance with the laws of the State of Florida without reference to conflict of laws principles.  You consent to the personal jurisdiction of the courts of this County and waive their rights to venue outside of Broward County, Florida.
+
+ENTIRE AGREEMENT AND AMENDMENTS: This Agreement constitutes the sole and entire agreement between Licensee and Licensor as to the matter set forth herein and supersedes any previous agreements, understandings, and arrangements between the parties relating hereto.

SuperGluePretrainedNetwork/README.md

@@ -0,0 +1,388 @@
+<img src="assets/magicleap.png" width="240">
+
+### Research @ Magic Leap (CVPR 2020, Oral)
+
+# SuperGlue Inference and Evaluation Demo Script
+
+## Introduction
+SuperGlue is a CVPR 2020 research project done at Magic Leap. The SuperGlue network is a Graph Neural Network combined with an Optimal Matching layer that is trained to perform matching on two sets of sparse image features. This repo includes PyTorch code and pretrained weights for running the SuperGlue matching network on top of [SuperPoint](https://arxiv.org/abs/1712.07629) keypoints and descriptors. Given a pair of images, you can use this repo to extract matching features across the image pair.
+
+<p align="center">
+  <img src="assets/teaser.png" width="500">
+</p>
+
+SuperGlue operates as a "middle-end," performing context aggregation, matching, and filtering in a single end-to-end architecture. For more details, please see:
+
+* Full paper PDF: [SuperGlue: Learning Feature Matching with Graph Neural Networks](https://arxiv.org/abs/1911.11763).
+
+* Authors: *Paul-Edouard Sarlin, Daniel DeTone, Tomasz Malisiewicz, Andrew Rabinovich*
+
+* Website: [psarlin.com/superglue](https://psarlin.com/superglue) for videos, slides, recent updates, and more visualizations.
+
+* `hloc`: a new toolbox for visual localization and SfM with SuperGlue, available at [cvg/Hierarchical-Localization](https://github.com/cvg/Hierarchical-Localization/). Winner of 3 CVPR 2020 competitions on localization and image matching!
+
+We provide two pre-trained weights files: an indoor model trained on ScanNet data, and an outdoor model trained on MegaDepth data. Both models are inside the [weights directory](./models/weights). By default, the demo will run the **indoor** model.
+
+## Dependencies
+* Python 3 >= 3.5
+* PyTorch >= 1.1
+* OpenCV >= 3.4 (4.1.2.30 recommended for best GUI keyboard interaction, see this [note](#additional-notes))
+* Matplotlib >= 3.1
+* NumPy >= 1.18
+
+Simply run the following command: `pip3 install numpy opencv-python torch matplotlib`
+
+## Contents
+There are two main top-level scripts in this repo:
+
+1. `demo_superglue.py` : runs a live demo on a webcam, IP camera, image directory or movie file
+2. `match_pairs.py`: reads image pairs from files and dumps matches to disk (also runs evaluation if ground truth relative poses are provided)
+
+## Live Matching Demo Script (`demo_superglue.py`)
+This demo runs SuperPoint + SuperGlue feature matching on an anchor image and live image. You can update the anchor image by pressing the `n` key. The demo can read image streams from a USB or IP camera, a directory containing images, or a video file. You can pass all of these inputs using the `--input` flag.
+
+### Run the demo on a live webcam
+
+Run the demo on the default USB webcam (ID #0), running on a CUDA GPU if one is found:
+
+```sh
+./demo_superglue.py
+```
+
+Keyboard control:
+
+* `n`: select the current frame as the anchor
+* `e`/`r`: increase/decrease the keypoint confidence threshold
+* `d`/`f`: increase/decrease the match filtering threshold
+* `k`: toggle the visualization of keypoints
+* `q`: quit
+
+Run the demo on 320x240 images running on the CPU:
+
+```sh
+./demo_superglue.py --resize 320 240 --force_cpu
+```
+
+The `--resize` flag can be used to resize the input image in three ways:
+
+1. `--resize` `width` `height` : will resize to exact `width` x `height` dimensions
+2. `--resize` `max_dimension` : will resize largest input image dimension to `max_dimension`
+3. `--resize` `-1` : will not resize (i.e. use original image dimensions)
+
+The default will resize images to `640x480`.
+
+### Run the demo on a directory of images
+
+The `--input` flag also accepts a path to a directory. We provide a directory of sample images from a sequence. To run the demo on the directory of images in `freiburg_sequence/` on a headless server (will not display to the screen) and write the output visualization images to `dump_demo_sequence/`:
+
+```sh
+./demo_superglue.py --input assets/freiburg_sequence/ --output_dir dump_demo_sequence --resize 320 240 --no_display
+```
+
+You should see this output on the sample Freiburg-TUM RGBD sequence:
+
+<img src="assets/freiburg_matches.gif" width="560">
+
+The matches are colored by their predicted confidence in a jet colormap (Red: more confident, Blue: less confident).
+
+### Additional useful command line parameters
+* Use `--image_glob` to change the image file extension (default: `*.png`, `*.jpg`, `*.jpeg`).
+* Use `--skip` to skip intermediate frames (default: `1`).
+* Use `--max_length` to cap the total number of frames processed (default: `1000000`).
+* Use `--show_keypoints` to visualize the detected keypoints (default: `False`).
+
+## Run Matching+Evaluation (`match_pairs.py`)
+
+This repo also contains a script `match_pairs.py` that runs the matching from a list of image pairs. With this script, you can:
+
+* Run the matcher on a set of image pairs (no ground truth needed)
+* Visualize the keypoints and matches, based on their confidence
+* Evaluate and visualize the match correctness, if the ground truth relative poses and intrinsics are provided
+* Save the keypoints, matches, and evaluation results for further processing
+* Collate evaluation results over many pairs and generate result tables
+
+### Matches only mode
+
+The simplest usage of this script will process the image pairs listed in a given text file and dump the keypoints and matches to compressed numpy `npz` files. We provide the challenging ScanNet pairs from the main paper in `assets/example_indoor_pairs/`. Running the following will run SuperPoint + SuperGlue on each image pair, and dump the results to `dump_match_pairs/`:
+
+```sh
+./match_pairs.py
+```
+
+The resulting `.npz` files can be read from Python as follows:
+
+```python
+>>> import numpy as np
+>>> path = 'dump_match_pairs/scene0711_00_frame-001680_scene0711_00_frame-001995_matches.npz'
+>>> npz = np.load(path)
+>>> npz.files
+['keypoints0', 'keypoints1', 'matches', 'match_confidence']
+>>> npz['keypoints0'].shape
+(382, 2)
+>>> npz['keypoints1'].shape
+(391, 2)
+>>> npz['matches'].shape
+(382,)
+>>> np.sum(npz['matches']>-1)
+115
+>>> npz['match_confidence'].shape
+(382,)
+```
+
+For each keypoint in `keypoints0`, the `matches` array indicates the index of the matching keypoint in `keypoints1`, or `-1` if the keypoint is unmatched.
+
+### Visualization mode
+
+You can add the flag `--viz` to dump image outputs which visualize the matches:
+
+```sh
+./match_pairs.py --viz
+```
+
+You should see images like this inside of `dump_match_pairs/` (or something very close to it, see this [note](#a-note-on-reproducibility)):
+
+<img src="assets/indoor_matches.png" width="560">
+
+The matches are colored by their predicted confidence in a jet colormap (Red: more confident, Blue: less confident).
+
+### Evaluation mode
+
+You can also estimate the pose using RANSAC + Essential Matrix decomposition and evaluate it if the ground truth relative poses and intrinsics are provided in the input `.txt` files. Each `.txt` file contains three key ground truth matrices: a 3x3 intrinsics matrix of image0: `K0`, a 3x3 intrinsics matrix of image1: `K1` , and a 4x4 matrix of the relative pose extrinsics `T_0to1`.
+
+To run the evaluation on the sample set of images (by default reading `assets/scannet_sample_pairs_with_gt.txt`), you can run:
+
+```sh
+./match_pairs.py --eval
+```
+
+
+Since you enabled `--eval`, you should see collated results printed to the terminal. For the example images provided, you should get the following numbers (or something very close to it, see this [note](#a-note-on-reproducibility)):
+
+```txt
+Evaluation Results (mean over 15 pairs):
+AUC@5    AUC@10  AUC@20  Prec    MScore
+26.99    48.40   64.47   73.52   19.60
+```
+
+The resulting `.npz` files in `dump_match_pairs/` will now contain scalar values related to the evaluation, computed on the sample images provided. Here is what you should find in one of the generated evaluation files:
+
+```python
+>>> import numpy as np
+>>> path = 'dump_match_pairs/scene0711_00_frame-001680_scene0711_00_frame-001995_evaluation.npz'
+>>> npz = np.load(path)
+>>> print(npz.files)
+['error_t', 'error_R', 'precision', 'matching_score', 'num_correct', 'epipolar_errors']
+```
+
+You can also visualize the evaluation metrics by running the following command:
+
+```sh
+./match_pairs.py --eval --viz
+```
+
+You should also now see additional images in `dump_match_pairs/` which visualize the evaluation numbers (or something very close to it, see this [note](#a-note-on-reproducibility)):
+
+<img src="assets/indoor_evaluation.png" width="560">
+
+The top left corner of the image shows the pose error and number of inliers, while the lines are colored by their epipolar error computed with the ground truth relative pose (red: higher error, green: lower error).
+
+### Running on sample outdoor pairs
+
+<details>
+  <summary>[Click to expand]</summary>
+
+In this repo, we also provide a few challenging Phototourism pairs, so that you can re-create some of the figures from the paper. Run this script to run matching and visualization (no ground truth is provided, see this [note](#reproducing-outdoor-evaluation-final-table)) on the provided pairs:
+
+```sh
+./match_pairs.py --resize 1600 --superglue outdoor --max_keypoints 2048 --nms_radius 3  --resize_float --input_dir assets/phototourism_sample_images/ --input_pairs assets/phototourism_sample_pairs.txt --output_dir dump_match_pairs_outdoor --viz
+```
+
+You should now image pairs such as these in `dump_match_pairs_outdoor/` (or something very close to it, see this [note](#a-note-on-reproducibility)):
+
+<img src="assets/outdoor_matches.png" width="560">
+
+</details>
+
+### Recommended settings for indoor / outdoor
+
+<details>
+  <summary>[Click to expand]</summary>
+
+For **indoor** images, we recommend the following settings (these are the defaults):
+
+```sh
+./match_pairs.py --resize 640 --superglue indoor --max_keypoints 1024 --nms_radius 4
+```
+
+For **outdoor** images, we recommend the following settings:
+
+```sh
+./match_pairs.py --resize 1600 --superglue outdoor --max_keypoints 2048 --nms_radius 3 --resize_float
+```
+
+You can provide your own list of pairs `--input_pairs` for images contained in `--input_dir`. Images can be resized before network inference with `--resize`. If you are re-running the same evaluation many times, you can use the `--cache` flag to reuse old computation.
+</details>
+
+### Test set pair file format explained
+
+<details>
+  <summary>[Click to expand]</summary>
+
+We provide the list of ScanNet test pairs in `assets/scannet_test_pairs_with_gt.txt` (with ground truth) and Phototourism test pairs `assets/phototourism_test_pairs.txt` (without ground truth) used to evaluate the matching from the paper. Each line corresponds to one pair and is structured as follows:
+
+```
+path_image_A path_image_B exif_rotationA exif_rotationB [KA_0 ... KA_8] [KB_0 ... KB_8] [T_AB_0 ... T_AB_15]
+```
+
+The `path_image_A` and `path_image_B` entries are paths to image A and B, respectively. The `exif_rotation` is an integer in the range [0, 3] that comes from the original EXIF metadata associated with the image, where, 0: no rotation, 1: 90 degree clockwise, 2: 180 degree clockwise, 3: 270 degree clockwise. If the EXIF data is not known, you can just provide a zero here and no rotation will be performed. `KA` and `KB` are the flattened `3x3` matrices of image A and image B intrinsics. `T_AB` is a flattened `4x4` matrix of the extrinsics between the pair.
+</details>
+
+### Reproducing the indoor evaluation on ScanNet
+
+<details>
+  <summary>[Click to expand]</summary>
+
+We provide the groundtruth for ScanNet in our format in the file `assets/scannet_test_pairs_with_gt.txt` for convenience. In order to reproduce similar tables to what was in the paper, you will need to download the dataset (we do not provide the raw test images). To download the ScanNet dataset, do the following:
+
+1. Head to the [ScanNet](https://github.com/ScanNet/ScanNet) github repo to download the ScanNet test set (100 scenes).
+2. You will need to extract the raw sensor data from the 100 `.sens` files in each scene in the test set using the [SensReader](https://github.com/ScanNet/ScanNet/tree/master/SensReader) tool.
+
+Once the ScanNet dataset is downloaded in `~/data/scannet`, you can run the following:
+
+```sh
+./match_pairs.py --input_dir ~/data/scannet --input_pairs assets/scannet_test_pairs_with_gt.txt --output_dir dump_scannet_test_results --eval
+```
+
+You should get the following table for ScanNet (or something very close to it, see this [note](#a-note-on-reproducibility)):
+
+```txt
+Evaluation Results (mean over 1500 pairs):
+AUC@5    AUC@10  AUC@20  Prec    MScore
+16.12    33.76   51.79   84.37   31.14
+```
+
+</details>
+
+### Reproducing the outdoor evaluation on YFCC
+
+<details>
+  <summary>[Click to expand]</summary>
+
+We provide the groundtruth for YFCC in our format in the file `assets/yfcc_test_pairs_with_gt.txt` for convenience. In order to reproduce similar tables to what was in the paper, you will need to download the dataset (we do not provide the raw test images). To download the YFCC dataset, you can use the [OANet](https://github.com/zjhthu/OANet) repo:
+
+```sh
+git clone https://github.com/zjhthu/OANet
+cd OANet
+bash download_data.sh raw_data raw_data_yfcc.tar.gz 0 8
+tar -xvf raw_data_yfcc.tar.gz
+mv raw_data/yfcc100m ~/data
+```
+
+Once the YFCC dataset is downloaded in `~/data/yfcc100m`, you can run the following:
+
+```sh
+./match_pairs.py --input_dir ~/data/yfcc100m --input_pairs assets/yfcc_test_pairs_with_gt.txt --output_dir dump_yfcc_test_results --eval --resize 1600 --superglue outdoor --max_keypoints 2048 --nms_radius 3 --resize_float
+```
+
+You should get the following table for YFCC (or something very close to it, see this [note](#a-note-on-reproducibility)):
+
+```txt
+Evaluation Results (mean over 4000 pairs):
+AUC@5    AUC@10  AUC@20  Prec    MScore
+39.02    59.51   75.72   98.72   23.61  
+```
+
+</details>
+
+### Reproducing outdoor evaluation on Phototourism
+
+<details>
+  <summary>[Click to expand]</summary>
+
+The Phototourism results shown in the paper were produced using similar data as the test set from the [Image Matching Challenge 2020](https://vision.uvic.ca/image-matching-challenge/), which holds the ground truth data private for the test set. We list the pairs we used in `assets/phototourism_test_pairs.txt`. To reproduce similar numbers on this test set, please submit to the challenge benchmark. While the challenge is still live, we cannot share the test set publically since we want to help maintain the integrity of the challenge. 
+
+</details>
+
+### Correcting EXIF rotation data in YFCC and Phototourism
+
+<details>
+  <summary>[Click to expand]</summary>
+
+In this repo, we provide manually corrected the EXIF rotation data for the outdoor evaluations on YFCC and Phototourism. For the YFCC dataset we found 7 images with incorrect EXIF rotation flags, resulting in 148 pairs out of 4000 being corrected. For Phototourism, we found 36 images with incorrect EXIF rotation flags, resulting in 212 out of 2200 pairs being corrected.
+
+The SuperGlue paper reports the results of SuperGlue **without** the corrected rotations, while the numbers in this README are reported **with** the corrected rotations. We found that our final conclusions from the evaluation still hold with or without the corrected rotations. For backwards compatability, we included the original, uncorrected EXIF rotation data in `assets/phototourism_test_pairs_original.txt` and `assets/yfcc_test_pairs_with_gt_original.txt` respectively.
+
+</details>
+
+### Outdoor training / validation scene splits of MegaDepth
+
+<details>
+  <summary>[Click to expand]</summary>
+
+For training and validation of the outdoor model, we used scenes from the [MegaDepth dataset](http://www.cs.cornell.edu/projects/megadepth/). We provide the list of scenes used to train the outdoor model in the `assets/` directory:
+
+* Training set: `assets/megadepth_train_scenes.txt`
+* Validation set: `assets/megadepth_validation_scenes.txt`
+
+</details>
+
+### A note on reproducibility
+
+<details>
+  <summary>[Click to expand]</summary>
+
+After simplifying the model code and evaluation code and preparing it for release, we made some improvements and tweaks that result in slightly different numbers than what was reported in the paper. The numbers and figures reported in the README were done using Ubuntu 16.04, OpenCV 3.4.5, and PyTorch 1.1.0. Even with matching the library versions, we observed some slight differences across Mac and Ubuntu, which we believe are due to differences in OpenCV's image resize function implementation and randomization of RANSAC.
+</details>
+
+### Creating high-quality PDF visualizations and faster visualization with --fast_viz
+
+<details>
+  <summary>[Click to expand]</summary>
+
+When generating output images with `match_pairs.py`, the default `--viz` flag uses a Matplotlib renderer which allows for the generation of camera-ready PDF visualizations if you additionally use `--viz_extension pdf` instead of the default png extension.
+
+```
+./match_pairs.py --viz --viz_extension pdf
+```
+
+Alternatively, you might want to save visualization images but have the generation be much faster.  You can use the `--fast_viz` flag to use an OpenCV-based image renderer as follows:
+
+```
+./match_pairs.py --viz --fast_viz
+```
+
+If you would also like an OpenCV display window to preview the results (you must use non-pdf output and use fast_fiz), simply run:
+
+```
+./match_pairs.py --viz --fast_viz --opencv_display
+```
+
+</details>
+
+
+## BibTeX Citation
+If you use any ideas from the paper or code from this repo, please consider citing:
+
+```txt
+@inproceedings{sarlin20superglue,
+  author    = {Paul-Edouard Sarlin and
+               Daniel DeTone and
+               Tomasz Malisiewicz and
+               Andrew Rabinovich},
+  title     = {{SuperGlue}: Learning Feature Matching with Graph Neural Networks},
+  booktitle = {CVPR},
+  year      = {2020},
+  url       = {https://arxiv.org/abs/1911.11763}
+}
+```
+
+## Additional Notes
+* For the demo, we found that the keyboard interaction works well with OpenCV 4.1.2.30, older versions were less responsive and the newest version had a [OpenCV bug on Mac](https://stackoverflow.com/questions/60032540/opencv-cv2-imshow-is-not-working-because-of-the-qt)
+* We generally do not recommend to run SuperPoint+SuperGlue below 160x120 resolution (QQVGA) and above 2000x1500
+* We do not intend to release the SuperGlue training code.
+* We do not intend to release the SIFT-based or homography SuperGlue models.
+
+## Legal Disclaimer
+Magic Leap is proud to provide its latest samples, toolkits, and research projects on Github to foster development and gather feedback from the spatial computing community. Use of the resources within this repo is subject to (a) the license(s) included herein, or (b) if no license is included, Magic Leap's [Developer Agreement](https://id.magicleap.com/terms/developer), which is available on our [Developer Portal](https://developer.magicleap.com/).
+If you need more, just ask on the [forums](https://forum.magicleap.com/hc/en-us/community/topics)!
+We're thrilled to be part of a well-meaning, friendly and welcoming community of millions.

SuperGluePretrainedNetwork/assets/megadepth_train_scenes.txt

@@ -0,0 +1,153 @@
+0000
+0001
+0002
+0003
+0004
+0005
+0007
+0008
+0011
+0012
+0013
+0015
+0017
+0020
+0022
+0023
+0026
+0027
+0032
+0033
+0034
+0035
+0036
+0037
+0039
+0041
+0042
+0043
+0044
+0046
+0048
+0049
+0050
+0056
+0057
+0060
+0061
+0062
+0063
+0065
+0067
+0070
+0071
+0076
+0080
+0083
+0086
+0087
+0090
+0092
+0094
+0095
+0098
+0099
+0100
+0101
+0102
+0103
+0104
+0105
+0107
+0115
+0117
+0122
+0130
+0137
+0141
+0143
+0147
+0148
+0149
+0150
+0151
+0156
+0160
+0162
+0176
+0177
+0183
+0189
+0190
+0197
+0200
+0209
+0214
+0224
+0231
+0235
+0237
+0238
+0240
+0243
+0252
+0257
+0258
+0265
+0269
+0275
+0277
+0281
+0290
+0299
+0306
+0307
+0312
+0323
+0326
+0327
+0331
+0335
+0341
+0348
+0360
+0366
+0377
+0380
+0389
+0394
+0402
+0406
+0407
+0411
+0430
+0446
+0455
+0472
+0474
+0476
+0478
+0493
+0494
+0496
+0505
+0559
+0733
+0860
+1017
+4541
+5000
+5001
+5002
+5003
+5004
+5005
+5006
+5007
+5008
+5009
+5010
+5011
+5012
+5013
+5017

SuperGluePretrainedNetwork/assets/megadepth_validation_scenes.txt

@@ -0,0 +1,36 @@
+0016
+0047
+0058
+0064
+0121
+0129
+0133
+0168
+0175
+0178
+0181
+0185
+0186
+0204
+0205
+0212
+0217
+0223
+0229
+0271
+0285
+0286
+0294
+0303
+0349
+0387
+0412
+0443
+0482
+0768
+1001
+3346
+5014
+5015
+5016
+5018

SuperGluePretrainedNetwork/assets/phototourism_sample_pairs.txt

@@ -0,0 +1,7 @@
+london_bridge_78916675_4568141288.jpg london_bridge_19481797_2295892421.jpg
+london_bridge_94185272_3874562886.jpg london_bridge_49190386_5209386933.jpg
+piazza_san_marco_15148634_5228701572.jpg piazza_san_marco_06795901_3725050516.jpg
+piazza_san_marco_43351518_2659980686.jpg piazza_san_marco_06795901_3725050516.jpg
+piazza_san_marco_58751010_4849458397.jpg piazza_san_marco_18627786_5929294590.jpg
+st_pauls_cathedral_37347628_10902811376.jpg st_pauls_cathedral_30776973_2635313996.jpg
+united_states_capitol_98169888_3347710852.jpg united_states_capitol_98169888_3347710852.jpg